CN106108894A - A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness - Google Patents

A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness Download PDF

Info

Publication number
CN106108894A
CN106108894A CN201610574108.0A CN201610574108A CN106108894A CN 106108894 A CN106108894 A CN 106108894A CN 201610574108 A CN201610574108 A CN 201610574108A CN 106108894 A CN106108894 A CN 106108894A
Authority
CN
China
Prior art keywords
emotion
frequency
identification model
emotion identification
matrix
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610574108.0A
Other languages
Chinese (zh)
Inventor
刘爽
明东
仝晶晶
安兴伟
许敏鹏
綦宏志
何峰
周鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin University
Original Assignee
Tianjin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin University filed Critical Tianjin University
Priority to CN201610574108.0A priority Critical patent/CN106108894A/en
Priority to PCT/CN2016/098165 priority patent/WO2018014436A1/en
Publication of CN106108894A publication Critical patent/CN106108894A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165Evaluating the state of mind, e.g. depression, anxiety
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7203Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/725Details of waveform analysis using specific filters therefor, e.g. Kalman or adaptive filters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271Specific aspects of physiological measurement analysis

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Psychiatry (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Pathology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Signal Processing (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physiology (AREA)
  • Psychology (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Social Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Child & Adolescent Psychology (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The invention discloses a kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness, including: 64 collected are led EEG signals, and to include that change is referenced to ears average;It is downsampled to 500Hz;1 100Hz bandpass filtering;And utilize the algorithm of independent component analysis to remove the pretreatment of eye electrical interference;By pretreated EEG signals by optimal separability frequency range can be found by frequency-division section adaptive tracing, calculate respectively each lead most preferably can the power spectral density of frequency-division section, constitute emotional characteristics matrix;Utilize PCA that eigenmatrix is carried out dimensionality reduction;Use support vector machine classifier that the electroencephalogram power spectrum signature after dimensionality reduction is identified, set up Emotion identification model.The present invention, by finding optimal separability frequency range by frequency-division section adaptive tracing, enhances emotion correlated characteristic by the natural law of sample in the training set of increase Emotion identification model, weakens temporal feature, improve the time robustness of Emotion identification model.

Description

A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness
Technical field
The present invention relates to electroencephalogramrecognition recognition field, particularly relate to a kind of emotion brain improving Emotion identification model time robustness Electricity recognition methods.
Background technology
Emotion (emotion) is whether people meets self needs to objective things and the comprehensive state that produces.It is as people The Premium Features of brain, it is ensured that organic existence and adaptation, affect the study of people, memory and decision-making in varying degrees.? In the routine work of people and life, the effect of emotion is ubiquitous.Negative Emotional can affect our physical and mental health, reduces work Make quality and efficiency, will also result in serious work mistake.There are some researches prove that the long term accumulation of Negative Emotional can damage immunity The function of system, makes people be infected more susceptible to virus around.So, in time find Negative Emotional and give suitable Intervene the most necessary, especially to some particular job persons such as driver, spacefarer with regulation and control.On the other hand, in man-machine interaction system In system, if system can capture the emotional state of people, then man-machine interaction will become more friendly, natural and efficient. The analysis of emotion and identification have become as the fields such as neuroscience, psychology, Cognitive Science, computer science and artificial intelligence and learn The important research topic that section intersects.
Development and the rise of brain imaging technique, EEG signals along with neuro physiology (Electroencephalography, EEG) because its temporal resolution is high, not by anthropic factor control, can objective reality ground The emotional state of reflection people and by the attention of research worker and be introduced in Emotion identification field.And new-type theoretical method Propose to improve Emotion identification accuracy rate based on brain electricity to a certain extent.But once moving towards actual application, discrimination is big Amplitude declines, and is difficult to meet the demand of application, and the Emotion identification model setting up pinpoint accuracy still faces huge challenge.
One of them difficult point is how to reject or reduce the time effect of EEG signals, and then improves Emotion identification model Time universality.It is known that hormonal readiness, external environment condition (such as temperature and humidity), and diet can draw with sleep Rise physiological signal difference, even if so in the different time EEG signals under same emotional state be also variant Property.And in actual applications, will certainly there is the regular hour in the foundation of Emotion identification model and the identification of emotional state Interval, and test data and cannot participate in the foundation of Emotion identification model, particularly in the application scenarios that some are special, such as The identification of spacefarer's emotional state, identify model sets up the preparatory stage occurred on the ground, and the identification of emotional state is sent out Raw working stage in space.It is unpractical for setting up the same day and identifying that then model immediately enters application.
In sum, reject or reduce the time effect of EEG signals, and then improve the time robust of Emotion identification model Property is the most necessary.In existing research, the research about the time universality of emotion grader is very few.2001 Year, Picard et al.[1]Attempt removing the time effect impact on Emotion identification model, use other emotional states to deduct calmness The method of state, but utilize the method can reduce with regard to None-identified neutrality emotion, type of emotion, and centering emotional state Identifying it is also extremely important and indispensable, neutral emotion is an important indicator of emotional stability.2012, Chueh, Tung-Hung et al.[2]The method utilizing multivariate analysis of variance removes the impact of time effect, improves the performance of grader.But It is still to there is a problem, it is simply that the data in test set are not independent, and still the data mixing with other times exists Building grader together, this is the most also unpractical.
Summary of the invention
The invention provides a kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness, the present invention can It is effectively improved time robustness and the universality of Emotion identification model, solves the bottleneck problem in current Emotion identification, by mould Application pushed to by type, and obtains considerable Social benefit and economic benefit, described below:
A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness, described emotion electroencephalogramrecognition recognition method Comprise the following steps:
EEG signals is led in 64 collected and carries out pretreatment, including: it is average that change is referenced to ears;It is downsampled to 500Hz; 1-100Hz bandpass filtering;And utilize the algorithm of independent component analysis to remove eye electrical interference;
Pretreated EEG signals is used and the algorithm of frequency-division section adaptive tracing can find most preferably may be used of each user Point property frequency range, calculate respectively each lead most preferably can the power spectral density of frequency-division section, constitute emotional characteristics matrix;
PCA is utilized the emotional characteristics matrix obtained to be carried out dimension-reduction treatment, as final eigenmatrix;
Use support vector machine classifier that the feature in final eigenmatrix is identified, by increasing mood model In training set, the natural law of sample weakens temporal characteristics, improves the time robustness of mood model, is distinguished by difference emotional state, Set up Emotion identification model.
Described method also includes:
Gather different time sections subjects 64 EEG signals led under different emotional states.
Described pretreated EEG signals employing the algorithm of frequency-division section adaptive tracing can find each user The step of good separability frequency range particularly as follows:
1) Short Time Fourier Transform is used to calculate each time-frequency matrix led;
2) fisher ratio, the capacity volume variance in weighing class with it and between class are calculated;
3) can fraction weight DW (f) can be tried to achieve by Fisher ratio;DFC, iterations is calculated by wave band iteration selection method Equal to the band number needing acquisition;Optimal separability frequency range is obtained from the band number obtained.
Described from the band number obtained, obtain optimal separability frequency range particularly as follows:
When frequency window moves along the frequency axis of DW (f), calculate Energy distribution;It is distributed α, in institute according to ceiling capacity Some band numbers select optimalCalculateRelatively change δj
If a threshold value δmin, compare δ2And δminIf, δ2More than δmin, the most then compare δ3With δminSize, until Find δjLess than δmin, then the position of j-1 is exactly the frequency range of optimal separability.
Described utilize PCA that the emotional characteristics matrix obtained is carried out dimension-reduction treatment, as final feature square Battle array step particularly as follows:
1) it is standardized initial data processing, obtains original matrix;Then its covariance matrix is sought;To covariance square Battle array carries out characteristic root decomposition, obtains characteristic root matrix and characteristic vector;
2) original matrix projection in new vector space, i.e. principal component vector group are asked;
3) the characteristic root size of each main constituent represents its number containing quantity of information, asks the accumulation tribute of front k main constituent Offer rate;
4) the selected accumulation contribution rate preset, makes front d main constituent FNi*dPattern recognition is carried out as new data.
Feature in final eigenmatrix is identified by described use support vector machine classifier, by difference emotion shape State distinguishes, set up the step of Emotion identification model particularly as follows:
The data of every day are carried out row normalization respectively, normalizes to [-1.1], obtain eigenmatrix;
Utilize SVM classifier to set up Emotion identification model, in modeling process, the data of many days are put into training set, to carry The time robustness of high-class device.
The technical scheme that the present invention provides provides the benefit that: the purport of the present invention is to propose one to improve Emotion identification mould The new method of type time robustness, by can frequency-division section adaptive tracing method search out each user most preferably can frequency-division section, logical Crossing and improve in training set that the natural law of sample is to weaken temporal feature, accurate stable carries out Emotion identification in real time then. This invention can be effectively improved time robustness and the accuracy of Emotion identification model, can obtain considerable social benefit and warp Ji benefit.Optimum implementation is intended using patent transfer, technological cooperation or product development.
Accompanying drawing explanation
Fig. 1 is the flow chart of a kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness;
Fig. 2 is 60 to lead EEG and lead figure;
Fig. 3 is tested experimental period calendar;
Fig. 4 is can frequency-division section adaptive tracing calculation flow chart;
Fig. 5 is DFCs algorithm flow chart;
Fig. 6 is the recognition correct rate under different training natural law.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below embodiment of the present invention is made further Ground describes in detail.
In order to solve the problem in background technology, when the embodiment of the present invention proposes a kind of new raising Emotion identification model Between the emotion electroencephalogramrecognition recognition method of robustness, by the optimal separability of each user can be found by frequency-division section adaptive tracking algorithm Frequency range, calculate respectively each lead most preferably can the power spectral density of frequency-division section, constitute emotional characteristics matrix, utilize main constituent to divide The analysis method eigenmatrix to obtaining carries out dimension-reduction treatment, as the eigenmatrix of final Emotion identification, uses support vector machine to build Vertical Emotion identification model, weakens temporal characteristics by increasing the natural law of sample in mood model training set, improves mood model Time robustness, thus accurately, objectively carry out Emotion identification.
The method overcoming above-mentioned two problem, both will not reduce the categories of emotions of identification, the data of test set are the most not The foundation of Emotion identification model can be participated in, meet the requirement in reality application.
Embodiment 1
Embodiments provide a kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness, ginseng Seeing Fig. 1, this emotion electroencephalogramrecognition recognition method comprises the following steps:
101: data acquisition phase collection be different time sections subjects under different emotional states (actively, neutral, disappear Pole) 64 EEG signals led;
102: EEG signals is led in 64 collected and carries out the pretreatment of four steps.Including: it is average that change is referenced to ears; It is downsampled to 500Hz;1-100Hz bandpass filtering;And independent component analysis (independent component Analysis, ICA) go an electrical interference;
103: pretreated EEG signals is used and the algorithm of frequency-division section adaptive tracing can find each user Good separability frequency range, calculate respectively each lead most preferably can the power spectral density of frequency-division section, constitute emotional characteristics matrix;
104: utilize PCA that the emotional characteristics matrix obtained is carried out dimension-reduction treatment, as final feature square Battle array;
105: use support vector machine classifier that the feature in final eigenmatrix is identified, by increasing emotion Model training concentrates the natural law of sample to weaken temporal characteristics, improves the time robustness of mood model, by difference emotional state district Separately, Emotion identification model is set up.
In order to improve the time robustness of Emotion identification model, the embodiment of the present invention is by increasing the sky of sample in training set Number weakens the feature of temporal.Before feature identification, the most respectively the data of every day are normalized.
In sum, the embodiment of the present invention is by finding most preferably can dividing of each user by frequency-division section adaptive tracking algorithm Property frequency range, calculate respectively each lead most preferably can the power spectral density of frequency-division section, constitute emotional characteristics matrix, utilize main constituent The analytic process eigenmatrix to obtaining carries out dimension-reduction treatment, as the eigenmatrix of final Emotion identification, uses support vector machine Set up Emotion identification model, weaken temporal characteristics by increasing the natural law of sample in mood model training set, improve mood model Time robustness, thus accurately, objectively carry out Emotion identification.This invention can be effectively improved Emotion identification model time Between robustness and accuracy.
Embodiment 2
Below in conjunction with Fig. 2, Fig. 3, Fig. 4, Fig. 5, the scheme in embodiment 1 is described in detail, described below:
201: data acquisition phase;
Wherein, brain wave acquisition device is that the 64 of Neuroscan company leads amplifier and Scan 4.5 acquisition system, electrode The standard 10-20 system specified in accordance with international Nao electricity association is placed, and removes leading of 60 conductive electrode outside eye electricity and reference electrode Distribution is as shown in Figure 2.Using right mastoid process as reference electrode during collection, brain forehead top side centre ground connection, all electrodes Impedance is held in below 5k Europe, and sample frequency is 1000Hz.
Every subjects need to carry out 5 secondary data collections in one month, and the time interval between gathering each time is respectively One day, three days, one week and two weeks.Fig. 3 is subjects's experimental period calendar.Every subjects came in the same time of this day Laboratory carries out data acquisition, with video induction three kinds of emotional states tested actively, neutral, passive.
202: data prediction;
EEG signals is led in 64 collected and carries out the pretreatment of four steps.Including: it is average that change is referenced to ears;Fall is adopted Sample goes an electrical interference to 500Hz:1-100Hz bandpass filtering and ICA.
Wherein, reference potential during collection is at auris dextra mastoid process, and this signal amplitude causing You Naoqu to lead is on the low side.Therefore First carry out reference potential conversion, reference potential becomes being positioned at M1, the M2 at mastoid process position, both sides and leads place, it is simple to follow-up data Process.The sample frequency of system is 1000Hz, primarily to meet EEG signals to change rapid requirement.But 1000Hz adopts Sample frequency is far longer than the theoretical sample frequency of Nyquist's theorem, and sample frequency is crossed after conference causes data volume to cross ambassador Continuous treatment effeciency reduces.Therefore, carry out down-sampled to the data collected, the sample frequency of EEG signals is reduced to by 1000Hz 500Hz。
The embodiment of the present invention carries out the bandpass filtering of 1Hz~100Hz to remove DC influence and high-frequency signal.Owing to adopting Collect to EEG signals inevitably contain eye electricity (include eyeball upper and lower, move left and right, blink) and electromyographic signal band The impact come.Wherein eye electricity, the electro-ocular signal especially blinked is strong especially, and being rung maximum by eye film is leading of forehead region Connection.The impact produced for the electro-ocular signal adulterated in EEG signals and electromyographic signal, the embodiment of the present invention passes through isolated component The method that analysis (Independent Component Analysis, ICA) filters is filtered.
Wherein, the method for concrete filtering is known to those skilled in the art, and the embodiment of the present invention is without limitation.
203: can the adaptive tracing method of frequency-division section;
Because different user has different optimal separability frequency ranges, therefore the embodiment of the present invention utilize can frequency-division section adaptive The method that should follow the tracks of (adaptive tracking of discriminative frequency components, ATDFCs) Find the optimum frequency band that different type of emotion can be distinguished, this to extracting feature accurately, to improve classification accuracy rate be the heaviest Want.The calculating process of DFC adaptive tracing method is as shown in Figure 4.
1) Short Time Fourier Transform is used to calculate each time-frequency matrix led;
Therefore, each leads a discrete time-frequency matrix In(f,t)。
2) calculate fisher ratio, weigh in class with it and (in same pattern, refer to same feelings in embodiments of the present invention Thread type) and class between the capacity volume variance of (between different mode, referring in embodiments of the present invention between different type of emotion).Its Shown in computational methods such as formula (1), formula (2), formula (3).
S w ( f , t ) = Σ k = 1 c Σ n = 1 n k ( I n ( f , t ) - m k ( f , t ) ) ( I n ( f , t ) - m k ( f , t ) ) T - - - ( 1 )
S B ( f , t ) = Σ k = 1 C n k ( m ( f , t ) - m k ( f , t ) ) ( m ( f , t ) - m k ( f , t ) ) T - - - ( 2 )
F R ( f , t ) = S B ( f , t ) S w ( f , t ) - - - ( 3 )
Wherein, Sw(f,t)、SB(f,t)、mk(f, t), m (f, t) and FR(f t) is two-dimensional matrix.Sw(f,t)、SB(f, T) represent in class respectively and class inherited, FR(f t) is fisher ratio, mk(f t) is the frequent degree of mean time of kth class, m (f, t) is the frequent degree of mean time of all classes, and C represents classification number, C=3, n in the embodiment of the present inventionkIt it is the sample of kth apoplexy due to endogenous wind Number.
3) can fraction weight DW (f) can be tried to achieve by Fisher ratio, its computational methods such as formula (4):
D W ( f ) = Σ t = 1 τ F R ( f , t ) - - - ( 4 )
Wherein, τ represents time period when STFT calculates.
4) after obtaining DW (f), calculating DFC by wave band iteration selection method, iterations is equal to the band number needing acquisition.
Five steps of Step1 to Step5 cited below can be used to calculate the frequency range of most separability, such as Fig. 5 institute Show.Then weight DW (f) under most separability frequency range is set to zero, then calculates separability and be positioned at deputy frequency range.
Such as, the most frequency range of separability is 9~14Hz, just the DW (f) that 9,10,11,12 is corresponding with 13Hz is set to zero, Calculating second again can frequency-division section;Constantly repeat this process until obtaining the band number needed.
Step1, first determine needs selected frequency range be 1~100Hz, the frequency window of slip between 3~7Hz with step Long 1Hz changes (as shown in Figure 5).Therefore, it can obtain 5 different bandwidth parameters and be designated as BWj(j=1,2,3,4,5).
Step2, when frequency window moves along the frequency axis of DW (f), calculate Energy distribution α according to formula (5).
α ( F i , BW j ) = Σ f = F i - BW j 2 f = F i + BW j 2 D W ( f ) - - - ( 5 )
Wherein, FiRepresent frequency window along frequency axis move time i-th frequency range mid frequency.Such as, frequency window is worked as During a width of 3Hz, then can obtain 97 frequency ranges, such as: 1~4Hz, 2~5Hz, 3~6Hz, 4~7Hz ..., 97Hz~100Hz.
Step3, according to ceiling capacity be distributed α, at all of FiMiddle selection is optimalSuch as formula (6).
F j o p t = arg m a x F i α ( F i , BW j ) - - - ( 6 )
To each BWjOne will be obtainedTherefore, each j, an all corresponding optimal mid frequencyAnd Optimum capacity is distributed
Step4, for relatively each BWjResolution capability, calculateRelative change, j=(2,3,4,5), utilize public affairs Formula (7) calculates δj
δ j = α j o p t - α j - 1 o p t α j o p t * 100 % - - - ( 7 )
Step5, calculate δjAfterwards, if a threshold value δmin
It is demonstrated experimentally that for different threshold values, such as: 10%, 20%, 30%, 40% ..., threshold value is the least, should Algorithm more levels off to and selects frequency window is the frequency band of 3Hz.
Relatively δ2And δminIf, δ2More than δmin, the most then compare δ3With δminSize, until find δjLess than δmin.That The position of j-1 is exactly the frequency range of most separability.
The embodiment of the present invention select each lead first can frequency-division section, second can frequency-division section and the 3rd can the merit of frequency-division section Rate spectrum sets up the eigenmatrix P of every dayNi*180.Ni is the sample size of i-th day.60 lead * 3 frequency range=180 dimensional features.
PNi*180=(P1,P2,…,P180) (8)
204: PCA dimensionality reduction;
During actual application, there is certain plyability and dependency, if directly between the information contained by parameters They are used for pattern recognition, the overfitting of model parameter can be caused to reduce accuracy and the reliability of classification, and can be because of The speed of classification is reduced for data volume is excessive.Therefore before pattern classification, the embodiment of the present invention first with PCA to each It characteristic vector obtained carries out dimension-reduction treatment.
PCA, according to maximum variance principle, characterizes original data with one group of linear independence and mutually orthogonal new vector The row (or row) of matrix, reaches to compress variable number, rejects redundancy, maximize the purpose preserving effective information.Original to Amount group is (P1,P2,…,P180), principal component vector group is designated as (F1,F2,…,Fm), usual m is less than 180.Then main constituent is with original The relation of Vector Groups is:
F 1 = a 1 , 1 P 1 + a 1 , 2 P 2 + ... + a 1 , 180 P 180 F 2 = a 2 , 1 P 1 + a 2 , 2 P 2 + ... + a 2 , 180 P 180 ... F k = a k , 1 P 1 + a k , 2 P 2 + ... + a k , 180 P 180 ... F m = a m , 1 P 1 + a m , 2 P 2 + ... + a m , 180 P 180 - - - ( 9 )
Wherein, it is most that F1 contains quantity of information, has maximum variance, referred to as first principal component, F2 ..., Fm successively decreases successively, claims For Second principal component, ..., m main constituent.Therefore the process of principal component analysis is considered as determining that weight coefficient αk,h(k= 1,…,m;H=1 ... 180) process.
In embodiments of the present invention, Ni the sample (i=1,2,3,4,5) obtained for i-th day, available following matrix represents
P N i * 180 = P 1 , 1 P 1 , 2 ... P 1 , h ... P 1 , 180 P 2 , 1 P 2 , 2 ... P 2 , h ... P 2 , 180 . . . . . . ... . ... . . . . . P b , 1 P b , 2 ... P b , h ... P b , 180 . . . . . . . . . . . . . . . . . . P N i , 1 P N i , 2 ... P N i , h ... P N i , 180 - - - ( 10 )
Wherein, Pb,hIt is the h feature of b sample.
The solution procedure carrying out Feature Dimension Reduction with PCA is as follows:
1) to initial data PNi*180Being standardized processing, the element in matrix deducts the average of column, then divided by The standard deviation of column so that the average of each variable is 0, and variance is 1, obtains matrix PNi*180 *
PNi*180 *=[yb,h]Ni*180, b=1,2 ..., Ni;H=1,2 ..., 180 (11)
y b , h = [ P b , h - P h ‾ ] / S h - - - ( 12 )
Wherein,
2) its covariance matrix C is then sought180*180,PNi*180 *In wantonly two row between can calculate the covariance between two variablees, Then covariance matrix is obtained:
3) to covariance matrix C180*180Carry out characteristic root decomposition, obtain characteristic root matrix Λ180*180And characteristic vector U180*180
C180*180=U180*180Λ180*180U180*180(14) wherein, characteristic vector U180*180As the coordinate axes of main constituent, Constitute new vector space,Wherein, characteristic root λr(r=1,2 ..., 180) size represent The quantity of information that the r main constituent is contained.U180*180' it is U180*180Transposed matrix.
4) initial data P is soughtNi*180Projection in new vector space, i.e. principal component vector group FNi*180:
FNi*180=PNi*180U180*180 (15)
5) accumulation contribution rate is sought.The characteristic root size of each main constituent represents its number containing quantity of information.Ask front k master The accumulation contribution rate of composition (k=1 ..., 180).
pre k = Σ i = 1 k λ i Σ i = 1 180 λ i - - - ( 16 )
Wherein, λ i is the ith feature root obtained.
6) the selected accumulation contribution rate preset, makes front d main constituent FNi*dAs new data carry out pattern recognition (d < 180)。
Such as: draw altogether 7 main constituents.The contribution rate of first main constituent F1 is 48%, and the contribution rate of F2 is 32%, The contribution rate of F3 is 15%, and F4, F5, F6, F7 contribution rate altogether is 5% (contribution rate of 7 main constituents comes to 100%). So the accumulation contribution rate of first three main constituent (F1, F2, F3) is to 95%, say, that first three main constituent has contained 7 The information of individual main constituent 95%, then, select these three main constituent to carry out pattern recognition as new data, in guarantee information amount While reduce the dimension of eigenmatrix.
205: the foundation of Emotion identification model;
After Feature Dimension Reduction, use support vector machine (Support Vector Machine, SVM)[3]Set up Emotion identification mould Type, identifies the emotional state that user is current.In the pattern recognition stage, a part of sample is used for setting up grader, referred to as training set, Remaining sample is used for testing classification device, referred to as test set.
The embodiment of the present invention first passes through increases in training set the natural law of sample to improve the time Shandong of Emotion identification model Rod.So in the pattern recognition stage, the data of four days being used for training pattern, the sample remaining a day is attributed to test set.This Sample is conducive to training set to extract the feature relevant to emotion, and weakens the feature of temporal.
Before setting up grader, it is necessary first to the data of every day are carried out row normalization respectively, normalizes to [-1.1], Obtain eigenmatrix PPNi*d, (d is the dimension of eigenmatrix after dimensionality reduction)
PPi,j=(ymax-ymin)*(Fi,j-Fj min)/(Fj max-Fj min)+ymin,
Wherein, ymax=1, ymin=-1;For the eigenmatrix F after dimensionality reductionNi*dJth row minima, in like manner,It is characterized matrix FNi*dJth row maximum.After normalization, SVM classifier is utilized to set up Emotion identification model.
In sum, the embodiment of the present invention is by frequency-division section adaptive tracing method searching out most preferably can dividing of each user Frequency range;By PCA, eigenmatrix is carried out Feature Dimension Reduction;Weaken by improving the natural law of sample in training set Temporal feature, accurate stable carries out Emotion identification in real time then.This invention can be effectively improved Emotion identification mould The time robustness of type and accuracy.
Embodiment 3
Below in conjunction with Fig. 6, the scheme of embodiment 1 and 2 is carried out feasibility checking, described below:
Fig. 6 is the recognition correct rate under 9 tested different training sample natural law.Transverse axis is the natural law N of sample in training set (N=1,2,3,4), the sample training of i.e. N days, the sample of remaining 5-N days is tested.Under the conditions of the longitudinal axis is N days obtained Mean accurate rate of recognition.By in Fig. 6 it can be seen that along with the increase of natural law in training set, accuracy improves, accuracy and instruction The natural law practicing sample is proportionate;The sample of 4 days is for training the grader sample training compared to 1 day, and its accuracy carries High by about 10%, and there is significant difference (p < 0.01).This method also demonstrating present invention proposition is effective.
The embodiment of the present invention by can frequency-division section adaptive tracing method find each user most preferably can frequency-division section, main constituent Analytic process carries out Feature Dimension Reduction, and increases in Emotion identification model the natural law of sample in training set and enhance the spy that emotion is relevant Levy, weaken the feature of temporal, thus improve the time robustness of Emotion identification model.This Fig. 6 illustrates to increase In training set, the natural law of sample can significantly improve the time robustness of grader.The present invention can be effectively improved Emotion identification mould The time robustness of type and preparatory, moves towards application for Emotion identification from laboratory and provides technical support.
List of references
[1]PICARD R W,VYZAS E,HEALEY J.Toward machine emotional intelligence: Analysis of affective physiological state[J].Pattern Analysis and Machine Intelligence,IEEE Transactions on,2001,23(10):1175-91.
[2]CHUEH T-H,CHEN T-B,LU H H-S,et al.Statistical Prediction of Emotional States by Physiological Signals with Manova and Machine Learning [J].International Journal of Pattern Recognition and Artificial Intelligence, 2012,26(04):
[3]HIDALGO-MU OZ AR,L PEZ M M,SANTOS I M,et al.Application of SVM-RFE on EEG signals for detecting the most relevant scalp regions linked to affective valence processing[J].Expert Systems with Applications,2013,40(6): 2102–8.
It will be appreciated by those skilled in the art that accompanying drawing is the schematic diagram of a preferred embodiment, the invention described above embodiment Sequence number, just to describing, does not represent the quality of embodiment.
The foregoing is only presently preferred embodiments of the present invention, not in order to limit the present invention, all spirit in the present invention and Within principle, any modification, equivalent substitution and improvement etc. made, should be included within the scope of the present invention.

Claims (6)

1. the emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness, it is characterised in that described emotion brain Electricity recognition methods comprises the following steps:
EEG signals is led in 64 collected and carries out pretreatment, including: it is average that change is referenced to ears;It is downsampled to 500Hz;1- 100Hz bandpass filtering;And utilize the algorithm of independent component analysis to remove eye electrical interference;
Pretreated EEG signals is used and the algorithm of frequency-division section adaptive tracing can find the optimal separability of each user Frequency range, calculate respectively each lead most preferably can the power spectral density of frequency-division section, constitute emotional characteristics matrix;
PCA is utilized the emotional characteristics matrix obtained to be carried out dimension-reduction treatment, as final eigenmatrix;
Use support vector machine classifier that the feature in final eigenmatrix is identified, train by increasing mood model The natural law concentrating sample weakens temporal characteristics, improves the time robustness of mood model, is distinguished by difference emotional state, sets up Emotion identification model.
A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness the most according to claim 1, its Being characterised by, described method also includes:
Gather different time sections subjects 64 EEG signals led under different emotional states.
A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness the most according to claim 1, its Being characterised by, described pretreated EEG signals employing the algorithm of frequency-division section adaptive tracing can find each user The step of good separability frequency range particularly as follows:
1) Short Time Fourier Transform is used to calculate each time-frequency matrix led;
2) fisher ratio, the capacity volume variance in weighing class with it and between class are calculated;
3) can fraction weight DW (f) can be tried to achieve by Fisher ratio;Calculating DFC by wave band iteration selection method, iterations is equal to Need the band number obtained;Optimal separability frequency range is obtained from the band number obtained.
A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness the most according to claim 1, its Be characterised by, described from the band number obtained, obtain optimal separability frequency range particularly as follows:
When frequency window moves along the frequency axis of DW (f), calculate Energy distribution;It is distributed α, all of according to ceiling capacity Band number select optimalCalculateRelatively change δj
If a threshold value δmin, compare δ2And δminIf, δ2More than δmin, the most then compare δ3With δminSize, until find δjLess than δmin, then the position of j-1 is exactly the frequency range of optimal separability.
A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness the most according to claim 1, its It is characterised by, described utilizes PCA the emotional characteristics matrix obtained to be carried out dimension-reduction treatment, as final feature The step of matrix particularly as follows:
1) it is standardized initial data processing, obtains original matrix;Then its covariance matrix is sought;Covariance matrix is entered Row characteristic root decomposes, and obtains characteristic root matrix and characteristic vector;
2) original matrix projection in new vector space, i.e. principal component vector group are asked;
3) the characteristic root size of each main constituent represents its number containing quantity of information, seeks the accumulation contribution rate of front k main constituent;
4) the selected accumulation contribution rate preset, makes front d main constituent FNi*dPattern recognition is carried out as new data.
A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness the most according to claim 1, its Being characterised by, the feature in final eigenmatrix is identified by described use support vector machine classifier, by increasing feelings Thread model training concentrates the natural law of sample to weaken temporal characteristics, improves the time robustness of mood model, by difference emotional state Distinguish, set up the step of Emotion identification model particularly as follows:
The data of every day are carried out row normalization respectively, normalizes to [-1.1], obtain eigenmatrix;
SVM classifier is utilized to set up Emotion identification model;In modeling process, the data of many days are put into training set, divide to improve The time robustness of class device.
CN201610574108.0A 2016-07-18 2016-07-18 A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness Pending CN106108894A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610574108.0A CN106108894A (en) 2016-07-18 2016-07-18 A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness
PCT/CN2016/098165 WO2018014436A1 (en) 2016-07-18 2016-09-06 Emotion eeg recognition method providing emotion recognition model time robustness

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610574108.0A CN106108894A (en) 2016-07-18 2016-07-18 A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness

Publications (1)

Publication Number Publication Date
CN106108894A true CN106108894A (en) 2016-11-16

Family

ID=57289670

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610574108.0A Pending CN106108894A (en) 2016-07-18 2016-07-18 A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness

Country Status (2)

Country Link
CN (1) CN106108894A (en)
WO (1) WO2018014436A1 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106725452A (en) * 2016-11-29 2017-05-31 太原理工大学 Based on the EEG signal identification method that emotion induces
CN106805969A (en) * 2016-12-20 2017-06-09 广州视源电子科技股份有限公司 Brain electricity allowance recognition methods and device based on Kalman filtering and wavelet transformation
CN106974648A (en) * 2017-03-27 2017-07-25 广州视源电子科技股份有限公司 The electric allowance recognition methods of brain based on time domain and domain space and device
CN107411738A (en) * 2017-04-18 2017-12-01 天津大学 A kind of mood based on resting electroencephalogramidentification similitude is across individual discrimination method
CN107411737A (en) * 2017-04-18 2017-12-01 天津大学 A kind of across the time recognition methods of mood based on resting electroencephalogramidentification similitude
CN108042145A (en) * 2017-11-28 2018-05-18 广州视源电子科技股份有限公司 Emotional state recognition methods and system, emotional state identification equipment
CN109009101A (en) * 2018-07-27 2018-12-18 杭州电子科技大学 A kind of adaptive real-time de-noising method of EEG signals
CN109255309A (en) * 2018-08-28 2019-01-22 中国人民解放军战略支援部队信息工程大学 Brain electricity and eye movement fusion method and device towards Remote Sensing Target detection
WO2019062595A1 (en) * 2017-09-30 2019-04-04 深圳市岩尚科技有限公司 Method for quality evaluation of photoplethysmogram
CN110070105A (en) * 2019-03-25 2019-07-30 中国科学院自动化研究所 Brain electricity Emotion identification method, the system quickly screened based on meta learning example
CN110390272A (en) * 2019-06-30 2019-10-29 天津大学 A kind of EEG signal feature dimension reduction method based on weighted principal component analyzing
CN107463792B (en) * 2017-09-21 2023-11-21 北京大智商医疗器械有限公司 Nerve feedback device, system and method

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2564865A (en) * 2017-07-24 2019-01-30 Thought Beanie Ltd Biofeedback system and wearable device
CN109117787A (en) * 2018-08-10 2019-01-01 太原理工大学 A kind of emotion EEG signal identification method and system
CN109948516B (en) * 2019-03-18 2022-12-02 湖南大学 Composite power quality disturbance identification method and method based on energy maximization and kernel SVM
CN111312215B (en) * 2019-12-20 2023-05-30 台州学院 Natural voice emotion recognition method based on convolutional neural network and binaural characterization
CN111134667B (en) * 2020-01-19 2024-01-26 中国人民解放军战略支援部队信息工程大学 Time migration emotion recognition method and system based on electroencephalogram signals
CN111528866A (en) * 2020-04-30 2020-08-14 北京脑陆科技有限公司 EEG signal emotion recognition method based on LightGBM model
CN111832438B (en) * 2020-06-27 2024-02-06 西安电子科技大学 Emotion recognition-oriented electroencephalogram signal channel selection method, system and application
CN112101152B (en) * 2020-09-01 2024-02-02 西安电子科技大学 Electroencephalogram emotion recognition method, electroencephalogram emotion recognition system, computer equipment and wearable equipment
CN112132328A (en) * 2020-09-04 2020-12-25 国网上海市电力公司 Photovoltaic output power ultra-short-term local emotion reconstruction neural network prediction method
CN112263252B (en) * 2020-09-28 2024-05-03 贵州大学 PAD emotion dimension prediction method based on HRV features and three-layer SVR
CN113128552B (en) * 2021-03-02 2024-02-02 杭州电子科技大学 Electroencephalogram emotion recognition method based on depth separable causal graph convolution network
CN113190114B (en) * 2021-04-14 2022-05-20 三峡大学 Virtual scene experience system and method with haptic simulation and emotional perception
CN113688673B (en) * 2021-07-15 2023-05-30 电子科技大学 Cross-user emotion recognition method for electrocardiosignals in online scene
CN113554110B (en) * 2021-07-30 2024-03-01 合肥工业大学 Brain electricity emotion recognition method based on binary capsule network
CN114218986B (en) * 2021-12-10 2024-05-07 中国航空综合技术研究所 State classification method based on EEG (electroencephalogram) data
CN114190944B (en) * 2021-12-23 2023-08-22 上海交通大学 Robust emotion recognition method based on electroencephalogram signals
CN114578963B (en) * 2022-02-23 2024-04-05 华东理工大学 Electroencephalogram identity recognition method based on feature visualization and multi-mode fusion
CN114947852B (en) * 2022-06-14 2023-01-10 华南师范大学 Multi-mode emotion recognition method, device, equipment and storage medium
CN116369949B (en) * 2023-06-06 2023-09-15 南昌航空大学 Electroencephalogram signal grading emotion recognition method, electroencephalogram signal grading emotion recognition system, electronic equipment and medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102499677A (en) * 2011-12-16 2012-06-20 天津大学 Emotional state identification method based on electroencephalogram nonlinear features

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101488189B (en) * 2009-02-04 2012-01-18 天津大学 Brain-electrical signal processing method based on isolated component automatic clustering process
CN105395192A (en) * 2015-12-09 2016-03-16 恒爱高科(北京)科技有限公司 Wearable emotion recognition method and system based on electroencephalogram

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102499677A (en) * 2011-12-16 2012-06-20 天津大学 Emotional state identification method based on electroencephalogram nonlinear features

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
曾红梅: "情绪图片视觉诱发EEG特征提取与分析", 《中国优秀硕士学位论文全文数据库(电子特刊)》 *

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106725452A (en) * 2016-11-29 2017-05-31 太原理工大学 Based on the EEG signal identification method that emotion induces
CN106805969A (en) * 2016-12-20 2017-06-09 广州视源电子科技股份有限公司 Brain electricity allowance recognition methods and device based on Kalman filtering and wavelet transformation
CN106974648A (en) * 2017-03-27 2017-07-25 广州视源电子科技股份有限公司 The electric allowance recognition methods of brain based on time domain and domain space and device
CN106974648B (en) * 2017-03-27 2020-02-14 广州视源电子科技股份有限公司 Electroencephalogram relaxation degree identification method and device based on time domain and frequency domain space
CN107411738A (en) * 2017-04-18 2017-12-01 天津大学 A kind of mood based on resting electroencephalogramidentification similitude is across individual discrimination method
CN107411737A (en) * 2017-04-18 2017-12-01 天津大学 A kind of across the time recognition methods of mood based on resting electroencephalogramidentification similitude
CN107463792B (en) * 2017-09-21 2023-11-21 北京大智商医疗器械有限公司 Nerve feedback device, system and method
WO2019062595A1 (en) * 2017-09-30 2019-04-04 深圳市岩尚科技有限公司 Method for quality evaluation of photoplethysmogram
CN108042145A (en) * 2017-11-28 2018-05-18 广州视源电子科技股份有限公司 Emotional state recognition methods and system, emotional state identification equipment
CN109009101A (en) * 2018-07-27 2018-12-18 杭州电子科技大学 A kind of adaptive real-time de-noising method of EEG signals
CN109009101B (en) * 2018-07-27 2021-04-06 杭州电子科技大学 Electroencephalogram signal self-adaptive real-time denoising method
CN109255309A (en) * 2018-08-28 2019-01-22 中国人民解放军战略支援部队信息工程大学 Brain electricity and eye movement fusion method and device towards Remote Sensing Target detection
CN109255309B (en) * 2018-08-28 2021-03-23 中国人民解放军战略支援部队信息工程大学 Electroencephalogram and eye movement fusion method and device for remote sensing image target detection
CN110070105A (en) * 2019-03-25 2019-07-30 中国科学院自动化研究所 Brain electricity Emotion identification method, the system quickly screened based on meta learning example
CN110070105B (en) * 2019-03-25 2021-03-02 中国科学院自动化研究所 Electroencephalogram emotion recognition method and system based on meta-learning example rapid screening
CN110390272A (en) * 2019-06-30 2019-10-29 天津大学 A kind of EEG signal feature dimension reduction method based on weighted principal component analyzing
CN110390272B (en) * 2019-06-30 2023-07-18 天津大学 EEG signal feature dimension reduction method based on weighted principal component analysis

Also Published As

Publication number Publication date
WO2018014436A1 (en) 2018-01-25

Similar Documents

Publication Publication Date Title
CN106108894A (en) A kind of emotion electroencephalogramrecognition recognition method improving Emotion identification model time robustness
CN106886792B (en) Electroencephalogram emotion recognition method for constructing multi-classifier fusion model based on layering mechanism
CN110070105B (en) Electroencephalogram emotion recognition method and system based on meta-learning example rapid screening
CN110353702A (en) A kind of emotion identification method and system based on shallow-layer convolutional neural networks
George et al. Recognition of emotional states using EEG signals based on time-frequency analysis and SVM classifier.
CN110772268A (en) Multimode electroencephalogram signal and 1DCNN migration driving fatigue state identification method
CN105894039A (en) Emotion recognition modeling method, emotion recognition method and apparatus, and intelligent device
CN108577865A (en) A kind of psychological condition determines method and device
CN106388814B (en) Epileptic EEG Signal recognition methods based on optimal core time-frequency distributions Visual Graph
CN110353673B (en) Electroencephalogram channel selection method based on standard mutual information
CN105956624A (en) Motor imagery electroencephalogram classification method based on space-time-frequency optimization feature sparse representation
CN110786849B (en) Electrocardiosignal identity recognition method and system based on multi-view discriminant analysis
CN110037693A (en) A kind of mood classification method based on facial expression and EEG
CN107411738A (en) A kind of mood based on resting electroencephalogramidentification similitude is across individual discrimination method
Al-Salman et al. An efficient approach for EEG sleep spindles detection based on fractal dimension coupled with time frequency image
CN109009098B (en) Electroencephalogram signal feature identification method under motor imagery state
CN113208593A (en) Multi-modal physiological signal emotion classification method based on correlation dynamic fusion
Ramos-Aguilar et al. Analysis of EEG signal processing techniques based on spectrograms
CN114492513A (en) Electroencephalogram emotion recognition method for adaptation to immunity domain based on attention mechanism in cross-user scene
Ramakrishnan et al. Epileptic eeg signal classification using multi-class convolutional neural network
Thilagaraj et al. Identification of Drivers Drowsiness Based on Features Extracted from EEG Signal Using SVM Classifier
Fattah et al. An approach for classifying alcoholic and non-alcoholic persons based on time domain features extracted from EEG signals
CN112869743B (en) Exercise initiation intention neural analysis method considering cognitive distraction
CN105787459A (en) ERP signal classification method based on optimal score sparse determination
Murugappan et al. Subtractive fuzzy classifier based driver drowsiness levels classification using EEG

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20161116