CN115813385A - Multi-mode audio-visual combined blood oxygen compensation level quantitative evaluation method - Google Patents
Multi-mode audio-visual combined blood oxygen compensation level quantitative evaluation method Download PDFInfo
- Publication number
- CN115813385A CN115813385A CN202211621682.9A CN202211621682A CN115813385A CN 115813385 A CN115813385 A CN 115813385A CN 202211621682 A CN202211621682 A CN 202211621682A CN 115813385 A CN115813385 A CN 115813385A
- Authority
- CN
- China
- Prior art keywords
- blood oxygen
- signal
- mode
- paradigm
- eeg
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 210000004369 blood Anatomy 0.000 title claims abstract description 48
- 239000008280 blood Substances 0.000 title claims abstract description 48
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 title claims abstract description 46
- 239000001301 oxygen Substances 0.000 title claims abstract description 46
- 229910052760 oxygen Inorganic materials 0.000 title claims abstract description 46
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000011158 quantitative evaluation Methods 0.000 title claims abstract description 13
- 230000006870 function Effects 0.000 claims abstract description 12
- 230000008859 change Effects 0.000 claims abstract description 9
- 238000013210 evaluation model Methods 0.000 claims abstract description 8
- 230000004044 response Effects 0.000 claims abstract description 8
- 230000007659 motor function Effects 0.000 claims abstract description 5
- 238000000611 regression analysis Methods 0.000 claims abstract description 4
- 238000002474 experimental method Methods 0.000 claims description 27
- 210000004556 brain Anatomy 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 12
- 238000011156 evaluation Methods 0.000 claims description 6
- CURLTUGMZLYLDI-UHFFFAOYSA-N Carbon dioxide Chemical compound O=C=O CURLTUGMZLYLDI-UHFFFAOYSA-N 0.000 claims description 4
- 229910002092 carbon dioxide Inorganic materials 0.000 claims description 2
- 239000001569 carbon dioxide Substances 0.000 claims description 2
- 230000001149 cognitive effect Effects 0.000 claims description 2
- 239000000284 extract Substances 0.000 claims description 2
- 238000012935 Averaging Methods 0.000 claims 1
- 238000001914 filtration Methods 0.000 claims 1
- 230000003920 cognitive function Effects 0.000 abstract description 4
- 238000013461 design Methods 0.000 abstract description 3
- 238000000605 extraction Methods 0.000 abstract description 2
- 101150068427 EP300 gene Proteins 0.000 description 18
- 102100038885 Histone acetyltransferase p300 Human genes 0.000 description 18
- 230000000638 stimulation Effects 0.000 description 17
- 208000006011 Stroke Diseases 0.000 description 11
- 230000000007 visual effect Effects 0.000 description 10
- 238000001514 detection method Methods 0.000 description 7
- 206010006322 Breath holding Diseases 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 201000010099 disease Diseases 0.000 description 5
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 5
- 230000033001 locomotion Effects 0.000 description 5
- 238000012360 testing method Methods 0.000 description 5
- 108010054147 Hemoglobins Proteins 0.000 description 4
- 102000001554 Hemoglobins Human genes 0.000 description 4
- 238000013459 approach Methods 0.000 description 4
- 238000007477 logistic regression Methods 0.000 description 4
- 238000011160 research Methods 0.000 description 4
- 230000029058 respiratory gaseous exchange Effects 0.000 description 4
- 206010008190 Cerebrovascular accident Diseases 0.000 description 3
- 230000017531 blood circulation Effects 0.000 description 3
- 230000002490 cerebral effect Effects 0.000 description 3
- 208000010877 cognitive disease Diseases 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 3
- 230000008557 oxygen metabolism Effects 0.000 description 3
- 238000007781 pre-processing Methods 0.000 description 3
- 210000004761 scalp Anatomy 0.000 description 3
- INGWEZCOABYORO-UHFFFAOYSA-N 2-(furan-2-yl)-7-methyl-1h-1,8-naphthyridin-4-one Chemical compound N=1C2=NC(C)=CC=C2C(O)=CC=1C1=CC=CO1 INGWEZCOABYORO-UHFFFAOYSA-N 0.000 description 2
- WQZGKKKJIJFFOK-GASJEMHNSA-N Glucose Natural products OC[C@H]1OC(O)[C@H](O)[C@@H](O)[C@@H]1O WQZGKKKJIJFFOK-GASJEMHNSA-N 0.000 description 2
- 208000032843 Hemorrhage Diseases 0.000 description 2
- 208000012902 Nervous system disease Diseases 0.000 description 2
- 208000025966 Neurological disease Diseases 0.000 description 2
- 108010064719 Oxyhemoglobins Proteins 0.000 description 2
- 229910021607 Silver chloride Inorganic materials 0.000 description 2
- 210000002565 arteriole Anatomy 0.000 description 2
- 230000002238 attenuated effect Effects 0.000 description 2
- 208000034158 bleeding Diseases 0.000 description 2
- 230000000740 bleeding effect Effects 0.000 description 2
- 230000036770 blood supply Effects 0.000 description 2
- 210000004204 blood vessel Anatomy 0.000 description 2
- 210000005013 brain tissue Anatomy 0.000 description 2
- 210000003710 cerebral cortex Anatomy 0.000 description 2
- 230000019771 cognition Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 108010002255 deoxyhemoglobin Proteins 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000008103 glucose Substances 0.000 description 2
- 210000002569 neuron Anatomy 0.000 description 2
- 210000005259 peripheral blood Anatomy 0.000 description 2
- 239000011886 peripheral blood Substances 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- HKZLPVFGJNLROG-UHFFFAOYSA-M silver monochloride Chemical compound [Cl-].[Ag+] HKZLPVFGJNLROG-UHFFFAOYSA-M 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 230000003936 working memory Effects 0.000 description 2
- 208000003174 Brain Neoplasms Diseases 0.000 description 1
- 208000014644 Brain disease Diseases 0.000 description 1
- 206010007687 Carotid artery stenosis Diseases 0.000 description 1
- 208000028698 Cognitive impairment Diseases 0.000 description 1
- 206010012289 Dementia Diseases 0.000 description 1
- 206010061296 Motor dysfunction Diseases 0.000 description 1
- 208000001089 Multiple system atrophy Diseases 0.000 description 1
- 238000005481 NMR spectroscopy Methods 0.000 description 1
- 208000018737 Parkinson disease Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 239000000956 alloy Substances 0.000 description 1
- 229910045601 alloy Inorganic materials 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 210000004958 brain cell Anatomy 0.000 description 1
- 230000005978 brain dysfunction Effects 0.000 description 1
- 230000008822 capillary blood flow Effects 0.000 description 1
- 208000006170 carotid stenosis Diseases 0.000 description 1
- 210000004027 cell Anatomy 0.000 description 1
- 230000003930 cognitive ability Effects 0.000 description 1
- 230000006999 cognitive decline Effects 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 230000000779 depleting effect Effects 0.000 description 1
- 238000013400 design of experiment Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000004064 dysfunction Effects 0.000 description 1
- 238000005401 electroluminescence Methods 0.000 description 1
- 206010014599 encephalitis Diseases 0.000 description 1
- 206010015037 epilepsy Diseases 0.000 description 1
- 230000000763 evoking effect Effects 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 239000007789 gas Substances 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 208000023589 ischemic disease Diseases 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 238000012417 linear regression Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000004060 metabolic process Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000009427 motor defect Effects 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 230000008904 neural response Effects 0.000 description 1
- 230000004770 neurodegeneration Effects 0.000 description 1
- 208000015122 neurodegenerative disease Diseases 0.000 description 1
- 230000000926 neurological effect Effects 0.000 description 1
- 230000003565 oculomotor Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000003647 oxidation Effects 0.000 description 1
- 238000007254 oxidation reaction Methods 0.000 description 1
- 238000007427 paired t-test Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000001242 postsynaptic effect Effects 0.000 description 1
- 230000003518 presynaptic effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 230000009257 reactivity Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 201000000980 schizophrenia Diseases 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 229910052709 silver Inorganic materials 0.000 description 1
- 239000004332 silver Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 210000003625 skull Anatomy 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000002269 spontaneous effect Effects 0.000 description 1
- 230000000946 synaptic effect Effects 0.000 description 1
- 230000005062 synaptic transmission Effects 0.000 description 1
- 210000001519 tissue Anatomy 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000002792 vascular Effects 0.000 description 1
- 230000006492 vascular dysfunction Effects 0.000 description 1
Images
Abstract
The invention discloses a quantitative evaluation method for blood oxygen compensation level of multi-mode audio-visual combination, which comprises four parts of multi-mode equipment establishment, multi-mode experimental paradigm design and signal acquisition, and multi-mode feature extraction and significance and regression analysis. By simulating the blood oxygen compensation state on normal people, the response level of cognitive function and motor function under normal conditions and blood oxygen compensation is evaluated, so that the blood oxygen compensation level of the subject is quantitatively evaluated. The invention adopts a multi-mode to obtain the electrophysiological signals and the blood oxygen signals, and can well capture the function change condition. Therefore, the blood oxygen compensation state multi-mode quantitative evaluation method designed by the invention can establish an objective physiological level comprehensive evaluation model to realize the objective quantitative evaluation of the blood oxygen compensation level.
Description
Technical Field
The invention belongs to the field of brain-computer interfaces, and particularly relates to a multi-mode audio-visual combined blood oxygen compensation level quantitative evaluation method.
Background
The world health organization defines stroke as a "rapidly progressive focal (or global)" brain dysfunction, a neurological disease caused by cerebral vascular dysfunction. Vascular complications may include bleeding from the blood vessels or formation of clots in the blood vessels. Predictions indicate that stroke incidence will continue to increase in the next decade or longer. Fortunately, there is evidence that stroke is a highly preventable, treatable and controllable disease. Therefore, through the detection of individual blood oxygen compensation state, quantization blood oxygen compensation level, and then the evaluation individual suffers from the apoplexy risk, accomplishes that the apoplexy early warning prevents that the apoplexy from taking place the work that very makes sense. The existing blood oxygen metabolism related level detection technology mostly stays in blood oxygen saturation related level index detection, a single-mode-based signal detection method is proved to have quite obvious one-sidedness, and cannot quantitatively evaluate the blood oxygen compensation level of a human body, especially the brain, on a dynamic task and individual function level layer, so that the further correlation with the stroke risk cannot be carried out.
Stroke is generally thought to be associated with a decline in cognitive ability that may hinder functional recovery and rehabilitation, while event-related potentials (ERP) may help assess cognitive impairment. The event-related response at the time of the lock may be phase-locked or non-phase-locked with respect to the presentation of the stimulus. When the event-related response is phase-locked to the stimulus onset, the researcher may average the relatively fixed neural response observed in the time domain after multiple trials, i.e., ERP. ERP begins with postsynaptic potentials generated during neurotransmission, which are passively transmitted through the brain and skull to the scalp where an integrated electroencephalogram is formed. P300 is the most studied component of ERP composition studies, is a positive deviation in electroencephalogram (EEG) of scalp recordings, and is typically evoked about 300ms after the appearance of a target stimulus (e.g., visual, auditory). One particular set of cases that trigger P300 is referred to as the Oddball paradigm. In the Oddball experimental paradigm, there are two stimuli, one standard and one offset, that are physically very close, such as two different letter flashes and two distinct frequency beeps alternating. The standard stimulation is background stimulation, namely stimulation with more occurrence times in the experiment, while the deviation stimulation is also called target stimulation, namely target stimulation, and the occurrence times are less and account for about two times of the total number of stimulation. In this example, P300 and other ERPs are triggered unintentionally whenever the subject's brain detects a target stimulus (deviation event). P300 is an important link to the assessment of cognitive function, and can be used to assess cognitive processes such as attention, working memory, and the like. The latent period reflects the process of distinguishing target stimulation from non-target stimulation, and is an embodiment of working memory, and the amplitude is related to the allocation of attention resources. P300 is considered to be a good indicator for assessing the presence or absence of cognitive decline in some mild cognitive dysfunction studies, and therefore, P300 signaling is important brain response information in relation to diagnosis of neurological brain diseases. An extension of P300 latency and a decrease in P300 amplitude may indicate a slowing of cognition, possibly indicating various diseases and injuries of the brain, including dementia, schizophrenia, etc. There have been many studies to study P300 in the time domain, frequency domain, time-frequency domain, space domain by using wavelet transform, CSP, etc. Previous research has focused on visual oddball, but some stroke patients have oculomotor dysfunction and therefore we also consider auditory oddball. Studies have shown that both visual and auditory oddball can evoke P300, and that P300 from auditory tasks is smaller in amplitude and shorter in delay than P300 for visual tasks.
On the other hand, motor dysfunction is common in stroke patients. Motor Imagery (MI) is one of the common paradigms in BCI research, which is done by performing perceptual imagery rather than actual motion. The brain regions where MI tasks are activated coincide with the brain regions where motor execution is activated. MI test has great research value for some neurological diseases which can cause motor defects, so that the MI test has wide application in medical rehabilitation. The appearance of EEG signals in particular is the event-related desynchronization/synchronization (ERD/ERS) phenomenon. When a person is performing motor imagery or motor performance, corresponding areas of the cerebral cortex are active and the mu-and beta-rhythms of these brain areas are attenuated in amplitude, which is the ERD. The application of the ERD phenomenon is now widespread, and the phenomenon is most obvious in that when the limbs regularly perform symmetric movement, the amplitude attenuation of the opposite side alpha frequency band and beta low frequency band is prior to the movement itself, which is proved by many researches combined with myoelectricity. At some point, local areas of the cerebral cortex are not stimulated by the task and local components of the EEG signal in that brain area experience an increase in amplitude, known as ERS. ERD/ERS are distinct responses of neuronal structures in the brain and are all time-locked to events. In patients with neurodegenerative diseases, such as Parkinson's disease. Multiple system atrophy, etc., the spatio-temporal pattern of ERD/ERS changes. ERD occurs because after activation of the cortex of the brain, the metabolism and blood flow in this area increases, greatly depleting oxygen and blood glucose, etc., in this area, so that the discharge of cells is blocked, as opposed to ERS, which is consistent with the phenomenon observed in nuclear magnetic resonance of the brain. Changes in oxygen metabolism are the basis for this study to combine EEG with fNIRS.
For the invention, the collected electric signals are amplified and recorded through the electrodes at different positions of the scalp to obtain the whole brain electroencephalogram signals. When an individual is healthy and normal, the nerve cell discharge of the individual is spontaneous discharge following a certain rule, but when the brain suffers from diseases of different degrees, such as brain tumor, encephalitis, epilepsy, bleeding and ischemic diseases caused by various diseases, abnormal discharge of nerve cells can occur. Therefore, all lesions that cause changes in synaptic potentials of brain cells can certainly find changes in electroencephalogram (EEG) signals to a certain extent and degree.
In individuals, blood oxygen signals are mainly related to energy-consuming processes in the process of life activities, and for brain blood oxygen information, as presynaptic activity energy is consumed, glucose aerobic oxidation is intensified, peripheral blood supply arterioles are controllably dilated, and capillary blood flow associated with the peripheral blood supply arterioles is increased, and accordingly, the content of peripheral oxygenated hemoglobin (Hb) and deoxygenated hemoglobin (deoxy-Hb) is directly changed.
Cerebral blood oxygen status information is often measured using a functional near infrared device (fNIRS), which uses optical non-invasive means to measure cerebral blood oxygen information using the characteristics of near infrared light. The same as other parts of an individual, the blood oxygen information of the brain is directly related to oxyhemoglobin (Hb) and deoxyhemoglobin (deoxy-Hb) in blood flow, and if the real-time content relation information of the two types of hemoglobin in the human brain can be obtained through technical means, the related brain blood oxygen state information can be obtained. Near infrared light (650-950 nm) is almost completely transmitted to other tissues of the brain (such as bones, skin and the like), and oxyhemoglobin (Hb) and deoxyhemoglobin (deoxy-Hb) are relatively sensitive to the light in the part, so that different brain tissues are attenuated by the near infrared light differently, and real-time brain blood oxygen state information can be obtained through blood flow parameters transmitted through different brain tissues.
Because the endogenous light signal and the electrophysiological signal can not generate crosstalk in the process of combined acquisition, the EEG high time response speed and the fNIRS good spatial resolution can be achieved, and the evaluation detection result is integrally improved.
Breath holding and expiration can be used for evaluating cerebrovascular reactivity abnormality, and by being related to the severity of small vessel diseases and the risk of stroke of carotid artery stenosis, the breath holding is adopted to simulate the blood oxygen compensation state, so that the blood oxygen compensation level condition of a human body is quantitatively evaluated.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides a multi-modal audio-visual combined blood oxygen compensation level quantitative evaluation method, which solves the problems that the blood oxygen metabolism related level detection technology in the prior art mostly stays in blood oxygen saturation related level index detection, has quite obvious one-sidedness, and cannot quantitatively evaluate the blood oxygen compensation level of a human body, particularly the brain on the dynamic task and individual function level.
The technical scheme of the invention is as follows:
a multi-modal audio-visual combined blood oxygen compensation level quantitative evaluation method comprises the following four steps: the method comprises the steps of building multi-mode equipment, designing a multi-mode experimental paradigm, collecting signals, extracting multi-mode features, analyzing significance, analyzing regression and constructing a model.
In the signal acquisition process in the step 1, the user is required to enter a blood oxygen compensation state under the conditions of breath holding, advance movement and quantitative carbon dioxide gas inhalation;
the wavelength of near infrared light wave used in the signal collection process is 780nm and 830nm.
In the signal acquisition process of the step 2, the method integrates the audio-visual oddball paradigm to jointly evaluate the cognitive response change situation, and the motor function change situation is evaluated through the Motor Imagery (MI) paradigm, and the two evaluation results are integrated to construct a comprehensive evaluation model with multi-dimensional functions.
In the execution of the experiment task, a user executes an experiment with specific duration range and specific content according to prompts, obtains an EEG signal and an fNIRS signal through the experiment, extracts features by using blood oxygen change and time-space change of electrophysiological signals, and establishes an evaluation model.
The EEG filter range is [8,45Hz ] for data acquired in the oddball paradigm, [8,30Hz ] for EEG signals acquired in the MI paradigm, and [0,.01,0.1Hz ] for the fNIRS signals.
And acquiring the amplitude and the latency of the P300 for the EEG signal acquired by the oddball normal form through average superposition of time domains, acquiring time-frequency information for the EEG signal acquired by the MI normal form through ERSP, and extracting a mean slope characteristic for the fNIRS signal.
And performing regression analysis on the characteristics through a multivariate linear and nonlinear algorithm to construct an evaluation model.
The invention has the beneficial effects that: the invention designs a multi-mode audio-visual combined blood oxygen compensation level quantitative evaluation method. The state of blood oxygen compensation is simulated through the signal simulation when a normal person holds breath, the situation of the blood oxygen compensation level in the state is quantitatively evaluated, a model is established, the model is perfected, and the objective evaluation of the blood oxygen compensation level is realized. According to the invention, through the joint acquisition of EEG and fNIRS, cognitive function assessment is carried out by applying oddball paradigm, and motor function assessment is carried out by applying MI paradigm. In addition, the invention adopts a multi-mode to acquire electrophysiological signals and blood oxygen signals, and can well capture the function change condition. Therefore, the blood oxygen compensation state multi-mode quantitative evaluation method designed by the invention can establish an objective physiological level comprehensive evaluation model to realize the objective quantitative evaluation of the blood oxygen compensation level.
Drawings
FIG. 1 is a flow chart of the method of the present invention;
FIG. 2 is a schematic diagram of an experimental paradigm; the method comprises the following steps of (a) acquiring a brain electrical signal site diagram, (b) acquiring a functional near-infrared signal site diagram, (c) arranging an experiment of a visual/audio oddball; (d) Experimental arrangement for MI.
Detailed Description
The present invention will be described in detail with reference to the accompanying drawings.
1. Design of experiments
The invention discloses a blood oxygen compensation level quantitative evaluation method which is constructed by inducing a tested blood oxygen compensation state through experimental conditions and analyzing brain information through multi-mode audio-visual combination. In the multi-modal BCI, an EEG signal and an fNIRS signal during a patient task are acquired, then signal preprocessing, feature extraction and significance analysis are carried out, signal difference between a normal state and a blood oxygen compensation state is analyzed, and a multi-modal assessment system is established through logistic regression. The experiments designed by the invention totally comprise three experiments, namely visual oddball, auditory oddball and MI, and the cognitive function and the motor function in a normal state and a blood oxygen compensation state are evaluated through the analysis of three task signals, so that the early warning evaluation on the blood oxygen compensation level is better carried out. The structure schematic diagram is shown in figure 1.
Before the experiment begins, EEG and fNIRS combined collecting equipment is set up, and the arrangement of channels is completed according to the channel design. A schematic diagram of the EEG and fNIRS co-production experimental setup is shown in fig. 2 (a). The whole experiment is completed in a quiet and non-interfering environment.
The experiments in this application take the P300 paradigm, with both specific forms of stimulation, auditory and visual. The tested person sits in the front of the screen by about 50cm, the whole experiment process is carried out in a quiet dark environment, the comfortable state is kept, and the large-scale movement of the body is avoided as much as possible. When the experiment is started, the state of the experiment (breath holding or rest) is indicated, and then the screen shows a cross of 5s, which indicates that the experiment focuses on the attention and adjusts the breathing. Considering the breath-holding capacity of the test, there are 25 target stimuli and 5 non-target stimuli per block, for a total of 10 blocks. For visual stimulation, the target stimulation was X, the non-target stimulation was O, each stimulation interval was 200ms, each group had a rest 15s after the end of the experiment, and the breathing was adjusted. For acoustic stimulation, two different frequency beeps were used for stimulation, again with 200ms intervals between each stimulation.
The MI experiments herein employ left and right hand motor imagery experiments. When the experiment is started, the state of the experiment (breath holding or rest) is indicated, and then the screen shows a cross of 5s, which indicates that the experiment focuses on the attention and adjusts the breathing. The task period is 4s, and the effect of the perceptual imagery is better than that of the visual imagery, so that the testee is required to imagine the perceptual perception of the left/right hand in the process of making a fist within the task period and imagine the feeling once. Then a rest period of 15s is entered and the subject is asked to relax and adjust his breathing. There were 10 trials for a block, for a total of 10 blocks.
The experiment adopts a 64-lead electroencephalogram acquisition system developed by Neuroscan company to acquire 60-100 Hz electroencephalogram signals (CB 1, CB2, HEO and VEO leads are removed) through a silver/silver chloride (Ag/AgCl) alloy electrode cap. The sampling frequency is 1000Hz, and 50Hz power frequency interference is filtered. The lead distribution of the electrode caps is according to the international standard 10/20 electrode system. Wherein the reference electrode is attached to the tip of the nose and the ground electrode is attached to the forehead. In the pre-processing, the oddbal paradigm of signals is bandpass filtered using a Common Average Reference (CAR) in the range [8,45Hz ], the MI paradigm of acquired signals is bandpass filtered in the range [8,30Hz ], and the signals are down-sampled to 200Hz.
Near-infrared data were collected using near-infrared equipment developed by Shimadzu for the experiments. With a frequency of 17Hz, in the pre-processing, the original light intensity signal is converted to a change in the concentration of oxygenated and deoxygenated hemoglobin by modified beer-lambert law, the signal is band-pass filtered, ranging from 0.01,0.1hz, and down-sampled to 10Hz.
2. Time domain analysis
ERP is a signal of locking time and phase, and time domain information of data acquired by the oddball paradigm is very important. Bad derivative data and test orders with poor signals are removed firstly, and then, the test orders obtained by all visual/auditory oddball experiments are subjected to average superposition to draw a waveform diagram. Finally, the average amplitude of the superimposed P300 component is extracted, and the latency of P300 is calculated. The analysis of the P300 component has focused primarily on Fz, cz, pz, etc. leads, and the corresponding fNIRS channels.
3. Time-frequency analysis
For MI tasks, an event-related spectral perturbation (ERSP) method is often employed to analyze time-frequency domain characteristics of EEG (electroluminescence phase mapping) signals, analyzing ERD/SSSEP patterns under different imaginative tasks. The definition formula of ERSP is as follows:
wherein n represents the number of experimental runs, F k (f, t) refers to the spectral estimation at frequency f at time t of the k-th experiment. And (3) calculating the ERSP by adopting short-time Fourier transform, wherein the hamming window width is 256 sampling points, and the spectrum mean value in 2s before a task is subtracted from the original data so as to remove a base line.
For the fNIRS signal, the mean slope feature is extracted as the feature of the MI task, and the formula is (2) (3).
4. Significance analysis and regression analysis
The invention uses the paired t test (formula (4)) to observe whether there is significant difference between the ERD/ERS of P300 amplitude, latency and MI in normal state and blood oxygen compensation state.
Next, the present invention employs a Logistic Regression (Logistic Regression) algorithm to construct the model. Linear regression can be used to predict the values of the dependent variable, while Logistic regression uses a function on this basis (formula (5)) to normalize the dependent variable so that the dependent variable is within the interval (0, 1), this function is called Logistic function (Logistic function) and is also called Sigmoid function, formula (6):
as z of the Logistic function approaches infinity, g (z) approaches 1; as z approaches infinity, g (z) approaches 0.
Claims (10)
1. A multi-modal audio-visual combined blood oxygen compensation level quantitative evaluation method is characterized by comprising the following four steps: the method comprises the steps of building multi-mode equipment, designing a multi-mode experimental paradigm, collecting signals, extracting multi-mode features, analyzing significance, analyzing regression and constructing a model.
2. The method as claimed in claim 1, wherein the signal acquisition process in the above steps requires the user to enter the blood oxygen compensation status by holding breath, moving a priori, inhaling a certain amount of carbon dioxide.
3. The method of claim 1, wherein the signal acquisition step comprises EEG signal and fNIRS signal acquisition.
4. The method as claimed in claim 1, wherein the wavelengths of near infrared light waves used in the signal acquisition process are 780nm and 830nm.
5. The method as claimed in claim 1, wherein in the signal collection process, the audio-visual oddball paradigm is integrated to evaluate the cognitive response change condition jointly, the motor function change condition is evaluated through a Motor Imagery (MI) paradigm, and a comprehensive evaluation model of multi-dimensional functions is constructed by integrating two evaluation results.
6. The method as claimed in claim 1, wherein during the experiment task, the user performs the experiment with specific duration and specific content according to the prompt, and obtains the EEG signal and the fNIRS signal through the experiment, and extracts the feature by using the blood oxygen variation and the time-space variation of the electrophysiological signal to build the evaluation model.
7. The method as claimed in claim 4, wherein the EEG filtering range is [8,45Hz ] for data acquired in oddball paradigm, [8,30Hz ] for EEG signal acquired in MI paradigm, and [0,.01,0.1Hz ] for fNIRS signal.
8. The method as claimed in claim 4, wherein the amplitude and latency of P300 are obtained by averaging and overlapping time domains of EEG signals obtained in oddball paradigm, time frequency information is obtained by ERSP for EEG signals obtained in MI paradigm, and mean slope characteristic is extracted for fNIRS signals.
9. The method of claim 1, wherein the evaluation model is constructed by regression analysis of the features through a multivariate linear and nonlinear algorithm.
10. The method according to claim 3, wherein the brain region collected by EEG is the whole brain, and the brain region collected by fNIRS is the sensorimotor region.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211621682.9A CN115813385B (en) | 2022-12-16 | 2022-12-16 | Multi-mode audio-visual combined blood oxygen compensation level quantitative evaluation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211621682.9A CN115813385B (en) | 2022-12-16 | 2022-12-16 | Multi-mode audio-visual combined blood oxygen compensation level quantitative evaluation method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115813385A true CN115813385A (en) | 2023-03-21 |
| CN115813385B CN115813385B (en) | 2024-04-12 |
Family
ID=85516242
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211621682.9A Active CN115813385B (en) | 2022-12-16 | 2022-12-16 | Multi-mode audio-visual combined blood oxygen compensation level quantitative evaluation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115813385B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100268096A1 (en) * | 2009-02-04 | 2010-10-21 | Advanced Brain Monitoring, Inc. | Method and Apparatus For Non-Invasive Assessment of Hemodynamic and Functional State of the Brain |
| CN204863182U (en) * | 2015-06-25 | 2015-12-16 | 昆明理工大学 | Motion imagination EEG and fNIRS synchronous sampling brain information apparatus |
| WO2016110804A1 (en) * | 2015-01-06 | 2016-07-14 | David Burton | Mobile wearable monitoring systems |
| CN106845563A (en) * | 2015-12-07 | 2017-06-13 | 中国科学院沈阳自动化研究所 | Feature extracting method based on brain electricity and near infrared signal |
| US20190231230A1 (en) * | 2018-01-30 | 2019-08-01 | Soochow University | Cerebral function state evaluation device based on brain hemoglobin information |
| US20200038653A1 (en) * | 2015-12-22 | 2020-02-06 | University Of Florida Research Foundation, Inc. | Multimodal closed-loop brain-computer interface and peripheral stimulation for neuro-rehabilitation |
| CN113040790A (en) * | 2021-03-29 | 2021-06-29 | 中国科学院自动化研究所 | Closed-loop neural regulation system, method and equipment based on endogenous brain signals |
| CN114176610A (en) * | 2021-12-31 | 2022-03-15 | 杭州电子科技大学 | Workload assessment method for diagnosis of mild cognitive dysfunction patient |
| CN115374831A (en) * | 2022-10-24 | 2022-11-22 | 睿瞳(杭州)科技发展有限公司 | Dynamic and static combination velocity imagery classification method for multi-modal registration and space-time feature attention |
-
2022
- 2022-12-16 CN CN202211621682.9A patent/CN115813385B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100268096A1 (en) * | 2009-02-04 | 2010-10-21 | Advanced Brain Monitoring, Inc. | Method and Apparatus For Non-Invasive Assessment of Hemodynamic and Functional State of the Brain |
| WO2016110804A1 (en) * | 2015-01-06 | 2016-07-14 | David Burton | Mobile wearable monitoring systems |
| CN204863182U (en) * | 2015-06-25 | 2015-12-16 | 昆明理工大学 | Motion imagination EEG and fNIRS synchronous sampling brain information apparatus |
| CN106845563A (en) * | 2015-12-07 | 2017-06-13 | 中国科学院沈阳自动化研究所 | Feature extracting method based on brain electricity and near infrared signal |
| US20200038653A1 (en) * | 2015-12-22 | 2020-02-06 | University Of Florida Research Foundation, Inc. | Multimodal closed-loop brain-computer interface and peripheral stimulation for neuro-rehabilitation |
| US20190231230A1 (en) * | 2018-01-30 | 2019-08-01 | Soochow University | Cerebral function state evaluation device based on brain hemoglobin information |
| CN113040790A (en) * | 2021-03-29 | 2021-06-29 | 中国科学院自动化研究所 | Closed-loop neural regulation system, method and equipment based on endogenous brain signals |
| CN114176610A (en) * | 2021-12-31 | 2022-03-15 | 杭州电子科技大学 | Workload assessment method for diagnosis of mild cognitive dysfunction patient |
| CN115374831A (en) * | 2022-10-24 | 2022-11-22 | 睿瞳(杭州)科技发展有限公司 | Dynamic and static combination velocity imagery classification method for multi-modal registration and space-time feature attention |
Non-Patent Citations (2)
| Title |
|---|
| ZHEN YUAN ET AL: "Editorial: Techniques Advances and Clinical Applications in Fused EEG-fNIRS", 《FRONTIERS IN HUMAN NEUROSCIENCE》, 22 November 2019 (2019-11-22) * |
| 周伊婕 等: "基于脑电的多模态神经功能成像新技术研究进展", 《中国生物医学工程学报》, vol. 39, no. 5, 31 October 2020 (2020-10-31) * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115813385B (en) | 2024-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Travis | Autonomic and EEG patterns distinguish transcending from other experiences during Transcendental Meditation practice | |
| Holm et al. | Estimating brain load from the EEG | |
| DE102012002037B4 (en) | Device for carrying out driver status analyzes | |
| Poltavski | The use of single-electrode wireless EEG in biobehavioral investigations | |
| KR20120100320A (en) | Devices and methods for readiness potential-based brain-computer interface | |
| US20070276281A1 (en) | Monitoring of the state of the central nervous system of a subject | |
| Zhang et al. | Automatic recognition of cognitive fatigue from physiological indices by using wavelet packet transform and kernel learning algorithms | |
| Gupta et al. | Neurophysiological experimental facility for Quality of Experience (QoE) assessment | |
| Lee et al. | Feasibility of a mobile electroencephalogram (EEG) sensor-based stress type classification for construction workers | |
| Smith | Electroencephalograph based brain computer interfaces | |
| Tiwari et al. | Movement artifact-robust mental workload assessment during physical activity using multi-sensor fusion | |
| Bonjyotsna et al. | Correlation of drowsiness with electrocardiogram: A review | |
| CN115813385B (en) | Multi-mode audio-visual combined blood oxygen compensation level quantitative evaluation method | |
| Pavithran et al. | Index of Theta/Alpha ratio to quantify visual-spatial attention in dyslexics using Electroencephalogram | |
| von Rosenberg et al. | Smart helmet: monitoring brain, cardiac and respiratory activity | |
| Dolezalek et al. | Physiological signal monitoring system to analyze driver attentiveness | |
| Kaur et al. | Brain computer interface: a review | |
| Salleh et al. | AR modeling as EEG spectral analysis on prostration | |
| Müller-Putz et al. | Electroencephalography and brain–computer interfaces | |
| Del Prete | Enhancements of EEG Artifact Automatic Correction Algorithm and Processing of Hemiplegic Patients' EEG | |
| Attar | Stress Analysis Based on ECG and EEG | |
| Bhuvaneswari et al. | A note on methods used for deception analysis and influence of thinking stimulus in deception detection | |
| Sultanov et al. | Mobile EEG systems for alpha neurofeedback and anxiety control | |
| Zhang et al. | Clenching-Related Motion Artifacts in Functional Near-Infrared Spectroscopy in the Auditory Cortex | |
| Das et al. | Complexity Analysis of Ocular Signal for Detection of Human Fatigue Using Small Datasets |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |