CN116919424A - Brain-computer interface rehabilitation method, device, electronic equipment and storage medium - Google Patents
Brain-computer interface rehabilitation method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN116919424A CN116919424A CN202311079901.XA CN202311079901A CN116919424A CN 116919424 A CN116919424 A CN 116919424A CN 202311079901 A CN202311079901 A CN 202311079901A CN 116919424 A CN116919424 A CN 116919424A
- Authority
- CN
- China
- Prior art keywords
- brain
- visual video
- stimulation
- stimulus
- computer interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 210000004556 brain Anatomy 0.000 claims abstract description 93
- 230000000007 visual effect Effects 0.000 claims abstract description 79
- 230000000638 stimulation Effects 0.000 claims abstract description 72
- 230000033001 locomotion Effects 0.000 claims abstract description 64
- 238000011084 recovery Methods 0.000 claims abstract description 56
- 230000007659 motor function Effects 0.000 claims abstract description 31
- 230000000737 periodic effect Effects 0.000 claims abstract description 31
- 230000004044 response Effects 0.000 claims abstract description 23
- 238000011156 evaluation Methods 0.000 claims abstract description 20
- 210000005036 nerve Anatomy 0.000 claims abstract description 17
- 230000000763 evoking effect Effects 0.000 claims abstract description 16
- 230000033764 rhythmic process Effects 0.000 claims abstract description 13
- 230000033228 biological regulation Effects 0.000 claims abstract description 12
- 230000001953 sensory effect Effects 0.000 claims abstract description 11
- 230000009471 action Effects 0.000 claims description 28
- 230000006870 function Effects 0.000 claims description 25
- 238000013145 classification model Methods 0.000 claims description 12
- 238000012549 training Methods 0.000 claims description 12
- 230000008569 process Effects 0.000 claims description 9
- 230000005611 electricity Effects 0.000 claims description 4
- 230000001939 inductive effect Effects 0.000 claims description 4
- 230000003068 static effect Effects 0.000 claims description 4
- 230000009466 transformation Effects 0.000 claims description 3
- 208000006011 Stroke Diseases 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 238000007781 pre-processing Methods 0.000 description 7
- 238000013527 convolutional neural network Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 230000003925 brain function Effects 0.000 description 5
- 238000012360 testing method Methods 0.000 description 5
- 230000006978 adaptation Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 206010008190 Cerebrovascular accident Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000002490 cerebral effect Effects 0.000 description 2
- 230000001771 impaired effect Effects 0.000 description 2
- 230000001976 improved effect Effects 0.000 description 2
- 230000006698 induction Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001737 promoting effect Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000004936 stimulating effect Effects 0.000 description 2
- 206010001497 Agitation Diseases 0.000 description 1
- 208000012661 Dyskinesia Diseases 0.000 description 1
- 230000009118 appropriate response Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005978 brain dysfunction Effects 0.000 description 1
- 208000029028 brain injury Diseases 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000034994 death Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000005021 gait Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000926 neurological effect Effects 0.000 description 1
- 230000004007 neuromodulation Effects 0.000 description 1
- 210000002569 neuron Anatomy 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000009012 visual motion Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
- A61B5/372—Analysis of electroencephalograms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
- A61B5/377—Electroencephalography [EEG] using evoked responses
- A61B5/378—Visual stimuli
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
- A61B5/377—Electroencephalography [EEG] using evoked responses
- A61B5/383—Somatosensory stimuli, e.g. electric stimulation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
- A61B5/386—Accessories or supplementary instruments therefor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
- A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Public Health (AREA)
- Pathology (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Psychiatry (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Artificial Intelligence (AREA)
- Psychology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physiology (AREA)
- Signal Processing (AREA)
- Evolutionary Computation (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- Rehabilitation Tools (AREA)
Abstract
The application provides a brain-computer interface rehabilitation method, a brain-computer interface rehabilitation device, electronic equipment and a storage medium. Wherein the method comprises displaying visual video stimuli of periodic motion of the target; visual video stimuli are used to elicit a response in the brain of the subject; responses include steady state motor vision evoked potentials ssmep and sensory motor rhythms SMR; acquiring brain electrical data of a tested person when receiving visual video stimulation through an brain electrical acquisition system; determining and displaying specific types of stimuli according to the SSMVEP; analyzing the SMR, evaluating the motor function recovery condition of the tested specific brain area corresponding to the specific type of stimulation, and outputting an evaluation result; in the case that the motor function recovery situation does not accord with the expected recovery situation, the specific brain area to be tested is subjected to nerve regulation by applying electric stimulation through the transcranial electric stimulation tES equipment.
Description
Technical Field
The present application relates to the field of brain-computer interface rehabilitation technologies, and in particular, to a brain-computer interface rehabilitation method, a device, an electronic apparatus, and a storage medium.
Background
Currently, stroke has become the second leading cause of death worldwide, and dyskinesia is the most common sequelae after stroke. The Brain-computer interface (Brain-computer interface, BCI) establishes a direct communication path between the Brain and external equipment, can provide closed-loop nerve feedback, and is a potential nerve rehabilitation method.
In the related art, most of post-stroke rehabilitation means adopt machines to perform physical exercise rehabilitation, but nerve rehabilitation is omitted, and the rehabilitation effect is not ideal. Studies have demonstrated that post-stroke patients can induce sensory-Motor rhythms through Motor Imaging (MI) and thus can be used for neurological rehabilitation. However, in practical clinical applications, the ability of MI to heal with MI is not available after a partial post-stroke patient brain injury. Therefore, a rehabilitation method with low adaptation requirements and good rehabilitation effect is needed in the rehabilitation field.
Disclosure of Invention
The application provides an improved brain-computer interface rehabilitation method, device, electronic equipment and storage medium, which have low adaptation requirements and good rehabilitation effect.
The application provides a brain-computer interface rehabilitation method, which comprises the following steps:
displaying visual video stimuli of periodic movements of the target; the visual video stimulus is used for inducing the brain to respond; the response includes steady state motor vision evoked potential ssmvp and sensory motor rhythm SMR;
acquiring brain electricity data of a tested person when receiving the visual video stimulus through an brain electricity acquisition system;
determining and displaying a specific class of stimulus according to the SSMVEP;
analyzing the SMR, evaluating the motion function recovery condition of the tested specific brain area corresponding to the specific type of stimulation, and outputting an evaluation result;
and in the case that the motor function recovery condition does not accord with the expected recovery condition, applying electric stimulation to the specific brain region to be tested through transcranial electric stimulation tES equipment to carry out nerve regulation.
Further, the visual video stimulus for displaying the periodic motion of the target includes:
and displaying the visual video stimulus of the target periodic motion according to the screen refreshing frequency and the action executing frequency corresponding to the target periodic motion.
Further, the visual video stimulus for displaying the periodic motion of the target includes:
at the initial stage of the stimulation, any frame of the visual video stimulation with a first preset duration is displayed in a static mode;
stimulus is started, and visual video stimulus of a second preset time duration is continuously displayed; wherein the second predetermined time period is greater than or equal to the first predetermined time period.
Further, the visual video stimulus comprises a plurality of visual video stimuli, the screen refreshing frequency corresponding to each visual video stimulus is different, and the action execution frequency of the periodic motion in each visual video stimulus is different.
Further, the target periodic motion of the visual video stimulus includes a limb motion in a single direction, and one or more of repeating the limb motion in a first direction and an opposite direction to the first direction.
Further, the repeating limb movement actions in the first direction and the opposite direction of the first direction include a single complete action of swinging the limb in the first direction and swinging the limb in the opposite direction of the first direction to reset; and/or the number of the groups of groups,
the movement of the limb in a single direction includes movement of the limb in a second direction and a transformation.
Further, the brain-computer interface rehabilitation method further comprises the following steps: and displaying the visual video stimulus or executing the instruction corresponding to the visual video stimulus by the equipment terminal.
Further, determining a specific category of stimulation according to the ssmvps, including:
inputting the SSMVEP in the induced brain electrical data to a classification model to output a specific class of stimulus; the classification model is obtained through sample data training, and the sample data training process comprises the steps of selecting leads of a main existence area of an SSMVEP response;
the analyzing the SMR, evaluating the motor function recovery condition of the tested specific brain area corresponding to the specific type of stimulation comprises the following steps:
and according to the visual video stimulus, determining a brain region function recovery index of the SMR induced by each lead in the specific brain region to be tested corresponding to the stimulus, and evaluating the function recovery condition of the specific brain region to be tested.
The embodiment of the application provides a brain-computer interface rehabilitation device, which comprises:
the stimulation module is used for displaying visual video stimulation of the periodic movement of the target; the visual video stimulus is used for inducing the brain to respond; the response includes steady state motor vision evoked potential ssmvp and sensory motor rhythm SMR;
the electroencephalogram data acquisition module is used for acquiring electroencephalogram data of a tested person when receiving the visual video stimulus through an electroencephalogram acquisition system;
the classification and identification module is used for determining and displaying specific class stimulation according to the SSMVEP;
the brain region movement function evaluation module is used for analyzing the SMR, evaluating the movement function recovery condition of the tested specific brain region corresponding to the specific type of stimulation and outputting an evaluation result;
and the nerve regulation and control module is used for applying electric stimulation to the specific brain region to be tested through the transcranial electric stimulation tES equipment to carry out nerve regulation and control under the condition that the motor function does not accord with the expected recovery.
The application provides an electronic device comprising the brain-computer interface rehabilitation device.
The present application provides a computer-readable storage medium having stored thereon a program which, when executed by a processor, implements the brain-computer interface rehabilitation method as described in any one of the above.
In some embodiments, the brain-computer interface rehabilitation method of the present application displays visual video stimuli of the periodic movement of the target; visual video stimuli are used to elicit a response in the brain of the subject; responses include steady state motor vision evoked potentials ssmep and sensory motor rhythms SMR; acquiring brain electrical data of a tested person when receiving visual video stimulation through an brain electrical acquisition system; determining a specific category of stimulation according to the SSMVEP, and displaying the stimulation of the specific category; analyzing the SMR, evaluating the motor function recovery condition of the tested specific brain area corresponding to the specific type of stimulation, and outputting an evaluation result; in the case that the motor function recovery situation does not accord with the expected recovery situation, the specific brain area to be tested is subjected to nerve regulation by applying electric stimulation through the transcranial electric stimulation tES equipment.
The AO and SSMVEP mixed coding paradigm used by the application does not require patients to have MI capability, and has low requirements for patient adaptation. And the paradigm can induce stronger responses in different brain regions at the same time, and can better promote functional connection between different brain regions. Specifically, the rehabilitation method provided by the application can activate the corresponding brain region through visual video stimulation of target periodic motion to obtain SSMVEP and SMR, and further can evaluate the motion function recovery condition of the tested specific brain region corresponding to specific category stimulation. Compared with the rehabilitation BCI of the related art, the mixed coding paradigm system instruction set based on the AO and the SSMVEP is larger, the information transmission rate is higher, and the interactive friendliness of the system is improved. The brain function recovery condition can be estimated in real time according to the induction effects of different exercises, and the brain function recovery condition can be properly regulated and controlled for the user, so that the brain function recovery of the user is promoted. Therefore, the multi-response BCI rehabilitation and regulation system based on the SSMVEP and the tES can better help patients with impaired motor function brain regions to perform rehabilitation, has a certain market application prospect, and is expected to obtain considerable social and economic benefits.
Drawings
Fig. 1 is a schematic flow chart of a brain-computer interface rehabilitation method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of visual video stimuli of the brain-computer interface rehabilitation method of FIG. 1;
FIG. 3 is a schematic flow chart of classification model identification in the brain-computer interface rehabilitation method shown in FIG. 1;
FIG. 4 is a flow chart of the brain-computer interface rehabilitation method of FIG. 1, illustrating the brain-region motor function assessment of step 140;
fig. 5 is a schematic block diagram of a brain-computer interface rehabilitation device according to an embodiment of the present application;
FIG. 6 is a schematic diagram of another module of a brain-computer interface rehabilitation device according to an embodiment of the present application;
fig. 7 is a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with one or more embodiments of the present specification. Rather, they are merely examples of apparatus and methods consistent with aspects of one or more embodiments of the present description as detailed in the accompanying claims.
It should be noted that: in other embodiments, the steps of the corresponding method are not necessarily performed in the order shown and described in this specification. In some other embodiments, the method may include more or fewer steps than described in this specification. Furthermore, individual steps described in this specification, in other embodiments, may be described as being split into multiple steps; while various steps described in this specification may be combined into a single step in other embodiments.
In order to solve the problem that the rehabilitation effect of partial post-stroke patients is not ideal, the embodiment of the application provides a brain-computer interface rehabilitation method.
Wherein, visual video stimulus of the periodic motion of the target is displayed; visual video stimuli are used to elicit a response in the brain of the subject; responses include Steady-state motor vision evoked potentials (Steady-state motion visual evoked potential, ssmvp) and sensory motor rhythms (Sensorimotor rhythm, SMR); acquiring brain electrical data of a tested person when receiving visual video stimulation through an brain electrical acquisition system; determining a specific category of stimulation according to the SSMVEP, and displaying the stimulation of the specific category; analyzing the SMR, evaluating the motor function recovery condition of the tested specific brain area corresponding to the specific type of stimulation, and outputting an evaluation result; in the event that motor function recovery does not meet expected recovery, neuromodulation is performed by applying electrical stimulation to the specific brain region under test via a transcranial electrical stimulation (Transcranial electrical stimulation, tES) device.
In the embodiment of the application, the corresponding brain regions are activated through visual video stimulation of the target periodic motion, so that SSMVEP and SMR are obtained, and further, the motion function recovery condition of the tested specific brain region corresponding to the specific type of stimulation is evaluated. In addition, under the condition of non-ideal motor function evaluation, the method can be combined with tES equipment to perform appropriate transcranial electric stimulation on the brain region of the patient to be tested, so that the method is beneficial to the recovery of the brain region of the patient to be tested, does not need MI capacity, has low adaptation requirement, and can promote the rehabilitation of motor functions of patients suffering from cerebral apoplexy.
The brain-computer interface rehabilitation method provided by the embodiment of the application is applied to electronic equipment. The electronic device may include, but is not limited to, an electroencephalogram acquisition system. And the electroencephalogram acquisition system is used for acquiring electroencephalogram data induced by visual video stimulation.
The electronic equipment can realize the brain-computer interface rehabilitation method of the embodiment of the application. Further, the electronic device may be a desktop computer, a portable computer, an intelligent mobile terminal, or the like. The present application is not limited to any specific electronic device capable of implementing the embodiments of the present application, and falls within the scope of protection of the present application.
Of course, the electronic device may include a stimulation module. This stimulation module may implement a display, also referred to as a display module. The display module may be included in a host-independent display. The display module may also be a display screen. The present application is not limited thereto, and may be applied as the case may be.
In other embodiments, similar to the electronic device described above, the only difference is that in this embodiment, the electronic device may also include, but is not limited to, a device terminal. The device terminal is connected with the electronic device. The equipment terminal is used for feeding back the command to be executed.
The device terminal may include, but is not limited to, one or more of a mechanical arm, an unmanned aerial vehicle, a wheelchair, and a brain-controlled vehicle, so that the terminal device executes a corresponding control command. Thus, the required equipment terminal can be selected according to the requirements of the user so as to execute the corresponding instruction.
For a detailed description of the brain-computer interface rehabilitation method, please refer to the following.
Fig. 1 is a schematic flow chart of a brain-computer interface rehabilitation method according to an embodiment of the present application.
As shown in fig. 1, the brain-computer interface rehabilitation method includes the following steps 110 to 150:
step 110, displaying visual video stimulus of periodic movement of a target; visual video stimuli are used to elicit a response in the brain of the subject; the response includes steady state motor vision evoked potential ssmep and sensory motor rhythm SMR. Wherein the test may be a human body.
The above-described periodic movement of the target is used to reflect visual stimuli of limb movement. The period of the target periodic movement may be set according to the user's demand.
The above-described step 110 is based on a hybrid coding paradigm of natural limb visual motion design (Action observation, AO) to simultaneously induce the user's brain to produce steady-state motor visual evoked potentials ssmvp and sensory motor rhythms SMR.
Wherein the visual video stimulus is used for reflecting the periodic motion of the target. The above-described periodic movement of the target by the visual video stimulus may include, but is not limited to, a movement of the limb in a single direction, or a repetition of a movement of the limb in a first direction and a direction opposite to the first direction.
Wherein the first direction is used to reflect the direction of movement. The first direction may be leftward, and correspondingly, the opposite direction of the first direction may be rightward. The first direction may be upward, and correspondingly, the opposite direction of the first direction may be downward. And are not exemplified here.
Further, the repeating limb movement in the first direction and the opposite direction of the first direction may include, but is not limited to, a single complete movement of swinging the limb in the first direction and swinging the limb in the opposite direction of the first direction to a reset. And/or the motion of the limb in a single direction comprises a motion of the limb in a second direction and a transformation motion.
FIG. 2 is a schematic diagram of visual video stimuli of the brain-computer interface rehabilitation method of FIG. 1. As shown in fig. 2, the following example:
in example one, the left hand swings left to right, then swings right to left until the position is restored to the original single complete action, the screen center displays "+", the action repeatedly appears on the left side of "+", and the screen refresh frequency is f 1 The action execution frequency is F 1 。
In example two, the right hand swings from right to left, then swings from left to right until the position is restored to the original single complete action, the action is repeatedly displayed on the right side of "+", and the screen refresh frequency is f 2 The action execution frequency is F 2 。
Example three, a single complete action is used as a left hand to punch a punch from bottom to top and stretch the palm, the screen center displays "+", "+" and the action repeatedly appears on the left, and the screen refresh frequency is f 3 The action execution frequency is F 3 。
Example four, a single complete action is a right hand punch from bottom to top and the palm is extended, the screen center shows "+", the action is repeated right of "+", and the screen refresh frequency is f 4 The action execution frequency is F 4 。
Example five, a single action is that the left leg and the right leg are sequentially lifted and jumped, the action repeatedly appears on the center of the screen, and the display frequency is f 5 The action execution frequency is F 5 。
The mixed coding paradigm realizes the simultaneous induction of multiple responses, can evaluate the brain function recovery condition in real time and perform proper nerve regulation, and can better help the recovery of patients with impaired motor function brain areas. This paradigm reduces the dependence of the BCI system on the patient's MI ability, and BCI control can be performed by decoding ssmvps for subjects with MI deletions, while also facilitating recovery of motor function areas. The AO paradigm of the related art is less useful in the field of BCI rehabilitation, and some are applied to the BCI rehabilitation system to involve a single gait stimulus. The application aims at using a plurality of natural limb movement stimuli to encode an AO paradigm to induce the compound correspondence of the tested multiple brain areas, thereby better promoting the recovery of the movement function.
In some embodiments of step 110 described above, the visual video stimulus may include, but is not limited to, one or more visual video stimuli, each visual video stimulus of the plurality of visual video stimuli having a different screen refresh frequency, and each visual video stimulus having a different frequency of performance of the periodic motion. The "plurality" may be 2 or more.
In another embodiment of step 110 above, any frame of visual video stimulus for a first predetermined duration is displayed stationary at the beginning of the stimulus; stimulus is started, and visual video stimulus of a second preset time duration is continuously displayed; wherein the second predetermined time period is greater than or equal to the first predetermined time period. Thus, any frame of visual video stimulus for a first predetermined duration is displayed at rest at the beginning of the stimulus, leaving the user with time to prepare and resume attention.
Any of the frames may include, but is not limited to, a first frame, a second frame, or other frames. And are not exemplified here.
The first predetermined period of time may be set according to a user's demand. The first predetermined time period may be T 1 Second. The second predetermined time period may be T 2 Second. Illustratively, the number of individual action occurrences in each stimulus is N; at the beginning of each stimulus, the action image is prompted to display T in a still mode 1 Second, then the stimulus starts playing, the playing duration time is T 2 Second.
Step 120, acquiring electroencephalogram (EEG) data of a subject receiving visual video stimulus by an electroencephalogram acquisition system.
Step 130, determining a specific category of stimulus according to the ssmvp and displaying the stimulus of the specific category.
The method of an embodiment of the application further comprises preprocessing the raw EEG data.
Further, the preprocessing may include, but is not limited to, re-referencing, downsampling, filtering, feature extraction, etc. the raw EEG data.
And 140, analyzing the SMR, evaluating the motor function recovery condition of the tested specific brain area corresponding to the specific type of stimulation, and outputting an evaluation result.
Step 150, in case that the motor function recovery situation does not accord with the expected recovery situation, applying electric stimulation to the tested specific brain area through the transcranial electric stimulation tES equipment to carry out nerve regulation. Among them, transcranial electrical stimulation is a non-invasive technique that uses electrical current to regulate neuronal cell excitability, which can cause changes in brain functionality. Thus, the tES can be used for electrically stimulating the brain dysfunction area detected by the BCI system, and promoting the recovery of brain functions.
If the motor function of the brain under test is restored to be expected, an appropriate response will be evoked in the corresponding brain region upon receiving visual video stimuli. If the exercise function recovery condition is not in line with expectations, after the tested person receives the visual video stimulus, the evoked response of the corresponding brain area is weak, even none, and the steps 110 to 150 of the application need to be continuously executed to recover the tested person.
In some embodiments of the brain-computer interface rehabilitation method of the present application, transcranial electrical stimulation tES may not be used in cases where motor function recovery conditions are consistent with expected recovery conditions.
The embodiment of the application can display visual video stimulus through the equipment terminal or the stimulus module. The method includes the steps of transmitting an instruction corresponding to the periodic motion of a target in visual video stimulation to the mechanical arm, and enabling the mechanical arm to execute a corresponding instruction.
Fig. 3 is a schematic flow chart of classification model identification in the brain-computer interface rehabilitation method shown in fig. 1.
Referring to fig. 3, in combination with fig. 1, the induced brain electrical data is input to the classification model in step 130 to output a specific class of stimulus; the classification model is obtained through sample data training, and the sample data training process comprises the step of selecting leads of the main existence area of the SSMVEP response. As shown in fig. 3, step one, off-line data is collected, five different stimuli in each round are presented in sequence, and EEG data for multiple rounds of testing is collected.
Training a classification model, dividing offline data into a training set and a verification set, inputting the training set and the verification set into a convolutional neural network (Convolutional Neural Network, CNN), performing training verification for multiple times, and selecting optimal model parameters to obtain a trained CNN model. The trained CNN model is used as a classification model for classifying and identifying the data input subsequently.
And thirdly, decoding in real time on line, collecting data of a user in real time when the user performs a test, inputting a trained CNN model for classification and identification, and determining the specific category of the current stimulus. The specific category of the current stimulus may be represented by a label, which classification recognition is also referred to as target recognition.
Fig. 4 is a schematic flow chart of brain region motor function assessment in step 140 of the brain-computer interface rehabilitation method shown in fig. 1.
As shown in fig. 4, the step 140 may further include the following steps 141 to 145:
step 141, determining a tested specific brain area corresponding to the specific category of stimulation according to the stimulation instruction, and selecting analysis leads of the tested specific brain area.
Step 142 calculates the power of the selected leads within the particular frequency band. Assume thatIs the data of the ith lead corresponding to the d-th stimulation instruction, the average power of the leads is:
wherein,,the average power of the ith lead corresponding to the d-th stimulation instruction is represented, N represents the number of sampling points, and t represents the serial number of the sampling points.
Step 143, calculate the function connection index of all leads. Wherein the functional connection index of the selected lead can reflect the brain region movement function recovery condition. Assuming the data of the ith lead corresponding to the d-th stimulation instruction, the phase lock values (Phase Locking Value, PLV) for the ith and jth leads are calculated as follows:
wherein PLV represents the phase-locked value,representation->And θ (t) represents +.>Is used for the instantaneous phase of the signal.
Step 144, constructing a brain topology network based on the functional connection indexes of all the leads, and calculating the topology index of each lead (node). Wherein the functional connection index of all leads comprises the functional connection index of the selected lead and other leads of the brain. The centrality of the i-th lead (node) is calculated here according to the following formula:
wherein k (i) represents the centrality, w, of the ith lead (node) ij Representing the connection weights of the ith and jth leads in the constructed weighted undirected graph, u representing the number of leads.
And 145, judging whether the topological structure index of the selected lead of the target brain region is lower than the average level, and obtaining an evaluation result of the motor function recovery condition of the tested specific brain region corresponding to the specific type of stimulation. Specifically, the average level of three brain region function recovery indexes including the average power of the leads, the phase-locked values of the ith lead and the jth lead, the centrality of the ith lead (node) and the like is calculated, and whether the brain region function recovery index accords with the expected recovery is judged. Leads whose brain region function recovery index is below the expected set threshold will be considered as the specific brain region tested that does not meet the expected recovery. Leads with brain region function restoration indices above the expected set threshold will be considered as the specific brain region tested that meets the expected restoration.
Fig. 5 is a schematic block diagram of a brain-computer interface rehabilitation device according to an embodiment of the present application.
Based on the same application concept as the above method, the embodiment of the application further provides a brain-computer interface rehabilitation device, as shown in fig. 5, where the device may include the following modules:
a stimulus module 31 for displaying visual video stimulus of the periodic movement of the target; visual video stimuli are used to elicit a response in the brain of the subject; responses include steady state motor vision evoked potentials ssmep and sensory motor rhythms SMR;
the electroencephalogram data acquisition module 32 is used for acquiring electroencephalogram data of a tested person when receiving visual video stimulation through the electroencephalogram acquisition system;
a classification recognition module 33, configured to determine and display a specific class of stimulus according to the ssmvp;
the brain region motor function evaluation module 34 is used for analyzing the SMR, evaluating the motor function recovery condition of the tested specific brain region corresponding to the specific type of stimulation, and outputting an evaluation result;
the nerve control module 35 is used for performing nerve control by applying electric stimulation to the tested specific brain region through the transcranial electric stimulation tES equipment under the condition that the motor function recovery condition does not accord with the expected recovery condition.
Fig. 6 is another schematic block diagram of a brain-computer interface rehabilitation device according to an embodiment of the present application.
As shown in fig. 6, in conjunction with fig. 5, the apparatus according to the embodiment of the present application further includes a preprocessing module 30 for preprocessing the original EEG data, and using the preprocessed EGG data as inputs of the classification recognition module and the brain region motor function evaluation module. Thus, the preprocessing of the preprocessing module can improve the accuracy of the data.
The content displayed inside the stimulation module 31 in fig. 6 is the content of fig. 2.
In embodiments of the present application, the stimulation module 31 may induce the user's brain to produce steady-state motor vision evoked potentials and sensory motor rhythms; the electroencephalogram data acquisition module 32 can acquire electroencephalogram data of a user using an electroencephalogram acquisition system; the preprocessing module can preprocess the original electroencephalogram data; the classification and identification module 33 and the brain region movement function evaluation module 34 can analyze the brain electrical data of the user, identify the stimulation target and evaluate the movement function brain region recovery condition of the user; the nerve control module 35 may feed back the recognition result to the user, and perform nerve control on the user using the tES device according to the motor function brain region evaluation result.
In some embodiments, the stimulation module comprises:
and the first stimulus sub-module is used for displaying visual video stimulus of the target periodic motion according to the screen refreshing frequency and the action executing frequency corresponding to the target periodic motion.
In some embodiments, the stimulation module comprises:
the second stimulus sub-module is used for stimulating the initial stage and displaying any frame of visual video stimulus for a first preset time in a static mode;
stimulus is started, and visual video stimulus of a second preset time duration is continuously displayed; wherein the second predetermined time period is greater than or equal to the first predetermined time period.
In some embodiments, the classification recognition module includes inputting ssmvps in the evoked electroencephalogram data to a classification model to output a specific class of stimulus; the classification model is obtained through sample data training, and the sample data training process comprises the steps of selecting leads of a main existence area of an SSMVEP response;
and the brain region motor function evaluation module comprises a state evaluation sub-module which is used for determining brain region function recovery indexes of SMRs induced by each lead in the tested specific brain region corresponding to the visual video stimulus, evaluating the function recovery condition of the tested specific brain region and outputting an evaluation result.
The implementation process of the functions and actions of each module/sub-module in the above device is specifically detailed in the implementation process of the corresponding steps in the above method, so that the same technical effects can be achieved, and will not be described herein again.
The embodiment of the application provides electronic equipment, which comprises the brain-computer interface rehabilitation device.
The multi-response BCI based on SSMVEP and tES realizes rehabilitation and regulation and control, and promotes rehabilitation of the motor function of a cerebral apoplexy patient.
Fig. 7 is a block diagram of an electronic device according to an embodiment of the present application.
As shown in fig. 7, the electronic device 40 includes one or more processors 41 for implementing the brain-computer interface rehabilitation method as described above.
In some embodiments, the electronic device 40 may include a computer-readable storage medium 49, and the computer-readable storage medium 49 may store a program that may be called by the processor 41, and may include a non-volatile storage medium. In some embodiments, electronic device 40 may include memory 48 and interface 47. In some embodiments, electronic device 40 may also include other hardware depending on the actual application.
The computer-readable storage medium 49 of the embodiment of the present application has stored thereon a program for implementing the brain-computer interface rehabilitation method described above when executed by the processor 41.
The present application may take the form of a computer program product embodied on one or more computer-readable storage media 49 (including, but not limited to, magnetic disk storage, CD-ROM, optical storage, etc.) having program code embodied therein. Computer readable storage media 49 include both permanent and non-permanent, removable and non-removable media, and information storage may be implemented in any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer readable storage media 49 include, but are not limited to: phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, may be used to store information that may be accessed by the computing device.
The foregoing description of the preferred embodiments is provided for the purpose of illustration only, and is not intended to limit the scope of the disclosure, since any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the disclosure are intended to be included within the scope of the disclosure.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the phrase "comprising one … …" does not exclude the presence of additional identical elements in a process, method, article, or apparatus that comprises the depicted element.
Claims (11)
1. A brain-computer interface rehabilitation method, comprising:
displaying visual video stimuli of periodic movements of the target; the visual video stimulus is used for inducing the brain to respond; the response includes steady state motor vision evoked potential ssmvp and sensory motor rhythm SMR;
acquiring brain electricity data of a tested person when receiving the visual video stimulus through an brain electricity acquisition system;
determining and displaying a specific class of stimulus according to the SSMVEP;
analyzing the SMR, evaluating the motion function recovery condition of the tested specific brain area corresponding to the specific type of stimulation, and outputting an evaluation result;
and in the case that the motor function recovery condition does not accord with the expected recovery condition, applying electric stimulation to the specific brain region to be tested through transcranial electric stimulation tES equipment to carry out nerve regulation.
2. The brain-computer interface rehabilitation method according to claim 1, wherein the displaying of visual video stimuli of the periodic motion of the target comprises:
and displaying the visual video stimulus of the target periodic motion according to the screen refreshing frequency and the action executing frequency corresponding to the target periodic motion.
3. The brain-computer interface rehabilitation method according to claim 1, wherein the displaying of visual video stimuli of the periodic motion of the target comprises:
at the initial stage of the stimulation, any frame of the visual video stimulation with a first preset duration is displayed in a static mode;
stimulus is started, and visual video stimulus of a second preset time duration is continuously displayed; wherein the second predetermined time period is greater than or equal to the first predetermined time period.
4. The brain-computer interface rehabilitation method according to claim 1, 2 or 3, wherein the visual video stimulus includes a plurality of visual video stimuli, a screen refresh frequency corresponding to each visual video stimulus is different, and an action execution frequency of the periodic motion in each visual video stimulus is different.
5. The brain-computer interface rehabilitation method according to claim 1, 2 or 3, wherein the target periodic motion of the visual video stimulus includes one or more of a limb motion in a single direction, and a repetition of limb motion in a first direction and an opposite direction of the first direction.
6. The brain-computer interface rehabilitation method according to claim 5, wherein the repeating limb movement actions in a first direction and an opposite direction of the first direction includes a single complete action of swinging a limb in a first direction and swinging a limb in an opposite direction of the first direction to a reset; and/or the number of the groups of groups,
the movement of the limb in a single direction includes movement of the limb in a second direction and a transformation.
7. The brain-computer interface rehabilitation method according to claim 1, further comprising: and displaying the visual video stimulus or executing the instruction corresponding to the visual video stimulus by the equipment terminal.
8. The brain-computer interface rehabilitation method according to claim 1, wherein said determining a specific category of stimulation according to said ssmvp comprises:
inputting the evoked electroencephalogram data into a classification model to output a specific class of stimulus; the classification model is obtained through sample data training, and the sample data training process comprises the steps of selecting leads of a main existence area of an SSMVEP response;
the analyzing the SMR, evaluating the motor function recovery condition of the tested specific brain area corresponding to the specific type of stimulation comprises the following steps:
and according to the visual video stimulus, determining a brain region function recovery index of the SMR induced by each lead in the specific brain region to be tested corresponding to the stimulus, and evaluating the function recovery condition of the specific brain region to be tested.
9. A brain-computer interface rehabilitation device, comprising:
the stimulation module is used for displaying visual video stimulation of the periodic movement of the target; the visual video stimulus is used for inducing the brain to respond; the response includes steady state motor vision evoked potential ssmvp and sensory motor rhythm SMR;
the electroencephalogram data acquisition module is used for acquiring electroencephalogram data of a tested person when receiving the visual video stimulus through an electroencephalogram acquisition system;
the classification and identification module is used for determining and displaying specific class stimulation according to the SSMVEP;
the brain region movement function evaluation module is used for analyzing the SMR, evaluating the movement function recovery condition of the tested specific brain region corresponding to the specific type of stimulation and outputting an evaluation result;
and the nerve regulation and control module is used for applying electric stimulation to the specific brain region to be tested through the transcranial electric stimulation tES equipment to carry out nerve regulation and control under the condition that the motor function recovery condition does not accord with the expected recovery condition.
10. An electronic device comprising the brain-computer interface rehabilitation device according to claim 9.
11. A computer-readable storage medium, having stored thereon a program which, when executed by a processor, implements the brain-computer interface rehabilitation method according to any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311079901.XA CN116919424B (en) | 2023-08-24 | 2023-08-24 | Brain-computer interface rehabilitation device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311079901.XA CN116919424B (en) | 2023-08-24 | 2023-08-24 | Brain-computer interface rehabilitation device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116919424A true CN116919424A (en) | 2023-10-24 |
| CN116919424B CN116919424B (en) | 2024-05-03 |
Family
ID=88394202
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311079901.XA Active CN116919424B (en) | 2023-08-24 | 2023-08-24 | Brain-computer interface rehabilitation device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116919424B (en) |
Citations (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050004624A1 (en) * | 2003-04-24 | 2005-01-06 | Gliner Bradford E. | Systems and methods for facilitating and/or effectuating development, rehabilitation, restoration, and/or recovery of visual function through neural stimulation |
| CN101464728A (en) * | 2009-01-05 | 2009-06-24 | 清华大学 | Human-machine interaction method with vision movement related neural signal as carrier |
| WO2012044261A1 (en) * | 2010-09-29 | 2012-04-05 | The Office Of National Telecommunications Commission | System and method for ssvep based control of electrical devices |
| KR20120042252A (en) * | 2010-10-25 | 2012-05-03 | 연세대학교 산학협력단 | Rehabilitation training system with functional electrical stimulation based on steady-state visually evoked potentials |
| US8239030B1 (en) * | 2010-01-06 | 2012-08-07 | DJ Technologies | Transcranial stimulation device and method based on electrophysiological testing |
| CN104825159A (en) * | 2015-04-23 | 2015-08-12 | 张鸣沙 | Electrocerebral co-frequency detection method, electrocerebral co-frequency stimulation method and device |
| CN105938397A (en) * | 2016-06-21 | 2016-09-14 | 西安交通大学 | Hybrid brain-computer interface method based on steady state motion visual evoked potential and default stimulation response |
| CN106264520A (en) * | 2016-07-27 | 2017-01-04 | 深圳先进技术研究院 | A kind of neural feedback athletic training system and method |
| CN106362287A (en) * | 2016-10-24 | 2017-02-01 | 天津大学 | Novel MI-SSSEP mixed brain-computer interface method and system thereof |
| US20170113015A1 (en) * | 2014-04-04 | 2017-04-27 | Sapporo Medical University | Device for rehabilitation, rehabilitation system provided therewith, program for rehabilitation and rehabilitation method |
| US20170143229A1 (en) * | 2014-06-03 | 2017-05-25 | Koninklijke Philips N.V. | Rehabilitation system and method |
| US20170151123A1 (en) * | 2014-06-03 | 2017-06-01 | Koninklijke Philips N.V. | Rehabilitation system and method |
| CN107315478A (en) * | 2017-07-05 | 2017-11-03 | 中国人民解放军第三军医大学 | A kind of Mental imagery upper limbs intelligent rehabilitation robot system and its training method |
| CN108245763A (en) * | 2017-12-28 | 2018-07-06 | 中国科学院宁波材料技术与工程研究所 | Brain-machine interaction rehabilitation training system and method |
| CN108319367A (en) * | 2018-01-31 | 2018-07-24 | 清华大学 | A kind of brain-machine interface method |
| CN109276808A (en) * | 2018-11-20 | 2019-01-29 | 广州市花都区人民医院 | The multi-modal cerebral apoplexy rehabilitation training of upper limbs system captured based on video motion |
| US20190314600A1 (en) * | 2015-10-23 | 2019-10-17 | Hrl Laboratories, Llc | Enhanced brain-machine interfaces with neuromodulation |
| CN111584030A (en) * | 2020-04-30 | 2020-08-25 | 天津大学 | Idea control intelligent rehabilitation system based on deep learning and complex network and application |
| CN111631848A (en) * | 2020-05-31 | 2020-09-08 | 天津大学 | Mind control artificial limb system based on brain-computer hybrid intelligence |
| CN111631907A (en) * | 2020-05-31 | 2020-09-08 | 天津大学 | Cerebral apoplexy patient hand rehabilitation system based on brain-computer interaction hybrid intelligence |
| US10849526B1 (en) * | 2016-10-13 | 2020-12-01 | University Of South Florida | System and method for bio-inspired filter banks for a brain-computer interface |
| WO2021008087A1 (en) * | 2019-07-17 | 2021-01-21 | 西安交通大学 | Contrast sensitivity test method based on motion visual evoked potential |
| WO2022020045A1 (en) * | 2020-07-22 | 2022-01-27 | Nexalin Technology, Inc. | Transcranial alternating current dynamic frequency stimulation (tacs) system and method for alzheimers and dementia |
| CN116098634A (en) * | 2023-01-31 | 2023-05-12 | 首都医科大学宣武医院 | Brain function detection and assessment method, device and system based on stimulation event |
| CN116360600A (en) * | 2023-04-06 | 2023-06-30 | 东南大学 | Space positioning system based on steady-state visual evoked potential |
-
2023
- 2023-08-24 CN CN202311079901.XA patent/CN116919424B/en active Active
Patent Citations (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050004624A1 (en) * | 2003-04-24 | 2005-01-06 | Gliner Bradford E. | Systems and methods for facilitating and/or effectuating development, rehabilitation, restoration, and/or recovery of visual function through neural stimulation |
| CN101464728A (en) * | 2009-01-05 | 2009-06-24 | 清华大学 | Human-machine interaction method with vision movement related neural signal as carrier |
| US8239030B1 (en) * | 2010-01-06 | 2012-08-07 | DJ Technologies | Transcranial stimulation device and method based on electrophysiological testing |
| WO2012044261A1 (en) * | 2010-09-29 | 2012-04-05 | The Office Of National Telecommunications Commission | System and method for ssvep based control of electrical devices |
| KR20120042252A (en) * | 2010-10-25 | 2012-05-03 | 연세대학교 산학협력단 | Rehabilitation training system with functional electrical stimulation based on steady-state visually evoked potentials |
| US20170113015A1 (en) * | 2014-04-04 | 2017-04-27 | Sapporo Medical University | Device for rehabilitation, rehabilitation system provided therewith, program for rehabilitation and rehabilitation method |
| US20170143229A1 (en) * | 2014-06-03 | 2017-05-25 | Koninklijke Philips N.V. | Rehabilitation system and method |
| US20170151123A1 (en) * | 2014-06-03 | 2017-06-01 | Koninklijke Philips N.V. | Rehabilitation system and method |
| CN104825159A (en) * | 2015-04-23 | 2015-08-12 | 张鸣沙 | Electrocerebral co-frequency detection method, electrocerebral co-frequency stimulation method and device |
| US20190314600A1 (en) * | 2015-10-23 | 2019-10-17 | Hrl Laboratories, Llc | Enhanced brain-machine interfaces with neuromodulation |
| CN105938397A (en) * | 2016-06-21 | 2016-09-14 | 西安交通大学 | Hybrid brain-computer interface method based on steady state motion visual evoked potential and default stimulation response |
| CN106264520A (en) * | 2016-07-27 | 2017-01-04 | 深圳先进技术研究院 | A kind of neural feedback athletic training system and method |
| US10849526B1 (en) * | 2016-10-13 | 2020-12-01 | University Of South Florida | System and method for bio-inspired filter banks for a brain-computer interface |
| CN106362287A (en) * | 2016-10-24 | 2017-02-01 | 天津大学 | Novel MI-SSSEP mixed brain-computer interface method and system thereof |
| CN107315478A (en) * | 2017-07-05 | 2017-11-03 | 中国人民解放军第三军医大学 | A kind of Mental imagery upper limbs intelligent rehabilitation robot system and its training method |
| CN108245763A (en) * | 2017-12-28 | 2018-07-06 | 中国科学院宁波材料技术与工程研究所 | Brain-machine interaction rehabilitation training system and method |
| CN108319367A (en) * | 2018-01-31 | 2018-07-24 | 清华大学 | A kind of brain-machine interface method |
| CN109276808A (en) * | 2018-11-20 | 2019-01-29 | 广州市花都区人民医院 | The multi-modal cerebral apoplexy rehabilitation training of upper limbs system captured based on video motion |
| WO2021008087A1 (en) * | 2019-07-17 | 2021-01-21 | 西安交通大学 | Contrast sensitivity test method based on motion visual evoked potential |
| CN111584030A (en) * | 2020-04-30 | 2020-08-25 | 天津大学 | Idea control intelligent rehabilitation system based on deep learning and complex network and application |
| CN111631848A (en) * | 2020-05-31 | 2020-09-08 | 天津大学 | Mind control artificial limb system based on brain-computer hybrid intelligence |
| CN111631907A (en) * | 2020-05-31 | 2020-09-08 | 天津大学 | Cerebral apoplexy patient hand rehabilitation system based on brain-computer interaction hybrid intelligence |
| WO2022020045A1 (en) * | 2020-07-22 | 2022-01-27 | Nexalin Technology, Inc. | Transcranial alternating current dynamic frequency stimulation (tacs) system and method for alzheimers and dementia |
| CN116098634A (en) * | 2023-01-31 | 2023-05-12 | 首都医科大学宣武医院 | Brain function detection and assessment method, device and system based on stimulation event |
| CN116360600A (en) * | 2023-04-06 | 2023-06-30 | 东南大学 | Space positioning system based on steady-state visual evoked potential |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116919424B (en) | 2024-05-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104871160B (en) | System and method for feeling and recognizing anatomy | |
| Wang et al. | Central and peripheral vision for scene recognition: A neurocomputational modeling exploration | |
| Molina et al. | Joint time-frequency-space classification of EEG in a brain-computer interface application | |
| CN107168524A (en) | A kind of Steady State Visual Evoked Potential sorting technique based on deep learning mixed model | |
| CN107194426A (en) | A kind of image-recognizing method based on Spiking neutral nets | |
| CN111714118A (en) | Brain cognition model fusion method based on ensemble learning | |
| Chen et al. | DeepFocus: Deep encoding brainwaves and emotions with multi-scenario behavior analytics for human attention enhancement | |
| CN111783942A (en) | Brain cognition process simulation method based on convolution cyclic neural network | |
| Lahiri et al. | Evolutionary perspective for optimal selection of EEG electrodes and features | |
| Gupta et al. | Detecting eye movements in EEG for controlling devices | |
| CN105105771A (en) | Cognitive index analysis method for potential value test | |
| Batres-Mendoza et al. | Improving EEG‐Based Motor Imagery Classification for Real‐Time Applications Using the QSA Method | |
| CN111772629B (en) | Brain cognitive skill transplanting method | |
| CN108710895A (en) | Motor imagery electroencephalogram signal classification method based on independent component analysis | |
| US20230101539A1 (en) | Physiological electric signal classification processing method and apparatus, computer device and storage medium | |
| WO2021142532A1 (en) | Activity recognition with deep embeddings | |
| CN115311737A (en) | Method for recognizing hand motion of non-aware stroke patient based on deep learning | |
| CN117131356A (en) | Space-time convolution brain electrolysis code method based on multi-head self-attention mechanism fusion | |
| CN116687411B (en) | Game comprehensive score acquisition method and device, intelligent terminal and storage medium | |
| CN116919424B (en) | Brain-computer interface rehabilitation device and electronic equipment | |
| Hu et al. | EEG authentication system based on auto-regression coefficients | |
| AU2020101294A4 (en) | Student’s physiological health behavioural prediction model using svm based machine learning algorithm | |
| Gu et al. | Generating sequence of eye fixations using decision-theoretic attention model | |
| Chen et al. | Research on EEG classification with neural networks based on the Levenberg-Marquardt algorithm | |
| CN114997229A (en) | Electroencephalogram signal-based motor imagery classification method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |