CN108417249A - The multi-modal healing hand function method of audiovisual tactile based on VR - Google Patents
The multi-modal healing hand function method of audiovisual tactile based on VR Download PDFInfo
- Publication number
- CN108417249A CN108417249A CN201810181029.2A CN201810181029A CN108417249A CN 108417249 A CN108417249 A CN 108417249A CN 201810181029 A CN201810181029 A CN 201810181029A CN 108417249 A CN108417249 A CN 108417249A
- Authority
- CN
- China
- Prior art keywords
- training
- user
- modal
- feedback
- function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
Abstract
A kind of multi-modal healing hand function training method of audiovisual tactile based on VR.The system that this method uses includes user and its eeg signal acquisition and the multi-modal feedback training system of processing system, virtual reality.User and its eeg signal acquisition and processing system acquire user's eeg signal in real time, it is filtered pretreatment first, then cospace pattern algorithm is used to carry out feature extraction, whether analysis user has Mental imagery intention, and gives virtual reality multi-modal feedback training system by TCP/IP communication transfers classification results；The multi-modal feedback training system of virtual reality includes mainly：1) design 2 of VR Training scenes) the multi-modal feedback of audiovisual tactile realization.In addition, being also an option that background music when training, in conjunction with electric stimulating instrument, sense of touch impression is formed, it is final to realize the multi-modal feedback of audiovisual tactile.
Description
Technical field
A multi-modal hand of audiovisual tactile based on VR is devised herein for hand dysfunction caused by cerebral apoplexy disease
Function rehabilitation training method, the system are the multi-modal rehabilitation systems of an audiovisual tactile, and there is user to be actively engaged in and immerse
Feel strong feature.The remodeling for promoting nervous centralis in combination with brain-computer interface technology, new training mode is provided for healing hand function.
Background technology
Cerebral apoplexy is a kind of brain blood circulation disorder disease, is a kind of frequently-occurring disease and common disease, incidence is every in recent years
Year is all in rejuvenation trend in growth and morbidity crowd, have become it is current cause patient's upper extremity motor function disorder it is important because
Element.Clinical manifestation after the upper extremity function of patient is impaired is that hand joint activity is difficult, loses motion perception feedback function, causes
Prevent patient from completing to grasp, to the fine hand exercise work(function such as referring to, it is serious to even result in entire arm motion function
It loses.This causes patient to lose the ability lived on one's own life, and white elephant is brought to household and society.Currently, mainly according to
Rely therapist with the one-to-one traditional remedies for carrying out rehabilitation training of patient to restore the simple hand movement function of patient, some meetings
It is aided with rehabilitation appliances.But traditional remedies training time length, slowly effect, process are uninteresting, it is difficult to transfer the training product of patient
Polarity, therefore rehabilitation is inefficient.
In order to solve the above problems, people are seeking always a kind of more rational scheme.
Invention content
The multi-modal hand function of audiovisual tactile that in view of the deficiencies of the prior art, it is an object of the present invention to provide a kind of based on VR
Recovery training method, basic principle are the EEG signals generated using the external equipments such as the electrode cap acquisition patient motion imagination,
It is handled and is converted into the order that controlled training acts in VR scenes；After receiving the corresponding command, rehabilitation training system
System provides training feedback in terms of audiovisual tactile three, specially patient can see the training action of visual human in Training scene into
Row visual feedback, enables patient to hear that related sound carries out audio feedback, and touch feedback is realized in combination with electric stimulating instrument；Pass through
The multi-faceted feedback of audiovisual tactile makes patient promptly and accurately understand the correctness of oneself Mental imagery, strengthens patient and correctly moves
Imagination pattern is finally reached the purpose for reinforcing patient motion imagination brain region remodeling, can be the hand function of patients with cerebral apoplexy
Rehabilitation provides a kind of recovery training method that audiovisual tactile is multi-modal.
To achieve the goals above, the present invention uses following technical proposals：
A kind of multi-modal healing hand function training method of audiovisual tactile based on VR is amplified using by user, electrode cap and signal
The eeg signal acquisition and processing system of device composition and the multi-modal feedback training system of virtual reality based on computer are trained,
It is characterized in that：The healing hand function method includes following four step：
（1）The acquisition and processing of EEG signals：The EEG signal that user is acquired using electrode cap, after being pre-processed, uses total sky
Between pattern CSP algorithms feature extraction is carried out to the signal of acquisition；
（2）Training scene selection interface designs：In order to avoid the too unification of rehabilitation training environment, this system devise it is indoor,
Seabeach and three kinds of tennis court Training scene complete grasping, than rotation before OK and forearm rotation with six different 3D virtual human models
Afterwards three kinds of clinical rehabilitation training actions, drink water eat two kinds of life activities of fruit and a kind of athletic performance of playing volleyball totally six kinds of training are dynamic
Make；
（3）The design of VR Training scenes：VR scenes are built in 3dsmax first and 3D person models are built and complete 3D personage's hand
Portion's cartoon making is then introduced into Unity3D and completes VR scenes arrangement, finally writes code to realize to 3D visual humans in scene
The control of training action；
（4）The realization of communication function：The brain that the rehabilitation training system of the present invention is made of user, electrode cap and signal amplifier
Electric signal EEG acquisition and processing system and the multi-modal feedback training system three parts composition of virtual reality based on computer, each portion
Point it is the function that information that the brain-computer interface that receives that treated transmits is realized by TCP/IP communication agreement.
The step（1）In EEG signals acquisition and processing realize steps are as follows：
（1-1）Pretreatment：Channel selecting, frequency reducing are carried out to the EEG signals of acquisition；
（1-2）Feature extraction：Cospace pattern CSP algorithms are selected to extract feature vector.
The step（2）In Training scene selection interface design procedure it is as follows：
（1-1）The basic interfaces UI are built using the plug-in unit NGUI of Unity3D；
（1-2）Scene sectional drawing under five kinds of training environments is added on interface, rational deployment is carried out；
（1-3）The function that C# scripts realize scene switching is write, user, which clicks corresponding picture, will enter corresponding training
Scene.
The step（3）In VR Training scenes design procedure it is as follows：
（2-1）Determine seabeach, interior and three kinds of volleyball court training environment；
（2-2）Determine young, middle aged and three age brackets of old age each one of 3D visual human men and women totally six virtual human models；
（2-3）Determination grasps, preceding supination is revolved than OK, forearm, drink water, eat fruit and play volleyball six kinds of training actions, and
3D personage's hand cartoon making is completed in 3dsmax；
（2-4）The model of place made and 3D person models are imported in Unity3D and carry out rational scene arrangement, and is write
Corresponding code realizes function that controlled training action plays.
The step（4）In communication function realization process it is as follows：When carrying out rehabilitation training, system is by user, electricity
EEG signals (EEG) acquisition of polar cap and signal amplifier composition and processing system and virtual reality based on computer are multi-modal anti-
Present training system three parts composition.The EEG signal that wherein user generates is ordered in order to control by signal acquisition and processing system conversion
After order, training system is passed to by TCP/IP communication agreement, realizes user and the multi-modal feedback training system of virtual reality
Information exchange.
The multi-modal feedback training system of virtual reality based on computer is built, brain Mental imagery is can receive and is intended to, lead to
The multi-modal feedback of audiovisual tactile is crossed, personalized hand function active, immersion rehabilitation training can be carried out, concrete function is：
（1）The communication function that brain is intended to is received to realize：Each equipment be by TCP/IP communication agreement come realize transmit information work(
Energy；When carrying out rehabilitation training, user will wear electrode cap or other eeg signal acquisition devices in advance, adopted when Mental imagery
Collect its EEG signals, training system is sent in real time using ICP/IP protocol after motion intention analyzing processing, coordinates Unity
The action of control command co- controlling 3D visual humans, only when system receives the control command that user has Mental imagery to be intended to
When, corresponding actions are made in the virtual talent conferences of 3D, that is, complete seance；Otherwise, 3D visual humans do not make any action；
（2）The realization of the multi-modal feedback of audiovisual tactile：VR glasses are worn when user trains can arrive effect as if on the spot in person, completely
Be immersed in three-dimensional training environment, user can experience the feeling of 3D visual humans, receive 3D visual humans after order make it is corresponding
Action passes to user as visual feedback information；In addition, background music also may be selected when training, make it to user's hearing enjoying
More it is immersed in training environment.Based on the multi-modal feedback of implementation above audiovisual tactile；
（3）The feedback training of personalized active immersion：User can select training environment and 3D when training according to the hobby of oneself
Visual human according to hemiplegia degree to select suitable training action, and is adjusted according to training effect；Virtual scene makes user
There is stronger feeling of immersion, entire training process is no longer uninteresting, and training result can be directly anti-by vision every time
The user to feed in training, can excite the training enthusiasm of user, can also allow user preferably to immerse in the training process, generate
The EEG signals for being more prone to identification realize the rehabilitation training of autonomous active to improve rehabilitation process.
Compared with prior art, the present invention having the advantages that following substantive distinguishing features outstanding and notable：Being one has
Closed loop healing hand function training method in more Training scenes, more virtual portraits, mostly trained level, user's participation system.User
Training scene, 3D visual humans and training action can be selected according to personal like when carrying out rehabilitation training using the system, carried
The selection of some personalization training is supplied.It is capable of providing environment more true to nature, user can be enhanced and train enthusiasm, can also allow use
Family is preferably immersed in the training process, and the EEG signals for being more prone to identification are generated, and to improve rehabilitation efficiency, is realized autonomous
The rehabilitation training of active.
Description of the drawings
Fig. 1 is that the present invention is based on the multi-modal healing hand function training method general flow charts of the audiovisual tactile of VR.
Fig. 2 is that the present invention is based on the multi-modal healing hand function training method hardware system structure block diagrams of the audiovisual tactile of VR.
Fig. 3 is schemed in the Training scene room of the present invention.
Fig. 4 is the Training scene seabeach figure of the present invention.
Fig. 5 is the Training scene volleyball court figure of the present invention.
Fig. 6 is 3D visual human's display diagrams of the present invention.
Fig. 7 is the Training scene selection interface figure of the present invention.
Specific implementation mode
Details are as follows for the preferred embodiment of the present invention combination attached drawing：
Embodiment one：
Referring to Fig. 1-7 based on the multi-modal healing hand function training method of audiovisual tactile of VR, using by user, electrode cap and letter
The eeg signal acquisition and processing system of number amplifier composition and the multi-modal feedback training system of virtual reality based on computer into
Row training, it is characterised in that：The healing hand function method includes following four step：
（1）The acquisition and processing of EEG signals：The EEG signal that user is acquired using electrode cap, after being pre-processed, uses total sky
Between pattern CSP algorithms feature extraction is carried out to the signal of acquisition；
（2）Training scene selection interface designs：In order to avoid the too unification of rehabilitation training environment, this system devise it is indoor,
Seabeach and three kinds of tennis court Training scene complete grasping, than rotation before OK and forearm rotation with six different 3D virtual human models
Afterwards three kinds of clinical rehabilitation training actions, drink water eat two kinds of life activities of fruit and a kind of athletic performance of playing volleyball totally six kinds of training are dynamic
Make；
（3）The design of VR Training scenes：VR scenes are built in 3dsmax first and 3D person models are built and complete 3D personage's hand
Portion's cartoon making is then introduced into Unity3D and completes VR scenes arrangement, finally writes code to realize to 3D visual humans in scene
The control of training action；
（4）The realization of communication function：The brain that the rehabilitation training system of the present invention is made of user, electrode cap and signal amplifier
Electric signal EEG acquisition and processing system and the multi-modal feedback training system three parts composition of virtual reality based on computer, each portion
Point it is the function that information that the brain-computer interface that receives that treated transmits is realized by TCP/IP communication agreement.
Embodiment two：The present embodiment and embodiment one are essentially identical, and special feature is as follows：
The multi-modal feedback training system of virtual reality based on brain electricity is built, brain Mental imagery is can receive and is intended to, by regarding
The multi-modal feedback of tactile is listened, personalized hand function active, immersion rehabilitation training can be carried out, concrete function is：
（1）The communication function that brain is intended to is received to realize：Each equipment be by TCP/IP communication agreement come realize transmit information work(
Energy；When carrying out rehabilitation training, user will wear electrode cap or other eeg signal acquisition devices in advance, adopted when Mental imagery
Collect its EEG signals, training system is sent in real time using ICP/IP protocol after motion intention analyzing processing, coordinates Unity
The action of control command co- controlling 3D visual humans, only when system receives the control command that user has Mental imagery to be intended to
When, corresponding actions are made in the virtual talent conferences of 3D, that is, complete seance；Otherwise, 3D visual humans do not make any action；
（2）The realization of the multi-modal feedback of audiovisual tactile：VR glasses are worn when user trains can arrive effect as if on the spot in person, completely
Be immersed in three-dimensional training environment, user can experience the feeling of 3D visual humans, receive 3D visual humans after order make it is corresponding
Action passes to user as visual feedback information；In addition, background music also may be selected when training, make it to user's hearing enjoying
More it is immersed in training environment.Based on the multi-modal feedback of implementation above audiovisual tactile；
（3）The feedback training of personalized active immersion：User can select training environment and 3D when training according to the hobby of oneself
Visual human according to hemiplegia degree to select suitable training action, and is adjusted according to training effect；Virtual scene makes user
There is stronger feeling of immersion, entire training process is no longer uninteresting, and training result can be directly anti-by vision every time
The user to feed in training, can excite the training enthusiasm of user, can also allow user preferably to immerse in the training process, generate
The EEG signals for being more prone to identification realize the rehabilitation training of autonomous active to improve rehabilitation process.
Embodiment three：
Referring to Fig. 1 and Fig. 2, based on the operation of the multi-modal healing hand function training method of the audition tactile of VR, including following step
Suddenly：
（1）User will wear electrode cap and relevant eeg signal acquisition device in advance when carrying out rehabilitation training；
（2）When starting to train, the Training scene selection interface of system is initially entered（Referring to Fig. 7）, user independently selects training place
Scape and the 3D virtual human models of training, click to enter Training scene；
（3）Mental imagery is carried out according to prompt, user carries out Mental imagery and collects EEG signals；
（4）System carries out signal processing to the EEG signals of acquisition, Feature Extraction Feature identifies that being converted into system can know
Other control command；
（5）The EEG signal of identification is sent to training system in real time using ICP/IP protocol after treatment；
（6）In conjunction with Unity to the control command of 3D visual humans, the action of co- controlling 3D visual humans；
（7）Only when system, which receives user, the order that Mental imagery is intended to, corresponding actions are made in the virtual talent conferences of 3D, i.e.,
Complete primary complete therapeutic process.Otherwise, 3D visual humans do not make any action；
（8）Vision and auditory information are had in virtual scene when user trains, each training result can directly pass through audiovisual
Touch feedback is to training user.
Claims (2)
1. a kind of multi-modal healing hand function training method of audiovisual tactile based on VR, puts using by user, electrode cap and signal
The eeg signal acquisition and processing system of big device composition and the multi-modal feedback training system of virtual reality based on computer are instructed
Practice, it is characterised in that：The healing hand function method includes following four step：
（1-1）The acquisition and processing of EEG signals：The EEG signal that user is acquired using electrode cap, after being pre-processed, using altogether
Spatial model CSP algorithms carry out feature extraction to the signal of acquisition；
（1-2）Training scene selection interface designs：In order to avoid the too unification of rehabilitation training environment, this system devises room
Interior, seabeach and three kinds of tennis court Training scene, with six different 3D virtual human models complete grasping, than OK and forearm rotation before
Three kinds of clinical rehabilitation training actions of supination drink water and eat two kinds of life activities of fruit and a kind of athletic performance totally six kinds of training of playing volleyball
Action；
（1-3）The design of VR Training scenes：VR scenes are built in 3dsmax first and 3D person models are built and complete 3D personage
Hand cartoon making is then introduced into Unity3D and completes VR scenes arrangement, and it is virtual to 3D in scene to realize finally to write code
The control of people's training action；
（1-4）The realization of communication function：The rehabilitation training system of the present invention is made of user, electrode cap and signal amplifier
EEG signals EEG acquisition and processing system and the multi-modal feedback training system three parts composition of virtual reality based on computer, respectively
Part is to realize the function of receiving the information that treated brain-computer interface transmits by TCP/IP communication agreement.
2. the multi-modal healing hand function training method of the audiovisual tactile according to claim 1 based on VR, it is characterised in that：
The step（1-2）、（1-3）And（1-4）The multi-modal feedback training system of virtual reality based on computer is built, can receive big
Brain Mental imagery is intended to, and by the multi-modal feedback of audiovisual tactile, can carry out personalized hand function active, immersion rehabilitation instruction
Practice, concrete function is：
（2-1）The communication function that brain is intended to is received to realize：Each equipment is to transmit information by TCP/IP communication agreement to realize
Function；When carrying out rehabilitation training, user will wear electrode cap or other eeg signal acquisition devices in advance, when carrying out Mental imagery
Its EEG signals is acquired, training system is sent in real time using ICP/IP protocol after motion intention analyzing processing, is coordinated
The action of Unity control command co- controlling 3D visual humans, only when system receives the control that user has Mental imagery to be intended to
When order, corresponding actions are made in the virtual talent conferences of 3D, that is, complete seance；Otherwise, 3D visual humans do not make any action；
（2-2）The realization of the multi-modal feedback of audiovisual tactile：VR glasses are worn when user trains can arrive effect as if on the spot in person, complete
It is immersed in entirely in three-dimensional training environment, user can experience the feeling of 3D visual humans, receive the phase that 3D visual humans after order make
It should act and pass to user as visual feedback information；In addition, background music also may be selected when training, make to user's hearing enjoying
It is more immersed in training environment, is based on the multi-modal feedback of implementation above audiovisual tactile；
（2-3）The feedback training of personalized active immersion：User train when can according to the hobby of oneself select training environment and
3D visual humans according to hemiplegia degree to select suitable training action, and are adjusted according to training effect；Virtual scene uses
There is stronger feeling of immersion at family, and entire training process is no longer uninteresting, and training result can directly pass through vision every time
The user in training is fed back to, the training enthusiasm of user can be excited, user can also be allowed preferably to immerse in the training process, production
The raw EEG signals for being more prone to identification realize the rehabilitation training of autonomous active to improve rehabilitation process.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810181029.2A CN108417249A (en) | 2018-03-06 | 2018-03-06 | The multi-modal healing hand function method of audiovisual tactile based on VR |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810181029.2A CN108417249A (en) | 2018-03-06 | 2018-03-06 | The multi-modal healing hand function method of audiovisual tactile based on VR |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108417249A true CN108417249A (en) | 2018-08-17 |
Family
ID=63130210
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810181029.2A Pending CN108417249A (en) | 2018-03-06 | 2018-03-06 | The multi-modal healing hand function method of audiovisual tactile based on VR |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108417249A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109166369A (en) * | 2018-10-11 | 2019-01-08 | 龚映清 | A kind of transparent screen formula augmented reality listens transverse screen training system and method depending on-touching- |
| CN109925582A (en) * | 2019-03-20 | 2019-06-25 | 天津大学 | Bimodal brain-machine interactive movement neural feedback training device and method |
| CN110400619A (en) * | 2019-08-30 | 2019-11-01 | 上海大学 | A kind of healing hand function training method based on surface electromyogram signal |
| CN111312363A (en) * | 2020-02-28 | 2020-06-19 | 暨南大学 | Double-hand coordination enhancing system based on virtual reality |
| CN112085052A (en) * | 2020-07-28 | 2020-12-15 | 中国科学院深圳先进技术研究院 | Training method of motor imagery classification model, motor imagery method and related equipment |
| CN112201324A (en) * | 2020-09-15 | 2021-01-08 | 山东海天智能工程有限公司 | Brain-computer interface rehabilitation training system and method |
| CN112578912A (en) * | 2020-12-25 | 2021-03-30 | 中国科学院宁波材料技术与工程研究所慈溪生物医学工程研究所 | Brain control finger training equipment based on music stimulation |
| CN113506607A (en) * | 2021-04-29 | 2021-10-15 | 上海大学 | Portable stroke rehabilitation training system and method based on raspberry pi |
| CN114082158A (en) * | 2021-11-18 | 2022-02-25 | 南京医科大学 | Upper limb rehabilitation training system for stroke patient |
| CN115381465A (en) * | 2022-07-28 | 2022-11-25 | 山东海天智能工程有限公司 | Rehabilitation training system based on BCI/VR and AR technologies |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923392A (en) * | 2010-09-02 | 2010-12-22 | 上海交通大学 | Asynchronous brain-computer interactive control method for EEG signal |
| CN105511600A (en) * | 2015-07-31 | 2016-04-20 | 华南理工大学 | Multi-media man-machine interaction platform based on mixed reality |
| CN106621287A (en) * | 2017-02-07 | 2017-05-10 | 西安交通大学 | Upper limb rehabilitation training method based on brain-computer interface and virtual reality technology |
-
2018
- 2018-03-06 CN CN201810181029.2A patent/CN108417249A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923392A (en) * | 2010-09-02 | 2010-12-22 | 上海交通大学 | Asynchronous brain-computer interactive control method for EEG signal |
| CN105511600A (en) * | 2015-07-31 | 2016-04-20 | 华南理工大学 | Multi-media man-machine interaction platform based on mixed reality |
| CN106621287A (en) * | 2017-02-07 | 2017-05-10 | 西安交通大学 | Upper limb rehabilitation training method based on brain-computer interface and virtual reality technology |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109166369A (en) * | 2018-10-11 | 2019-01-08 | 龚映清 | A kind of transparent screen formula augmented reality listens transverse screen training system and method depending on-touching- |
| CN109925582A (en) * | 2019-03-20 | 2019-06-25 | 天津大学 | Bimodal brain-machine interactive movement neural feedback training device and method |
| CN109925582B (en) * | 2019-03-20 | 2021-08-03 | 天津大学 | Dual-mode brain-computer interactive motor nerve feedback training device and method |
| CN110400619A (en) * | 2019-08-30 | 2019-11-01 | 上海大学 | A kind of healing hand function training method based on surface electromyogram signal |
| CN111312363B (en) * | 2020-02-28 | 2024-03-19 | 暨南大学 | Double-hand coordination enhancement system based on virtual reality |
| CN111312363A (en) * | 2020-02-28 | 2020-06-19 | 暨南大学 | Double-hand coordination enhancing system based on virtual reality |
| CN112085052A (en) * | 2020-07-28 | 2020-12-15 | 中国科学院深圳先进技术研究院 | Training method of motor imagery classification model, motor imagery method and related equipment |
| CN112201324A (en) * | 2020-09-15 | 2021-01-08 | 山东海天智能工程有限公司 | Brain-computer interface rehabilitation training system and method |
| CN112578912A (en) * | 2020-12-25 | 2021-03-30 | 中国科学院宁波材料技术与工程研究所慈溪生物医学工程研究所 | Brain control finger training equipment based on music stimulation |
| CN113506607A (en) * | 2021-04-29 | 2021-10-15 | 上海大学 | Portable stroke rehabilitation training system and method based on raspberry pi |
| CN114082158A (en) * | 2021-11-18 | 2022-02-25 | 南京医科大学 | Upper limb rehabilitation training system for stroke patient |
| CN114082158B (en) * | 2021-11-18 | 2022-05-20 | 南京医科大学 | Upper limb rehabilitation training system for stroke patient |
| WO2023087954A1 (en) * | 2021-11-18 | 2023-05-25 | 南京医科大学 | Upper limb rehabilitation training system for stroke patients |
| CN115381465A (en) * | 2022-07-28 | 2022-11-25 | 山东海天智能工程有限公司 | Rehabilitation training system based on BCI/VR and AR technologies |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108417249A (en) | The multi-modal healing hand function method of audiovisual tactile based on VR | |
| CN111110982A (en) | Hand rehabilitation training method based on motor imagery | |
| CN106422208B (en) | Exercise guide method and apparatus based on intelligent wearable device | |
| CN104436526B (en) | Double upper limbs coordinated movement of various economic factors training aids | |
| CN110400619B (en) | Hand function rehabilitation training method based on surface electromyographic signals | |
| CN101574297B (en) | Rehabilitation system for disabled persons based on virtual reality | |
| CN113398422B (en) | Rehabilitation training system and method based on motor imagery-brain-computer interface and virtual reality | |
| CN111938991A (en) | Hand rehabilitation training device and training method in double active control modes | |
| CN109166612B (en) | Large-scale game scene rehabilitation system and method based on eye movement and electroencephalogram information | |
| Xiao et al. | An electrooculogram-based interaction method and its music-on-demand application in a virtual reality environment | |
| CN107626040A (en) | It is a kind of based on the rehabilitation system and method that can interact virtual reality and nerve electric stimulation | |
| CN103019386B (en) | A kind of control method of human-computer interaction and its utilization | |
| CN107802262A (en) | A kind of brain is electrically coupled the device that VR is used for the more dynamic attention deficit therapeutic intervention of children | |
| CN106095086B (en) | A kind of Mental imagery brain-computer interface control method based on noninvasive electro photoluminescence | |
| Wang et al. | A VR combined with MI-BCI application for upper limb rehabilitation of stroke | |
| CN104288909A (en) | Multi-feeling interactive and multimode control functional electrical stimulation system | |
| Polak et al. | Novel gamified system for post-stroke upper-limb rehabilitation using a social robot: focus groups of expert clinicians | |
| CN110639172A (en) | Augmented reality rehabilitation training system based on rich scenes | |
| McDaniel et al. | Therapeutic haptics for mental health and wellbeing | |
| CN113713333A (en) | Dynamic virtual induction method and system for lower limb rehabilitation full training process | |
| CN112863644A (en) | Method, device, equipment and storage medium for training memorial idea based on VR technology | |
| CN106371588A (en) | Movement imagery brain-computer interface-based hand function rehabilitation method | |
| CN105832503B (en) | A kind of picture outputting method and device for orthpia | |
| CN112230777A (en) | Cognitive training system based on non-contact interaction | |
| CN207120250U (en) | Intelligent robot based on brain-computer interface technology BCI |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |