CN108433721A - The training method and system of brain function network detection and regulation and control based on virtual reality - Google Patents

The training method and system of brain function network detection and regulation and control based on virtual reality Download PDF

Info

Publication number
CN108433721A
CN108433721A CN201810089742.4A CN201810089742A CN108433721A CN 108433721 A CN108433721 A CN 108433721A CN 201810089742 A CN201810089742 A CN 201810089742A CN 108433721 A CN108433721 A CN 108433721A
Authority
CN
China
Prior art keywords
brain
brain function
virtual reality
control
situation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810089742.4A
Other languages
Chinese (zh)
Inventor
秦路
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZHEJIANG FANJU TECHNOLOGY Co Ltd
Original Assignee
ZHEJIANG FANJU TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZHEJIANG FANJU TECHNOLOGY Co Ltd filed Critical ZHEJIANG FANJU TECHNOLOGY Co Ltd
Priority to CN201810089742.4A priority Critical patent/CN108433721A/en
Publication of CN108433721A publication Critical patent/CN108433721A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Psychiatry (AREA)
  • Artificial Intelligence (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Physiology (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Neurosurgery (AREA)
  • Neurology (AREA)
  • Dermatology (AREA)
  • Psychology (AREA)
  • User Interface Of Digital Computer (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

The training method and system of the invention discloses a kind of brain function network detection and regulation and control based on virtual reality, include the following steps:A:Different brain function network models is selected according to different user and user is made to enter in different virtual reality situations;B:It acquires EEG signals of the user in virtual reality situation and EEG signals is handled to obtain brain electric network characteristic parameter, and brain function network is built according to brain electric network characteristic parameter;C:Brain electric network characteristic parameter is converted into signal in order to control and is sent to virtual reality situation task simulation system;D:Change virtual reality task according to control signal by virtual reality situation task simulation system to include the sense of hearing and/or the activity of vision control and act to adjust brain function network.The advantage of the invention is that using virtual reality technology to provide more true virtual environment for phrenoblabia user carries out rehabilitation training, and situation can be adjusted according to the reaction of user, improve training effect.

Description

The training method and system of brain function network detection and regulation and control based on virtual reality
Technical field
The invention belongs to nerve/phrenoblabia supplemental training technical field, more particularly, to a kind of based on virtual reality Brain function network detects and the training method and system of regulation and control.
Background technology
No matter human brain is all in structure or functionally extremely complex, is referred to as complex gigantic system.It is estimated that people Brain about dry hundred million neurons, each neuron are connected by cynapse with thousands of other neurons, formation one it is huge and Sparse neural network.Recent years, Complex Networks Theory starts to apply the research in human brain, and has made great progress, base In the complex network research of Graph Analysis can disclose the mechanism of brain structure and brain function that passing analysis means cannot disclose with Feature.Brain is with small world and uncalibrated visual servo characteristic complex network, even if simple brain work(by extensive confirmation at present It can not also can be independently performed by single neuron or single brain area, need neuron colony, the functional column in neural network Or multiple brain area reciprocations are realized.When dysfunction or missing occurs in specific brain regions network, between different brain regions Normal connection damage or abnormal, so that it may show as all kinds of nerves or phrenoblabia.To including Alzheimer disease, spirit point It splits the progress complex brain network analysis of the diseases such as disease, epilepsy, depression, attention deficit disorder, self-closing disease, brain trauma to find, these diseases Brain network exist jointly the topological structures such as small world, hierarchical organization, key node change, it is considered to be by brain network " losing connection syndrome " caused by connection disorder.
To above-mentioned spirit/neurological disorder user progress supplemental training mainly for neural network disorder or missing link Function amendment or reconstruction, mainly include deep brain stimulation (Deep Brain Stimulation, DBS) in the prior art, Transcranial magnetic stimulation (TMS), through cranium galvanic current stimulation (TDCS) and neural biofeedback (Neurofeedback, NFB).Wherein, NBF need not receive external electricity, Neural stem cell by the feedback regulation to own physiological signal, and safety is higher, be easy to by with Family receives, auxiliary to the progress of a variety of cerebral diseases such as depression, epilepsy, self-closing disease, hyperactivity, Alzheimer disease and Parkinson's disease Validity is all shown during helping training, shows huge application prospect, has become current research and most widely used Methods for Neuromodulation.Neural biofeedback refers to using electroencephalongraph EEG signals, passes through the training to subject, selection Property enhance or inhibit the EEG signals of a certain frequency range, so that function brain network is changed according to the requirement of subject, because should Method mainly feeds back EEG signals, also known as electroencephalogram biofeedback.
But although neural biofeedback is for neural network disorder or the function amendment of missing link or restructuration Extensive confirmation is obtained, but it is applied in supplemental training not be consistent with expected theoretical effect, is primarily due to:1、 NFB mainly carries out feedback adjusting to the wave amplitude of electroencephalogram and power, and the content of feedback is lack of pertinence;2,1-2 lead brains are carried out Electricity feedback, feedback site are very few.
And brain network disorder is required for carrying out period longer supplemental training, in the prior art, for spirit/neurological disorder User supplemental training is usually carried out to user by simulated environment, and need in specific laboratory environment, full Foot is specific to require the lower cerebration recorded, is not to occur under natural situation, can not react true brain function situation, A virtual environment true enough can not be provided to the user, it also can not be in time to the virtual environment residing for user according to user EEG signals regulated and controled in time, existence condition creates difficult, the problems such as rehabilitation efficacy is limited, and cost is higher.
Later, more actually empty there has been proposed using virtual reality (virtual real ity, VR) to provide to the user Psychological assessment, phrenoblabia supplemental training etc. are completed in near-ring border, and virtual reality is that one kind possesses a variety of sensory perceptions (vision is touched Feel, cinesthesia etc.) 3D of interaction experiences interface, and the environment of a similar reality is generated by computer, and people is allowed to immerse it In, have the feeling of a kind of " on the spot in person " ".
In order to realize that above-mentioned technical problem, Chinese patent disclose a kind of based on VR interactions and brain wave and brain blood flow monitoring Psychiatric appraisal procedure [application number:CN201610304151.5], include that the user based on virtual reality interaction technique is special Thread of pledging love induces link, the user's physiological data analysis link monitored in real time based on brain wave brain blood flow data and user's spirit Psychological assessment link;User's specific emotional based on virtual reality interaction technique induces link, is generated for inducing user Expected mood swing;The Users'Data Analysis method monitored in real time based on brain wave brain blood flow data, for analyzing The difference for the data that the physiological data of acquisition user should be generated with expection, and it is incorporated in the behavior of user in virtual reality content Data, to judge that user watches the feedback effects of the virtual reality content;User's psychiatric appraisal procedure, in conjunction with user A series of feedback effects for watching virtual reality contents with specific emotional induced effectiveness carry out the psychiatric of user comprehensive Close assessment.
The EEG signals of above method feedback are lack of pertinence, and be cannot achieve and are purposefully repaiied to certain abnormal brain network Refreshment is practiced, and can only assess the psychological condition of user, and existing can not regulate and control virtually now according to the psychological condition of user The problems such as truth border.
Invention content
Regarding the issue above, the present invention provides a kind of being showed based on virtual with preferable supplemental training effect The supplemental training method that real brain function network detection and regulation and control are intervened.
Another object of the present invention be in view of the above-mentioned problems, provide it is a kind of using the above method based on virtual reality The auxiliary training system that brain function network detects and regulation and control are intervened.
In order to achieve the above objectives, present invention employs following technical proposals:
The supplemental training method of the detection of brain function network and regulation and control intervention based on virtual reality of the present invention, feature exist In including the following steps:
A:Different brain function network models is selected according to different user and user is made to enter different virtual reality situations In;
B:It acquires EEG signals of the user in virtual reality situation and EEG signals is handled to obtain brain electric network Characteristic parameter, and brain function network is built according to brain electric network characteristic parameter;
C:Brain electric network characteristic parameter is converted into signal in order to control and is sent to virtual reality situation task simulation system;
D:By virtual reality situation task simulation system according to control signal change virtual reality task include the sense of hearing with/ Or the activity and action of vision control are to adjust brain function network.
In the supplemental training method that the above-mentioned brain function network detection based on virtual reality and regulation and control are intervened, in step It is further comprising the steps of before A:
Several are uploaded to database carry supplied including vision and/or sense of hearing control and the situation element information that can combine Virtual reality situation task simulation system is called, and uploads different situation element informations and brain function situation and/or brain simultaneously The correspondence of electric network characteristic parameter, and different brain electric network characteristic parameter and brain function correspondence.
In the supplemental training method that the above-mentioned brain function network detection based on virtual reality and regulation and control are intervened, in step Further include following methods in B:
It is used according to the brain electric network characteristic parameter and brain electric network characteristic parameter received and the analysis of brain function correspondence The brain function situation at family;
Further include following methods in step C:
According to brain electric network characteristic parameter and/or brain function situation analysis as a result, in conjunction with situation element information and brain work( The correspondence of energy situation and/or brain electric network characteristic parameter extracts corresponding situation element data for controlling from database Virtual reality situation.
In the supplemental training method that the above-mentioned brain function network detection based on virtual reality and regulation and control are intervened, in step In B, the specific steps that EEG signals are handled to obtain with brain electric network characteristic parameter include:
EEG signals are carried out including pseudo-, denoising and the processing for the waveform for extracting special frequency band to carry out EEG signals Quantization obtains brain electric network characteristic parameter.
A kind of auxiliary training system that the detection of brain function network and regulation and control based on virtual reality are intervened, including brain wave acquisition System, the eeg collection system are connected with brain function network evaluation system and brain function parameter regulator control system, the brain Functional network assessment system and brain function parameter regulator control system are all connected to virtual reality situation task simulation system, wherein
Eeg collection system is handled the EEG signals to obtain brain electric network for detecting and acquiring EEG signals Characteristic parameter, and the brain electric network characteristic parameter is sent to brain function network evaluation system and brain function parameter regulator control system;
Brain function network evaluation system, for selecting suitable brain network model for different users, and according to brain electricity The brain electric network characteristic parameter that acquisition system is sent carries out the structure of functional network.
Brain function parameter regulator control system, for by brain electric network characteristic parameter conversion in order to control signal to control virtual reality Task includes the sense of hearing and/or the activity of vision control and acts and then adjust brain function network;
Virtual reality situation task simulation system, it is virtual for being built according to the assessment result of brain function network evaluation system Real situation task, and the control signal change virtual reality task fed back according to brain function parameter regulator control system includes The sense of hearing and/or the activity of vision control and action.
In the auxiliary training system that the above-mentioned brain function network detection based on virtual reality and regulation and control are intervened, this system Further include database, the database purchase has the correspondence of different brain electric network characteristic parameters and brain function, described Brain function network evaluation system is additionally operable to analyze the brain of user according to the correspondence and the brain electric network characteristic parameter received Function situation.
It is described in the auxiliary training system that the above-mentioned brain function network detection based on virtual reality and regulation and control are intervened Several situations combined for carrying activity and action including vision and/or sense of hearing control are also stored in database Element information and different situation element informations and brain function situation and/or the correspondence of brain electric network characteristic parameter, institute The brain function parameter regulator control system stated is according to brain function situation and/or brain electric network characteristic parameter by the brain electric network characteristic parameter Signal control virtual reality situation task simulation system controls virtual reality situation in order to control for conversion.
It is described in the auxiliary training system that the above-mentioned brain function network detection based on virtual reality and regulation and control are intervened Eeg collection system is multichannel brain electric Fast Acquisition System, and the multichannel brain electric Fast Acquisition System includes brain telecommunications Number detection module and the EEG Processing module for being connected to EEG signals detection module, the EEG signals detection module packet Several electrode modules for receiving EEG signals are included, and each electrode module includes at least two electrode units, Mei Ge electricity Pole unit includes for contacting the dry electrode of user's skin and being connected to the preamplifier of dry electrode, and multiple electrodes list It is mutually isolated by metal screen layer between member;The EEG Processing module includes being connected to the brain electricity of preamplifier Amplify analog to digital conversion circuit module and Signal Pretreatment and characteristic extracting module.
It is described in the auxiliary training system that the above-mentioned brain function network detection based on virtual reality and regulation and control are intervened EEG Processing module further includes neural feedback control module, the input terminal and output end of the neural feedback control module It is connected to the Signal Pretreatment and characteristic extracting module and the brain function parameter regulator control system.
It is described in the auxiliary training system that the above-mentioned brain function network detection based on virtual reality and regulation and control are intervened Signal Pretreatment and characteristic extracting module are used to carry out including pseudo-, denoising and the waveform for extracting special frequency band to EEG signals To be quantified EEG signals to obtain brain electric network characteristic parameter, the neural feedback control module is used for brain electricity for processing Network characterization parameter is sent to the brain function parameter regulator control system.
Compared with prior art, the present invention is based on the brain function network of virtual reality detection and regulation and control training method and System has the following advantages:1, can height analogue simulation reality situation, ensure the presence of user;2, collection multichannel brain electric is fast Speed acquisition, virtual reality situation task are realized, the detection in real time of brain function network and brain function network dynamic adjustment are equal to a physical efficiency Enough effectively improve the supplemental training effect of spirit/neurological disorder user;3, brain function network can be assessed, and virtual The regulation and control of brain function network are carried out in real situation so that virtual reality situation is adapted to User Status to reality to the maximum extent Now best training effect;4, by selecting the eeg data of suitable brain function network model and acquisition to build brain function net Network, and by system requirements extract special frequency band waveform make feedback have specific aim, can purposefully to certain brain network into Row training is corrected;5, it is fed back using the composite module of how dry electrode, that is, multi-lead brain electricity, there is enough feedback points Position.
Figure of description
Fig. 1 is the knot of the auxiliary training system of the detection of brain function network and regulation and control intervention based on virtual reality of the present invention Structure block diagram;
Fig. 2 is the structure diagram of eeg collection system of the present invention;
Fig. 3 is the structural schematic diagram of electrode module of the present invention;
Fig. 4 is the flow chart of the method for the present invention.
Reference numeral:Eeg collection system 1;EEG signals detection module 11;EEG Processing module 12;Electrode module 13;Electrode unit 14;Dry electrode 141;Preamplifier 15;Metal screen layer 16;The electrically amplified analog to digital conversion circuit module of brain 17; Signal Pretreatment and characteristic extracting module 18;Neural feedback control module 19;Brain function network evaluation system 2;Brain function parameter Regulator control system 3;Virtual reality situation task simulation system 4;Database 5.
Specific implementation mode
Although operations are described as the processing of sequence by flow chart, many of which operation can by concurrently, Concomitantly or simultaneously implement.The sequence of operations can be rearranged.Processing can be terminated when its operations are completed, It is also possible to the additional step being not included in attached drawing.Processing can correspond to method, function, regulation, subroutine, son Program etc..
Term "and/or" used herein above includes the arbitrary and institute of the associated item listed by one of them or more There is combination.When a unit is referred to as " connecting " or when " coupled " to another unit, can be connected or coupled to described Another unit, or may exist temporary location.
Term used herein above is not intended to limit exemplary embodiment just for the sake of description specific embodiment.Unless Context clearly refers else, otherwise singulative used herein above "one", " one " also attempt to include plural number.Also answer When understanding, term " include " and or " include " used herein above provide stated feature, integer, step, operation, The presence of unit and/or component, and do not preclude the presence or addition of other one or more features, integer, step, operation, unit, Component and/or a combination thereof.
The present invention will be further described in detail with reference to the accompanying drawings and detailed description.
As shown in Figure 1, the auxiliary training system for detecting and regulating and controlling intervention based on the brain function network of virtual reality includes There are database 5, the database 5 to be stored with the correspondence of different brain electric network characteristic parameters and brain function;In addition to this, Several situations combined for carrying activity and action including vision and/or sense of hearing control are also stored in database 5 Element information and different situation element informations and brain function situation and/or the correspondence of brain electric network characteristic parameter.
This system further includes eeg collection system 1, and the eeg collection system 1 is connected with brain function network evaluation system 2 and brain function parameter regulator control system 3, the brain function network evaluation system 2 and brain function parameter regulator control system 3 be all connected to Virtual reality situation task simulation system 4.
Wherein, as shown in Fig. 2, eeg collection system 1 is multichannel brain electric Fast Acquisition System, eeg collection system 1 is used In detecting and acquire EEG signals, and it includes EEG signals detection module 11 and is connected to the brain of EEG signals detection module 11 Electronic signal processing module 12, as shown in figure 3, the EEG signals detection module 11 includes several for receiving EEG signals Electrode module 13, and each electrode module 13 includes at least two electrode units 14, specific several electrode units 14 are as needed Setting, each electrode unit 14 include for contacting the dry electrode 141 of the finger-like of user's skin and being connected to dry electrode 141 Preamplifier 15 can be accurate to obtain neural biofeedback letter under various skins, hair circumstances using the dry electrode 141 of finger-like It is more convenient to obtain signal without rejecting hair and increasing gelatinous medium for breath.Electrode module 13 is by wearing in gatherer process It is fixed on head, is worn and is referred to similar helmet structure and be in the netted object that can be worn on user's head, electrode module 13 can be installed on mesh node.In order to keep signal acquisition quality and noise control, the multiple electrodes unit of the present embodiment It is mutually isolated by metal screen layer 16 between 14, reduce biology and ring by connecting preamplifier 15 behind dry electrode Interference of the border noise to EEG signals, and EEG Processing module 12 is electrically amplified including the brain for being connected to preamplifier 15 Analog to digital conversion circuit module 17 and Signal Pretreatment and characteristic extracting module 18, the electrically amplified analog to digital conversion circuit module of midbrain 17 Include the main control chip with 8 EEG signals input channels, which may be used the ADS1299 of TI companies.
Further, the electrically amplified analog to digital conversion circuit of brain 17 further includes having wireless link block and wired connection module, Middle wired connection module includes being connected to the USB interfaces of main control chip, and it includes being connected to the indigo plant of main control chip to be wirelessly connected module Tooth module can take into account different acquisition requirement and adapt to different electricity by wired and wireless two kinds of optional data transfer modes Valid data transmission in magnetic disturbance environment.
Further, EEG Processing module 12 further includes neural feedback control module 19, the neural feedback control The input terminal and output end of molding block 19 are connected to the Signal Pretreatment and characteristic extracting module 18 and the brain Functional parameter regulator control system 3.Wherein Signal Pretreatment and characteristic extracting module 18 are used to complete real-time Transmission or offline storage exists The Time-Frequency Domain Filtering of data in system, by system requirements extract time and frequency domain characteristics to EEG signals carry out include puppet, denoising and The processing of the waveform of special frequency band is extracted to be quantified EEG signals to obtain brain electric network characteristic parameter;Neural feedback controls Module 19 is used to for brain electric network characteristic parameter to be sent to the brain function parameter regulator control system 3.
Brain function parameter regulator control system 3 be used for by brain electric network characteristic parameter conversion in order to control signal to control virtual reality Task includes the activity of the controls such as the sense of hearing and/or vision and acts and then adjust brain function network.Brain function parameter regulation and control system System 3 sends control signal according to the EEG signals detected to virtual reality situation task simulation system 4, and virtual reality situation is appointed Business simulation system 4 is according to the elements such as sense of hearing control and vision control in the control signal control virtual reality scenario sended over The activity of control and setting mission requirements, that is to say, that the situation for changing virtual reality situation, because in virtual reality situation The change of control element and the variation of task make the brain function network of user change to realize regulation and control brain again in turn The purpose of functional network.
Due to needing the concrete reason of progress supplemental training, practical electrical activity of brain and brain work(for different users and user Can abnormal area it is also different, so the present embodiment is by a variety of brain function nets in the prior art existing brain function network research field Selective in network model write-in database 5, it is suitable that brain function network evaluation system 2 is just for different user's selections Brain network model, after selecting suitable network model, the present embodiment is by brain function network evaluation system 2 and according to brain electricity Network characterization parameter carries out the structure of functional network on the basis of brain network model, while for different user according to brain power grid The brain function situation of network characteristic parameter and the correspondence and the brain electric network characteristic parameter parsing user received of brain function, together When also the functional network constructed is analyzed, analysis according to include characteristic path length, efficiency, cluster coefficients, section Point, modular character, robustness, backbone point etc., and combine the data in big data from these features of multiple angle analysis The physiological significance that parameter may reflect.It is used for record in addition, brain network evaluation system also uploads assessment data to database 5 Family different times electroencephalogram parameter information checks the supplemental training situation of oneself for user at any time.
The corresponding hardware device of virtual reality situation task simulation system 4 is virtual reality device, and HTC may be used Vive Pre is shown and matched host machine, with stronger graphics processing function, the functions such as abundant interface between software and hardware, and Neng Gouyu Other modules of this system carry out fusion and data interaction well.
Virtual reality situation task simulation system 4 is used to be built according to the assessment result of brain function network evaluation system 2 empty Quasi- reality situation task, and changed in virtual reality task according to the control signal that brain function parameter regulator control system 3 is fed back Activity including the sense of hearing and/or vision control and action.
In particular it is required that explanation, virtual reality situation task simulation system 4 is counted using the framework of three-decker According to access layer, three parts of Business Logic and user's presentation layer, data access layer:Virtual reality situation task simulation system 4 Storage structure several scenes and the modules such as threedimensional model and situation element, various threedimensional models and situation element are connect by OpenGL Mouth accesses;Business Logic:Including call data library 5 and data access interface, mainly for building and the operation of publication scene, The request of brain function parameter regulator control system 3 is handled, and calls access data, realizes system requirements;Presentation layer:It is mainly responsible for brain work( Control of the control signal that energy parameter regulator control system 3 is sent to element in virtual environment and object, presentation layer realize brain function The interface that parameter regulator control system 3 is interacted with virtual reality situation task simulation system 4.
Virtual reality situation task simulation system 4 is completed in structure after three-decker framework, it is also necessary to according to user's Demand carries out Scenario Design and exploitation and the design of personage's situation, and wherein Scenario Design and the exploitation part includes to situation Task implements, and includes the structure of scene environment, the structure etc. of the elements such as model and object.Scene development procedure is three ranks Section, scene modeling, editor and publication, situation elements include threedimensional model and its attached textures, material further include scene In other basic components, such as text, sound and video, the present embodiment select the three-dimensional of current virtual reality technology prevalence Moulding and Software for producing Unity3D.Unity3D is a professional visual interactive automotive engine system integrated comprehensively, has exploitation effect Rate is high, and the advantages such as abundant third side plug and resource, such as real-time 3D animated videos, object and building visualization class may be selected The modularization scene task of matched combined object is capable of in type interaction content, and system relative simplicity itself, suitable exploitation, especially suitable The task based access control scene exploitation that the present embodiment proposes is closed, such as trains scene for memory, situation task object is to advise Task is completed in fixed situation plot and obtains corresponding score, names a scene example:It is to go sightseeing by Scenario Design Sight spot, an every outpost of the tax office (task execution point are gone sight-seeing on vehicle;When, user will solve the sequence of scenery showplace, compare, and analysis etc. is recognized Know problem, when task is locked and in limited time, and records and complete task time etc..The present embodiment can pass through brain function parameter regulator control system 3 and the interactive relation of brain function parameter regulator control system 3 and virtual reality situation task simulation system 4 make virtual reality task Middle control is controlled by EEG signals parameter, is reached using the brain function network brain characteristic component or EEG signals parameter of structure To threshold requirement as controlling, scenery control realizes operation, Successful Operation according to the design requirement of task in driving task scene Afterwards, according to performance, score is calculated, and enter next scene;
Task situation designs:It is a to know from experience into the specific cognitive state of task when the task of processing, and it includes to know to build To feel, pay attention to, remembering, reacting relevant task setting, processing task is self-teaching and adjusts the process of cognition, certain nerves/ Phrenoblabia user can have the performance of cognition dysfunction, cognitive function to include mainly:Directive force, memory, is returned at attention Recall power, language competence, visual space and language function etc..And cognition dysfunction can be reflected from processing task process, EEG signals when therefore designing the task for Different Cognitive function, and recording processing task, analyze brain electric network characteristic parameter, The variation of brain function can be objectively monitored, the present embodiment utilizes the audio visual Transmitting of Multi-media Information that virtual reality technology provides Ability, the high simulated environment of immersion create for Different Cognitive function, and meet the scene task on user cognition basis, In addition it is directed to brain function study on regulation, the control with user interaction is designed in virtual reality task system, it can Real-time Feedback user Brain function network activity.
As shown in figure 4, the present embodiment is based on using above system and the realization of the hardware device embedded with above-mentioned software module The supplemental training method that the brain function network of virtual reality detects and regulation and control are intervened specifically includes following steps:
A:Brain function network evaluation system 2 selects different brain function network models according to different user, by virtual reality Situation task simulation system 4 is that user builds basic scene task so that user is into compliance with oneself for different users In virtual reality situation;
B:EEG signals of the user in virtual reality situation are acquired by eeg collection system 1 and EEG signals are carried out Reason obtains brain electric network characteristic parameter, and brain function network evaluation system 2 is based on brain function network model and according to brain electric network spy Levy parameter and build brain function network, and execute according to the brain electric network characteristic parameter that receives and brain electric network characteristic parameter with Brain function correspondence analyzes the brain function situation etc. of user;
C:Brain electric network characteristic parameter is converted signal in order to control and is sent to virtual reality by brain function parameter regulator control system 3 Situation task simulation system 4;And according to brain electric network characteristic parameter and/or brain function situation analysis as a result, in conjunction with situation member Prime information extracts corresponding situation member with the correspondence of brain function situation and/or brain electric network characteristic parameter from database 5 Prime number is according to for controlling virtual reality situation;
D:It includes the sense of hearing to change virtual reality task according to control signal by virtual reality situation task simulation system 4 And/or movable and the action and other situation elements of the controls such as vision are to adjust brain function network.Wherein, it needs to illustrate It is that, when starting to train, step BCD cycles are executed to realize constantly regulation and control user's brain function network.
Further, further comprising the steps of before step A:
Several are uploaded to database 5 to carry including vision and/or sense of hearing control and the situation element information that can combine Called for virtual reality situation task simulation system 4, and upload simultaneously different situation element informations and brain function situation and/or The correspondence of brain electric network characteristic parameter, and different brain electric network characteristic parameter and brain function correspondence.
Specifically, in stepb, EEG signals are handled to obtain the specific steps packet of brain electric network characteristic parameter It includes:
EEG signals are carried out including pseudo-, denoising and the processing for the waveform for extracting special frequency band to carry out EEG signals Quantization obtains brain electric network characteristic parameter.
The training method and system of the detection of brain function network and regulation and control based on virtual reality of the present invention pass through to brain electricity Signal detection, processing, record, analysis and regulation and control are carried out, structure one can be real-time, purposive according to the training of user Ground converts the virtual environment of situation element, close to the natural exchange status with true environment, gives the more true scene of user Sense, effectively improves supplemental training effect.
Specific embodiment described herein is only an example for the spirit of the invention.Technology belonging to the present invention is led The technical staff in domain can make various modifications or additions to the described embodiments or replace by a similar method In generation, however, it does not deviate from the spirit of the invention or beyond the scope of the appended claims.
Although eeg collection system 1 is used more herein;EEG signals detection module 11;EEG Processing mould Block 12;Electrode module 13;Electrode unit 14;Dry electrode 141;Preamplifier 15;Metal screen layer 16;The electrically amplified modulus of brain Conversion circuit module 17;Signal Pretreatment and characteristic extracting module 18;Neural feedback control module 19;Brain function network evaluation system System 2;Brain function parameter regulator control system 3;Virtual reality situation task simulation system 4;The terms such as database 5, but be not precluded and make With the possibility of other terms.The use of these items is only for more easily describe and explain the essence of the present invention;It Be construed to any one of the additional limitations and all disagreed with spirit of that invention.

Claims (10)

1. a kind of supplemental training method that the detection of brain function network and regulation and control based on virtual reality are intervened, which is characterized in that packet Include following steps:
A:Different brain function network models is selected according to different user and user is made to enter in different virtual reality situations;
B:It acquires EEG signals of the user in virtual reality situation and EEG signals is handled to obtain brain electric network feature Parameter, and brain function network is built according to brain electric network characteristic parameter;
C:Brain electric network characteristic parameter is converted into signal in order to control and is sent to virtual reality situation task simulation system (4);
D:By virtual reality situation task simulation system (4) according to control signal change virtual reality task include the sense of hearing with/ Or the activity and action of vision control are to adjust brain function network.
2. the supplemental training side that the detection of brain function network and regulation and control according to claim 1 based on virtual reality are intervened Method, which is characterized in that further comprising the steps of before step A:
Several are uploaded to database (5) carry supplied including vision and/or sense of hearing control and the situation element information that can combine Virtual reality situation task simulation system (4) is called, and upload simultaneously different situation element informations and brain function situation and/or The correspondence of brain electric network characteristic parameter, and different brain electric network characteristic parameter and brain function correspondence.
3. the supplemental training side that the detection of brain function network and regulation and control according to claim 2 based on virtual reality are intervened Method, which is characterized in that further include following methods in stepb:
Analyze user's according to the brain electric network characteristic parameter and brain electric network characteristic parameter received and brain function correspondence Brain function situation;
Further include following methods in step C:
According to brain electric network characteristic parameter and/or brain function situation analysis as a result, in conjunction with situation element information and brain function feelings The correspondence of condition and/or brain electric network characteristic parameter corresponding situation element data of extraction from database (5) is used to control Virtual reality situation.
4. the supplemental training side that the detection of brain function network and regulation and control according to claim 3 based on virtual reality are intervened Method, which is characterized in that in stepb, the specific steps that EEG signals are handled to obtain with brain electric network characteristic parameter include:
EEG signals are carried out including pseudo-, denoising and the processing for the waveform for extracting special frequency band to quantify EEG signals Obtain brain electric network characteristic parameter.
5. a kind of auxiliary training system that the detection of brain function network and regulation and control based on virtual reality are intervened, which is characterized in that packet Eeg collection system (1) is included, the eeg collection system (1) is connected with brain function network evaluation system (2) and brain function ginseng Number regulator control system (3), the brain function network evaluation system (2) and brain function parameter regulator control system (3) are all connected to virtually Real situation task simulation system (4), wherein
Eeg collection system (1) is handled the EEG signals to obtain brain electric network spy for detecting and acquiring EEG signals Parameter is levied, and the brain electric network characteristic parameter is sent to brain function network evaluation system (2) and brain function parameter regulator control system (3);
Brain function network evaluation system (2) for selecting suitable brain network model for different users, and is adopted according to brain electricity The brain electric network characteristic parameter that collecting system (1) is sent carries out the structure of functional network.
Brain function parameter regulator control system (3), for by brain electric network characteristic parameter conversion in order to control signal to control virtual reality Task includes the sense of hearing and/or the activity of vision control and acts and then adjust brain function network;
Virtual reality situation task simulation system (4), it is empty for being built according to the assessment result of brain function network evaluation system (2) Quasi- reality situation task, and virtual reality task is changed according to the control signal that brain function parameter regulator control system (3) is fed back Include the sense of hearing and/or the activity of vision control and action.
6. the supplemental training system that the detection of brain function network and regulation and control according to claim 5 based on virtual reality are intervened System, which is characterized in that this system further includes database (5), and the database (5) is stored with different brain electric network characteristic parameters With the correspondence of brain function, the brain function network evaluation system (2) is additionally operable to according to the correspondence and receives Brain electric network characteristic parameter analyzes the brain function situation of user.
7. the supplemental training system that the detection of brain function network and regulation and control according to claim 6 based on virtual reality are intervened System, which is characterized in that be also stored with several in the database (5) and carry the work including vision and/or sense of hearing control The dynamic and action situation element information combined and different situation element informations and brain function situation and/or brain power grid The correspondence of network characteristic parameter, the brain function parameter regulator control system (3) are special according to brain function situation and/or brain electric network Levying parameter, signal controls virtually for virtual reality situation task simulation system (4) in order to control by brain electric network characteristic parameter conversion Real situation.
8. the supplemental training system that the detection of brain function network and regulation and control according to claim 7 based on virtual reality are intervened System, which is characterized in that the eeg collection system (1) is multichannel brain electric Fast Acquisition System, and the multichannel brain Electric Fast Acquisition System includes EEG signals detection module (11) and the EEG signals for being connected to EEG signals detection module (11) Processing module (12), the EEG signals detection module (11) include several electrode modules for receiving EEG signals (13), and each electrode module (13) includes at least two electrode units (14), and each electrode unit (14) includes to be used for It contacts the dry electrode (141) of user's skin and is connected to the preamplifier (15) of dry electrode (141), and multiple electrodes unit (14) mutually isolated by metal screen layer (16) between;The EEG Processing module (12) includes being connected to preceding storing The electrically amplified analog to digital conversion circuit module (17) of brain of big device (15) and Signal Pretreatment and characteristic extracting module (18).
9. the supplemental training system that the detection of brain function network and regulation and control according to claim 8 based on virtual reality are intervened System, which is characterized in that the EEG Processing module (12) further includes neural feedback control module (19), the nerve The input terminal and output end of feedback control module (19) are connected to the Signal Pretreatment and characteristic extracting module (18) With the brain function parameter regulator control system (3).
10. the supplemental training system that the detection of brain function network and regulation and control according to claim 9 based on virtual reality are intervened System, which is characterized in that the Signal Pretreatment and characteristic extracting module (18) are used for that carry out to include puppet, is gone to EEG signals The processing of the waveform of special frequency band is made an uproar and extracted to be quantified EEG signals to obtain brain electric network characteristic parameter, the god It is used to for brain electric network characteristic parameter to be sent to the brain function parameter regulator control system (3) through feedback control module (19).
CN201810089742.4A 2018-01-30 2018-01-30 The training method and system of brain function network detection and regulation and control based on virtual reality Pending CN108433721A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810089742.4A CN108433721A (en) 2018-01-30 2018-01-30 The training method and system of brain function network detection and regulation and control based on virtual reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810089742.4A CN108433721A (en) 2018-01-30 2018-01-30 The training method and system of brain function network detection and regulation and control based on virtual reality

Publications (1)

Publication Number Publication Date
CN108433721A true CN108433721A (en) 2018-08-24

Family

ID=63191210

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810089742.4A Pending CN108433721A (en) 2018-01-30 2018-01-30 The training method and system of brain function network detection and regulation and control based on virtual reality

Country Status (1)

Country Link
CN (1) CN108433721A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109224242A (en) * 2018-09-05 2019-01-18 华南理工大学 Psychological relaxation system and method based on VR interaction
CN109431496A (en) * 2018-10-16 2019-03-08 北京工业大学 A kind of assessment system and method using EEG signals assessment brain ability
CN109875509A (en) * 2019-02-27 2019-06-14 京东方科技集团股份有限公司 The test macro and method of Alzheimer Disease patient rehabilitation training effect
CN110478593A (en) * 2019-05-15 2019-11-22 常州大学 Brain electricity attention training system based on VR technology
CN110680314A (en) * 2019-09-30 2020-01-14 浙江凡聚科技有限公司 Virtual reality situation task attention training system based on brain electricity multi-parameter
CN110772699A (en) * 2019-09-30 2020-02-11 浙江凡聚科技有限公司 Attention training system for automatically adjusting heart rate variability based on virtual reality
CN110786825A (en) * 2019-09-30 2020-02-14 浙江凡聚科技有限公司 Spatial perception detuning training system based on virtual reality visual and auditory pathway
CN110808091A (en) * 2019-09-30 2020-02-18 浙江凡聚科技有限公司 Virtual reality visual and auditory pathway-based sensory integration detuning training system
CN111265213A (en) * 2020-02-20 2020-06-12 郑州大学第三附属医院(河南省妇幼保健院) Brain monitoring and protecting method
CN111631736A (en) * 2020-06-03 2020-09-08 安徽建筑大学 Building indoor learning efficiency detection method and system
CN111920408A (en) * 2020-08-11 2020-11-13 深圳大学 Signal analysis method and component of electroencephalogram nerve feedback system combined with virtual reality
CN112085052A (en) * 2020-07-28 2020-12-15 中国科学院深圳先进技术研究院 Training method of motor imagery classification model, motor imagery method and related equipment
CN113706459A (en) * 2021-07-15 2021-11-26 电子科技大学 Detection and simulation restoration device for abnormal brain area of autism patient

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030002677A (en) * 2001-06-29 2003-01-09 림스테크널러지주식회사 Wireless telemetric system and method for neurofeedback training using parameters of electroencephalogram(EEG)
CN106377252A (en) * 2016-09-30 2017-02-08 兰州大学 Biologic information feedback system based on virtual reality
CN106407733A (en) * 2016-12-12 2017-02-15 兰州大学 Depression risk screening system and method based on virtual reality scene electroencephalogram signal
US20170120043A1 (en) * 2005-01-21 2017-05-04 Michael Sasha John Programming Adjustment for Brain Network Treatment
CN106933348A (en) * 2017-01-24 2017-07-07 武汉黑金科技有限公司 A kind of brain electric nerve feedback interventions system and method based on virtual reality

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030002677A (en) * 2001-06-29 2003-01-09 림스테크널러지주식회사 Wireless telemetric system and method for neurofeedback training using parameters of electroencephalogram(EEG)
US20170120043A1 (en) * 2005-01-21 2017-05-04 Michael Sasha John Programming Adjustment for Brain Network Treatment
CN106377252A (en) * 2016-09-30 2017-02-08 兰州大学 Biologic information feedback system based on virtual reality
CN106407733A (en) * 2016-12-12 2017-02-15 兰州大学 Depression risk screening system and method based on virtual reality scene electroencephalogram signal
CN106933348A (en) * 2017-01-24 2017-07-07 武汉黑金科技有限公司 A kind of brain electric nerve feedback interventions system and method based on virtual reality

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109224242A (en) * 2018-09-05 2019-01-18 华南理工大学 Psychological relaxation system and method based on VR interaction
CN109431496A (en) * 2018-10-16 2019-03-08 北京工业大学 A kind of assessment system and method using EEG signals assessment brain ability
CN109875509A (en) * 2019-02-27 2019-06-14 京东方科技集团股份有限公司 The test macro and method of Alzheimer Disease patient rehabilitation training effect
CN110478593A (en) * 2019-05-15 2019-11-22 常州大学 Brain electricity attention training system based on VR technology
CN110680314B (en) * 2019-09-30 2022-06-10 浙江凡聚科技有限公司 Virtual reality situation task attention training system based on brain electricity multi-parameter
CN110680314A (en) * 2019-09-30 2020-01-14 浙江凡聚科技有限公司 Virtual reality situation task attention training system based on brain electricity multi-parameter
CN110772699A (en) * 2019-09-30 2020-02-11 浙江凡聚科技有限公司 Attention training system for automatically adjusting heart rate variability based on virtual reality
CN110786825A (en) * 2019-09-30 2020-02-14 浙江凡聚科技有限公司 Spatial perception detuning training system based on virtual reality visual and auditory pathway
CN110808091A (en) * 2019-09-30 2020-02-18 浙江凡聚科技有限公司 Virtual reality visual and auditory pathway-based sensory integration detuning training system
CN110808091B (en) * 2019-09-30 2023-05-23 浙江凡聚科技有限公司 Sensory integration maladjustment training system based on virtual reality visual-audio sense path
CN110786825B (en) * 2019-09-30 2022-06-21 浙江凡聚科技有限公司 Spatial perception detuning training system based on virtual reality visual and auditory pathway
CN111265213A (en) * 2020-02-20 2020-06-12 郑州大学第三附属医院(河南省妇幼保健院) Brain monitoring and protecting method
CN111631736B (en) * 2020-06-03 2023-04-18 安徽建筑大学 Building indoor learning efficiency detection method and system
CN111631736A (en) * 2020-06-03 2020-09-08 安徽建筑大学 Building indoor learning efficiency detection method and system
CN112085052A (en) * 2020-07-28 2020-12-15 中国科学院深圳先进技术研究院 Training method of motor imagery classification model, motor imagery method and related equipment
CN111920408A (en) * 2020-08-11 2020-11-13 深圳大学 Signal analysis method and component of electroencephalogram nerve feedback system combined with virtual reality
CN111920408B (en) * 2020-08-11 2023-04-07 深圳大学 Signal analysis method and component of electroencephalogram nerve feedback system combined with virtual reality
CN113706459A (en) * 2021-07-15 2021-11-26 电子科技大学 Detection and simulation restoration device for abnormal brain area of autism patient
CN113706459B (en) * 2021-07-15 2023-06-20 电子科技大学 Detection and simulation repair device for abnormal brain area of autism patient

Similar Documents

Publication Publication Date Title
CN108433721A (en) The training method and system of brain function network detection and regulation and control based on virtual reality
CN110070944B (en) Social function assessment training system based on virtual environment and virtual roles
CN101464729B (en) Independent desire expression method based on auditory sense cognition neural signal
US7460903B2 (en) Method and system for a real time adaptive system for effecting changes in cognitive-emotive profiles
CN112932502B (en) Electroencephalogram emotion recognition method combining mutual information channel selection and hybrid neural network
CN110353702A (en) A kind of emotion identification method and system based on shallow-layer convolutional neural networks
CN105938397A (en) Hybrid brain-computer interface method based on steady state motion visual evoked potential and default stimulation response
Bulárka et al. Brain-computer interface review
CN110691550A (en) System and method for measuring perception experience
CN101515200B (en) Target selecting method based on transient visual evoked electroencephalogram
CN106933348A (en) A kind of brain electric nerve feedback interventions system and method based on virtual reality
CN108236464A (en) Feature extracting method and its Detection and Extraction system based on EEG signals
CN106407733A (en) Depression risk screening system and method based on virtual reality scene electroencephalogram signal
CN108056774A (en) Experimental paradigm mood analysis implementation method and its device based on visual transmission material
CN109620257B (en) Mental state intervention and regulation system based on biofeedback and working method thereof
Pei et al. Silent communication: toward using brain signals
Molina et al. Joint time-frequency-space classification of EEG in a brain-computer interface application
CN111598453B (en) Control work efficiency analysis method, device and system based on execution force in virtual scene
CN106264520A (en) A kind of neural feedback athletic training system and method
CN104799852B (en) The extracting method of Mental imagery EEG signals feature based on the learning machine own coding that transfinites
CN111553617B (en) Control work efficiency analysis method, device and system based on cognitive power in virtual scene
CN111598451B (en) Control work efficiency analysis method, device and system based on task execution capacity
CN107122050A (en) Stable state of motion VEP brain-machine interface method based on CSFL GDBN
CN107479702A (en) A kind of human emotion's dominance classifying identification method using EEG signals
Davis et al. An integrative approach to analyze EEG signals and human brain dynamics in different cognitive states

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination