CN109901711A - By the asynchronous real-time brain prosecutor method of the micro- expression EEG signals driving of weak Muscle artifacts - Google Patents
By the asynchronous real-time brain prosecutor method of the micro- expression EEG signals driving of weak Muscle artifacts Download PDFInfo
- Publication number
- CN109901711A CN109901711A CN201910087028.6A CN201910087028A CN109901711A CN 109901711 A CN109901711 A CN 109901711A CN 201910087028 A CN201910087028 A CN 201910087028A CN 109901711 A CN109901711 A CN 109901711A
- Authority
- CN
- China
- Prior art keywords
- expression
- micro
- brain
- brain control
- eeg signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of asynchronous real-time brain prosecutor methods by the micro- expression EEG signals driving of weak Muscle artifacts.Using 100ms EEG signals as single signal source, the micro- expression attribute of brain control is carried out first with Muscle artifacts energy accounting and is determined.Secondly it executes brain control state and opens/stop the micro- expression detection of brain control and its availability deciding, start brain control state after being determined as the micro- expression of true property brain control, into after brain control state, the micro- Expression Recognition of brain control and its availability deciding are carried out after determining the micro- expression attribute of brain control, generates brain control instruction for controlling controlled device or stopping brain control state after being determined as the micro- expression of true property brain control.The present invention is based on the micro- expressions of brain control to realize that brain control state opens/stops and 8 kinds of controlled device motion actions, effectively increase real-time, flexibility and the accuracy of brain prosecutor method, and increase asynchronous brain control interface detection and the micro- expression availability deciding of brain control, the practical value for improving brain prosecutor method, can be widely used in a variety of brain control systems.
Description
Technical field
The present invention relates to brain-computer interface technical fields, and in particular to a kind of to be driven by the micro- expression EEG signals of weak Muscle artifacts
Dynamic asynchronous real-time brain prosecutor method.
Background technique
Brain-computer interface (Brain Computer Interface, BCI) technology, i.e., using user's EEG signals as signal
Source, the decoding being intended to user is realized using advanced Computerized Information Processing Tech, and avoiding user may be damaged outer
All nerve/muscle systems establish the direct communication between user's consciousness and peripheral hardware.It is in rehabilitation medical, high-risk operation, game joy
The fields such as pleasure, aerospace military all have great application value.
Traditional brain-computer interface be based on more stable state vision inducting (Steady State Visual Evoked Potential,
SSVEP) and Mental imagery (Motor Imagery, MI) normal form is realized, wherein SSVEP has high, the recognizable classification of accuracy more
The advantages of, but since its normal form principle restricts, additional visual stimulator and visual stimulation time are needed, is deposited in brain control problem
In the limited problem of equipment redundancy and response real-time；MI has the advantages that meet human brain spontaneous brain electricity and generates process, but due to
The difficulty of implementation for imagining movement, needs additional subject's adaptation time, and there are user friendly is low and can in brain control problem
Identify the limited problem of classification.And existing research only allows user in default mostly based on synchronous brain-computer interface expansion
Special time period send instruction, can not provide user independently dominates transmission the control instruction time permission, in real EEG control
Using limited in problem.
To solve the problems, such as that above-mentioned traditional brain-computer interface equipment redundancy, user friendly are low, Chinese patent
201510423224, Chinese patent 201510423398 etc. discloses the brain control based on the driving brain-computer interface normal form of expression
Method.Its related driving brain prosecutor method of expression, in terms of facial expressions and acts, do not consider its in actual application with its
The difference of remaining daily facial expression and the aesthetic measure of user's use process；Before only including in terms of the EEG signals channel selecting
Cortex of frontal lobe and limbic system, have ignored facial expression as a kind of facial muscle action cerebral motor cortex information table
It reaches；In terms of provided brain control facial expressions and acts, it is only applicable to control the operation of target within 4 kinds, control number of targets is limited；?
In the course of work of brain control interface, it is not introduced into asynchronous brain control interface, cannot achieve independently starting/stop for user's brain control state
Only, lack practical application value.
Above based on brain prosecutor method derived from brain-computer interface technology, different degrees of at this stage that there are real-times is low
It is (control instruction output frequency is low), additional stimulus device redundancy, asynchronous brain-computer interface (brain control interface) afunction, user friendly
The problems such as property is low.
Summary of the invention
The present invention existing brain prosecutor method there are aiming at the problem that, propose one kind by the micro- expression EEG signals of weak Muscle artifacts
The asynchronous real-time brain prosecutor method of driving.
To achieve the above objectives, the invention adopts the following technical scheme:
A kind of asynchronous real-time brain prosecutor method by the micro- expression EEG signals driving of weak Muscle artifacts, comprising the following steps:
First stage --- starting brain control state
The attribute that user's facial expression is determined according to the Muscle artifacts of EEG signals, if the facial expression belongs to brain control
Micro- expression then carries out the micro- Expression Recognition of brain control and availability deciding to the facial expression, if the effective micro- expression of brain control recognized
(present invention is referred to as the micro- expression of true property brain control) is that brain control state opens/stop the micro- expression of brain control, then enters brain control state；
Second stage --- asynchronous real-time control under brain control state
Under brain control state, the attribute of user's facial expression is determined according to the Muscle artifacts of EEG signals, if the face
Portion's expression belongs to the micro- expression of brain control, then carries out the micro- Expression Recognition of brain control and availability deciding to the facial expression, according to recognizing
With the micro- expression control controlled device movement of the matched effective brain control of controlled device control instruction, or it is effective according to what is recognized
Brain control state opens/stops the micro- expression of brain control and stops brain control state.
Preferably, the sampling period of the EEG signals is 100~150ms.
Preferably, the acquisition channel of the EEG signals includes Prefrontal Cortex cortex, cerebral limbic system and brain fortune
Dynamic cortex channel position (such as F7, F8, FC5, FC6, FCz, C3, C4 and Cz).
Preferably, using the EEG signals obtained in the single sampling period as signal source, the signal source deutocerebrum forehead is calculated
The Muscle artifacts energy accounting of leaf skin matter channel (such as F7 and F8) signal, when the energy accounting is in certain threshold interval
(threshold interval can voluntarily be adjusted by user), then judge user's facial expression for the micro- expression of brain control.Prefrontal Cortex skin
Matter region is due to closer apart from human face's muscle, so with the Muscle artifacts energy accounting of the regional signal, it is determined whether belongs to
The micro- expression of brain control.
Preferably, the micro- expression of brain control be selected from mention eyebrow, frown, a left side is curled one's lip, the right side is curled one's lip, is smiled, mouth of beeping, is opened one's mouth, grits one's teeth
Or tranquillization, each micro- expression of brain control are identified according to the disaggregated model pre-generated using EEG signals.
Preferably, in the availability deciding, if the micro- expression of brain control is in the identification knot in continuous n EEG signals sampling period
Fruit is consistent (n is set by user), then is judged as the effective micro- expression of brain control, and generates corresponding brain control instruction (control
The control instruction or controlled device brain control state of controlled device movement processed open/stop instruction).
The present invention also proposed a kind of by the different of the micro- expression EEG signals driving of weak Muscle artifacts according to above-mentioned brain prosecutor method
Walk real-time brain control system, including electroencephalogramsignal signal acquisition module, EEG signals data client and controlled device, the brain telecommunications
Number client includes EEG signals source module, the micro- expression attribute determination module of brain control, the true micro- expression determination module of property brain control
And brain control instruction generates and sending module, the EEG signals source module is periodically acquired for receiving electroencephalogramsignal signal acquisition module
User's EEG signals, the micro- expression attribute determination module of brain control is used to according to the EEG signals determine that user is done
The micro- expression of brain control in facial expression out, the brain control that the true micro- expression determination module of property brain control is used to make user are micro-
The validity for the micro- expression of brain control that expression progress type identification and determination are identified, the brain control instruction generates and sending module
For comparing and matching the instruction of brain control corresponding to the effective micro- expression of brain control and the instruction is sent to controlled device.
The beneficial effects of the present invention are embodied in:
The present invention is on the basis of expression driving brain-computer interface normal form, from the practical angle of brain prosecutor method, with
EEG signals in operating process under the micro- facial expressions and acts of user's face are signal source, and user operates mesh according to controlled device
Mark, makes the corresponding micro- expression of brain control, not only realizes the asynchronous real-time control under brain control state for controlled device, but also increase
The available brain control instruction number of controlled device, to improve real-time, flexibility and the accuracy of brain control operation.
Further, the more traditional brain control expression of the micro- expression of brain control of the present invention weakens the movement range of facial expression,
Convenient for user's regular job, and provide more for the expression classification of operation.
Further, the present invention increases asynchronous brain control interface detection (asynchronous brain control interface brain control state starting detection and brain
The detection of control state hypencephalon control micro- expression), (Muscle artifacts energy accounting is in certain threshold interval the micro- expression amplitude adjusted of brain control
When, Muscle artifacts energy accounting is high, then micro- facial expressions and acts amplitude is big；Muscle artifacts energy accounting is low, then micro- facial expressions and acts amplitude
It is small) and the micro- expression availability deciding link of brain control, the practical value of brain prosecutor method is improved, the stabilization of brain control operation is effectively increased
Property, it can be widely used in a variety of brain control systems.
Further, the midbrain control command signal source of the present invention micro- expression brain electricity shorter by the sampling period (100~150ms)
Signal is constituted, and significantly shortens brain control signal source duration, effectively increases the real-time of brain control operation.
Detailed description of the invention
Fig. 1 is the asynchronous real-time brain control system schematic in the embodiment of the present invention.
Fig. 2 is the electrode arrangement position view of electroencephalogramsignal signal acquisition module in the embodiment of the present invention.
Fig. 3 is the schematic diagram of the micro- expression of midbrain of embodiment of the present invention control；Wherein, (a) be mention eyebrow, (b) be frown, (c) is
A left side is curled one's lip, (d) be the right side curl one's lip, (e) be smile, (f) be beep mouth, (g) be open one's mouth, (h) for grit one's teeth, (i) is quiescent condition；For exhibition
Show needs, reinforce micro- facial expressions and acts amplitude, grits one's teeth and carry out opening one's mouth to demonstrate.
Fig. 4 is the asynchronous real-time brain control algorithm based on the micro- expression EEG signals driving of weak Muscle artifacts in the embodiment of the present invention
Flow chart.
Specific embodiment
Present invention will be further explained below with reference to the attached drawings and examples.The embodiment is only used for illustrating this hair
Bright technical concepts and features can not be limited the scope of the invention with this embodiment.
Fig. 1 illustrates a kind of asynchronous real-time brain control system by the micro- expression driving of brain control by way of example, which includes
Electroencephalogramsignal signal acquisition module, EEG signals data client and controlled device.Wherein, electroencephalogramsignal signal acquisition module includes using
The electroencephalogramsignal signal collection equipment that person wears, brain electricity cap channel position arrangement meet international 10-20 standard, the multichannel brain of acquisition
Electric signal (100ms EEG) can be via local network transport to EEG signals data client；EEG signals data client utilizes
Computer receives EEG signals sampled data, and completes EEG signals data processing work by micro- expression formula brain control program, micro-
Expression formula brain control program is based on Matlab platform, and what is proposed according to the present invention is driven based on the micro- expression EEG signals of weak Muscle artifacts
Dynamic asynchronous real-time brain control algorithm, output brain control order-driven controlled device movement；According to the micro- expression of brain control and different instruction
Matching, the system can realize different controlled devices and control.
The micro- expression of brain control be a series of EEG signals Muscle artifacts multicomponent energy accounting E and existing brain control expression
It is different, and can use machine learning or deep learning carries out EEG's Recognition, the facial expression of classification, these brain controls are micro-
The characteristics of more existing brain control expression of expression weakens the movement range of facial expression, shows weak Muscle artifacts.Due to myoelectricity puppet
Mark compared to the other compositions many places in EEG signals in high frequency section, therefore can choose filter pass band be (75, fs/2] Hz
Muscle artifacts ingredient is obtained, wherein fs is taken as equipment sample frequency.
The present invention pass through in an experiment analysis compared with vulnerable to facial muscles myoelectricity interference EEG signals channel data (for example,
Channel F7, F8, Fig. 2), obtain 9 kinds of micro- expressions of brain control (Fig. 3) altogether, be respectively mention eyebrow, frown, a left side is curled one's lip, the right side is curled one's lip, smile,
Beep mouth opens one's mouth, grits one's teeth and tranquillization.Muscle artifacts multicomponent energy accounting E corresponding to expression has the feature that E takes slightly for this
Value range: 5%~50%, wherein energy accounting height then illustrates that facial expressions and acts muscular movement amplitude is big, and energy accounting is low, illustrates
Facial expressions and acts muscular movement amplitude is small, so as to pass through the threshold range [E for specifying E1,E2] and distinguished with existing brain control expression,
Realize that the micro- expression attribute of brain control determines.Due to different use habit differences, this threshold range [E1,E2] be can be by using
What person voluntarily adjusted in the value range of E, convenient for the specified micro- expression for belonging to a certain movement range to execute brain control operation.
The present invention also found by experiment, and the EEG signals after Muscle artifacts ingredient are removed by filtering, can be used as
Sample is trained the eeg signal classification device of the micro- expression of above 9 kinds of brain controls, and obtains effective automatic identification and classification energy
Power.Wherein, EEG signals initial data obtains pure EEG signals frequency by the bandpass filtering treatment complementary with above-mentioned filter pass band
Band can be based on cospace mode (Common Spatial Pattern, CSP) algorithm to the pure EEG signals, utilize space
Filter realizes time-space domain feature extraction, according to signal characteristic combination supporting vector machine (the Support Vector extracted
Machine, SVM) identification of the different micro- expressions of brain control, spatial filter and SVM classifier may be implemented by user's training number
According to pre-generated.
It is recognizing in a certain brain electricity sampling periods of user after the corresponding micro- expression of brain control, in order to avoid user's face
Expression malfunction causes controlled device to malfunction, on the other hand also for the control flexibility for improving brain control instruction, to user's
The micro- expression of brain control carries out Effective judgement, the i.e. micro- Expression Recognition of true property brain control, also, for the different micro- expressions of brain control, can be with
According to its matched brain control instruction difference, set different recognition thresholds.
Referring to fig. 4, below by taking above-mentioned asynchronous real-time brain control system and 9 kinds of micro- expressions of brain control as an example, the micro- expression of brain control is described
The asynchronous real-time brain flow control journey of driving:
(1) controlled device is that the five fingers independently drive, have the bionical artificial hand of carpal 6DOF, and computer is controlled with this
It is communicated between object by bluetooth module, i.e., the artificial hand brain control generated after processing is instructed and sent by bluetooth module by computer
To the drive control device being embedded in artificial palm, eventually by motor driven artificial hand execution target.
(2) user wears electroencephalogramsignal signal collection equipment, acquires user's EEG signals
Select the Bo Ruikang NeursenW8 brain wave acquisition equipment in 8 channels, brain electricity cap arrange electrode in F7, F8, FC5, FC6,
The position FCz, C3, C4, Cz (Fig. 2), that is, acquire the EEG signals in 8 channels.Wherein, reference electrode uses AFz, CPz according to equipment
The double reference electrode arrangements in channel, sample frequency 1000Hz, the EEG signals data of acquisition are via local network transport to meter
Calculation machine.
(3) the micro- expression attribute decision threshold of brain control is adjusted by user.I.e. when Muscle artifacts multicomponent energy in EEG signals
Accounting is inBetween when, determine user execute be the micro- expression of brain control.
(4) each true micro- expression decision threshold n ∈ { n of property brain control is arranged by user1... ..., n9, index number representative pair
The micro- expression of brain control answered.That is 9 kinds of micro- expressions respectively need n times continuously the consistent micro- Expression Recognition of brain control as a result, can be determined as true
Property the micro- expression of brain control, and generate effective brain control instruction.Wherein, n is set1~n8>=3, n9≥6.Artificial hand control instruction (1.~
8.) and brain control state open/the corresponding setting (matching) of the micro- expression of the brain control of stop instruction is as follows:
1. proposing eyebrow control palm closed action；
Index finger operating gesture (index finger stretching, extension, remaining four finger closure) are controlled 2. frowning；
3. a left side, which is curled one's lip, controls wrist pronation；
4. the right side, which is curled one's lip, controls wrist outward turning movement；
Pinching is made 5. control two of smiling refers to；
6. beep mouth control index finger list refers to back hook movement (remaining four finger closure)；
7. control artificial hand of opening one's mouth resets and (is reset to all fingers extension, wrist is returned just)；
8. tranquillization controls artificial hand movement and keeps；
It opens/stops 9. gritting one's teeth and controlling brain control state.
(5)/corresponding micro- the expression of brain control of stop instruction is opened according to brain control state, user opens at any time according to personal inclination's selection
Beat one's brains control state, makes the micro- expression of corresponding a kind of brain control.
(6) start micro- expression formula brain control program
Using EEG signals data transfer protocol, electroencephalogramsignal signal collection equipment is received through office by EEG signals data client
The EEG signals sampled data that domain net is sent, completes the data processing work by micro- expression formula brain control program.
(7) micro- expression formula brain control program receives 8 channel EEG signals by sampling period (100ms duration), since equipment is adopted
Sample frequency is 1000Hz, the practical correspondence each 100 EEG signals sampled points in 8 channels of 100ms data collected, that is, is obtained pair
Answer 8 × 100 initial data of current sample period.
(8) the micro- expression attribute of brain control is carried out to determine
Compared with the F7 vulnerable to facial muscles myoelectricity interference in micro- 8 channel (8 × 100 initial data) of expression formula brain control Program extraction
With F8 channel data, using its Muscle artifacts frequency range of bandpass filtering rapidly extracting, filter pass band be (75,500] Hz, compare myoelectricity
The spectrum energy of artefact signal and original signal, and by calculating Muscle artifacts multicomponent energy accounting in the data, when its energy
AccountingWhen determine belong to the micro- expression of brain control, enter step (9)；It is on the contrary then send null value to step (10), it returns
Step (7).
(9) asynchronous brain control interface starting detection (execute brain control state and open/stop the micro- Expression Recognition of brain control)
The step is substantially 2 classification problems that brain control state opened/stopped micro- expression whether being.Micro- expression formula brain control procedure selection
Filter pass band [0.5,75] Hz by current 8 × 100 initial data by bandpass filtering treatment to pure EEG signals frequency band, using pre-
The spatial filter and SVM classifier first generated obtains the corresponding brain control state of current sample period and opens/stop the micro- expression knowledge of brain control
Other result.
(10) brain control state opens/stops the micro- Expression Recognition result availability deciding of brain control
Micro- expression formula brain control program retains current sample period and the sampling period, and continuous multiple sampling periods are corresponding before
Brain control state opens/stops the micro- Expression Recognition of brain control as a result, using current sample period recognition result as standard, if it is continuous with the past
n9Secondary recognition result (brain control state opens/stop the micro- expression of brain control) unanimously, then determines the micro- expression of brain control of current sample period identification
Recognition result is very, to export recognition result 1, enter step (11)；It is on the contrary then export recognition result 0, return step (7).
(11) enabled instruction of brain control state generates
Micro- expression of gritting one's teeth (brain control state opens/stop the micro- expression of brain control) is made for starting brain according to personal inclination in user
After control state, micro- expression formula brain control program opens/stops the micro- expression of brain control according to current true property brain control state, enables brain control Status Flag
Position generates brain control state enabled instruction.
(12) controlled device brain control state starts
The brain control state enabled instruction of generation is sent to bionical artificial hand driving control via bluetooth by micro- expression formula brain control program
Device processed, bionical artificial hand brain control condition prompting lamp switch to green.
(13) user according to artificial hand operation target, make the micro- expression of corresponding 8 kinds of brain controls (mention eyebrow, frown, a left side is curled one's lip,
The right side curls one's lip, smiles, mouth of beeping, open one's mouth or tranquillization) for operating artificial hand；Or selection does not execute brain control operation, without the micro- table of brain control
Feelings movement, carries out free facial expressions and acts；Or selection stops brain control state etc., makes corresponding a kind of brain control micro- expression (micro- table of gritting one's teeth
Feelings).
(14) micro- expression formula brain control program receives current 8 channel EEG signals of 100ms duration and carries out the micro- expression attribute of brain control
Determine, judgement belongs to the micro- facial expressions and acts of brain control, enters step (15)；It is on the contrary then send null value to step (16), and continue under
The data in one sampling period (100ms duration) receive and the micro- expression attribute of brain control determines.Step (14) specific implementation method
It is consistent with step (7) and step (8).
(15) the micro- Expression Recognition of brain control is executed
The step is substantially 9 classification problems of 9 kinds of micro- expressions of brain control.Sorting algorithm used in the step and step (9)
Unanimously, spatial filter and SVM classifier are pre-generated by user's training data.
(16) the micro- Expression Recognition result availability deciding of brain control
Micro- expression formula brain control program continuous n (n ∈ { n before retaining current sample period and the sampling period1... ..., n9})
A sampling period corresponds to the micro- Expression Recognition of brain control as a result, using current sample period recognition result as standard, if it connected with the past
Continuous n times recognition result is consistent, then determines that the micro- Expression Recognition result of the brain control of current sample period is very, it is micro- to export the true property brain control
Expression Recognition is as a result, enter step (17)；On the contrary then return step (14)；
Specifically by recognition result be for 1. class proposes the micro- expression of eyebrow, if the continuous n of current and past1It is secondary to be identified as the 1. class
Propose the micro- expression of eyebrow, then determine the 1. class mention the micro- Expression Recognition result of eyebrow be it is true, export recognition result 1, enter step (17)；It is on the contrary
Then export recognition result 0, return step (14).
(17) the current true micro- expression instruction of property brain control of matching
Current recognition result is the genuine micro- expression of brain control and the preset micro- expression of brain control by micro- expression formula brain control program
It corresponds to artificial hand control instruction to compare, if output is 8 kinds of artificial hands operation micro- expression of brain control, (i.e. non-brain control state opens/stop the micro- table of brain control
Feelings) then enter step (18)；Otherwise (being that brain control state opens/stop the micro- expression of brain control) then enters step (19).
(18) micro- expression formula brain control program is according to the micro- expression of current true property brain control, corresponding generation brain control instruction, via bluetooth
Communication is sent to artificial hand drive control device, and driving motor control artificial hand executes corresponding actions, and action command of doing evil through another person in detail is shown in step
(4), return step (14) after movement is finished.
(19) it is made again in user according to personal inclination after gritting one's teeth micro- expression, micro- expression formula brain control program is according to current
True property brain control state opens/stops the micro- expression of brain control and resets brain control state flag bit, brain control state halt instruction is generated, by brain control state
Halt instruction is sent to bionical artificial hand drive control device via bluetooth, and bionical artificial hand brain control condition prompting lamp switchs to red, is controlled
Object brain control state stops, return step (5).
The present invention has the advantages that
1. the asynchronous real-time brain prosecutor method proposed by the invention by the micro- expression EEG signals driving of weak Muscle artifacts, so that
(for example, 100ms) EEG signals in short-term when user does different brain controls micro- expression are realized as control signal source for peripheral hardware quilt
Asynchronous, the real-time control for controlling object multiple target task effectively increase control command quantity and its control signal output frequency.
2. the present invention weakens facial expression movement range during brain control, increases the micro- expression attribute of brain control and determine step
Suddenly, it and provides and can (on the one hand daily expression effectively have been distinguished by the micro- expression attribute decision threshold of brain control that user voluntarily adjusts
Refer to brain control expression in the prior art；On the other hand other facial tables not being inconsistent with the micro- expression amplitude of brain control of user are also instigated
Feelings) with the difference of the micro- expression of brain control state, shorten EEG signals duration required for single brain control instruction is handled, realize different
The real-time detection for walking brain control interface, more meets user's daily use.
3. effective brain control instruction that the present invention, which provides user, voluntarily to be adjusted generates threshold value, (i.e. the micro- expression of true property brain control is sentenced
Determine threshold value n), different judgment thresholds can be set for different brain controls instruction, improve user's different application target hypencephalon control and refer to
The stability and accuracy, flexibility of order.
Claims (10)
1. a kind of asynchronous real-time brain prosecutor method by the micro- expression EEG signals driving of weak Muscle artifacts, it is characterised in that: including with
Lower step:
1) start brain control state
The attribute that user's facial expression is determined according to the Muscle artifacts of EEG signals, if the facial expression belongs to the micro- table of brain control
Feelings then carry out the micro- Expression Recognition of brain control and availability deciding to the facial expression, if the effective micro- expression of brain control recognized is brain
Control state opens/stops the micro- expression of brain control, then enters brain control state；
2) asynchronous real-time control under brain control state
Under brain control state, the attribute of user's facial expression is determined according to the Muscle artifacts of EEG signals, if the face table
Feelings belong to the micro- expression of brain control, then carry out the micro- Expression Recognition of brain control and availability deciding to the facial expression, according to recognize with
The matched effective micro- expression control controlled device movement of brain control of controlled device control instruction, or according to the effective brain control recognized
State opens/stops the micro- expression of brain control and stops brain control state.
2. a kind of asynchronous real-time brain prosecutor method by the micro- expression EEG signals driving of weak Muscle artifacts according to claim 1,
It is characterized by: the sampling period of the EEG signals is 100~150ms.
3. a kind of asynchronous real-time brain prosecutor by the micro- expression EEG signals driving of weak Muscle artifacts according to claim 1 or claim 2
Method, it is characterised in that: the acquisition channel of the EEG signals includes Prefrontal Cortex cortex, cerebral limbic system and brain movement
Cortex channel position.
4. a kind of asynchronous real-time brain prosecutor by the micro- expression EEG signals driving of weak Muscle artifacts according to claim 1 or claim 2
Method, it is characterised in that: using the EEG signals obtained in the single sampling period as signal source, calculate the signal source deutocerebrum prefrontal lobe
The Muscle artifacts energy accounting of cortex channel signal then judges user when the energy accounting is in certain threshold interval
Facial expression is the micro- expression of brain control.
5. a kind of asynchronous real-time brain prosecutor method by the micro- expression EEG signals driving of weak Muscle artifacts according to claim 4,
It is characterized by: the threshold interval is specified in 5%~50% range by user.
6. a kind of asynchronous real-time brain prosecutor method by the micro- expression EEG signals driving of weak Muscle artifacts according to claim 1,
It is characterized by: the micro- expression of brain control be selected from mention eyebrow, frown, a left side is curled one's lip, the right side is curled one's lip, is smiled, mouth of beeping, is opened one's mouth, gritting one's teeth or quiet
Breath.
7. a kind of asynchronous real-time brain prosecutor by the micro- expression EEG signals driving of weak Muscle artifacts according to claim 1 or claim 2
Method, it is characterised in that: in the availability deciding, if the micro- expression of brain control is in the identification knot in continuous n EEG signals sampling period
Fruit is consistent, then is judged as the effective micro- expression of brain control.
8. a kind of asynchronous real-time brain control system by the micro- expression EEG signals driving of weak Muscle artifacts, it is characterised in that: including brain
Electrical signal collection module, EEG signals data client and controlled device, the EEG signals data client include brain electricity
Signal source module, the micro- expression attribute determination module of brain control, the micro- expression determination module of true property brain control and brain control instruction are generated and are sent
Module, the EEG signals source module is for receiving user's EEG signals that electroencephalogramsignal signal acquisition module periodically acquires, institute
The micro- expression attribute determination module of brain control is stated for determining in user's facial expression according to the Muscle artifacts of the EEG signals
The micro- expression of brain control, the true micro- expression determination module of property brain control for being identified to the micro- expression of brain control that user makes and
Determine the validity of the identified micro- expression of brain control, the brain control instruction generates and sending module is effective for comparing and matching
Brain control corresponding to the micro- expression of brain control instructs and the instruction is sent to controlled device.
9. a kind of asynchronous real-time brain control system by the micro- expression EEG signals driving of weak Muscle artifacts according to claim 8,
It is characterized by: the sampling period of the EEG signals is 100~150ms, with the EEG signals obtained in the single sampling period
For signal source, the Muscle artifacts energy accounting of the signal source deutocerebrum prefrontal cortex channel signal is calculated, when the energy accounting
When in certain threshold interval, then judge user's facial expression for the micro- expression of brain control.
10. a kind of asynchronous real-time brain control system by the micro- expression EEG signals driving of weak Muscle artifacts according to claim 9,
It is characterized by: the micro- expression of brain control be selected from mention eyebrow, frown, a left side is curled one's lip, the right side is curled one's lip, is smiled, mouth of beeping, is opened one's mouth, gritting one's teeth or quiet
Breath, threshold interval are specified in 5%~50% range by user；During validity determines, if the micro- expression of brain control is in continuous n brain
The recognition result in electric signal sampling period is consistent, then is judged as the effective micro- expression of brain control.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910087028.6A CN109901711B (en) | 2019-01-29 | 2019-01-29 | Asynchronous real-time brain control method driven by weak myoelectricity artifact micro-expression electroencephalogram signals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910087028.6A CN109901711B (en) | 2019-01-29 | 2019-01-29 | Asynchronous real-time brain control method driven by weak myoelectricity artifact micro-expression electroencephalogram signals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109901711A true CN109901711A (en) | 2019-06-18 |
| CN109901711B CN109901711B (en) | 2020-06-19 |
Family
ID=66944481
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910087028.6A Active CN109901711B (en) | 2019-01-29 | 2019-01-29 | Asynchronous real-time brain control method driven by weak myoelectricity artifact micro-expression electroencephalogram signals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109901711B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111611860A (en) * | 2020-04-22 | 2020-09-01 | 西南大学 | Micro-expression occurrence detection method and detection system |
| US11707233B1 (en) | 2022-12-16 | 2023-07-25 | Wisear | Simultaneous sub-Nyquist acquisition of a plurality of bioelectric signals |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923392A (en) * | 2010-09-02 | 2010-12-22 | 上海交通大学 | Asynchronous brain-computer interactive control method for EEG signal |
| CN102886102A (en) * | 2012-09-25 | 2013-01-23 | 深圳英智科技有限公司 | Mirror movement neuromodulation system |
| CN103494609A (en) * | 2013-10-16 | 2014-01-08 | 南京麦澜德医疗科技有限公司 | Method for indicating electromyographic signal interference and method for removing interference |
| CN105853140A (en) * | 2016-03-24 | 2016-08-17 | 西安交通大学 | Visual motion evoked brain-controlled lower limb active and passive cooperative rehabilitation training system |
| CN108836319A (en) * | 2018-03-08 | 2018-11-20 | 义乌市杰联电子科技有限公司 | A kind of nervous feedback system of fusion individuation encephalomere rule ratio and forehead myoelectricity energy |
-
2019
- 2019-01-29 CN CN201910087028.6A patent/CN109901711B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923392A (en) * | 2010-09-02 | 2010-12-22 | 上海交通大学 | Asynchronous brain-computer interactive control method for EEG signal |
| CN102886102A (en) * | 2012-09-25 | 2013-01-23 | 深圳英智科技有限公司 | Mirror movement neuromodulation system |
| CN103494609A (en) * | 2013-10-16 | 2014-01-08 | 南京麦澜德医疗科技有限公司 | Method for indicating electromyographic signal interference and method for removing interference |
| CN105853140A (en) * | 2016-03-24 | 2016-08-17 | 西安交通大学 | Visual motion evoked brain-controlled lower limb active and passive cooperative rehabilitation training system |
| CN108836319A (en) * | 2018-03-08 | 2018-11-20 | 义乌市杰联电子科技有限公司 | A kind of nervous feedback system of fusion individuation encephalomere rule ratio and forehead myoelectricity energy |
Non-Patent Citations (4)
| Title |
|---|
| ZHUFENG LU,XIAODONG ZHANG: "A Real-Time Brain Control Method Based on Facial Expression for Prosthesis Operation", 《2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO)》 * |
| 张驰: "基于脑电信号的情绪识别方法研究", 《中国优秀硕士学位论文全文数据库医药卫生科技辑》 * |
| 王洪涛: "混合脑机接口实现及其应用研究", 《中国博士学位论文全文数据库医药卫生科技辑》 * |
| 陆竹风: "基于表情辅助的假手脑控方法", 《中国机械工程》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111611860A (en) * | 2020-04-22 | 2020-09-01 | 西南大学 | Micro-expression occurrence detection method and detection system |
| CN111611860B (en) * | 2020-04-22 | 2022-06-28 | 西南大学 | Micro-expression occurrence detection method and detection system |
| US11707233B1 (en) | 2022-12-16 | 2023-07-25 | Wisear | Simultaneous sub-Nyquist acquisition of a plurality of bioelectric signals |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109901711B (en) | 2020-06-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101711709B (en) | Method for controlling electrically powered artificial hands by utilizing electro-coulogram and electroencephalogram information | |
| Rao et al. | Brain-computer interfacing [in the spotlight] | |
| CN106726030B (en) | Brain machine interface system and its application based on Clinical EEG Signals control robot movement | |
| CN103793058B (en) | A kind of active brain-computer interactive system Mental imagery classification of task method and device | |
| CN113398422B (en) | Rehabilitation training system and method based on motor imagery-brain-computer interface and virtual reality | |
| CN107957783A (en) | A kind of Multimode Intelligent control system and method based on brain electricity with myoelectric information | |
| CN107037883A (en) | A kind of mixing brain machine interface system and method based on Mental imagery | |
| CN101464728B (en) | Human-machine interaction method with vision movement related neural signal as carrier | |
| CN104398325B (en) | The device and method of brain-myoelectric-controlled prosthesis based on scene stable state vision inducting | |
| Nazarpour et al. | Application of higher order statistics to surface electromyogram signal classification | |
| CN106951064B (en) | Introduce the design of stable state vision inducting normal form and discrimination method of object continuous action | |
| Wei et al. | EMG and visual based HMI for hands-free control of an intelligent wheelchair | |
| CN111110982A (en) | Hand rehabilitation training method based on motor imagery | |
| CN102866775A (en) | System and method for controlling brain computer interface (BCI) based on multimode fusion | |
| CN106933353A (en) | A kind of two dimensional cursor kinetic control system and method based on Mental imagery and coded modulation VEP | |
| Su et al. | A biometric-based covert warning system using EEG | |
| Birch et al. | Brain-computer interface research at the Neil Squire Foundation | |
| CN112732090B (en) | Muscle cooperation-based user-independent real-time gesture recognition method | |
| CN107562191A (en) | The online brain-machine interface method of fine Imaginary Movement based on composite character | |
| CN109657560A (en) | Mechanical arm controls online brain-computer interface system and implementation method | |
| CN109901711A (en) | By the asynchronous real-time brain prosecutor method of the micro- expression EEG signals driving of weak Muscle artifacts | |
| Birch et al. | Current trends in brain-computer interface research at the Neil Squire Foundation | |
| CN113101021B (en) | Mechanical arm control method based on MI-SSVEP hybrid brain-computer interface | |
| Cososchi et al. | EEG features extraction for motor imagery | |
| CN106267551B (en) | The wearable facial paralysis of intelligence synchronizes Motor stimulation equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |