CN106354270A - Mobile head-mounted terminal and system based on brain-computer interface - Google Patents
Mobile head-mounted terminal and system based on brain-computer interface Download PDFInfo
- Publication number
- CN106354270A CN106354270A CN201610997907.9A CN201610997907A CN106354270A CN 106354270 A CN106354270 A CN 106354270A CN 201610997907 A CN201610997907 A CN 201610997907A CN 106354270 A CN106354270 A CN 106354270A
- Authority
- CN
- China
- Prior art keywords
- terminal
- user
- brain
- display
- head
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Dermatology (AREA)
- Neurosurgery (AREA)
- Neurology (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a mobile head-mounted terminal and system based on a brain-computer interface, and relates to the technical field of brain-computer interfaces. The mobile head-mounted terminal comprises a head-mounted device and a plurality of electrodes, wherein the head-mounted device comprises a fixing belt and a fixing frame which are connected with each other; the fixing belt is used for mounting the plurality of electrodes onto different positions of the head of a user; the fixing frame is used for fixing a display and voice broadcast terminal; and the electrodes are used for obtaining a brain electricity signal of the user in real time after being connected with the display and voice broadcast terminal, and sending the brain electrical signal to the display and voice broadcast terminal, so that characters to be expressed by the user are broadcast according to the brain electrical signal through the display and voice broadcast terminal. According to the mobile head-mounted terminal provided by the invention, the characters to be expressed by the user are broadcast through the display and voice broadcast terminal to assist expression of the deaf and the mute; and moreover, the mobile head-mounted terminal is convenient to use, is low in cost, and is convenient to popularize and apply.
Description
Technical field
The present invention relates to brain-computer interface technical field, worn based on the removable of brain-computer interface in particular to a kind of
Terminal and system.
Background technology
Deaf mute due to cannot clearly hear external sound and can not smooth acquisition information, also have no way of expressing the meaning of oneself
Be willing to, therefore with extraneous communication exchange during there is many obstacles.Wish the same with normal person convenient freely and extraneous
Interact, be the hope of each deaf mute.
The information technology of existing auxiliary deaf mute can be divided into three levels: is non-perturbation technique, such as " sign language first
Synthesis " and " Sign Language Recognition " technology；Next to that half perturbation technique, by the way of wearing auxiliary equipment, such as ossiphone
And osophone；The third is interference technology, needs to carry out a certain degree of store period, such as artificial ear to human body
Snail.But above- mentioned information technology there is a problem of using inconvenient or with high costs it is impossible to meet the requirement of deaf mute.
For above-mentioned auxiliary deaf mute information technology exist using problem inconvenient or with high costs, at present not yet
Effective solution is proposed.
Content of the invention
In view of this, it is an object of the invention to provide a kind of wear terminal and system based on the removable of brain-computer interface,
Auxiliary deaf mute's exchange, easy to use and cost is relatively low.
In a first aspect, embodiments provide a kind of terminal is worn based on the removable of brain-computer interface, comprising: wear
Device and multiple electrodes；This head-wearing device includes the fixing band being connected to each other and fixed mount；Fixing band is used for above-mentioned multiple electricity
Pole is placed to the diverse location of user's head；Fixed mount is used for fixing display and voice broadcast terminal；Above-mentioned electrode is used for and shows
Show after being connected with voice broadcast terminal, the EEG signals of user in real, this EEG signals is sent to display and broadcasts with voice
Report terminal, so that display plays, according to EEG signals, the word that user to be expressed with voice broadcast terminal.
In conjunction with a first aspect, embodiments providing the first possible embodiment of first aspect, wherein, many
Individual electrode is 12, corresponds respectively to the metopion of user's head, E Ding midpoint, central point, top pillow midpoint, summit, pillow point, a left side
Rest the head on behind top, left back pillow, left pillow, right pillow, You Ding and the right side；Or, multiple electrodes are 8, correspond respectively in the volume of user's head
Point, central point, summit, pillow point, Zuo Ding, left pillow, right pillow and right top.
In conjunction with the first possible embodiment of first aspect or first aspect, embodiments provide first party
The possible embodiment of the second in face, wherein, fixed mount includes face-piece and pedestal；This pedestal is curved, and when wearing with
Face's contact of user；This face-piece and pedestal are detachably connected；At least one of face-piece and pedestal are provided with locking member, this locking
Part is used for fixing display and voice broadcast terminal.
In conjunction with the first possible embodiment of first aspect or first aspect, embodiments provide first party
The third possible embodiment in face, wherein, fixing band includes annulus and heading tape, and above-mentioned multiple electrodes are separately fixed at annulus
With the precalculated position of heading tape, to gather the p300 EEG signals of user.
In conjunction with the first possible embodiment of first aspect or first aspect, embodiments provide first party
The 4th kind of possible embodiment in face, wherein, head-wearing device is vr glasses.
Second aspect, the embodiment of the present invention also provides a kind of system based on brain-computer interface, comprising: display and voice broadcast
Terminal and first aspect and its each possible the removable of embodiment offer wear terminal, and this display is solid with voice broadcast terminal
It is scheduled on removable wearing in terminal.
In conjunction with second aspect, embodiments provide the first possible embodiment of second aspect, wherein, show
Show and include display screen, processor, photographic head and speaker with voice broadcast terminal；Processor is used for receiving EEG signals, and root
Determine the word that user to be expressed according to EEG signals, controlling loudspeaker plays word；Photographic head be used for gathering external image and by
Display screen shows.
In conjunction with the first possible embodiment of second aspect or second aspect, embodiments provide second party
The possible embodiment of the second in face, wherein, display screen is additionally operable to show inputting interface, and circulates in flicker inputting interface
Button, in a cycle period, button does not repeat to flash at random；Whether the EEG signals that processor is additionally operable to according to user are big
Determine that user is intended to the button of selection in threshold potential, and carry out respective operations according to the button of this selection.
In conjunction with second aspect, embodiments provide the third possible embodiment of second aspect, wherein, show
Show and also include mike with voice broadcast terminal, this mike is used for gathering voice；Display screen is additionally operable to show that voice is corresponding
Word.
In conjunction with second aspect, embodiments provide the 4th kind of possible embodiment of second aspect, wherein, show
Show that with voice broadcast terminal be smart mobile phone.
The embodiment of the present invention brings following beneficial effect:
By head-wearing device, multiple electrodes are fixed to the diverse location of the head of user, gather the EEG signals of this user
And it is sent to display and voice broadcast terminal, thus the word that this user to be expressed is broadcast with voice broadcast terminal by this display
Quote, thus helping deaf mute to express, easy to use and low cost, easy to utilize.
Other features and advantages of the present invention will illustrate in the following description, and, partly become from description
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages are in description, claims
And in accompanying drawing specifically noted structure realizing and to obtain.
For enabling the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description
In order to be illustrated more clearly that the specific embodiment of the invention or technical scheme of the prior art, below will be to concrete
In embodiment or description of the prior art the accompanying drawing of required use be briefly described it should be apparent that, below describe in
Accompanying drawing is some embodiments of the present invention, for those skilled in the art, on the premise of not paying creative work,
Other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is the removable structural representation wearing terminal provided in an embodiment of the present invention；
Fig. 2 is the position view of the removable electrode wearing terminal use provided in an embodiment of the present invention；
Fig. 3 is that user provided in an embodiment of the present invention wears the removable schematic diagram wearing terminal；
Fig. 4 is the structured flowchart of the system based on brain-computer interface provided in an embodiment of the present invention；
Fig. 5 is the standard inputting interface schematic diagram of the system based on brain-computer interface provided in an embodiment of the present invention；
Fig. 6 is the quick inputting interface schematic diagram of the system based on brain-computer interface provided in an embodiment of the present invention；
Fig. 7 is the audition inputting interface schematic diagram of the system based on brain-computer interface provided in an embodiment of the present invention.
Icon:
100- may move and wears terminal；200- voice broadcast terminal；110- head-wearing device；120- electrode；111- fixing band；
112- fixed mount；211- face-piece；212- pedestal；310- smart mobile phone；311- annulus；312- heading tape.
Specific embodiment
Purpose, technical scheme and advantage for making the embodiment of the present invention are clearer, below in conjunction with accompanying drawing to the present invention
Technical scheme be clearly and completely described it is clear that described embodiment a part of embodiment that is the present invention, rather than
Whole embodiments.Based on the embodiment in the present invention, those skilled in the art institute under the premise of not making creative work
The every other embodiment obtaining, broadly falls into the scope of protection of the invention.
At present the information technology of auxiliary deaf mute exist using problem inconvenient or with high costs, based on this, this
A kind of bright the of embodiment offer wears terminal and system based on the removable of brain-computer interface, is used to help deaf mute's exchange, uses
Facilitate and cost is relatively low.
For ease of understanding to the present embodiment, first to a kind of disclosed in the embodiment of the present invention based on brain-computer interface
Removable wear terminal and describe in detail.
Embodiment one:
The embodiment of the present invention 1 provides a kind of wears terminal based on the removable of brain-computer interface.Brain-computer interface (brain-
Computer interface, bci) it is a kind of direct information set up between human brain and computer or other electronic equipments
Exchange and control passage, do not rely on conventional brain peripheral nervouss and musculature, directly in the electronic equipment such as human brain and computer
Between carry out communication and control.Bci system is related to two main aspects, be on the one hand the collection to EEG signals and
How to make the control signal that brain generation is easily distinguished and identifies；On the other hand it is computer how effective process signal, carry
Go out the feature of EEG signals and select to identify these features.Present embodiments provide and a kind of worn based on the removable of brain-computer interface
Terminal, specific as follows:
Include head-wearing device 110 and multiple electrodes 120, wherein head-wearing device 110 as shown in figure 1, may move and wearing terminal
Including the fixing band 111 being connected to each other and fixed mount 112.
Specifically, fixing band 111 is used for multiple electrodes 120 are placed to the diverse location of user's head. and fixed mount 112 is used
In fixing display and voice broadcast terminal (not shown)；After above-mentioned electrode 120 is used for being connected with voice broadcast terminal with display, real
When obtain user EEG signals, and by this EEG signals be sent to display with voice broadcast terminal so that display broadcast with voice
Report terminal plays, according to EEG signals, the word that user to be expressed.
Also show the concrete structure of fixed mount 112 in FIG, specifically include face-piece 211 and pedestal 212.Wherein pedestal
212 are preferably arc, are fitted with user face when using with facilitating, it is to avoid extraneous light is from the seam of pedestal 212 and face
Gap enters, the display effect of impact display and voice broadcast terminal.
Face-piece 211 and pedestal 212 are detachably connected, and specifically can be connected by modes such as buckle or screw threads.At least exist
One of face-piece 211 and pedestal 212 are provided with locking member, and this locking member is used for fixing display and voice broadcast terminal.
Also show the concrete structure of fixing band 111 in FIG, specifically include annulus 311 and heading tape 312, above-mentioned multiple
Electrode 120 is separately fixed at annulus 311 and the precalculated position of heading tape 312, to gather the p300 EEG signals of user.Wherein p300
It is a kind of Evoked ptential, be specific electrical activity produced by the visual stimulus that nervous system accepts under AD HOC, betide spy
The fixed time, it is distributed obvious in specific brain scalp region signal energy, relatively easy detection, being suitable for brain-computer interface should
With.User just can reach preferable effect without special training.In FIG, heading tape 312 is equal with annulus 311 and pedestal 212
It is connected it is possible to understand that heading tape 312 can be connected with one of both, only play the effect of fixed electrode.
Gather the electrode position of above-mentioned p300 EEG signals as shown in Fig. 2 because p300 EEG signals are by vision induced
Brain electricity washed, and the generation of vision is concentrated mainly on occipital lobe area, therefore selects in two rectangle frames in this electrode position schematic diagram
Including electrode.When using 12 passage (electrode be 12), electrode position includes: metopion (fz), E Ding midpoint (fcz),
Central point (cz), top pillow midpoint (cpz), summit (pz), pillow point (oz), left top (p3), left back pillow (p7), left pillow (o1), right pillow
(o2), rest the head on (p8) behind right top (p4) and the right side.When using 8 passage (electrode be 8), electrode position includes: metopion (fz), in
Centre point (cz), summit (pz), pillow point (oz), left top (p3), left pillow (o1), right pillow (o2) He Youding (p4).
Above-mentioned head-wearing device 110 can use vr glasses of the prior art (or referred to as vr helmet), general vr glasses bag
The annulus including covers above-mentioned rear occipital region just, and heading tape then covers above-mentioned E Ding area just, therefore can directly fix electrode
On above-mentioned annulus and heading tape, attractive in appearance succinct, it is suitable for actually used.Above-mentioned vr glasses can also include integrally manufactured with glasses and
The display sold is shown and voice broadcast terminal it is also possible to put into other as needed with voice broadcast terminal, for example intelligent handss
Machine etc..User as shown in Figure 3 wears the removable schematic diagram wearing terminal, which show smart mobile phone 310.
In addition to aforesaid way, fixed electrode can also be carried out using the head-wearing device specially making, or increase on vr glasses
It is fixed part etc., as long as meeting fixed electrode to the collection position of needs.
Removable in above-described embodiment 1 wears terminal, is worn on user's head, can be with the brain telecommunications of Real-time Collection user
Number, and it is sent to display and voice broadcast terminal, thus the word that this user to be expressed passes through this display with voice broadcast eventually
End is reported out, and above-mentioned terminal-pair help deaf mute carries out communication exchange to have great importance, easy to use and low cost, just
In popularization and application.
Embodiment two:
The embodiment of the present invention 2 provides a kind of system based on brain-computer interface, as shown in figure 4, including in above-described embodiment
The removable of offer wears terminal 100 and display and voice broadcast terminal 200, and this display is fixed with voice broadcast terminal 200
Wear in terminal 100 removable.
Specifically, display and voice broadcast terminal 200 include display screen, processor, photographic head and speaker；Processor is used
In reception EEG signals, and determine, according to EEG signals, the word that user to be expressed, controlling loudspeaker plays above-mentioned word；Shooting
Head is used for gathering external image and being shown by display screen.Therefore user can be able to pass through in the case of wearing said system
Photographic head and display screen see extraneous scene, can move freely, easy to use and flexible.
Further, display screen is additionally operable to show inputting interface, and circulates the button in flicker inputting interface, circulates at one
In cycle, button does not repeat to flash at random；Whether the EEG signals that processor is additionally operable to according to user determine more than threshold potential is used
Family is intended to the button of selection, and carries out respective operations according to the button of this selection.Now inputting interface is superimposed with extraneous scene and shows
Show, user can carry out above-mentioned input while observing extraneous (object of such as talk).
In view of the audition existing problems of deaf mute, in order to other people voice is converted into the shape that deaf mute is capable of identify that
Formula, display and voice broadcast terminal 200 also include mike, and this mike is used for gathering voice；Display screen is additionally operable to show language
The corresponding word of sound.
Above-mentioned head-wearing device 110 can use vr glasses of the prior art (or referred to as vr helmet), and display is broadcast with voice
Report terminal 200 can be display that is integrally manufactured with glasses and selling and sound broadcasting device or other intelligent terminal,
Such as smart mobile phone etc..Above-mentioned display be provided with voice broadcast terminal or intelligent terminal corresponding input judge soft
Part.
The use flow process of brain machine interface system introduced below:
Introduce standard input method first, below for example:
1st, user's open system, now acquiescence entrance observing pattern, photographic head opens simultaneously upper display collection on a display screen
The external image arriving, what user saw is exactly extraneous scene in real time.
2nd, when user needs to exchange with other people, input pattern can be switched to by modes such as entity button.Now
Display screen display inputting interface, as shown in figure 5, now extraneous scene and inputting interface Overlapping display, in order to represent clear reality
When extraneous scene be not shown.Hereafter it is introduced it is possible to understand that can also adopt taking nine grids spelling input method as a example
Take other input modes, for example qwerty keyboard, five-stroke input method, according to the tactic keyboard of English alphabet or its other party
Keyboard of formula arbitrary arrangement etc..Also show button and the function key of nine grids in Figure 5, function key specifically includes " really
Fixed ", " select word/quick " and " revocation/switch ", also show input frame simultaneously.
3rd, after entering inputting interface, point out countdown 3 seconds.After countdown terminates, button will enter line flicker.
In actual enforcement, the flicker of one-touch and pause can be set to a test and (use below trial table
Show).For example, each trial is set to time-consuming 150ms, this button will show a picture 75ms setting, and stops
75ms waits the flicker of next button.In the present embodiment that 11 buttons as shown in Figure 5 are respectively fixed through a trial
For a circulation (using below round to represent).In a round, 11 buttons will be not repeatedly each by random function
Through trial.Therefore one round is just by time-consuming 11*0.15s=1.65s.
User will at least experience first three round, and for ensureing that first three round of discrimination is must be through program, reason is
EEG signals, as a kind of complicated nonstationary random signal, need the accuracy rate of the superposition guarantee identification of necessary number of times,
The more accuracys rate of number of times are higher.In order to take into account the time of accuracy rate and input cost, herein by the way of three circulations, permissible
Understand is also enabled using other number of cycles.
4th, electrode by the eeg signal acquisition of user in above-mentioned round and is sent to the process showing with voice broadcast terminal
Device, will determine that whether detect the p300 current potential reaching threshold value by Bayes classifier.If it is determined that detecting, will by when
Between sequentially judge user input, complete the first round judge.The first round takes 3*1.65s=4.95s.Wherein Bayes classifier
Principle of classification is the prior probability by certain object, calculates its posterior probability using Bayesian formula, and that is, this object belongs to certain
The probability of one class, selects the class with maximum a posteriori probability as the class belonging to this object.Above-mentioned Bayes classifier has been simultaneously
Complete to be trained using sample.
If in the first round, 5 judge that system does not detect the current potential reaching threshold value, carry out the second wheel judgement.Process
Device will filter out front 5 buttons being most likely to be user input in the first round, and they are not repeated by random function
Ground is through trial.This 5 trial constitute a new round.After each round, system will be judged, if combined
First round data has p300 current potential to reach threshold value, and system will be inputted.So system is not carried out with regard to directly eliminating
Round, decreases the time that input needs.Second most 4 round of wheel, if still do not reached after this 4 round
To the p300 current potential of threshold value, system will export that most possible button.Under worst case, the time-consuming 0.15s*5*4 of the second wheel
=3s.
For example, " n " when inputting " brain ", first in input " nao ".Before being successfully entered, user need to give more sustained attention
Button with " mno ", notes the number of times of its flicker.(this input method is defined as standard input method by here) is so defeated
After entering " nao ", user is accomplished by selecting " brain " word in the alternative frame of words.If first character in alternative frame, i.e. acquiescence choosing
It is simply that " brain ", user just can select " determination " key be determined selecting word with establishing criteria input method for the word selected.If necessary to select
Select next word, user needs to select according to input method " select word/quick " button, selects word frame to will move to down after being connected to this instruction
One alternative word.User can will select word to frame shift to the word needing by that analogy, then pass through " determination " and determine input.
After having inputted " brain-computer interface " by that analogy, user can be read aloud by input " determination " key determination again.System
The words and phrases having inputted will be read aloud by speaker after being connected to this order, and bright read states are represented by the flicker of microphone mark.
So far complete the whole process that the EEG signals of user are converted into voice output, make deaf mute possess the ability of " saying ",
Achieve the purpose that deaf mute expresses oneself wish.
Next introduces shortcut input method, below for example:
1st, in user using front, most 8 of typing in advance words and phrases can fast be inputted.User can be carried by quick input
High input efficiency.
2nd, under input pattern interface, user passes through standard input method and inputs " select word/quick " to be switched to quick input
Pattern.8 buttons will be changed into numeral keys in such a mode, as shown in fig. 6, correspond to the sentence that 8 users pre-set respectively
Son or word.As: 1 key represents " hello " that user pre-sets.If necessary to input " hello ", user now can pass through
Memory, selects 1 key with standard input pattern.It is connected to instruction, in input frame, will appear from " hello " words and phrases.Afterwards, user can select
Select input " determination " directly to read aloud, or carry out other inputs by fast inputting or switching back into the pattern of typically entering, with
Input content constitutes words and phrases together and is read aloud.
Finally introduce audition method, below for example:
User, when needing to receive extraneous sound, can input revocation/switch key and be switched to listening mode.Now, it is
System will show audition mark and display box.After countdown 3 seconds after switching.System will open mike, and the voice heard is converted
Show in display box for text, the content in display box as shown in Figure 7 be " brain-computer interface, be in human brain and computer or
A kind of direct communication and control passage set up between other electronic equipments, does not rely on conventional brain peripheral nervouss and flesh
Meat system, directly carries out communication and control between the electronic equipment such as human brain and computer ".During audition conversion, listen phonetic symbol
Will will enter line flicker.As user need to stop audition, " determination " can be inputted.Switching back into input pattern needs to input " switching ".Logical
Cross the mode of audition, the dialogue of extraneous sound such as other normal persons is converted to word and shows on a display screen, make deaf
Mute possesses the ability of " listening ".Specific voice transform mode uses prior art, will not be described here.
The system based on brain-computer interface in above-described embodiment 2, can be with the p300 EEG signals of Real-time Collection user, concurrently
Give display and voice broadcast terminal, according to above-mentioned EEG signals, this display can determine that user is intended to express with voice broadcast terminal
Word and controlling loudspeaker plays above-mentioned word, and extraneous sound can be converted to by word by audition and be shown in
On display screen, make deaf mute possess " saying " and the ability of " listening ", have great importance to helping deaf mute to carry out communication exchange,
Easy to use and low cost, easy to utilize.
In addition, in the description of the embodiment of the present invention, unless otherwise clearly defined and limited, term " installation ", " phase
Even ", " connection " should be interpreted broadly, for example, it may be being fixedly connected or being detachably connected, or is integrally connected；Can
To be to be mechanically connected or electrical connection；Can be to be joined directly together it is also possible to be indirectly connected to by intermediary, Ke Yishi
The connection of two element internals.To those skilled in the art, above-mentioned term can be understood in the present invention with concrete condition
Concrete meaning.
If above-mentioned functions realized using in the form of SFU software functional unit and as independent production marketing or use when, permissible
It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words
Partly being embodied in the form of software product of part that prior art is contributed or this technical scheme, this meter
Calculation machine software product is stored in a storage medium, including some instructions with so that a computer equipment (can be individual
People's computer, server, or network equipment etc.) execution each embodiment methods described of the present invention all or part of step.
And aforesaid storage medium includes: u disk, portable hard drive, read only memory (rom, read-only memory), random access memory are deposited
Reservoir (ram, random access memory), magnetic disc or CD etc. are various can be with the medium of store program codes.
In describing the invention, it should be noted that term " " center ", " on ", D score, "left", "right", " vertical ",
The orientation of instruction such as " level ", " interior ", " outward " or position relationship are based on orientation shown in the drawings or position relationship, merely to
Be easy to describe the present invention and simplify description, rather than instruction or the hint device of indication or element must have specific orientation,
With specific azimuth configuration and operation, therefore it is not considered as limiting the invention.Additionally, term " first ", " second ",
" the 3rd " is only used for describing purpose, and it is not intended that indicating or hint relative importance.
Last it is noted that the specific embodiment of above example, the only present invention, in order to the skill of the present invention to be described
Art scheme, is not intended to limit, and protection scope of the present invention is not limited thereto, although entering to the present invention with reference to the foregoing embodiments
Go detailed description, skilled artisan would appreciate that: any those familiar with the art takes off in the present invention
In the technical scope of dew, it still can be modified to the technical scheme described in previous embodiment or can readily occur in change
Change, or equivalent is carried out to wherein some technical characteristics；And these modifications, change or replacement, do not make relevant art
Scheme essence depart from embodiment of the present invention technical scheme spirit and scope, all should cover protection scope of the present invention it
Interior.Therefore, protection scope of the present invention should be defined by scope of the claims.
Claims (10)
1. a kind of based on brain-computer interface removable wear terminal it is characterised in that include:
Head-wearing device and multiple electrodes；Described head-wearing device includes the fixing band being connected to each other and fixed mount；
Described fixing band is used for the plurality of electrode is placed to the diverse location of user's head；
Described fixed mount is used for fixing display and voice broadcast terminal；
After described electrode is used for being connected with voice broadcast terminal with described display, obtain the EEG signals of described user in real time, will
Described EEG signals are sent to described display and voice broadcast terminal, so that described display and voice broadcast terminal are according to described brain
The signal of telecommunication plays the word that described user to be expressed.
2. according to claim 1 may move wears terminal it is characterised in that the plurality of electrode is 12, right respectively
The metopion of user's head described in Ying Yu, E Ding midpoint, central point, top pillow midpoint, summit, pillow point, left top, left back pillow, left pillow,
Rest the head on behind right pillow, You Ding and the right side；Or,
The plurality of electrode is 8, corresponds respectively to the metopion of described user's head, central point, summit, pillow point, Zuo Ding, a left side
Pillow, right pillow and right top.
3. removable according to any one of claim 1-2 wears terminal it is characterised in that described fixed mount includes face
Shell and pedestal；
Described pedestal is curved, and contacts with the face of described user when wearing；
Described face-piece is detachably connected with described pedestal；
One of at least described face-piece and pedestal are provided with locking member, and described locking member is used for fixing described display and is broadcast with voice
Report terminal.
4. removable according to any one of claim 1-2 wears terminal it is characterised in that described fixing band includes ring
Band and heading tape, the plurality of electrode is separately fixed at the precalculated position of described annulus and heading tape, to gather the p300 of described user
EEG signals.
5. removable according to any one of claim 1-2 wears terminal it is characterised in that described head-wearing device is vr
Glasses.
6. a kind of system based on brain-computer interface is it is characterised in that include: display and voice broadcast terminal and claim 1-5
Any one of removable wear terminal, described display and voice broadcast terminal are fixed on described removable wears terminal
In.
7. brain-computer interface according to claim 6 system it is characterised in that
Described display includes display screen, processor, photographic head and speaker with voice broadcast terminal；
Described processor is used for receiving described EEG signals, and determines, according to described EEG signals, the literary composition that described user to be expressed
Word, controls described speaker to play described word；
Described photographic head is used for gathering external image and being shown by described display screen.
8. the brain-computer interface according to claim 6 or 7 system it is characterised in that described display screen be additionally operable to show defeated
Enter interface, and circulate the button flashing in described inputting interface, described button does not repeat to flash at random in a cycle period；
More than threshold potential, whether the EEG signals that described processor is additionally operable to according to described user determine that described user is intended to select
Button, and carry out respective operations according to the button of described selection.
9. the system of brain-computer interface according to claim 6 is it is characterised in that described display is also wrapped with voice broadcast terminal
Include mike, described mike is used for gathering voice；Described display screen is additionally operable to show the corresponding word of described voice.
10. the system of brain-computer interface according to claim 6 is it is characterised in that described display with voice broadcast terminal is
Smart mobile phone.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610997907.9A CN106354270A (en) | 2016-11-11 | 2016-11-11 | Mobile head-mounted terminal and system based on brain-computer interface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610997907.9A CN106354270A (en) | 2016-11-11 | 2016-11-11 | Mobile head-mounted terminal and system based on brain-computer interface |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106354270A true CN106354270A (en) | 2017-01-25 |
Family
ID=57862381
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610997907.9A Pending CN106354270A (en) | 2016-11-11 | 2016-11-11 | Mobile head-mounted terminal and system based on brain-computer interface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106354270A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106951081A (en) * | 2017-03-18 | 2017-07-14 | 福州大学 | A kind of implementation method of the brain control language acoustical generator based on P300 |
| WO2018201779A1 (en) * | 2017-05-05 | 2018-11-08 | 京东方科技集团股份有限公司 | Interaction system, method and device |
| CN109032365A (en) * | 2018-10-16 | 2018-12-18 | 米运田 | A kind of E.E.G participates in the apallic syndrome patient interaction instrument and exchange method of control |
| CN110221701A (en) * | 2019-06-25 | 2019-09-10 | 浙江大学 | A kind of virtual reality scenario user security guard method based on brain wave |
| CN110366086A (en) * | 2019-07-18 | 2019-10-22 | 河海大学常州校区 | Ossiphone auto gain control method based on brain electricity EEG |
| CN110393015A (en) * | 2017-02-10 | 2019-10-29 | 科利耳有限公司 | High-level manual's sound ear-training |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101571748A (en) * | 2009-06-04 | 2009-11-04 | 浙江大学 | Brain-computer interactive system based on reinforced realization |
| US20100082325A1 (en) * | 2009-11-16 | 2010-04-01 | Manuel-Devadoss Johnson Smith | Automated phonetic language translation system using Human Brain Interface |
| CN205594579U (en) * | 2016-03-22 | 2016-09-21 | 昆明理工大学 | Multi -functional wireless brain electricity cap |
| CN205643854U (en) * | 2016-03-31 | 2016-10-12 | 中山品创塑胶制品有限公司 | Virtual reality (VR) glasses |
-
2016
- 2016-11-11 CN CN201610997907.9A patent/CN106354270A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101571748A (en) * | 2009-06-04 | 2009-11-04 | 浙江大学 | Brain-computer interactive system based on reinforced realization |
| US20100082325A1 (en) * | 2009-11-16 | 2010-04-01 | Manuel-Devadoss Johnson Smith | Automated phonetic language translation system using Human Brain Interface |
| CN205594579U (en) * | 2016-03-22 | 2016-09-21 | 昆明理工大学 | Multi -functional wireless brain electricity cap |
| CN205643854U (en) * | 2016-03-31 | 2016-10-12 | 中山品创塑胶制品有限公司 | Virtual reality (VR) glasses |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110393015A (en) * | 2017-02-10 | 2019-10-29 | 科利耳有限公司 | High-level manual's sound ear-training |
| CN106951081A (en) * | 2017-03-18 | 2017-07-14 | 福州大学 | A kind of implementation method of the brain control language acoustical generator based on P300 |
| CN106951081B (en) * | 2017-03-18 | 2019-12-17 | 福州大学 | implementation method of brain-controlled speech generator based on P300 |
| WO2018201779A1 (en) * | 2017-05-05 | 2018-11-08 | 京东方科技集团股份有限公司 | Interaction system, method and device |
| US11928982B2 (en) | 2017-05-05 | 2024-03-12 | Boe Technology Group Co., Ltd. | Interaction system, method and device |
| CN109032365A (en) * | 2018-10-16 | 2018-12-18 | 米运田 | A kind of E.E.G participates in the apallic syndrome patient interaction instrument and exchange method of control |
| CN110221701A (en) * | 2019-06-25 | 2019-09-10 | 浙江大学 | A kind of virtual reality scenario user security guard method based on brain wave |
| CN110366086A (en) * | 2019-07-18 | 2019-10-22 | 河海大学常州校区 | Ossiphone auto gain control method based on brain electricity EEG |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106354270A (en) | Mobile head-mounted terminal and system based on brain-computer interface | |
| CN106445156A (en) | Method, device and terminal for intelligent home device control based on virtual reality | |
| CN105843383A (en) | Application starting device and application starting method | |
| CN107193841A (en) | Media file accelerates the method and apparatus played, transmit and stored | |
| US20160253831A1 (en) | Serial visual presentation for wearable displays | |
| US11930131B2 (en) | Systems and methods for controlling a mobile device cover | |
| CN104169838A (en) | Eye tracking based selectively backlighting display | |
| CN108337543A (en) | A kind of video broadcasting method, terminal and computer readable storage medium | |
| KR20110059349A (en) | Mobile terminal and operation control method thereof | |
| CN104636734A (en) | Terminal face recognition method and device | |
| CN108847012A (en) | Control method and relevant device | |
| CN109240639A (en) | Acquisition methods, device, storage medium and the terminal of audio data | |
| CN107995105A (en) | A kind of intelligent terminal with blind operation software | |
| CN108519811A (en) | Screenshot method and Related product | |
| CN206193690U (en) | Portable terminal and system of wearing based on brain -computer interface | |
| CN106302137A (en) | Group chat message processing apparatus and method | |
| CN106406537A (en) | Display method and device | |
| CN108923810A (en) | Interpretation method and relevant device | |
| CN105959348A (en) | Method and device for avoiding disturbance when prompt messages are pushed | |
| CN105824427A (en) | Method and system for volume adjustment on basis of gesture operation | |
| CN106339067A (en) | Control method and electronic equipment | |
| CN109036410A (en) | Audio recognition method, device, storage medium and terminal | |
| CN106850774A (en) | The environmental interaction system and method for virtual reality terminal | |
| CN108269460A (en) | A kind of reading method of electronic curtain, system and terminal device | |
| CN105278837B (en) | Read based reminding method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |