CN101464729A - Independent desire expression method based on auditory sense cognition neural signal - Google Patents
Independent desire expression method based on auditory sense cognition neural signal Download PDFInfo
- Publication number
- CN101464729A CN101464729A CNA2009100762080A CN200910076208A CN101464729A CN 101464729 A CN101464729 A CN 101464729A CN A2009100762080 A CNA2009100762080 A CN A2009100762080A CN 200910076208 A CN200910076208 A CN 200910076208A CN 101464729 A CN101464729 A CN 101464729A
- Authority
- CN
- China
- Prior art keywords
- wish
- code book
- voice
- index
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
Abstract
A method based on auditory cognitive neural signals for autonomously expressing willingness relates to the fields of the assistance to the disabled, and the human-computer interaction. The method is characterized in that the method comprises the following steps: inputting the required willingness code book into a computer, wherein, a speech index is short Chinese and English, or digital speech, and an index content is the speech on completely expressing willingness; arranging an EEG detect electrode at a posterior position of the top of the head of a user; using a computer to repeatedly play a voice sequence consisting of codebook index speech in a random order; noticeably choosing the index speech corresponding with the target willingness should and conducting the identification of sound properties; using an EEG amplifier to record brain waves; aligning the brain waveforms in a segmenting manner according to the time starts of the index speech; detecting whether the late positive components (LPC) and the relevant characteristic waveforms exists or not; defining brain waves which has characteristic waveforms as a target index, tracking down the corresponding the index content through the willingness codebook; and playing the corresponding speech expressing willingness through an audible device.
Description
Technical field
The invention belongs to disabled person's servicing unit and field of human-computer interaction.The present invention is converted into voice output by extracting user's auditory sense cognition neural signal, can help the individuals with disabilities and the external world to link up effectively.In addition, also can be used for exploitation based on the man-machine interaction electronic entertainment system of nerve signal.
Background technology
In modern society, numerous disease all will cause patient's language motor function to be degenerated, until the forfeiture wish express and with the ability of extraneous communication exchange, (claim neuron gradually to freeze disease again as withering property of flesh lateral sclerosis disease, ALS), apoplexy, brain paralysis etc., had a strong impact on this type of patient's quality of life.By the high speed development of Neuscience and computer technology, increasing achievement in research be applied to helping this type of disabled patient rebuild that wish is expressed and with the channel of extraneous communication exchange, thereby improve individuals with disabilities's quality of life.Wherein, the development based on the man-machine interactive system of nerve signal is particularly rapid.The independent desire expression system based on auditory sense cognition neural signal that the present invention proposes can help the individuals with disabilities and the external world to link up effectively.This system can also be applied to the electronic entertainment field.Man-machine interaction electronic entertainment based on nerve signal is a kind of experience sense and interesting emerging entertainment way of being rich in.Utilize the nerve signal direct game, not only novel interesting, also have potential intelligence facilitation.
On the traditional sense, it is very limited that the individuals with disabilities of forfeiture language motor function expresses the mode of wish, such as use slightly can be movable deformed limb touching object, other people's simple problem is made action nictation expression "Yes" or "No" and is carried out eye movement etc.The expressed wish of these modes is very fuzzy, and for most of handicap personage, the any slight movement that comprises nictation all can't carry out, and connects extraneous channel and is cut off fully, must could rebuild and the extraneous path that exchanges by other backup system.
Human-computer interaction technology based on nerve signal is widely used in disabled person's servicing unit and the electronic entertainment field in recent years.This technology combines the newest fruits of aspects such as Neuscience, microelectronics and computer information processing, the nervous activity of directly extracting brain, and real time translation becomes control command, controls artificial limb, computer mouse, keyboard, sound equipment etc.Man-machine interactive system based on nerve signal comprises three ingredients usually: the collection of 1 signal and record.The acquisition mode of nerve signal has multiple: electroencephalogram (EEG), and cerebral cortex potential diagram (ECoG), magneticencephalogram (MEG) etc., the most frequently used is electroencephalogram; 2 signal processings.Extract user's consciousness from nerve signal, and by transfer algorithm the user's of input nerve signal is converted to the output order of control external unit, this is the core procedure of total system.3 control external units.Consciousness according to the user drives external unit, thus the motion and the ability to exchange of alternate user forfeiture.In addition, suitable result's feedback also often is introduced into this type systematic, to accelerate user's skill level, reaches better result of use.
At present, utilization utilizes the visual stimulus normal form to realize based on the human-computer interaction technology of nerve signal more widely.The user watches the sensation target on the screen attentively, thereby induces corresponding nerve signal, again by the analysis to the optic nerve signal, extracts user's wish.But, for a large amount of handicap personages, the visual performance serious degradation, the effect of visual stimulus normal form is very limited.Therefore, need seek that other sensory stimuli comes the inducing neural signal beyond the vision, thereby help the handicap personage of those Loss Of Visions independently to express wish.Generally speaking, the individuals with disabilities that vision is limited, its auditory function is very sound toward contact, so, have meaning based on the man-machine interactive system of acoustic stimuli normal form inducing neural signal.
Late period positive composition current potential (Late Positive Component LPC) is a kind of brain electric potential, and comprise a plurality of subconstiuents for stimulating initial back 300ms to 800ms latent period.LPC comes from the senior cortical activity of brain, and is relevant with process such as people's cognition, attention, intelligence, and the reflection brain is for the active response of environmental stimuli.Studies have shown that the not influence of irriate attribute and probability of LPC, so classical nerve signal P300 has superiority.Utilizing LPC to carry out independent desire and express, is a kind of whole new set of applications to the LPC current potential.
Chinese patent (01129935.5) " video music elextroencephalic biologic feedback method ", issued a kind of biofeedback therapy based on the brain electricity, after it is characterized in that electroencephalogram by the electroencephalogram acquisition mode collection of standard enters computing machine, E.E.G becomes the characteristic time sequence data through signature analysis, directly produce corresponding Brain Bites, or the graph image and the music that control and adjust by the computing machine generation reach feedback training.This system has adopted brain electric nerve signal to be used as the foundation of Control and Feedback, is spontaneous brain electricity but it adopts, can not express user's active wish, and only not be to use a kind of reaction of person's current state, and certain limitation is arranged.
Chinese patent (00815134.2) " based on control method and system and sensory testing's method and system of brain electricity steady-state induced response " has been issued a kind of control method based on vision induced EEG signals.This system can generate one or more visual stimulus signal that changes with different frequency, can be experienced by human body, by detection be excited human body EEG signals and analyze, therefrom extract and the corresponding feature physical quantity of a certain stimulation signal frequencies, control corresponding device thus and carry out a promptly fixed operation.This system has adopted the brain electric nerve signal that brings out, and can express user's independent desire, and still, what it adopted is the vision inducting brain electricity, and the visual stimulus meeting causes user's visual fatigue for a long time, produces discomfort, and certain limitation is arranged.
The independent desire expression system based on auditory sense cognition neural signal that the present invention proposes is a kind of brand-new man-machine interactive system based on acoustic stimuli normal form inducing neural signal.Native system uses the stimulus signal of the pure sense of hearing, the user makes a response to stimulus signal according to independent desire, system is by analysis and processing to user's nerve signal (mainly being LPC), extract user's wish, and express via the computing machine synthetic speech, substitute the ability to exchange of user's forfeiture.Owing to only adopt the acoustic stimuli signal, do not need display, the portability of system is improved, and simultaneously, is difficult for causing visual fatigue.Therefore, the present invention has very big theoretical research and practical application meaning.
Summary of the invention
The objective of the invention is to provides a kind of independent desire expression system based on the nerve signal that is brought out by acoustic stimuli for the individuals with disabilities.This system also can be applicable to the electronic entertainment field.
The invention is characterized in that this method contains following steps successively:
Step 31, according to the voice of random sequence repeat playing code book index correspondence, the time interval of adjacent two voice units is the random value of 50ms to 250ms, in this voice sequence with the corresponding code book index voice of user's wish content to be expressed, be called target stimulation, other is a non-target stimulation;
Step 32, the user makes initiatively psychoreaction to the target stimulation of the target wish correspondence heard, and produces corresponding neural response signal in brain wave;
Step 33, computing machine is after receiving brain wave, stimulate each index voice the brain wave type that is brought out to align according to the start time that voice begin, employing comprises the signal Enhancement Method of filtering, coherence average, and any sorting technique that comprises crest extraction method, area extraction method, support vector method, analyze wherein whether there is positive composition LPC and relevant composition thereof in late period;
Step 34, computing machine pick out by said method corresponding late period positive composition LPC maximum index voice, by expressing the voice code book of wish described in the finding step 1, obtain corresponding complete voice content, play back by audio amplifier, be the current target wish that will express of user;
The input information of computer system in this method:
(1) the wish code library information that is used to express experimenter's wish pre-deposits computing machine 4.The wherein Chinese individual character or the digital speech of the code book index correspondence of wish option, and the complete statement voice of code book content correspondence deposit respectively, the former constitutes acoustic stimuli sequence 2, and the latter is used for sound result output 5.
(2) each wish code library 1 numbering that needs input to choose of using, for example represent the code library of direction wish, the wish option that wherein comprises have " on ", D score, " left side ", " right side ", " in ".
The output information of computer system:
Computing machine is play the code book content intact voice of this wish option according to the wish option of the current wish correspondence of user by audible device.
Through experimental verification, the present invention has the following advantages:
(1) adopts the stimulus modality of the pure sense of hearing, do not rely on user's visual performance, good applicability is arranged, be difficult for causing visual fatigue simultaneously for the handicap personage of the ability of blinding.
(2) abandon obligato display screen in the visual stimulus pattern, only can send stimulus sequence and feedback result by earphone and Miniature acoustics, system is more portable.
(3) adopt the LPC that the target stimulation active response brought out by the user as characteristic of division, the not influence of irriate attribute uses classical P300 current potential to have superiority.
(4) this form of make code constitutes stimulus sequence with brief voice individual character, improves the speed that the user expresses wish, as the output result, makes the user express the more approaching daily interchange of wish with the complete statement of correspondence.
(5) adopting the eeg recording method, is not have the harmless method of wound.
Description of drawings
Fig. 1 illustrates the independent desire expression system block diagram based on auditory sense cognition neural signal;
Fig. 2 illustrates brain wave data and handles block diagram;
Fig. 3 illustrates brain wave testing result example;
Fig. 4 illustrates the computer program process flow diagram.
Embodiment
Late period positive composition current potential (Late Positive Component LPC) is a kind of brain electric potential, and comprise a plurality of subconstiuents for stimulating initial back 300ms to 800ms latent period.LPC comes from the senior cortical activity of brain, and is relevant with process such as people's cognition, attention, intelligence, and the reflection brain is for the active response of environmental stimuli.The LPC current potential that adopts in the native system is meant user's positive wave in late period at its scalp record when target stimulation is carried out active response.Studies have shown that the not influence of irriate attribute and probability of LPC, so, the active response that it can the user makes any target stimulation utilized.
Constitute acoustic stimuli sequence 2 according to the wish option index in the selected wish code library 1 and send to the user, the user's that records eeg data 3 is analyzed, extract the LPC potential waveform.And by the LPC waveform of all sub-codebook correspondences of contrast, judge user's target wish,, realize that user's independent desire is expressed by exporting complete wish statement.
Concrete enforcement of the present invention comprises following key step:
The foundation of 1 wish code library
State or the actual demand current according to the user, selection may comprise the code library of the current wish of user.Wish code library 1 can be selected in existing code library, also can generate personalized code library according to the special applications scope.Each wish code library 1 comprises several wish options.A wish option is made of two parts: code book index and code book content.Code book index is a Chinese and English individual character or the numeral that can represent certain wish, and the code book content is a complete statement of expressing corresponding wish, and code book index and code book content all have its corresponding voice in sound bank.Wish option number in each wish code library can be arbitrary number.
For example, the code book index of the wish option that a certain code library comprises has " starving ", " yearningly ", " heat ", " cold ", " aching ", " itching " etc., and then the code book content of corresponding sub-codebook is " I am hungry, and I want to have a meal ", " I am thirsty, and I want to drink water " waits.
The generation of 2 acoustic stimuli sequences and broadcast
For example, the index voice that comprises the wish option in the code library " is starved ", " yearningly ", " heat ", " cold ", " aching ", " itching ", and then acoustic stimuli sequence presents the voice sequence of formation at random repeatedly for these index voices.The target wish of supposing the user is " starving ", then it makes the psychoreaction of "Yes" when hearing that at every turn target stimulation sound " is starved ", perhaps judge the attribute that stimulates sound " to starve " at once, for example be male voice or schoolgirl, perhaps sound is from Left or right, and other several non-target stimulations are not done reaction.
3 eeg recordings
On scalp, lay electrode for encephalograms, obtain electroencephalogram by brain tele-release bigger device.Send the type number that sends synchronizing signal and stimulation when stimulating to eeg collection system 3, write down the digitizing EEG signals, and eeg data is sent into the extraction part of LPC current potential.The position of electrode for encephalograms is relevant with the space topography profile of user LPC composition, studies have shown that, for most of user, leads for good with Pz or P3.The data that record at first will be carried out pre-service, mainly comprise filtering, remove baseline wander and reduce the electric artefact of eye.The purpose of filtering is to remove low frequency wonder and high frequency interference, mainly is that the power frequency of getting rid of 50Hz is disturbed, and therefore adopts bandpass filtering usually, and low side is generally 0.05～0.5Hz, the high-end 10～15Hz that is generally.(this part brain tele-release big and record mostly be prior art)
The extraction of 4 signature waveforms:
Extract corresponding LPC current potential respectively according to different wish options, obtain the LPC potential waveform feature of each wish option correspondence.The enhancing of LPC current potential has many kinds of methods, and classical way is the coherence average method.The coherence average method is that alignment averages to stimulate constantly with every group brain electric potential.Signal after the enhancing, its LPC potential waveform feature can be obtained by dual mode,
1) crest extraction method is promptly so that (amplitude difference of minimum point of 300ms-700ms) and peak is as the LPC waveform character in the LPC window.Whether have that this amplitude difference has bigger difference under the LPC situation.
2) area extraction method, promptly with the area that curve is surrounded in the LPC window as the LPC waveform character.Whether have this area meeting of LPC far short of what is expected, can be a bulk of positive area because LPC occurs.
5 identifications and transmission user's subjective desire
From above-mentioned processing, obtain the LPC waveform character of each wish option correspondence in the code library.Because the user makes the active psychoreaction of "Yes" to the target stimulation of the target wish correspondence heard, so the LPC waveform character of the correspondence of target stimulation is extremely obvious, and the user does not do psychoreaction to non-target stimulation, so the LPC waveform character of non-target stimulation correspondence is not obvious or think and do not have LPC.Compare the LPC waveform character of each wish option correspondence, the wish option of LPC waveform character the most obvious (amplitude difference maximum or area maximum) promptly is judged as the target wish.Computing machine 4 calls the code book content statement of this wish option from sound bank, send to user and the external world (other personages), finishes the external expression of user's independent desire.
6 Adjustment System parameters are provided with
If in the operation, the accuracy of described system expression user wish is undesirable, then showing does not have the experimenter to want the wish of expressing in the current code library, and perhaps the parameter configuration of system is not suitable for current experimenter.Therefore, need changing code library, perhaps according to experimenter's situation, revise the parameter configuration of system, mainly is the electrode position of leading and the scope of LPC time window.Again carry out the wish expression after finishing described correction.
Specific embodiment
Use this method, realize that comprises the independent desire expression system that five positions is selected, system forms as Fig. 1.
Selected code library comprises 5 wish options altogether, code book index is respectively: " on ", D score, " left side ", " right side ", " in ", corresponding code book content is: " please move up ", " please move down " " please be moved to the left ", " please move right " and " please moving " to the centre.From sound bank, call " on ", D score, " left side ", " right side ", " in " five individual character voice, random alignment constitutes acoustic stimuli sequence 2, and each holophrastic speech duration of a sound degree is unified to be 250ms.Each sub-codebook index voice all will repeat five times at random, and promptly this acoustic stimuli sequence 2 comprises 25 individual character voice altogether.The stochastic distribution that is spaced apart 50ms to 250ms of adjacent two individual character voice.The target wish that the user will express is in the five positions option, such as " left side ".Then the user is when the target stimulation (i.e. " left side " these individual character voice) of the target wish correspondence of hearing, meditating " being exactly it " at heart waits any experimenter to be ready or naturally affirmation reaction, and other orientation voice are stimulated, do not do any psychoreaction.When computing machine 4 sends each individual character voice, send synchronizing signal and stimulus type numbering to eeg recording equipment 3, the each beginning that stimulates of mark on EEG signals is so that the brain of back electricity coherence average is handled.
Synchronous recording electroencephalogram during test is got Pz or P3 electrode in the standard brain electricity 10-20 lead system, and ear is a reference electrode, and ground electrode is at the forehead place.
The pre-service of EEG signals mainly comprises filtering, removes baseline wander and reduces the electric artefact of eye.The purpose of filtering is to remove low frequency wonder and high frequency interference, mainly is that the power frequency of getting rid of 50Hz is disturbed, and therefore adopts bandpass filtering usually, and low side is generally 0.05～0.5Hz, the high-end 10～15Hz that is generally.
Go baseline to handle after this, its objective is to make that respectively to lead the brain electricity all be stably substantially for zero-mean, this is particularly important when extracting the LPC current potential with coherence average.
The eye electricity is the most common artefact, and is rather obvious to the influence of EEG signals, the closer to the scalp frons, influences remarkable more.The simplest way that addresses this problem is to remove that time that comprises eye movement to stimulate corresponding data segment, promptly superposes once less during coherence average.
Next step is that each time stimuli responsive is done coherence average, to obtain bringing out relatively significantly current potential.With time reference point (stimulate the zero hour) alignment, each sample data sum-average arithmetic that again will be corresponding with the same time can be determined the estimation curve of induced response with a plurality of measured signals, and this method of estimation is called the coherence average algorithm.The coherence average algorithm can reduce the jamming power of spontaneous brain electricity signal.Carry out N time coherence average, will reduce to 1/N to spontaneous signal power.Thus, faint more induced response generally needs high more average time.
For extracting the LPC waveform character, need the average current potential that brings out is done quantitative test.More common method is aforesaid crest extraction method, area extraction method etc.Fig. 3 represents that for the result shows each wish option stimulates the LPC composition that brings out.If target stimulation is " left side ", then the LPC waveform character that wish option " left side " is corresponding is obviously in the LPC of other wish options waveform character.Relatively the LPC waveform character of each wish option correspondence is chosen the target wish that the most tangible wish option of LPC waveform character will be expressed as the user.Computing machine 4 calls the complete voice of this wish option from sound bank, play to user and other people, finishes the external expression of user's independent desire.For example, judge that the target wish is " left side ", then outwards send statement and " please be moved to the left ".
Claims (1)
1. based on the independent desire expression method of auditory sense cognition neural signal, it is characterized in that this method contains following steps successively:
Step 1, the voice code book that the user will express wish is set, wherein each wish option is made up of code book index and code book content two parts, code book index is the brief morpheme that comprises Chinese and English individual character or numeral, the code book content is a complete statement of expressing corresponding wish, and the corresponding voice of code book index and code book content all are stored in the computing machine;
Step 2, brain electrical testing electrode is placed on Pz or P3 position or near position after a while, the detected person crown, reference electrode is placed on detected person's ear, ground-electrode ground connection, the EEG signals that described each electrode obtains through amplify and mould/transformation of variables after be sent to the USB digital interface of computing machine;
Step 3, after the user started the program of expressing wish, described computing machine was handled according to the following steps:
Step 31, according to the voice of random sequence repeat playing code book index correspondence, the time interval of adjacent two voice units is the random value of 50ms to 250ms, in this voice sequence with the corresponding code book index voice of user's wish content to be expressed, be called target stimulation, other is a non-target stimulation;
Step 32, the user makes initiatively psychoreaction to the target stimulation of the target wish correspondence heard, and produces corresponding neural response signal in brain wave;
Step 33, computing machine is after receiving brain wave, stimulate each index voice the brain wave type that is brought out to align according to the start time that voice begin, employing comprises the signal Enhancement Method of filtering, coherence average, and any sorting technique that comprises crest extraction method, area extraction method, support vector method, analyze wherein whether there is positive composition LPC and relevant composition thereof in late period;
Step 34, computing machine pick out by said method corresponding late period positive composition LPC maximum index voice, by expressing the voice code book of wish described in the finding step 1, obtain corresponding complete voice content, play back by audio amplifier, be the current target wish that will express of user;
Step 4, if it is undesirable to express the accuracy of user's wish by the way, then showing does not have the experimenter to want the wish of expressing in the current code book, perhaps the parameter configuration of system is improper, therefore, needs to change code book, perhaps according to experimenter's situation, the parameter configuration of modification system, the position of leading comprising electrode and late period positive composition LPC time window scope, finish and carry out wish again after the described correction and express.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009100762080A CN101464729B (en) | 2009-01-05 | 2009-01-05 | Independent desire expression method based on auditory sense cognition neural signal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009100762080A CN101464729B (en) | 2009-01-05 | 2009-01-05 | Independent desire expression method based on auditory sense cognition neural signal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101464729A true CN101464729A (en) | 2009-06-24 |
| CN101464729B CN101464729B (en) | 2010-08-04 |
Family
ID=40805345
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009100762080A Active CN101464729B (en) | 2009-01-05 | 2009-01-05 | Independent desire expression method based on auditory sense cognition neural signal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101464729B (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102609618A (en) * | 2012-02-07 | 2012-07-25 | 清华大学 | Method for calculating brain asymmetric index based on information flow gain |
| CN102880656A (en) * | 2012-08-30 | 2013-01-16 | 苏州大学 | Method and system for decoding speech center, and lock with system |
| CN103077205A (en) * | 2012-12-27 | 2013-05-01 | 浙江大学 | Method for carrying out semantic voice search by sound stimulation induced ERP (event related potential) |
| CN103313653A (en) * | 2011-01-20 | 2013-09-18 | 唯听助听器公司 | Personal eeg monitoring device with electrode validation |
| CN105496404A (en) * | 2015-11-25 | 2016-04-20 | 华南理工大学 | Assessment method of auxiliary CRS-R scale auditory shock based on brain-computer interface |
| CN107024993A (en) * | 2017-05-05 | 2017-08-08 | 京东方科技集团股份有限公司 | interactive system, method and device |
| WO2017173721A1 (en) * | 2016-04-06 | 2017-10-12 | 中兴通讯股份有限公司 | Speech recognition method and device |
| CN108447504A (en) * | 2018-03-20 | 2018-08-24 | 校宝在线（杭州）科技股份有限公司 | A kind of oral evaluation method based on brain wave |
| WO2018205505A1 (en) * | 2017-05-11 | 2018-11-15 | 京东方科技集团股份有限公司 | Detecting device and detecting method |
| CN110278323A (en) * | 2018-03-13 | 2019-09-24 | 广东欧珀移动通信有限公司 | Network concealed management method and Related product |
| CN110333777A (en) * | 2019-05-20 | 2019-10-15 | 北京大学 | A kind of brain-machine interface method and system using endogenous frequency marker technology reflection brain brain signal |
| CN111419179A (en) * | 2013-11-07 | 2020-07-17 | 赛佛欧普手术有限公司 | System for detecting neurological function |
| CN111543949A (en) * | 2020-05-13 | 2020-08-18 | 北京航空航天大学 | Child ASD diagnosis device based on magnetoencephalogram and electroencephalogram |
| CN111639608A (en) * | 2020-06-02 | 2020-09-08 | 郑州大学 | Automatic labeling method and device, computer readable medium and electronic equipment |
| CN111681636A (en) * | 2020-06-16 | 2020-09-18 | 深圳市华创技术有限公司 | Technical term sound generation method based on brain-computer interface, medical system and terminal |
| CN112075945A (en) * | 2020-09-17 | 2020-12-15 | 浙江大学 | Consciousness detection method based on electro-oculogram signals under voice stimulation |
| CN113712560A (en) * | 2017-08-03 | 2021-11-30 | 墨尔本大学 | Medical device for sensing and or stimulating tissue |
| CN116269447A (en) * | 2023-05-17 | 2023-06-23 | 之江实验室 | Speech recognition evaluation system based on voice modulation and electroencephalogram signals |
-
2009
- 2009-01-05 CN CN2009100762080A patent/CN101464729B/en active Active
Cited By (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103313653A (en) * | 2011-01-20 | 2013-09-18 | 唯听助听器公司 | Personal eeg monitoring device with electrode validation |
| CN103313653B (en) * | 2011-01-20 | 2017-05-10 | T&W工程公司 | Personal eeg monitoring device with electrode validation |
| CN102609618B (en) * | 2012-02-07 | 2015-01-14 | 清华大学 | Method for calculating brain asymmetric index based on information flow gain |
| CN102609618A (en) * | 2012-02-07 | 2012-07-25 | 清华大学 | Method for calculating brain asymmetric index based on information flow gain |
| CN102880656A (en) * | 2012-08-30 | 2013-01-16 | 苏州大学 | Method and system for decoding speech center, and lock with system |
| CN102880656B (en) * | 2012-08-30 | 2015-03-25 | 苏州大学 | Method and system for decoding speech center, and lock with system |
| CN103077205A (en) * | 2012-12-27 | 2013-05-01 | 浙江大学 | Method for carrying out semantic voice search by sound stimulation induced ERP (event related potential) |
| CN111419179B (en) * | 2013-11-07 | 2023-04-07 | 赛佛欧普手术有限公司 | System for detecting neurological function |
| CN111419179A (en) * | 2013-11-07 | 2020-07-17 | 赛佛欧普手术有限公司 | System for detecting neurological function |
| CN105496404A (en) * | 2015-11-25 | 2016-04-20 | 华南理工大学 | Assessment method of auxiliary CRS-R scale auditory shock based on brain-computer interface |
| CN105496404B (en) * | 2015-11-25 | 2018-06-29 | 华南理工大学 | Appraisal procedure based on brain-computer interface auxiliary CRS-R scale Auditory Startles |
| WO2017173721A1 (en) * | 2016-04-06 | 2017-10-12 | 中兴通讯股份有限公司 | Speech recognition method and device |
| CN107024993A (en) * | 2017-05-05 | 2017-08-08 | 京东方科技集团股份有限公司 | interactive system, method and device |
| US11928982B2 (en) | 2017-05-05 | 2024-03-12 | Boe Technology Group Co., Ltd. | Interaction system, method and device |
| WO2018205505A1 (en) * | 2017-05-11 | 2018-11-15 | 京东方科技集团股份有限公司 | Detecting device and detecting method |
| US11216068B2 (en) | 2017-05-11 | 2022-01-04 | Boe Technology Group Co., Ltd. | Detection device and detection method |
| CN113712560A (en) * | 2017-08-03 | 2021-11-30 | 墨尔本大学 | Medical device for sensing and or stimulating tissue |
| CN110278323A (en) * | 2018-03-13 | 2019-09-24 | 广东欧珀移动通信有限公司 | Network concealed management method and Related product |
| CN108447504A (en) * | 2018-03-20 | 2018-08-24 | 校宝在线（杭州）科技股份有限公司 | A kind of oral evaluation method based on brain wave |
| CN110333777B (en) * | 2019-05-20 | 2020-11-20 | 北京大学 | Brain-computer interface method and system for reflecting brain signals by using endogenous frequency labeling technology |
| CN110333777A (en) * | 2019-05-20 | 2019-10-15 | 北京大学 | A kind of brain-machine interface method and system using endogenous frequency marker technology reflection brain brain signal |
| CN111543949A (en) * | 2020-05-13 | 2020-08-18 | 北京航空航天大学 | Child ASD diagnosis device based on magnetoencephalogram and electroencephalogram |
| CN111639608A (en) * | 2020-06-02 | 2020-09-08 | 郑州大学 | Automatic labeling method and device, computer readable medium and electronic equipment |
| CN111639608B (en) * | 2020-06-02 | 2023-09-01 | 郑州大学 | Automatic labeling method, automatic labeling device, computer readable medium and electronic equipment |
| CN111681636A (en) * | 2020-06-16 | 2020-09-18 | 深圳市华创技术有限公司 | Technical term sound generation method based on brain-computer interface, medical system and terminal |
| CN111681636B (en) * | 2020-06-16 | 2022-02-18 | 深圳市华创技术有限公司 | Technical term sound generation method based on brain-computer interface, medical system and terminal |
| CN112075945A (en) * | 2020-09-17 | 2020-12-15 | 浙江大学 | Consciousness detection method based on electro-oculogram signals under voice stimulation |
| CN116269447A (en) * | 2023-05-17 | 2023-06-23 | 之江实验室 | Speech recognition evaluation system based on voice modulation and electroencephalogram signals |
| CN116269447B (en) * | 2023-05-17 | 2023-08-29 | 之江实验室 | Speech recognition evaluation system based on voice modulation and electroencephalogram signals |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101464729B (en) | 2010-08-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101464729B (en) | Independent desire expression method based on auditory sense cognition neural signal | |
| Pfurtscheller et al. | Human brain-computer interface | |
| CN109656365B (en) | Brain-computer interface method and system based on real-time closed-loop vibration stimulation enhancement | |
| CN101464728B (en) | Human-machine interaction method with vision movement related neural signal as carrier | |
| CN106569604B (en) | Audiovisual bimodal semantic matches and semantic mismatch collaboration stimulation brain-machine interface method | |
| CN109893093A (en) | A kind of state of consciousness detection system for implicitly watching brain-computer interface attentively | |
| CN112488002B (en) | Emotion recognition method and system based on N170 | |
| CN109247917A (en) | A kind of spatial hearing induces P300 EEG signal identification method and device | |
| Dan et al. | An identification system based on portable EEG acquisition equipment | |
| CN109657560A (en) | Mechanical arm controls online brain-computer interface system and implementation method | |
| CN111000556A (en) | Emotion recognition method based on deep fuzzy forest | |
| CN109567936B (en) | Brain-computer interface system based on auditory attention and multi-focus electrophysiology and implementation method | |
| CN108491792B (en) | Office scene human-computer interaction behavior recognition method based on electro-oculogram signals | |
| Van Kokswijk et al. | Self adaptive BCI as service-oriented information system for patients with communication disabilities | |
| Xing et al. | The development of EEG-based brain computer interfaces: potential and challenges | |
| Kjaer et al. | A brain-computer interface to support functional recovery | |
| Cabrera | Feature extraction and classification for brain-computer interfaces | |
| Zakrzewski et al. | VR-oriented EEG signal classification of motor imagery tasks | |
| Xu et al. | Emotional recognition of EEG signals based on fractal dimension | |
| Ashari et al. | Design and simulation of virtual telephone keypad control based on brain computer interface (BCI) with very high transfer rates | |
| Kazi et al. | Image Retrieval and Interested Image Detection for thought processing using EEG Signals | |
| Zhang et al. | Analysis and classification for single-trial EEG induced by sequential finger movements | |
| CN103623504A (en) | Electroencephalo-graph language barrier recovery apparatus | |
| Sibilano et al. | Brain–Computer Interfaces | |
| Hui | Brain-Computer Interface: Use of Electroencephalogram in Neuro-Rehabilitation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |