CN1776572A - Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves - Google Patents
Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves Download PDFInfo
- Publication number
- CN1776572A CN1776572A CN 200510126358 CN200510126358A CN1776572A CN 1776572 A CN1776572 A CN 1776572A CN 200510126358 CN200510126358 CN 200510126358 CN 200510126358 A CN200510126358 A CN 200510126358A CN 1776572 A CN1776572 A CN 1776572A
- Authority
- CN
- China
- Prior art keywords
- computer
- frequency
- mouse
- brain wave
- steady
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 210000004556 brain Anatomy 0.000 title claims abstract description 18
- 238000000034 method Methods 0.000 title claims abstract description 17
- 230000003993 interaction Effects 0.000 title description 7
- 230000000007 visual effect Effects 0.000 title description 6
- 230000000763 evoking effect Effects 0.000 title description 4
- 210000004761 scalp Anatomy 0.000 claims abstract description 7
- 230000005611 electricity Effects 0.000 claims 2
- 238000013507 mapping Methods 0.000 claims 1
- 230000002093 peripheral effect Effects 0.000 claims 1
- 239000002775 capsule Substances 0.000 abstract description 2
- 230000002452 interceptive effect Effects 0.000 abstract description 2
- 230000003321 amplification Effects 0.000 abstract 1
- 238000003199 nucleic acid amplification method Methods 0.000 abstract 1
- 238000004891 communication Methods 0.000 description 2
- 230000001537 neural effect Effects 0.000 description 2
- 230000000638 stimulation Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000010183 spectrum analysis Methods 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
Abstract
Description
技术领域technical field
本技术发明属于生物医学工程中神经工程学技术领域。The technical invention belongs to the technical field of neural engineering in biomedical engineering.
背景技术Background technique
有关人的脑神经和脑电科学的研究表明和证实,某种频率(5-50次/秒)的光的闪烁或运动的视觉刺激,在脑电(EEG)中能诱发同频率及其谐波成分的电信号。根据这一重要生理特征,提取若干频度视觉刺激的脑电信号,经过编码组合,即可生成多种或复杂的控制电信号。Studies on human brain nerves and EEG science have shown and confirmed that flickering of light of a certain frequency (5-50 times per second) or visual stimulation of movement can induce the same frequency and its harmonics in EEG. Wave components of electrical signals. According to this important physiological feature, the EEG signals of several frequency visual stimuli are extracted, and after encoding and combination, various or complex control electrical signals can be generated.
脑—机接口(Brain-Computer Interface,BCI)是神经工程、康复工程、生物医学工程领域近年来的一个研究热点。其出发点是提供一种脑与外界直接的交流通道,而不再依赖于传统的通过肢体动作的交互方式。根据前述的原理,利用视觉诱发电位(Visual EvokedPotential,VEP)的脑电信号,是实现这一目的的一个途径。Brain-Computer Interface (BCI) is a research hotspot in the fields of neural engineering, rehabilitation engineering, and biomedical engineering in recent years. Its starting point is to provide a direct communication channel between the brain and the outside world, instead of relying on the traditional way of interaction through body movements. According to the aforementioned principle, the use of visual evoked potential (Visual Evoked Potential, VEP) EEG signals is a way to achieve this goal.
计算机强大的计算、控制和通讯功能是人所共知的。当前计算机的操作,主要是通过人手操作键盘、鼠标和显示屏的交互而实现的。基于脑—机接口技术的计算机交互控制方法,则用脑电信号取代肢体对实物键盘、鼠标的操作,实现人脑—计算机的交互界面。这种人机交互方式既可以帮助残疾人使用计算机,也可以用于正常人不便用手操作计算机的场合(如宇航员在飞船或太空仓中)。The powerful calculation, control and communication functions of computers are well known. The operation of the current computer is mainly realized through the interaction of manual operation of the keyboard, mouse and display screen. The computer interactive control method based on the brain-computer interface technology uses EEG signals to replace the physical keyboard and mouse operations of the limbs to realize the human brain-computer interaction interface. This human-computer interaction method can not only help the disabled to use the computer, but also can be used in occasions where it is inconvenient for normal people to operate the computer by hand (such as astronauts in spaceships or space capsules).
发明内容Contents of the invention
本发明设计的是一种基于稳态视觉诱发脑电的计算机人机交互方法。The present invention designs a computer human-computer interaction method based on steady-state visually induced EEG.
本发明的特征在于,所述方法依次含有以下步骤:The present invention is characterized in that the method comprises the following steps in sequence:
步骤1把脑电电极安装在被试者头皮枕骨隆突的位置(见附图2),把参考电极安在耳部,接地电极接地;Step 1. Install the EEG electrode on the occipital prominence of the subject's scalp (see Figure 2), install the reference electrode on the ear, and ground the ground electrode;
步骤2用计算机屏幕边上的闪烁图标作为不同频率的闪烁光源,该光源发出的闪烁光刺激被试者,每种光源的闪烁频率对应着计算机中的一条控制信号通道,或是鼠标的一个动作命令,或是直接的控制信号,各种光源的闪烁频率各不相同,其闪烁频率在5~50赫兹间选取;Step 2 Use the flickering icon on the side of the computer screen as a flickering light source with different frequencies. The flickering light emitted by the light source stimulates the subjects. The flickering frequency of each light source corresponds to a control signal channel in the computer, or an action of the mouse Command, or direct control signal, the flickering frequency of various light sources is different, and the flickering frequency is selected between 5 and 50 Hz;
步骤3当被试者专注于步骤2中的一种闪烁频率的光源时,在头皮上就能诱发出与该光源同频率及其谐波成分的脑电波;Step 3. When the subject focuses on a light source with a flickering frequency in step 2, brain waves with the same frequency as the light source and its harmonic components can be induced on the scalp;
步骤4步骤1中的脑电电极采集到这种稳态视觉刺激所诱发的脑电电波后,把该脑电电波依次通过放大器、模/数转换器,由USB或其它通用输入端口送入所述计算机的控制信号输入端,转化成计算机鼠标或者键盘的控制命令Step 4: After the EEG electrodes in Step 1 collect the EEG induced by the steady-state visual stimulation, the EEG is sent to the computer through the amplifier and the analog/digital converter in turn through the USB or other general-purpose input ports. The control signal input terminal of the computer is converted into the control command of the computer mouse or keyboard
步骤41由输入计算机的脑电信号检测出主要频率成分;Step 41 detects the main frequency components from the EEG signals input into the computer;
步骤42根据检测出的主要频率成分与设定的脑电频率与鼠标或者键盘动作的对应关系表,查出鼠标或者键盘的动作类别,输出相应的鼠标或者键盘动作。Step 42 Find out the type of mouse or keyboard action according to the detected main frequency components and the set correspondence table between EEG frequency and mouse or keyboard action, and output the corresponding mouse or keyboard action.
实验表明,本方法可以有效地实现用脑电波控制计算机鼠标的移动和命令操作,最高信息传输率可以达到40比特/分钟,平均可达25比特/分钟。Experiments show that this method can effectively control the movement and command operation of the computer mouse with brain waves, and the highest information transmission rate can reach 40 bits/minute, and the average can reach 25 bits/minute.
本方法的特点是突破传统的计算机人机交互方式,提取人的视觉诱发的脑电,将大脑电活动信息转换成控制电信号,由此来实现对计算机的操作,或对电控设备,装置等的控制和操作。该系统及装置在诸多领域具有重大应用意义,既可以帮助残疾人使用计算机,也可以用于正常人不便用手操作计算机的场合(如宇航员在飞船或太空仓中)。The feature of this method is to break through the traditional computer human-computer interaction method, extract the EEG induced by human vision, and convert the information of brain electrical activity into control electrical signals, thereby realizing the operation of the computer, or the control of electronic control equipment and devices. etc. control and operation. The system and device have great application significance in many fields, not only can help the disabled to use the computer, but also can be used in occasions where it is inconvenient for normal people to operate the computer by hand (such as astronauts in spaceships or space cabins).
附图说明Description of drawings
图1本发明的程序流程框图。Fig. 1 is a program flow diagram of the present invention.
图2脑电电极位置图。Figure 2. Location map of EEG electrodes.
图3显示在计算机屏幕周边的不同闪烁频率的图标。Figure 3 shows icons with different blinking frequencies around the perimeter of a computer screen.
图4屏幕图标与鼠标动作的对应关系示例。Figure 4 Example of correspondence between screen icons and mouse actions.
具体实施方式Detailed ways
用本方法实现对计算机鼠标的控制实例,可以通过以下步骤实现:Realize the control example to computer mouse with this method, can realize through the following steps:
(1)在计算机屏幕周边生成8个不同的图标,其闪烁频率分别为8-15赫兹。每一图标对应一个控制信号通道,或是鼠标的一个动作命令,或是直接的控制信号(参见附图3,附图4);(1) 8 different icons are generated around the computer screen, and their flickering frequencies are respectively 8-15 Hz. Each icon corresponds to a control signal channel, or an action command of the mouse, or a direct control signal (see accompanying drawing 3, accompanying drawing 4);
(2)将脑电电极安装在受试者的头皮上枕骨隆突的位置(附图2中的O1、O2或者附近的位置),由此采集受试者的脑电信号,经通用的脑电放大器数模转换后,通过USB口送入计算机;(2) Install the EEG electrodes on the subject's scalp at the position of the occipital prominence (O1, O2 or nearby positions in the attached drawing 2), thereby collecting the subject's EEG signals and passing them through the universal brain After the digital-to-analog conversion of the electric amplifier, it is sent to the computer through the USB port;
(3)采用通用的快速傅立叶变换或其它频谱分析方法,检测出视觉诱发脑电中的主要频率成分f;(3) Using general-purpose fast Fourier transform or other spectral analysis methods to detect the main frequency component f in the visually evoked EEG;
(4)根据检测出的频率f和脑电频率与鼠标动作的对应关系表(见附图4),计算机据此进行鼠标的移动和命令操作。实现对计算机的控制和应用,如打字、绘图和浏览网页等;(4) According to the detected frequency f and the corresponding relationship table between EEG frequency and mouse action (see accompanying drawing 4), the computer performs mouse movement and command operation accordingly. Realize the control and application of the computer, such as typing, drawing and browsing the web;
(5)附图4中图标8“退出键”的设置,可以让受试者选择退出本发明的计算机程序,回到正常计算机操作方式。在控制外部设备时可以用来选择退出控制。(5) The setting of the icon 8 "exit key" in the accompanying drawing 4 allows the subject to choose to exit the computer program of the present invention and return to the normal computer operation mode. Can be used to opt out of control when controlling external devices.
Claims (3)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200510126358 CN1776572A (en) | 2005-12-08 | 2005-12-08 | Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200510126358 CN1776572A (en) | 2005-12-08 | 2005-12-08 | Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves |
Publications (1)
Publication Number | Publication Date |
---|---|
CN1776572A true CN1776572A (en) | 2006-05-24 |
Family
ID=36766134
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 200510126358 Pending CN1776572A (en) | 2005-12-08 | 2005-12-08 | Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN1776572A (en) |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101980106A (en) * | 2010-10-15 | 2011-02-23 | 华南理工大学 | A two-dimensional cursor control method and device for a brain-computer interface |
CN101576772B (en) * | 2009-05-14 | 2011-07-27 | 天津工程师范学院 | Brain-computer interface system based on virtual instrument steady-state visual evoked potentials and control method thereof |
CN102309380A (en) * | 2011-09-13 | 2012-01-11 | 华南理工大学 | Intelligent wheelchair based on multimode brain-machine interface |
CN102426481A (en) * | 2011-11-03 | 2012-04-25 | 深圳Tcl新技术有限公司 | Method, device and system for remote control based on brain waves |
CN102426768A (en) * | 2011-08-16 | 2012-04-25 | 海尔集团公司 | System and method for controlling electronic equipment based on body electric wave |
CN102609618A (en) * | 2012-02-07 | 2012-07-25 | 清华大学 | Method for calculating brain asymmetric index based on information flow gain |
CN102722244A (en) * | 2012-05-25 | 2012-10-10 | 西安交通大学 | Steady-state evoked potential brain-computer interface method based on motion turning vision sensing |
CN102799274A (en) * | 2012-07-17 | 2012-11-28 | 华南理工大学 | Method of asynchronous brain switch based on steady state visual evoked potentials |
CN102945078A (en) * | 2012-11-13 | 2013-02-27 | 深圳先进技术研究院 | Human-computer interaction equipment and human-computer interaction method |
CN103076881A (en) * | 2013-01-18 | 2013-05-01 | 哈尔滨工业大学深圳研究生院 | Multimedia on-demand method and system based on brain wave signals |
CN103246344A (en) * | 2012-02-02 | 2013-08-14 | 联想(北京)有限公司 | Method for controlling electronic device and electronic device |
CN103699226A (en) * | 2013-12-18 | 2014-04-02 | 天津大学 | Tri-modal serial brain-computer interface method based on multi-information fusion |
CN105942975A (en) * | 2016-04-20 | 2016-09-21 | 西安电子科技大学 | Stable state visual sense induced EEG signal processing method |
CN106155329A (en) * | 2016-09-06 | 2016-11-23 | 西安交通大学 | Steady-state induced current potential brain-machine interface method based on reciprocally swinging visually-perceptible |
CN106468953A (en) * | 2016-09-06 | 2017-03-01 | 西安交通大学 | The stable state of motion Evoked ptential brain-machine interface method of screw visually-perceptible |
CN106468952A (en) * | 2016-09-06 | 2017-03-01 | 西安交通大学 | Stable state of motion Evoked ptential brain-machine interface method based on rotation visually-perceptible |
CN108470182A (en) * | 2018-01-23 | 2018-08-31 | 天津大学 | A kind of brain-computer interface method enhanced for asymmetric brain electrical feature with identification |
US10155121B2 (en) | 2012-08-25 | 2018-12-18 | National Chiao Tung University | Stimuli generating methods, devices and control systems to induce visual evoked potentials using imperceptible flickering multi-color lights |
CN114594854A (en) * | 2020-12-07 | 2022-06-07 | 北京小米移动软件有限公司 | Control method and device for electronic equipment, electronic equipment and storage medium |
CN114594852A (en) * | 2020-12-07 | 2022-06-07 | 北京小米移动软件有限公司 | Control method and device for electronic device, electronic device and storage medium |
-
2005
- 2005-12-08 CN CN 200510126358 patent/CN1776572A/en active Pending
Cited By (32)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101576772B (en) * | 2009-05-14 | 2011-07-27 | 天津工程师范学院 | Brain-computer interface system based on virtual instrument steady-state visual evoked potentials and control method thereof |
CN101980106A (en) * | 2010-10-15 | 2011-02-23 | 华南理工大学 | A two-dimensional cursor control method and device for a brain-computer interface |
CN101980106B (en) * | 2010-10-15 | 2012-08-08 | 华南理工大学 | Two-dimensional cursor control method and device for brain-computer interface |
CN102426768A (en) * | 2011-08-16 | 2012-04-25 | 海尔集团公司 | System and method for controlling electronic equipment based on body electric wave |
CN102426768B (en) * | 2011-08-16 | 2016-02-10 | 海尔集团公司 | The system and method for electronic equipment is controlled based on body electric wave |
CN102309380A (en) * | 2011-09-13 | 2012-01-11 | 华南理工大学 | Intelligent wheelchair based on multimode brain-machine interface |
CN102426481A (en) * | 2011-11-03 | 2012-04-25 | 深圳Tcl新技术有限公司 | Method, device and system for remote control based on brain waves |
CN102426481B (en) * | 2011-11-03 | 2015-02-04 | 深圳Tcl新技术有限公司 | Method, device and system for remote control based on brain waves |
CN103246344A (en) * | 2012-02-02 | 2013-08-14 | 联想(北京)有限公司 | Method for controlling electronic device and electronic device |
CN102609618A (en) * | 2012-02-07 | 2012-07-25 | 清华大学 | Method for calculating brain asymmetric index based on information flow gain |
CN102609618B (en) * | 2012-02-07 | 2015-01-14 | 清华大学 | Method for calculating brain asymmetric index based on information flow gain |
CN102722244A (en) * | 2012-05-25 | 2012-10-10 | 西安交通大学 | Steady-state evoked potential brain-computer interface method based on motion turning vision sensing |
CN102722244B (en) * | 2012-05-25 | 2014-10-15 | 西安交通大学 | Steady-state evoked potential brain-computer interface method based on motion turning vision sensing |
CN102799274B (en) * | 2012-07-17 | 2015-04-22 | 华南理工大学 | Method of asynchronous brain switch based on steady state visual evoked potentials |
CN102799274A (en) * | 2012-07-17 | 2012-11-28 | 华南理工大学 | Method of asynchronous brain switch based on steady state visual evoked potentials |
US10155121B2 (en) | 2012-08-25 | 2018-12-18 | National Chiao Tung University | Stimuli generating methods, devices and control systems to induce visual evoked potentials using imperceptible flickering multi-color lights |
CN102945078A (en) * | 2012-11-13 | 2013-02-27 | 深圳先进技术研究院 | Human-computer interaction equipment and human-computer interaction method |
CN103076881A (en) * | 2013-01-18 | 2013-05-01 | 哈尔滨工业大学深圳研究生院 | Multimedia on-demand method and system based on brain wave signals |
CN103699226A (en) * | 2013-12-18 | 2014-04-02 | 天津大学 | Tri-modal serial brain-computer interface method based on multi-information fusion |
CN103699226B (en) * | 2013-12-18 | 2016-08-24 | 天津大学 | A kind of three mode serial brain-computer interface methods based on Multi-information acquisition |
CN105942975A (en) * | 2016-04-20 | 2016-09-21 | 西安电子科技大学 | Stable state visual sense induced EEG signal processing method |
CN106468952A (en) * | 2016-09-06 | 2017-03-01 | 西安交通大学 | Stable state of motion Evoked ptential brain-machine interface method based on rotation visually-perceptible |
CN106468953A (en) * | 2016-09-06 | 2017-03-01 | 西安交通大学 | The stable state of motion Evoked ptential brain-machine interface method of screw visually-perceptible |
CN106155329A (en) * | 2016-09-06 | 2016-11-23 | 西安交通大学 | Steady-state induced current potential brain-machine interface method based on reciprocally swinging visually-perceptible |
CN106155329B (en) * | 2016-09-06 | 2019-01-08 | 西安交通大学 | Steady-state induced current potential brain-computer interface method based on reciprocally swinging visual perception |
CN106468953B (en) * | 2016-09-06 | 2019-02-26 | 西安交通大学 | Steady-state motor evoked potential brain-computer interface method for visual perception of spiral motion |
CN106468952B (en) * | 2016-09-06 | 2019-02-26 | 西安交通大学 | Steady-state motor evoked potential brain-computer interface method based on rotational visual perception |
CN108470182A (en) * | 2018-01-23 | 2018-08-31 | 天津大学 | A kind of brain-computer interface method enhanced for asymmetric brain electrical feature with identification |
CN108470182B (en) * | 2018-01-23 | 2022-04-29 | 天津大学 | Brain-computer interface method for enhancing and identifying asymmetric electroencephalogram characteristics |
CN114594854A (en) * | 2020-12-07 | 2022-06-07 | 北京小米移动软件有限公司 | Control method and device for electronic equipment, electronic equipment and storage medium |
CN114594852A (en) * | 2020-12-07 | 2022-06-07 | 北京小米移动软件有限公司 | Control method and device for electronic device, electronic device and storage medium |
CN114594854B (en) * | 2020-12-07 | 2024-07-02 | 北京小米移动软件有限公司 | Electronic equipment control method and device, electronic equipment and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN1776572A (en) | Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves | |
CN105022488B (en) | Wireless BCI input systems based on SSVEP brain electric potentials | |
CN103699226B (en) | A kind of three mode serial brain-computer interface methods based on Multi-information acquisition | |
CN101576772B (en) | Brain-computer interface system based on virtual instrument steady-state visual evoked potentials and control method thereof | |
CN103793058B (en) | A kind of active brain-computer interactive system Mental imagery classification of task method and device | |
CN101897640B (en) | Novel movement imagery electroencephalogram control-based intelligent wheelchair system | |
CN107037889B (en) | A method and system for inputting natural writing characters based on visual brain-computer interface | |
CN111150935B (en) | A myoelectric neck massage device and its control method | |
CN101571748A (en) | Brain-computer interactive system based on reinforced realization | |
CN109471530A (en) | Brain-controlled input method based on steady-state visual evoked potentials and motor imagery | |
CN102799267B (en) | Multi-brain-computer interface method for three characteristics of SSVEP (Steady State Visual Evoked Potential), blocking and P300 | |
CN111856958A (en) | Smart home control system, control method, computer equipment and storage medium | |
CN102654793B (en) | Electrocerebral-drive high-reliability control system based on dual-mode check mechanism | |
CN101373402A (en) | System and method for human-machine interaction based on brain wave excited by vision | |
CN103543836A (en) | Full-automatic webpage browsing control method based on brain-computer interface | |
CN102023701A (en) | Vision driving method, control method and control system of brainwave man-machine interface | |
Lo et al. | Novel non-contact control system for medical healthcare of disabled patients | |
CN104090653B (en) | Detecting method for multi-modal brain switch based on SSVEP and P300 | |
CN102799274B (en) | Method of asynchronous brain switch based on steady state visual evoked potentials | |
CN113359991B (en) | Intelligent brain-controlled mechanical arm auxiliary feeding system and method for disabled people | |
CN113101021B (en) | Mechanical arm control method based on MI-SSVEP hybrid brain-computer interface | |
CN1949139A (en) | Brain-machine interface mouse controlling device | |
Aravind et al. | Embedded implementation of brain computer interface using FPGA | |
Zhang et al. | Single channel brain-computer interface control system based on TGAM module | |
CN113345546A (en) | Hand function active rehabilitation training system and method based on steady-state visual evoked potential |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
WD01 | Invention patent application deemed withdrawn after publication |