CN1776572A - Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves - Google Patents

Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves Download PDF

Info

Publication number
CN1776572A
CN1776572A CN 200510126358 CN200510126358A CN1776572A CN 1776572 A CN1776572 A CN 1776572A CN 200510126358 CN200510126358 CN 200510126358 CN 200510126358 A CN200510126358 A CN 200510126358A CN 1776572 A CN1776572 A CN 1776572A
Authority
CN
China
Prior art keywords
computer
frequency
mouse
brain wave
steady
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 200510126358
Other languages
Chinese (zh)
Inventor
张志广
高上凯
高小榕
洪波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN 200510126358 priority Critical patent/CN1776572A/en
Publication of CN1776572A publication Critical patent/CN1776572A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

The invention belongs to neuro engineering in biomedical engineering. The method includes following steps: placing brain electrode on scalp of testee; using blinker light in different frequency to stimulate testee; making scalp of testee generate brain wave in same frequency and harmonic component; through amplification, brain wave is converted to digital signal, which is sent to computer; computer analyzes and detects main frequency component; based on coincidence relation list between frequency of brain wave and mouse action or control command, the method sends mouse action or control command corresponding to flash concentrated by testee so as to realize interactive interface between human brain-computer. The invention can help handicapped person to use computer, or normal person in situation of not convenient to use hand to operate computer, for example astronaut in airship or space capsule.

Description

基于稳态视觉诱发脑电波的计算机人机交互方法Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves

技术领域technical field

本技术发明属于生物医学工程中神经工程学技术领域。The technical invention belongs to the technical field of neural engineering in biomedical engineering.

背景技术Background technique

有关人的脑神经和脑电科学的研究表明和证实,某种频率(5-50次/秒)的光的闪烁或运动的视觉刺激,在脑电(EEG)中能诱发同频率及其谐波成分的电信号。根据这一重要生理特征,提取若干频度视觉刺激的脑电信号,经过编码组合,即可生成多种或复杂的控制电信号。Studies on human brain nerves and EEG science have shown and confirmed that flickering of light of a certain frequency (5-50 times per second) or visual stimulation of movement can induce the same frequency and its harmonics in EEG. Wave components of electrical signals. According to this important physiological feature, the EEG signals of several frequency visual stimuli are extracted, and after encoding and combination, various or complex control electrical signals can be generated.

脑—机接口(Brain-Computer Interface,BCI)是神经工程、康复工程、生物医学工程领域近年来的一个研究热点。其出发点是提供一种脑与外界直接的交流通道,而不再依赖于传统的通过肢体动作的交互方式。根据前述的原理,利用视觉诱发电位(Visual EvokedPotential,VEP)的脑电信号,是实现这一目的的一个途径。Brain-Computer Interface (BCI) is a research hotspot in the fields of neural engineering, rehabilitation engineering, and biomedical engineering in recent years. Its starting point is to provide a direct communication channel between the brain and the outside world, instead of relying on the traditional way of interaction through body movements. According to the aforementioned principle, the use of visual evoked potential (Visual Evoked Potential, VEP) EEG signals is a way to achieve this goal.

计算机强大的计算、控制和通讯功能是人所共知的。当前计算机的操作,主要是通过人手操作键盘、鼠标和显示屏的交互而实现的。基于脑—机接口技术的计算机交互控制方法,则用脑电信号取代肢体对实物键盘、鼠标的操作,实现人脑—计算机的交互界面。这种人机交互方式既可以帮助残疾人使用计算机,也可以用于正常人不便用手操作计算机的场合(如宇航员在飞船或太空仓中)。The powerful calculation, control and communication functions of computers are well known. The operation of the current computer is mainly realized through the interaction of manual operation of the keyboard, mouse and display screen. The computer interactive control method based on the brain-computer interface technology uses EEG signals to replace the physical keyboard and mouse operations of the limbs to realize the human brain-computer interaction interface. This human-computer interaction method can not only help the disabled to use the computer, but also can be used in occasions where it is inconvenient for normal people to operate the computer by hand (such as astronauts in spaceships or space capsules).

发明内容Contents of the invention

本发明设计的是一种基于稳态视觉诱发脑电的计算机人机交互方法。The present invention designs a computer human-computer interaction method based on steady-state visually induced EEG.

本发明的特征在于,所述方法依次含有以下步骤:The present invention is characterized in that the method comprises the following steps in sequence:

步骤1把脑电电极安装在被试者头皮枕骨隆突的位置(见附图2),把参考电极安在耳部,接地电极接地;Step 1. Install the EEG electrode on the occipital prominence of the subject's scalp (see Figure 2), install the reference electrode on the ear, and ground the ground electrode;

步骤2用计算机屏幕边上的闪烁图标作为不同频率的闪烁光源,该光源发出的闪烁光刺激被试者,每种光源的闪烁频率对应着计算机中的一条控制信号通道,或是鼠标的一个动作命令,或是直接的控制信号,各种光源的闪烁频率各不相同,其闪烁频率在5~50赫兹间选取;Step 2 Use the flickering icon on the side of the computer screen as a flickering light source with different frequencies. The flickering light emitted by the light source stimulates the subjects. The flickering frequency of each light source corresponds to a control signal channel in the computer, or an action of the mouse Command, or direct control signal, the flickering frequency of various light sources is different, and the flickering frequency is selected between 5 and 50 Hz;

步骤3当被试者专注于步骤2中的一种闪烁频率的光源时,在头皮上就能诱发出与该光源同频率及其谐波成分的脑电波;Step 3. When the subject focuses on a light source with a flickering frequency in step 2, brain waves with the same frequency as the light source and its harmonic components can be induced on the scalp;

步骤4步骤1中的脑电电极采集到这种稳态视觉刺激所诱发的脑电电波后,把该脑电电波依次通过放大器、模/数转换器,由USB或其它通用输入端口送入所述计算机的控制信号输入端,转化成计算机鼠标或者键盘的控制命令Step 4: After the EEG electrodes in Step 1 collect the EEG induced by the steady-state visual stimulation, the EEG is sent to the computer through the amplifier and the analog/digital converter in turn through the USB or other general-purpose input ports. The control signal input terminal of the computer is converted into the control command of the computer mouse or keyboard

步骤41由输入计算机的脑电信号检测出主要频率成分;Step 41 detects the main frequency components from the EEG signals input into the computer;

步骤42根据检测出的主要频率成分与设定的脑电频率与鼠标或者键盘动作的对应关系表,查出鼠标或者键盘的动作类别,输出相应的鼠标或者键盘动作。Step 42 Find out the type of mouse or keyboard action according to the detected main frequency components and the set correspondence table between EEG frequency and mouse or keyboard action, and output the corresponding mouse or keyboard action.

实验表明,本方法可以有效地实现用脑电波控制计算机鼠标的移动和命令操作,最高信息传输率可以达到40比特/分钟,平均可达25比特/分钟。Experiments show that this method can effectively control the movement and command operation of the computer mouse with brain waves, and the highest information transmission rate can reach 40 bits/minute, and the average can reach 25 bits/minute.

本方法的特点是突破传统的计算机人机交互方式,提取人的视觉诱发的脑电,将大脑电活动信息转换成控制电信号,由此来实现对计算机的操作,或对电控设备,装置等的控制和操作。该系统及装置在诸多领域具有重大应用意义,既可以帮助残疾人使用计算机,也可以用于正常人不便用手操作计算机的场合(如宇航员在飞船或太空仓中)。The feature of this method is to break through the traditional computer human-computer interaction method, extract the EEG induced by human vision, and convert the information of brain electrical activity into control electrical signals, thereby realizing the operation of the computer, or the control of electronic control equipment and devices. etc. control and operation. The system and device have great application significance in many fields, not only can help the disabled to use the computer, but also can be used in occasions where it is inconvenient for normal people to operate the computer by hand (such as astronauts in spaceships or space cabins).

附图说明Description of drawings

图1本发明的程序流程框图。Fig. 1 is a program flow diagram of the present invention.

图2脑电电极位置图。Figure 2. Location map of EEG electrodes.

图3显示在计算机屏幕周边的不同闪烁频率的图标。Figure 3 shows icons with different blinking frequencies around the perimeter of a computer screen.

图4屏幕图标与鼠标动作的对应关系示例。Figure 4 Example of correspondence between screen icons and mouse actions.

具体实施方式Detailed ways

用本方法实现对计算机鼠标的控制实例,可以通过以下步骤实现:Realize the control example to computer mouse with this method, can realize through the following steps:

(1)在计算机屏幕周边生成8个不同的图标,其闪烁频率分别为8-15赫兹。每一图标对应一个控制信号通道,或是鼠标的一个动作命令,或是直接的控制信号(参见附图3,附图4);(1) 8 different icons are generated around the computer screen, and their flickering frequencies are respectively 8-15 Hz. Each icon corresponds to a control signal channel, or an action command of the mouse, or a direct control signal (see accompanying drawing 3, accompanying drawing 4);

(2)将脑电电极安装在受试者的头皮上枕骨隆突的位置(附图2中的O1、O2或者附近的位置),由此采集受试者的脑电信号,经通用的脑电放大器数模转换后,通过USB口送入计算机;(2) Install the EEG electrodes on the subject's scalp at the position of the occipital prominence (O1, O2 or nearby positions in the attached drawing 2), thereby collecting the subject's EEG signals and passing them through the universal brain After the digital-to-analog conversion of the electric amplifier, it is sent to the computer through the USB port;

(3)采用通用的快速傅立叶变换或其它频谱分析方法,检测出视觉诱发脑电中的主要频率成分f;(3) Using general-purpose fast Fourier transform or other spectral analysis methods to detect the main frequency component f in the visually evoked EEG;

(4)根据检测出的频率f和脑电频率与鼠标动作的对应关系表(见附图4),计算机据此进行鼠标的移动和命令操作。实现对计算机的控制和应用,如打字、绘图和浏览网页等;(4) According to the detected frequency f and the corresponding relationship table between EEG frequency and mouse action (see accompanying drawing 4), the computer performs mouse movement and command operation accordingly. Realize the control and application of the computer, such as typing, drawing and browsing the web;

(5)附图4中图标8“退出键”的设置,可以让受试者选择退出本发明的计算机程序,回到正常计算机操作方式。在控制外部设备时可以用来选择退出控制。(5) The setting of the icon 8 "exit key" in the accompanying drawing 4 allows the subject to choose to exit the computer program of the present invention and return to the normal computer operation mode. Can be used to opt out of control when controlling external devices.

Claims (3)

1. based on the computer man-machine interacting method of steady-state vision induced brain wave, it is characterized in that described method contains following steps successively:
Step 1 is installed in the position of subject's scalp occipital protuberance to electrode for encephalograms, reference electrode is positioned on ear, ground-electrode ground connection;
Flashing icon on the step 2 usefulness computer screen limit is as the flasher of different frequency, the passage of scintillation light that this light source sends stimulates the subject, the flicker frequency correspondence of every kind of light source a control signal passage in the computing machine, an or action command of mouse, or direct control signal, the flicker frequency of various light sources has nothing in common with each other, and its flicker frequency is chosen between 5~50 hertz;
When step 3 is absorbed in the light source of a kind of flicker frequency in the step 2 as the subject, on scalp, just can induce brain wave with this light source same frequency and harmonic components thereof;
Electrode for encephalograms in step 4 step 1 collects after this stable state vision stimulates the brain electricity electric wave that is brought out, this brain electricity electric wave is passed through amplifier, A/D converter successively, send into the signal input end of described computing machine by USB or other general input port, change into the control command of computer mouse or keyboard
Step 41 detects the main frequency composition by the EEG signals of input computing machine;
Step 42 is found the action classification of mouse or keyboard according to the brain wave frequency of detected main frequency composition and setting and the mapping table of mouse or keyboard action, exports corresponding mouse or keyboard action.
2. the computer man-machine interacting method based on steady-state vision induced brain wave according to claim 1, the flasher that it is characterized in that described different frequency are the icons of the different frequency flicker of computer screen periphery.
3. the computer man-machine interacting method based on steady-state vision induced brain wave according to claim 1 is characterized in that the described control signal of step 4. directly exported by the output port of described computing machine, is used to control other peripheral devices.
CN 200510126358 2005-12-08 2005-12-08 Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves Pending CN1776572A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200510126358 CN1776572A (en) 2005-12-08 2005-12-08 Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200510126358 CN1776572A (en) 2005-12-08 2005-12-08 Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves

Publications (1)

Publication Number Publication Date
CN1776572A true CN1776572A (en) 2006-05-24

Family

ID=36766134

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200510126358 Pending CN1776572A (en) 2005-12-08 2005-12-08 Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves

Country Status (1)

Country Link
CN (1) CN1776572A (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101980106A (en) * 2010-10-15 2011-02-23 华南理工大学 A two-dimensional cursor control method and device for a brain-computer interface
CN101576772B (en) * 2009-05-14 2011-07-27 天津工程师范学院 Brain-computer interface system based on virtual instrument steady-state visual evoked potentials and control method thereof
CN102309380A (en) * 2011-09-13 2012-01-11 华南理工大学 Intelligent wheelchair based on multimode brain-machine interface
CN102426481A (en) * 2011-11-03 2012-04-25 深圳Tcl新技术有限公司 Method, device and system for remote control based on brain waves
CN102426768A (en) * 2011-08-16 2012-04-25 海尔集团公司 System and method for controlling electronic equipment based on body electric wave
CN102609618A (en) * 2012-02-07 2012-07-25 清华大学 Method for calculating brain asymmetric index based on information flow gain
CN102722244A (en) * 2012-05-25 2012-10-10 西安交通大学 Steady-state evoked potential brain-computer interface method based on motion turning vision sensing
CN102799274A (en) * 2012-07-17 2012-11-28 华南理工大学 Method of asynchronous brain switch based on steady state visual evoked potentials
CN102945078A (en) * 2012-11-13 2013-02-27 深圳先进技术研究院 Human-computer interaction equipment and human-computer interaction method
CN103076881A (en) * 2013-01-18 2013-05-01 哈尔滨工业大学深圳研究生院 Multimedia on-demand method and system based on brain wave signals
CN103246344A (en) * 2012-02-02 2013-08-14 联想(北京)有限公司 Method for controlling electronic device and electronic device
CN103699226A (en) * 2013-12-18 2014-04-02 天津大学 Tri-modal serial brain-computer interface method based on multi-information fusion
CN105942975A (en) * 2016-04-20 2016-09-21 西安电子科技大学 Stable state visual sense induced EEG signal processing method
CN106155329A (en) * 2016-09-06 2016-11-23 西安交通大学 Steady-state induced current potential brain-machine interface method based on reciprocally swinging visually-perceptible
CN106468953A (en) * 2016-09-06 2017-03-01 西安交通大学 The stable state of motion Evoked ptential brain-machine interface method of screw visually-perceptible
CN106468952A (en) * 2016-09-06 2017-03-01 西安交通大学 Stable state of motion Evoked ptential brain-machine interface method based on rotation visually-perceptible
CN108470182A (en) * 2018-01-23 2018-08-31 天津大学 A kind of brain-computer interface method enhanced for asymmetric brain electrical feature with identification
US10155121B2 (en) 2012-08-25 2018-12-18 National Chiao Tung University Stimuli generating methods, devices and control systems to induce visual evoked potentials using imperceptible flickering multi-color lights
CN114594854A (en) * 2020-12-07 2022-06-07 北京小米移动软件有限公司 Control method and device for electronic equipment, electronic equipment and storage medium
CN114594852A (en) * 2020-12-07 2022-06-07 北京小米移动软件有限公司 Control method and device for electronic device, electronic device and storage medium

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101576772B (en) * 2009-05-14 2011-07-27 天津工程师范学院 Brain-computer interface system based on virtual instrument steady-state visual evoked potentials and control method thereof
CN101980106A (en) * 2010-10-15 2011-02-23 华南理工大学 A two-dimensional cursor control method and device for a brain-computer interface
CN101980106B (en) * 2010-10-15 2012-08-08 华南理工大学 Two-dimensional cursor control method and device for brain-computer interface
CN102426768A (en) * 2011-08-16 2012-04-25 海尔集团公司 System and method for controlling electronic equipment based on body electric wave
CN102426768B (en) * 2011-08-16 2016-02-10 海尔集团公司 The system and method for electronic equipment is controlled based on body electric wave
CN102309380A (en) * 2011-09-13 2012-01-11 华南理工大学 Intelligent wheelchair based on multimode brain-machine interface
CN102426481A (en) * 2011-11-03 2012-04-25 深圳Tcl新技术有限公司 Method, device and system for remote control based on brain waves
CN102426481B (en) * 2011-11-03 2015-02-04 深圳Tcl新技术有限公司 Method, device and system for remote control based on brain waves
CN103246344A (en) * 2012-02-02 2013-08-14 联想(北京)有限公司 Method for controlling electronic device and electronic device
CN102609618A (en) * 2012-02-07 2012-07-25 清华大学 Method for calculating brain asymmetric index based on information flow gain
CN102609618B (en) * 2012-02-07 2015-01-14 清华大学 Method for calculating brain asymmetric index based on information flow gain
CN102722244A (en) * 2012-05-25 2012-10-10 西安交通大学 Steady-state evoked potential brain-computer interface method based on motion turning vision sensing
CN102722244B (en) * 2012-05-25 2014-10-15 西安交通大学 Steady-state evoked potential brain-computer interface method based on motion turning vision sensing
CN102799274B (en) * 2012-07-17 2015-04-22 华南理工大学 Method of asynchronous brain switch based on steady state visual evoked potentials
CN102799274A (en) * 2012-07-17 2012-11-28 华南理工大学 Method of asynchronous brain switch based on steady state visual evoked potentials
US10155121B2 (en) 2012-08-25 2018-12-18 National Chiao Tung University Stimuli generating methods, devices and control systems to induce visual evoked potentials using imperceptible flickering multi-color lights
CN102945078A (en) * 2012-11-13 2013-02-27 深圳先进技术研究院 Human-computer interaction equipment and human-computer interaction method
CN103076881A (en) * 2013-01-18 2013-05-01 哈尔滨工业大学深圳研究生院 Multimedia on-demand method and system based on brain wave signals
CN103699226A (en) * 2013-12-18 2014-04-02 天津大学 Tri-modal serial brain-computer interface method based on multi-information fusion
CN103699226B (en) * 2013-12-18 2016-08-24 天津大学 A kind of three mode serial brain-computer interface methods based on Multi-information acquisition
CN105942975A (en) * 2016-04-20 2016-09-21 西安电子科技大学 Stable state visual sense induced EEG signal processing method
CN106468952A (en) * 2016-09-06 2017-03-01 西安交通大学 Stable state of motion Evoked ptential brain-machine interface method based on rotation visually-perceptible
CN106468953A (en) * 2016-09-06 2017-03-01 西安交通大学 The stable state of motion Evoked ptential brain-machine interface method of screw visually-perceptible
CN106155329A (en) * 2016-09-06 2016-11-23 西安交通大学 Steady-state induced current potential brain-machine interface method based on reciprocally swinging visually-perceptible
CN106155329B (en) * 2016-09-06 2019-01-08 西安交通大学 Steady-state induced current potential brain-computer interface method based on reciprocally swinging visual perception
CN106468953B (en) * 2016-09-06 2019-02-26 西安交通大学 Steady-state motor evoked potential brain-computer interface method for visual perception of spiral motion
CN106468952B (en) * 2016-09-06 2019-02-26 西安交通大学 Steady-state motor evoked potential brain-computer interface method based on rotational visual perception
CN108470182A (en) * 2018-01-23 2018-08-31 天津大学 A kind of brain-computer interface method enhanced for asymmetric brain electrical feature with identification
CN108470182B (en) * 2018-01-23 2022-04-29 天津大学 Brain-computer interface method for enhancing and identifying asymmetric electroencephalogram characteristics
CN114594854A (en) * 2020-12-07 2022-06-07 北京小米移动软件有限公司 Control method and device for electronic equipment, electronic equipment and storage medium
CN114594852A (en) * 2020-12-07 2022-06-07 北京小米移动软件有限公司 Control method and device for electronic device, electronic device and storage medium
CN114594854B (en) * 2020-12-07 2024-07-02 北京小米移动软件有限公司 Electronic equipment control method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN1776572A (en) Computer Human-Computer Interaction Method Based on Steady-state Visual Evoked Brain Waves
CN105022488B (en) Wireless BCI input systems based on SSVEP brain electric potentials
CN103699226B (en) A kind of three mode serial brain-computer interface methods based on Multi-information acquisition
CN101576772B (en) Brain-computer interface system based on virtual instrument steady-state visual evoked potentials and control method thereof
CN103793058B (en) A kind of active brain-computer interactive system Mental imagery classification of task method and device
CN101897640B (en) Novel movement imagery electroencephalogram control-based intelligent wheelchair system
CN107037889B (en) A method and system for inputting natural writing characters based on visual brain-computer interface
CN111150935B (en) A myoelectric neck massage device and its control method
CN101571748A (en) Brain-computer interactive system based on reinforced realization
CN109471530A (en) Brain-controlled input method based on steady-state visual evoked potentials and motor imagery
CN102799267B (en) Multi-brain-computer interface method for three characteristics of SSVEP (Steady State Visual Evoked Potential), blocking and P300
CN111856958A (en) Smart home control system, control method, computer equipment and storage medium
CN102654793B (en) Electrocerebral-drive high-reliability control system based on dual-mode check mechanism
CN101373402A (en) System and method for human-machine interaction based on brain wave excited by vision
CN103543836A (en) Full-automatic webpage browsing control method based on brain-computer interface
CN102023701A (en) Vision driving method, control method and control system of brainwave man-machine interface
Lo et al. Novel non-contact control system for medical healthcare of disabled patients
CN104090653B (en) Detecting method for multi-modal brain switch based on SSVEP and P300
CN102799274B (en) Method of asynchronous brain switch based on steady state visual evoked potentials
CN113359991B (en) Intelligent brain-controlled mechanical arm auxiliary feeding system and method for disabled people
CN113101021B (en) Mechanical arm control method based on MI-SSVEP hybrid brain-computer interface
CN1949139A (en) Brain-machine interface mouse controlling device
Aravind et al. Embedded implementation of brain computer interface using FPGA
Zhang et al. Single channel brain-computer interface control system based on TGAM module
CN113345546A (en) Hand function active rehabilitation training system and method based on steady-state visual evoked potential

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication