CN115738025A - Concentration training system and method based on fusion of electroencephalogram signal and eye movement signal - Google Patents
Concentration training system and method based on fusion of electroencephalogram signal and eye movement signal Download PDFInfo
- Publication number
- CN115738025A CN115738025A CN202211695799.1A CN202211695799A CN115738025A CN 115738025 A CN115738025 A CN 115738025A CN 202211695799 A CN202211695799 A CN 202211695799A CN 115738025 A CN115738025 A CN 115738025A
- Authority
- CN
- China
- Prior art keywords
- eye movement
- electroencephalogram
- module
- training
- concentration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
Abstract
The invention provides a concentration training system and method based on fusion of an electroencephalogram signal and an eye movement signal, belonging to the technical field of signal processing and comprising an electroencephalogram hardware data acquisition module, a computer control end, an eye movement instrument, an eye movement acquisition program module and a database; the electroencephalogram hardware data acquisition module is connected with a computer control end, the eye tracker is connected with an eye movement acquisition program module, and the eye movement acquisition program module is connected with the computer control end; the computer control end is a concentration training system and is used for carrying out fusion analysis on the electroencephalogram signals and the eye movement signals to obtain a concentration training numerical value and guiding the testee to carry out the next training according to the numerical value. The invention improves the effect and the accuracy of the training prescription, avoids larger errors caused by single electroencephalogram data analysis or eye movement signal analysis, ensures that the acquired concentration numerical value is more accurate, and provides a firmer basis for the formulation of a subsequent treatment scheme.
Description
Technical Field
The invention relates to the technical field of signal processing, in particular to a concentration training system and method based on fusion of electroencephalogram signals and eye movement signals.
Background
The concentration is an important component of the cognitive ability development of teenagers, and the lack of concentration can cause that any activity is difficult to maintain and carry out, and the students cannot concentrate on the study, even the academic industry is influenced. The formation reasons include an innate factor and an acquired factor: the poor concentration of teenagers is caused by the defects of physiological functions of the teenagers, the imbalance of brain structures and other genetic diathesis on the basis of congenital factors; in acquired factors, teenagers have poor concentration due to physical discomfort caused by psychological factors such as anxiety, fatigue, depression and the like; secondly, because the will power of teenagers is not completely mature, the automatic control ability is poor, the teenagers are easily interfered by external things, and the teenagers are difficult to concentrate on a certain thing when being in a noisy and tempting environment, and finally the problem of poor concentration is formed. Concentration training is dedicated to guiding teenagers, and after a period of training, the teenagers can be stably focused on doing things for a long time.
The concentration training based on the electroencephalogram signals is to feed back the electroencephalogram activity rhythm waves of all the areas of the cerebral cortex, perform time domain analysis on the electroencephalogram information, train specific electroencephalogram activities, and selectively strengthen the electroencephalogram waves of a certain frequency band through training, so that the aim of improving the concentration is fulfilled.
Concentration training based on the eye movement signals judges whether the testee is concentrated in the training content or not by monitoring and tracking the positions of the eye fixation points, and a prompt is given when the testee is concentrated in other contents.
Currently, the existing concentration training methods have the following disadvantages:
in the single electroencephalogram signal analysis, when a testee does not concentrate on the current training content and looks at other surrounding contents, the beta wave ratio value also accords with the set condition, and is recorded as being in a concentration state, so that a large error is generated; in the single eye movement signal analysis, only the tracking of the eye movement signal is focused on, and whether the subject is in a thinking state cannot be determined. In conclusion, the prior art cannot quickly and accurately evaluate the concentration of the testee, so that the concentration training effect is influenced. Concentration training is formulated by the system, and the testee trains passively under the guidance, and the motivation to the training is not high, resulting in poor training effect.
Disclosure of Invention
The invention aims to provide a concentration training system and method based on brain electrical signal and eye movement signal fusion, so as to solve at least one technical problem in the background technology.
In order to achieve the purpose, the invention adopts the following technical scheme:
in one aspect, the invention provides a concentration training system based on fusion of electroencephalogram signals and eye movement signals, comprising: the device comprises an electroencephalogram hardware data acquisition module, a computer control end, an eye tracker, an eye tracking acquisition program module and a database;
the electroencephalogram hardware data acquisition module is connected with a computer control end, the eye tracker is connected with an eye movement acquisition program module, and the eye movement acquisition program module is connected with the computer control end;
the electroencephalogram hardware data acquisition module is used for acquiring electroencephalogram signals by using an electroencephalogram amplifier to perform time-frequency analysis to obtain a beta wave energy ratio, and transmitting the beta wave energy ratio to a computer control end;
the eye movement instrument is used for tracking the movement track of the eyes, confirming whether a testee is concentrated on the test content, inputting real-time monitoring data to the eye movement acquisition program module and transmitting the monitoring result to the computer control end;
the eye movement acquisition program module is used for displaying data of eye movement signals in real time;
and the database is used for storing the electroencephalogram signal and the eye movement signal data of all the testees.
Preferably, the computer control end is a concentration training system, the system records the beta wave energy ratio value as a concentration effective value when the examinee watches the set content range by combining the monitoring data of the eye tracker, and guides the examinee to carry out the next training according to the value.
Preferably, the computer control end comprises a database management module, a recorded information management module, a real-time data module, a passive acquisition module and an active test module;
the database management module is used for acquiring test data of different testees in a database list;
the recording information management module is used for selecting the data storage position of the current testee;
the real-time data module is used for acquiring the change of the brain waves in the test process in real time;
the passive acquisition module is used for performing passive training on the testee, analyzing the real-time data by combining electroencephalogram monitoring and recording the concentration effective value of the testee;
the active testing module is used for active training of the testee, the testee decides the progress of the game, and the content of the game is fed back in real time along with the information collected by the testee.
Preferably, the electroencephalogram hardware data acquisition module is connected with the computer control end through a wireless network.
Preferably, the eye movement acquisition program module is respectively connected with the computer control end and the eye movement instrument through a USB interface.
In a second aspect, the invention provides a concentration training method based on brain electrical signal and eye movement signal fusion, comprising the following steps:
the electroencephalogram hardware data acquisition module acquires an electroencephalogram signal of a subject, the eye tracker tracks the eye movement track of the subject, and the eye movement acquisition program module displays the eye movement data of the subject in real time;
selecting a database management module, selecting or creating a list, jumping to the recording information management module, and synchronizing a test result to the database;
selecting a passive acquisition module, training a testee according to a set eye movement track, giving real-time feedback of current training by a system, obtaining a concentration value, and storing the concentration value in the database;
and selecting an active test module, giving real-time feedback according to the passive training result and the autonomous training data, and recording and storing the real-time feedback in the database.
The invention has the beneficial effects that: the training effect and accuracy are improved, and larger errors caused by single electroencephalogram data analysis or eye movement signal analysis are avoided, so that the obtained concentration numerical value is more accurate, and a more solid basis is provided for the formulation of a subsequent treatment scheme; the passive acquisition is combined with the active test, so that the testee determines the progress of the game, the subjective activity of the testee is fully exerted, and a better effect is achieved compared with the existing concentration training method.
Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram of a concentration training method based on brain electrical signals and eye movement signals fusion according to an embodiment of the present invention.
Fig. 2 is a schematic diagram illustrating components of a concentration training system module in a concentration training method based on brain electrical signals and eye movement signals fusion according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by way of the drawings are illustrative only and are not to be construed as limiting the invention.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
For the purpose of facilitating an understanding of the present invention, the present invention will be further explained by way of specific embodiments with reference to the accompanying drawings, which are not intended to limit the present invention.
It should be understood by those skilled in the art that the drawings are merely schematic representations of embodiments and that the elements shown in the drawings are not necessarily required to practice the invention.
Examples
As shown in fig. 1 to 2, the present embodiment provides a concentration training system based on fusion of electroencephalogram signals and eye movement signals, including: the system comprises an electroencephalogram hardware data acquisition unit, a computer control end, an eye tracker, an eye movement acquisition program module and a database, wherein the electroencephalogram hardware data acquisition unit is wirelessly connected with the computer control end, the eye tracker is in wired connection with the eye movement acquisition program module, and the eye movement acquisition program module is in wired connection with the computer control end.
The electroencephalogram hardware data acquisition is used for acquiring electroencephalogram signals by an electroencephalogram amplifier to perform time-frequency analysis, obtaining a beta wave energy ratio value, and transmitting the beta wave energy ratio value to a computer control end;
the eye movement instrument is used for tracking the movement track of the eyes, confirming whether a testee is concentrated in the test content, inputting real-time monitoring data to the eye movement acquisition program module, and transmitting the monitoring result to the computer control end;
the eye movement acquisition program module is used for displaying data of the eye movement signals in real time, and can be used for medical personnel, a teacher for guidance and the like to display and guide the eye movement condition of the testee;
the database is used for storing electroencephalogram signal and eye movement signal data of all testees, extracting and analyzing the data, and observing and summarizing short-term and long-term training effects of the testees;
the computer control end is a concentration training system and is used for carrying out fusion analysis on the electroencephalogram signals and the eye movement signals to obtain a concentration training numerical value and guiding the testee to carry out the next training according to the numerical value. The system comprises a database management module, a recorded information management module, a real-time data module, a passive acquisition module and an active test module.
The database management module is pulled down and selected on the working interface, and the test data of different testees can be seen in the database list;
the recording information management module can select the data storage position of the current testee;
the real-time data module is connected with the hardware data acquisition equipment, and changes of brain waves can be observed in the real-time data module in the test process;
the passive acquisition module is used for performing passive training on the testee, analyzing the real-time data by combining electroencephalogram monitoring and recording the concentration effective value of the testee;
the active testing module can be used for active training of a testee, the testee decides the progress of a game, and the content of the game is fed back in real time along with information collected by the testee.
The electroencephalogram hardware data acquisition is connected with a computer control end through a wireless network;
and the eye movement acquisition program module is respectively connected with the computer control end and the eye movement instrument through a USB interface.
In this embodiment, based on the above system, a concentration training method based on the fusion of the electroencephalogram signal and the eye movement signal is implemented, including the following steps:
step 1, the electroencephalogram hardware data acquisition is used for acquiring electroencephalogram signals of a tested person, the eye movement instrument acquires eye movement tracks of the tested person, and the eye movement acquisition program module displays the eye movement data of the tested person in real time. The eye movement acquisition program module is respectively connected with the computer control end and the eye movement instrument through a USB interface;
step 2, operating the concentration training system after the hardware connection is finished, defaulting the installed software under the condition, starting the system software by double-stroke on a desktop, and waiting for a window to appear;
and 3, acquiring the electroencephalogram hardware data, and connecting the electroencephalogram hardware data with a computer control end through a wireless network. Completing the parameter setting of system software after connection, and setting a hardware environment for operating the system software in a shortcut toolbar; the suggested range of the filtering range is 1-35, here suggested to be set at 35; the size of a computer screen for running the software of the system; running the computer display resolution ratio of the system software.
Step 4, selecting the database management module in a working interface, selecting or creating a list, jumping to the recording information management module, and synchronizing a test result to the database;
step 5, selecting a passive acquisition module in a working interface, training a testee according to a set eye movement track, giving real-time feedback of current training by a system, obtaining a concentration value, and storing the concentration value in the database;
and 6, selecting an active testing module in the working interface, giving real-time feedback according to the passive training result and the autonomous training data, giving evaluation and suggestions by medical personnel or a teacher, and recording and storing the evaluation and suggestions in the database.
In this embodiment, training data of a human subject is collected through an eye tracker, an eye tracker collection program and electroencephalogram hardware data collection, and then is analyzed and processed through a computer control terminal, and the human subject is guided to perform active testing according to the obtained passive collected data. In this embodiment, through brain electrical signal and the technique of eye movement signal fusion, judge whether effective to be absorbed in the strength test result to improve the accuracy that the person being tested is absorbed in the strength test, improve the person being tested's concentration in through the training of initiative test module.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Although the embodiments of the present invention have been described with reference to the accompanying drawings, it is not intended to limit the scope of the present invention, and it should be understood by those skilled in the art that various modifications and variations can be made without inventive efforts based on the technical solutions disclosed in the present invention.
Claims (6)
1. A concentration training system based on electroencephalogram signal and eye movement signal fusion is characterized by comprising: the system comprises an electroencephalogram hardware data acquisition module, a computer control end, an eye movement instrument, an eye movement acquisition program module and a database;
the electroencephalogram hardware data acquisition module is connected with a computer control end, the eye tracker is connected with an eye movement acquisition program module, and the eye movement acquisition program module is connected with the computer control end;
the electroencephalogram hardware data acquisition module is used for acquiring electroencephalogram signals by using an electroencephalogram amplifier to perform time-frequency analysis to obtain a beta wave energy ratio, and transmitting the beta wave energy ratio to a computer control end;
the eye movement instrument is used for tracking the movement track of the eyes, confirming whether a testee is concentrated on the test content, inputting real-time monitoring data to the eye movement acquisition program module and transmitting the monitoring result to the computer control end;
the eye movement acquisition program module is used for displaying data of eye movement signals in real time;
and the database is used for storing the electroencephalogram signal data and the eye movement signal data of all the testees.
2. The concentration training system based on the fusion of the electroencephalogram signal and the eye movement signal as claimed in claim 1, wherein the computer control end is a concentration training system, the system records that the beta wave energy ratio at the moment is a concentration effective value when the examinee watches the set content range by combining the monitoring data of the eye movement instrument, and guides the examinee to carry out the next training according to the value.
3. The system for concentration training based on the fusion of electroencephalographic signals and ocular motility signals, as claimed in claim 4, wherein said computer control end comprises a database management module, a recorded information management module, a real-time data module, a passive acquisition module and an active testing module;
the database management module is used for acquiring test data of different testees in a database list;
the recording information management module is used for selecting the data storage position of the current testee;
the real-time data module is used for acquiring the change of the brain wave in the test process in real time;
the passive acquisition module is used for performing passive training on the testee, analyzing the real-time data by combining electroencephalogram monitoring and recording the concentration effective value of the testee;
the active testing module is used for active training of the testee, the testee decides the progress of the game, and the content of the game is fed back in real time along with the information collected by the testee.
4. The concentration training system based on the fusion of the electroencephalogram signal and the eye movement signal as claimed in claim 1, wherein the electroencephalogram hardware data acquisition module is connected with a computer control end through a wireless network.
5. The concentration training system based on the fusion of the electroencephalogram signal and the eye movement signal as claimed in claim 1, wherein the eye movement acquisition program module is respectively connected with the computer control terminal and the eye movement instrument through USB interfaces.
6. A concentration training method based on brain electrical signal and eye movement signal fusion is characterized by comprising the following steps:
the electroencephalogram hardware data acquisition module acquires electroencephalogram signals of a testee, the eye movement instrument acquires eye movement tracks of the testee, and the eye movement acquisition program module displays the eye movement data of the testee in real time;
selecting a database management module, selecting or creating a list, jumping to the recording information management module, and synchronizing a test result to the database;
selecting a passive acquisition module, training a testee according to a set eye movement track, giving real-time feedback of current training by a system, obtaining a concentration value, and storing the concentration value in the database;
and selecting an active test module, giving real-time feedback according to the passive training result and the autonomous training data, and recording and storing the feedback in the database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211695799.1A CN115738025A (en) | 2022-12-28 | 2022-12-28 | Concentration training system and method based on fusion of electroencephalogram signal and eye movement signal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211695799.1A CN115738025A (en) | 2022-12-28 | 2022-12-28 | Concentration training system and method based on fusion of electroencephalogram signal and eye movement signal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115738025A true CN115738025A (en) | 2023-03-07 |
Family
ID=85347795
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211695799.1A Pending CN115738025A (en) | 2022-12-28 | 2022-12-28 | Concentration training system and method based on fusion of electroencephalogram signal and eye movement signal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115738025A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117243569A (en) * | 2023-10-12 | 2023-12-19 | 国家康复辅具研究中心 | Cognitive function assessment method and system based on multi-source information fusion |
-
2022
- 2022-12-28 CN CN202211695799.1A patent/CN115738025A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117243569A (en) * | 2023-10-12 | 2023-12-19 | 国家康复辅具研究中心 | Cognitive function assessment method and system based on multi-source information fusion |
| CN117243569B (en) * | 2023-10-12 | 2024-05-07 | 国家康复辅具研究中心 | Cognitive function assessment method and system based on multi-source information fusion |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103169458B (en) | Biological information collection, intelligent analysis and monitoring and biological information recurrence system | |
| CN107898470B (en) | Data acquisition method and device, storage medium and medical equipment | |
| CN100427031C (en) | System and method for vision examination | |
| CN115738025A (en) | Concentration training system and method based on fusion of electroencephalogram signal and eye movement signal | |
| CN114847950A (en) | Attention assessment and training system and method based on virtual reality and storage medium | |
| Liu et al. | Taxonomy and real-time classification of artifacts during biosignal acquisition: A starter study and dataset of ECG | |
| CN105011949B (en) | A kind of method and device of automatic test | |
| CN115089190B (en) | Pilot multi-mode physiological signal synchronous acquisition system based on simulator | |
| CN104367306A (en) | Physiological and psychological career evaluation system and implementation method | |
| CN116250806A (en) | Near infrared brain function imaging system | |
| CN115299947A (en) | Psychological scale confidence evaluation method and system based on multi-modal physiological data | |
| CN113080900B (en) | Human body stress response testing method and system in sudden noise environment | |
| Slade et al. | Effortful listening: Sympathetic activity varies as a function of listening demand but parasympathetic activity does not | |
| CN107822628B (en) | Epileptic brain focus area automatic positioning device and system | |
| CN113546395A (en) | Intelligent exercise training system and training method | |
| Puwakpitiyage et al. | A proposed web based real time brain computer interface (BCI) system for usability testing | |
| Harrison et al. | EEG and fMRI agree: Mental arithmetic is the easiest form of imagery to detect | |
| CN115670484A (en) | Consciousness disturbance patient consciousness detection method based on language paradigm and electro-oculogram indexes | |
| CN112116856B (en) | BPPV diagnosis and treatment skill training system and method | |
| Yoshida et al. | Evaluation of the change of work using simple electroencephalography | |
| CN110008874B (en) | Data processing method and device, computer system and readable medium | |
| CN115985495A (en) | Cognitive impairment management method, device and medium | |
| CN112687373A (en) | System and method for quantifying psychological craving degree | |
| CN110008790A (en) | A kind of analysis method and device of multi-lead physiological signal | |
| KR102442778B1 (en) | Server supporting and managing cognitive training and operating method of the server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |