CN115277665A - Brain-computer interface system based on internet - Google Patents
Brain-computer interface system based on internet Download PDFInfo
- Publication number
- CN115277665A CN115277665A CN202210944514.7A CN202210944514A CN115277665A CN 115277665 A CN115277665 A CN 115277665A CN 202210944514 A CN202210944514 A CN 202210944514A CN 115277665 A CN115277665 A CN 115277665A
- Authority
- CN
- China
- Prior art keywords
- brain
- module
- data
- component
- computer interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 38
- 210000004556 brain Anatomy 0.000 claims abstract description 17
- 230000002452 interceptive effect Effects 0.000 claims abstract description 15
- 230000003993 interaction Effects 0.000 claims abstract description 13
- 238000004891 communication Methods 0.000 claims description 72
- 238000007726 management method Methods 0.000 claims description 25
- 238000004364 calculation method Methods 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 15
- 238000013500 data storage Methods 0.000 claims description 11
- 230000000638 stimulation Effects 0.000 claims description 9
- 238000002474 experimental method Methods 0.000 claims description 2
- 238000000034 method Methods 0.000 abstract description 12
- 230000008569 process Effects 0.000 abstract description 10
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000012360 testing method Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000011160 research Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000007635 classification algorithm Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 230000000763 evoking effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 210000004761 scalp Anatomy 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/161—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
- H04L69/162—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields involving adaptations of sockets based mechanisms
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses brain-computer interface system based on internet adopts the B/S framework to carry out deployment of brain-computer interface system, and the user need not to install special software alone, can carry out the interactive operation of brain-computer interface system through the mode that uses the browser to open the webpage, has avoided special software and different operating system compatibility problem, has simplified the operation flow and the process that the brain electric data was gathered, amazing was presented and user interaction for the system easily deploys and realizes. Meanwhile, the algorithm is deployed in the cloud server, the computing power of the cloud server can be utilized to meet the requirement of the complexity of the algorithm on the computing performance, and therefore real-time computing of the complex electroencephalogram algorithm can be achieved.
Description
Technical Field
The application relates to the technical field of brain interfaces, in particular to a brain-computer interface system based on the Internet.
Background
A Brain Computer Interface (BCI) is a new man-machine Interface mode, which means that a direct communication channel is established between the Brain of a human or animal and external equipment to realize information exchange between the Brain and the equipment. At present, the brain-computer interface mainly utilizes electroencephalogram signals to realize communication and control between a human brain and a computer or other electronic equipment, and has wide application prospects in the fields of brain science, rehabilitation engineering, neural engineering, human-computer interaction, artificial intelligence, education, entertainment and the like.
Brain-computer interface research and application based on the noninvasive electroencephalogram technology mainly comprise directions of Steady State Visual Evoked Potentials (SSVEP), motor Imagery (MI), P300 and the like. The brain-computer interface system generally comprises a plurality of parts such as stimulation presentation, electroencephalogram signal acquisition, electroencephalogram feature extraction and classification algorithm, human-computer interaction and the like.
Because of the complexity of the brain-computer interface itself, the existing systems impose very high requirements on the skilled technicians, including requiring researchers to be skilled in mastering the use of matlab, e-prime programming, and other various types of specialized software, and requiring familiarity with solutions to various compatibility problems of different software and operating systems. For example, in the research and application of the brain-computer interface of the SSVEP, because there is a high requirement for the frequency of the stimulus presentation, when designing the system, special factors such as the screen refresh rate should be considered, and in order to ensure the accuracy of the stimulus frequency, special application software or matlab code needs to be programmed sometimes to implement the method.
In addition, with the development of the technology, many algorithms of the brain-computer interface are realized based on machine learning and deep learning, and the calculation amount required by the algorithms is very large, so that the requirements on the performance of a computer are high, and the implementation and deployment of many systems are difficult. For example, it is difficult to implement real-time calculation of the algorithm with a common computer, and it is also difficult to deploy the constructed brain-computer interface application on a user computer.
Disclosure of Invention
Therefore, the application provides a brain-computer interface system based on the Internet, and aims to solve the problems that in the research and application development of the brain-computer interface system in the prior art, the system building technology threshold is high, the system building technology threshold is difficult to deploy, and technicians cannot concentrate on the core algorithm research.
In order to achieve the above purpose, the present application provides the following technical solutions:
an Internet-based brain-computer interface system comprises an electroencephalograph, an electroencephalogram data acquisition component, a browser application component and a server-side component, wherein the electroencephalograph, the electroencephalogram data acquisition component and the browser application component are deployed at a client, and the server-side component is deployed at a server;
the electroencephalograph is worn on the head of a subject and is used for acquiring electroencephalogram data of the subject in real time and transmitting the acquired electroencephalogram data to the electroencephalogram data acquisition component;
the electroencephalogram data acquisition component is used for receiving electroencephalogram data transmitted by the electroencephalograph, adding timestamp information to the electroencephalogram data, and transmitting the electroencephalogram data to the browser application component and the server end component;
the browser application component is used for providing a system operation interface for a user through a web browser, receiving and displaying electroencephalogram data containing timestamp information sent by the electroencephalogram data acquisition component, recording interface element data and user operation data, and transmitting the interface element data and the user operation data to the server end component;
the server-side component is used for providing a dynamic website application service based on Web, calculating according to an internally deployed brain-computer interface algorithm and received electroencephalogram data, and transmitting a calculation result to the browser application component for displaying.
Preferably, the electroencephalogram data acquisition component comprises an electroencephalogram acquisition module, a browser communication module, a data processing module and a server communication module, and the electroencephalogram acquisition module, the browser communication module and the server communication module are all connected with the data processing module;
the electroencephalogram acquisition module is used for receiving electroencephalogram data transmitted by the electroencephalograph and transmitting the electroencephalogram data to the data processing module;
the data processing module is used for adding timestamp information to the electroencephalogram data and then transmitting the timestamp information to the browser application component and the server-side component through the browser communication module and the server-side communication module.
Preferably, the electroencephalogram data acquisition component further comprises a file management module, the file management module is connected with the data processing module, and the file management module is used for storing the electroencephalogram data containing the timestamp on a local computer in a data file form and transmitting the stored local data file to a server for storage through the server communication module.
Preferably, the browser application component comprises a local communication module, a first network communication module, a user interface module and a brain-computer interface module, and the local communication module, the first network communication module and the brain-computer interface module are all connected with the user interface module;
the user interface module is used for providing a system operation menu, an operation interface and graphic display of electroencephalogram data and providing a user interaction function;
the brain-computer interface module is used for realizing a brain-computer interface experimental paradigm and providing an interactive interface for brain-computer interface operation for a user;
the local communication module is connected with the electroencephalogram data acquisition component and is used for receiving electroencephalogram data which are sent by the electroencephalogram data acquisition component and contain timestamp information;
the first network communication module is connected with the service end component and used for carrying out data interaction with the service end component based on a Web page.
Preferably, the brain-computer interface module is further configured to perform calculation according to the electroencephalogram data including the timestamp information, the interface element data, and the user operation data, and directly feed back a calculation result to the user.
Preferably, the brain-computer interface module comprises an SSVEP brain-computer interface module, and the SSVEP brain-computer interface module is used for providing an interactive interface in an SSVEP experiment process and flickering of a stimulation target.
Preferably, the browser application component further comprises an operation recording module, wherein the operation recording module is used for recording interface element data and corresponding user operation data displayed in an interactive interface of the brain-computer interface module, and transmitting the interface element data and the user operation data to the electroencephalogram data acquisition component through the local communication module.
Preferably, the service end component comprises a second network communication module, an application service module and an algorithm management module, and the second network communication module and the algorithm management module are both connected with the application service module;
the second network communication module is connected with the electroencephalogram data acquisition component and the browser application component and is used for receiving electroencephalogram data, interface element data and user operation data which are transmitted by the electroencephalogram data acquisition component or the browser application component and contain timestamp information;
the application service module is used for providing Web application service;
the algorithm management module is used for providing algorithm management and operation for a user, and the algorithm is a brain-computer interface algorithm.
Preferably, the server-side component further includes a data storage module, the data storage module is connected to the application service module, and the data storage module is configured to store data.
Preferably, the electroencephalogram data acquisition component and the browser application component are connected through a UDP/TCP/WebSocket network communication protocol.
Preferably, the server-side component and the browser application component are connected through a TCP/HTTP/WebSocket network communication protocol.
Compared with the prior art, the method has the following beneficial effects:
according to the brain-computer interface system based on the Internet, the brain-computer interface system is deployed by adopting the B/S architecture, a user does not need to independently install special software, interactive operation of the brain-computer interface system can be performed by opening a webpage by using a browser, the compatibility problem of the special software and different operating systems is avoided, the operation flow and process of electroencephalogram data acquisition, stimulation presentation and user interaction are simplified, and the system is easy to deploy and implement. Meanwhile, the algorithm is deployed in the cloud server, the computing power of the cloud server can be utilized to meet the requirement of the complexity of the algorithm on the computing performance, and therefore real-time computing of the complex electroencephalogram algorithm can be achieved.
Drawings
To more intuitively illustrate the prior art and the present application, several exemplary drawings are given below. It should be understood that the specific shapes, configurations and illustrations in the drawings are not to be construed as limiting, in general, the practice of the present application; for example, it is within the ability of those skilled in the art to make routine adjustments or further optimization of the add/drop/attribute division, specific shapes, positional relationships, connection manners, size ratios, etc. of certain elements (components) based on the technical concepts disclosed in the present application and the exemplary drawings.
Fig. 1 is a block diagram of an internet-based brain-computer interface system according to an embodiment of the present disclosure;
FIG. 2 is a flowchart of the operation of an Internet-based brain-computer interface system provided by an embodiment of the present application;
FIG. 3 is a logical structure diagram of an electroencephalogram data acquisition component provided in the present embodiment;
FIG. 4 is a logical block diagram of a browser application component provided in an embodiment of the present application;
FIG. 5 is a SSVEP brain-computer interface module interface diagram provided in an embodiment of the present application;
fig. 6 is a logical structure diagram of a server component according to an embodiment of the present application.
Detailed Description
The present application will be described in further detail below with reference to specific embodiments in conjunction with the accompanying drawings.
In the description of the present application: "plurality" means two or more unless otherwise specified. The terms "first", "second", "third", and the like in this application are intended to distinguish the referenced objects without particular meaning in the technical meaning (e.g., emphasis on degree or order of importance, etc.) being construed). The terms "comprising," "including," "having," and the like, are intended to be inclusive and mean "not limited to" (some elements, components, materials, steps, etc.).
In the present application, terms such as "upper", "lower", "left", "right", "middle", and the like are generally used for easy visual understanding with reference to the drawings, and are not intended to absolutely limit the positional relationship in an actual product. Changes in these relative positional relationships are also considered to be within the scope of the present disclosure without departing from the technical concepts disclosed in the present disclosure.
Referring to fig. 1 and 2, an embodiment of the present invention provides an internet-based brain-computer interface system, which includes an electroencephalograph, an electroencephalogram data acquisition component, a browser application component, and a server component; the electroencephalograph, the electroencephalogram data acquisition component and the browser application component are deployed at a client, the server component is deployed at a server, the electroencephalogram is connected with the electroencephalogram data acquisition component, the electroencephalogram data acquisition component is connected with the browser application component, the electroencephalogram data acquisition component is connected with the server component, and the browser application component is connected with the server component.
Electroencephalograph
Specifically, the electroencephalograph is preferably a CULabPro eight-lead electroencephalograph, the electroencephalograph is worn on the head of a tested subject, the electroencephalograph acquires electroencephalogram data of the tested subject in real time through 8 electroencephalogram electrodes placed at the position of the tested scalp, a brain-computer interface system based on an SSVEP standard test paradigm is realized, the 8 electrodes are placed according to the international 10-20 system standard, and the positions are PO3, POz, PO4, PO7, PO8, O1, oz and O2 respectively. The electroencephalograph is connected with the electroencephalogram data acquisition component and transmits the acquired electroencephalogram data to the electroencephalogram data acquisition component. The electroencephalograph and electroencephalogram data acquisition component can be connected in a wireless data transmission mode or a wired data transmission mode. The wireless data transmission can adopt wireless communication technology of WIFI or Bluetooth. The wired data transmission is realized by connecting the electroencephalograph with a parallel port or a serial port or a USB port of a computer through a cable.
Electroencephalogram data acquisition assembly
Specifically, the electroencephalogram data acquisition component is a software component running on a computer, is an independently running software, and can also be a browser extension program. The electroencephalogram data acquisition component is automatically downloaded and installed when a user logs in the system by using a web browser for the first time.
The electroencephalogram data acquisition component is connected with the browser application component. The electroencephalogram data acquisition component is used as independently running software, and the connection between the electroencephalogram data acquisition component and the browser application component can adopt a UDP/TCP/WebSocket network communication protocol. The electroencephalogram data acquisition component is used as a browser extension program, and the connection between the electroencephalogram data acquisition component and the browser application component is established in a JavaScript calling mode.
Referring to fig. 3, the electroencephalogram data acquisition component further includes an electroencephalogram acquisition module, a browser communication module, a data processing module, a server communication module, and a file management module. The electroencephalogram acquisition module receives electroencephalogram data transmitted by the electroencephalograph, transmits the electroencephalogram data to the data processing module, and the data processing module adds timestamp information to the electroencephalogram data. The data processing module transmits the electroencephalogram data containing the timestamp to the server communication module, the server communication module is connected with the server assembly, and the data are transmitted to the server assembly. The data processing module also transmits the electroencephalogram data containing the timestamp to the browser communication module, the browser communication module provides a WebSocket network communication service function, the browser application component is connected with the browser communication module through a WebSocket network communication protocol, and the browser communication module transmits the electroencephalogram data containing the timestamp to the browser application component. Further, the file management module stores the electroencephalogram data containing the time stamp on the local computer in a data file form. And the file management module transmits the stored local data file to the server side for storage through the server side communication module.
Browser application component
Specifically, the browser application component is a group of front-end web pages running in a web browser, and the browser application component and the server component are connected through a network. And the deployment process of the browser application component does not need to be carried out by separately installing software. Users can open the web page by using a web browser of a computer, such as a website provided by a Google browser login system, and can download the web page from a server component and load a browser application component. The page of the browser application component is realized based on the Html and the JavaScript, and a system operation interface facing user interaction is provided.
Referring to fig. 4, the browser application component includes a local communication module, a first network communication module, a user interface module, an operation recording module, and a plurality of brain-computer interface modules.
The local communication module is connected with the electroencephalogram data acquisition component, the local communication module is connected with a WebSocket service port of a browser communication module in the electroencephalogram data acquisition component through a WebSocket communication protocol, and electroencephalogram data containing timestamps from the electroencephalogram data acquisition component are acquired in real time through the WebSocket communication protocol.
The first network communication module is connected with the service end component through a TCP/HTTP/WebSocket network communication protocol, so that data interaction with the service end component based on a Web page is realized, and functions of logging in, logging out, acquiring a brain-computer interface module list and the like are included. The user interface module provides a system operation menu and an operation interface, the electroencephalogram data are displayed graphically on the page, and a user can judge whether the electroencephalogram electrodes are in good contact, whether the electroencephalogram data are normal, whether the test can be started and the like according to the electroencephalogram data displayed in real time on the page. Further, the user interface module provides user interaction functions, including mouse click, keyboard operation and other user interactions, such as start, stop and other operation buttons. The number of the brain-computer interface modules can be multiple, a user selects the brain-computer interface module to be used through the user interface module, each brain-computer interface experimental paradigm is an independent brain-computer interface module, and the brain-computer interface module provides an interactive interface for the operation of the brain-computer interface for the user. Furthermore, if the computing performance of the local computer meets the algorithm requirement, the brain-computer interface module can also realize the algorithm function of the brain-computer interface, namely, the calculation is carried out by combining the electroencephalogram data with the time stamp, the interface element data and the user operation data, and the calculation result is directly fed back to the user. For example, the SSVEP brain-computer interface module provides an interactive interface in the SSVEP experimental process and a flickering function of a stimulation target. Furthermore, the SSVEP brain-computer interface module can calculate the result by combining the brain-computer data with the time stamp and the interface element data, namely which target the user gazes at, and feeds the calculation result back to the user through the interactive interface.
Referring to fig. 5, the present embodiment includes a brain-computer interface module in SSVEP experimental paradigm. The brain-computer interface module provides an interactive interface for the operation of the brain-computer interface for a user, and in this embodiment, the SSVEP brain-computer interface module provides an interactive interface in the SSVEP experimental process and a flickering function of a stimulation target. Fig. 4 illustrates an operation interface of the SSVEP brain-computer interface module, where the screen has 10 white blocks flashing at different frequencies, and the flashing frequency of each block is different, and in the use process, the target to be operated is the block with a red outer frame, the red frame prompt is switched to other blocks within a fixed time, and the block with the red frame prompt is required to be watched all the time by the subject. The operation recording module records all interface element data contents and corresponding user operation data displayed in the interactive interface of the brain-computer interface module. The interface element data refers to the description contents of various stimulation elements presented on the interface and the appearance and disappearance time of the stimulation elements, and in this embodiment, the interface element data includes the position coordinates, the flashing frequency and the number of the number represented by each of 10 blocks on the screen, and the number of the target block flashing in sequence during the test process, the flashing frequency corresponding to the target block, the time for starting flashing, the time for stopping flashing, and other data. The user operation data comprises data such as operation contents and operation time of a keyboard and a mouse, which are performed by a user aiming at the interface prompt information. The operation recording module transmits the recorded interface element data and the user operation data to the electroencephalogram data acquisition component through the local communication module, and the file management module of the electroencephalogram data acquisition component stores the interface element data and the user operation data on a local computer in a data file form. Furthermore, the file management module of the electroencephalogram data acquisition component transmits the recorded interface element data, the user operation data file and the electroencephalogram data containing the timestamp to the server end component through the server end communication module, and it should be noted that the browser application component can also directly transmit the recorded interface element data, the user operation data file and the electroencephalogram data containing the timestamp to the server end component through the first network communication module.
Service end component
The server component is deployed on the cloud server. The service end component provides dynamic website application service based on Web, and a user can load the browser application component by opening a website address provided by the service end component through a browser.
Referring to fig. 6, the service end component includes a second network communication module, an application service module, an algorithm management module, and a data storage module.
The second network communication module is connected with the electroencephalogram data acquisition component through a network. The second network communication module provides a TCP/IP-based network communication service function. The electroencephalogram data acquisition component transmits electroencephalogram data containing timestamp information, interface element data and user operation data to the server component in real time. Furthermore, the browser application component is also connected with the second network communication module, and the browser application component can also transmit the electroencephalogram data, the interface elements and the data user operation data containing the timestamp information to the server end component.
The application service module provides Web application services, and comprises functions of logging in and out of a user, acquiring a computer interface module list and other website back-end services and the like. The algorithm management module provides algorithm management and operation functions for the user, and the user can deploy a brain-computer interface algorithm of the user in the server-side component, in this embodiment, a python algorithm of the SSVEP is deployed. The server-side component receives electroencephalogram data with timestamp information, interface element data and user operation data from the client side through the second network communication module, the data are transmitted to the algorithm management module, the algorithm management module performs calculation by combining the deployed SSVEP algorithm and the data, then the calculation result is transmitted to the browser application component through the second network communication module, the calculation result of the embodiment comprises data such as a target number of a tested current gazing analyzed from electroencephalogram signals, and if the calculation result target is consistent with the target of the tested gazing, the target is displayed in a red background to indicate that algorithm calculation is correct. If the calculated result target and the target to be observed in the test are inconsistent, the square corresponding to the calculated result target is displayed with a red background. For example, the target 2 is observed in the test, at this time, the target 2 has a red outline prompt, the server calculates the feedback and is also the target 2, and the target 2 is entirely a red background; if the server calculates that the feedback is the target 3, the target 3 is a red background as a whole, and the target 2 still keeps a red outer frame prompting state. The tested object can judge whether the operation is correct or not according to the difference of the background colors of the target blocks.
The data storage module realizes the data storage function, and stores the electroencephalogram data with the timestamp information, the interface element data, the user operation data and the calculation result which are received by the server-side component in the server-side. Furthermore, the data storage module receives data files uploaded by the file management module of the electroencephalogram data acquisition component through the second network communication module, the data files are stored in the server, and a user can download the data and the files at any time to perform offline data analysis.
The brain-computer interface system is deployed by adopting the B/S architecture, a user does not need to independently install special software, and can carry out interactive operation on the brain-computer interface system in a mode of opening a webpage by using a browser, so that the compatibility problem of the special software and different operating systems is avoided, the operation processes and processes of electroencephalogram data acquisition, stimulation presentation and user interaction are simplified, and the system is easy to deploy and implement. Meanwhile, the algorithm is deployed in the cloud server, the computing power of the cloud server can be used for meeting the requirement of the complexity of the algorithm on the computing performance, and therefore real-time computing of the complex electroencephalogram algorithm can be achieved.
All the technical features of the above embodiments can be arbitrarily combined (as long as there is no contradiction between the combinations of the technical features), and for brevity of description, all the possible combinations of the technical features in the above embodiments are not described; these examples, which are not explicitly described, should be considered to be within the scope of the present description.
The present application has been described in considerable detail with reference to the foregoing general description and specific examples. It should be understood that several conventional adaptations or further innovations of these specific embodiments may also be made based on the technical idea of the present application; however, such conventional modifications and further innovations can also fall into the scope of the claims of the present application as long as they do not depart from the technical idea of the present application.
Claims (10)
1. The brain-computer interface system based on the Internet is characterized by comprising a brain computer, a brain electrical data acquisition component, a browser application component and a server component, wherein the brain computer, the brain electrical data acquisition component and the browser application component are deployed at a client side, and the server component is deployed at a server side;
the electroencephalograph is worn on the head of a subject and used for acquiring electroencephalogram data of the subject in real time and transmitting the acquired electroencephalogram data to the electroencephalogram data acquisition component;
the electroencephalogram data acquisition component is used for receiving electroencephalogram data transmitted by the electroencephalograph, adding timestamp information to the electroencephalogram data and transmitting the electroencephalogram data to the browser application component and the server component;
the browser application component is used for providing a system operation interface for a user through a web browser, receiving and displaying electroencephalogram data containing timestamp information sent by the electroencephalogram data acquisition component, recording interface element data and user operation data, and transmitting the interface element data and the user operation data to the server end component;
the server-side component is used for providing a dynamic website application service based on Web, calculating according to an internal deployed brain-computer interface algorithm and received electroencephalogram data, and transmitting a calculation result to the browser application component for displaying.
2. The internet-based brain-computer interface system of claim 1, wherein the brain electrical data acquisition component comprises a brain electrical acquisition module, a browser communication module, a data processing module and a server communication module, the brain electrical acquisition module, the browser communication module and the server communication module are all connected with the data processing module;
the electroencephalogram acquisition module is used for receiving electroencephalogram data transmitted by the electroencephalograph and transmitting the electroencephalogram data to the data processing module;
the data processing module is used for adding timestamp information to the electroencephalogram data and then transmitting the timestamp information to the browser application component and the server component through the browser communication module and the server side communication module.
3. The internet-based brain-computer interface system of claim 2, wherein the brain electrical data acquisition component further comprises a file management module, the file management module is connected with the data processing module, and the file management module is configured to store the brain electrical data containing the timestamp on a local computer in a data file form, and transmit the stored local data file to a server for storage through the server communication module.
4. The internet-based brain-computer interface system of claim 1, wherein the browser application component includes a local communication module, a first network communication module, a user interface module, and a brain-computer interface module, the local communication module, the first network communication module, and the brain-computer interface module all being connected to the user interface module;
the user interface module is used for providing a system operation menu, an operation interface and graphic display of electroencephalogram data and providing a user interaction function;
the brain-computer interface module is used for realizing a brain-computer interface experimental paradigm and providing an interactive interface for brain-computer interface operation for a user;
the local communication module is connected with the electroencephalogram data acquisition component and is used for receiving electroencephalogram data which are sent by the electroencephalogram data acquisition component and contain timestamp information;
the first network communication module is connected with the service end component and used for carrying out data interaction with the service end component based on a Web page.
5. The internet-based brain-computer interface system of claim 4, wherein the brain-computer interface module is further configured to perform calculation according to the electroencephalogram data including the timestamp information, the interface element data, and the user operation data, and directly feed back the calculation result to the user.
6. The internet-based brain-computer interface system of claim 4, wherein the brain-computer interface module comprises an SSVEP brain-computer interface module, and the SSVEP brain-computer interface module is used for providing an interactive interface during an SSVEP experiment and flickering of a stimulation target.
7. The internet-based brain-computer interface system according to claim 4, wherein said browser application component further comprises an operation recording module, said operation recording module is configured to record interface element data and corresponding user operation data displayed in an interactive interface of said brain-computer interface module, and transmit the interface element data and the user operation data to said electroencephalogram data acquisition component through said local communication module.
8. The internet-based brain-computer interface system of claim 1, wherein the service-side component comprises a second network communication module, an application service module, and an algorithm management module, the second network communication module and the algorithm management module both being connected to the application service module;
the second network communication module is connected with the electroencephalogram data acquisition component and the browser application component and is used for receiving electroencephalogram data, interface element data and user operation data which are transmitted by the electroencephalogram data acquisition component or the browser application component and contain timestamp information;
the application service module is used for providing Web application service;
the algorithm management module is used for providing algorithm management and operation for a user, and the algorithm is a brain-computer interface algorithm.
9. The internet-based brain-computer interface system of claim 8, wherein the server component further comprises a data storage module, the data storage module is connected with the application service module, and the data storage module is configured to implement data storage.
10. The internet-based brain-computer interface system of claim 1, wherein the brain electrical data acquisition component and the browser application component are connected through UDP/TCP/WebSocket network communication protocol.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210944514.7A CN115277665A (en) | 2022-08-08 | 2022-08-08 | Brain-computer interface system based on internet |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210944514.7A CN115277665A (en) | 2022-08-08 | 2022-08-08 | Brain-computer interface system based on internet |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115277665A true CN115277665A (en) | 2022-11-01 |
Family
ID=83748208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210944514.7A Pending CN115277665A (en) | 2022-08-08 | 2022-08-08 | Brain-computer interface system based on internet |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115277665A (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050155043A1 (en) * | 2004-01-08 | 2005-07-14 | Schulz Kurt S. | Human-machine interface system and method for remotely monitoring and controlling a machine |
| CN103543836A (en) * | 2013-10-28 | 2014-01-29 | 哈尔滨工业大学 | Full-automatic webpage browsing control method based on brain-computer interface |
| CN104090653A (en) * | 2014-06-16 | 2014-10-08 | 华南理工大学 | Detecting method for multi-modal brain switch based on SSVEP and P300 |
| CN106777861A (en) * | 2016-01-11 | 2017-05-31 | 北京视友科技有限责任公司 | A kind of cognitive and brain TV university data system |
| US20170188932A1 (en) * | 2015-12-31 | 2017-07-06 | Brainscope Company, Inc. | System and methods for neurological monitoring and assisted diagnosis |
| KR20180123365A (en) * | 2017-05-08 | 2018-11-16 | 고려대학교 산학협력단 | Apparatus and method for context recognizable brain-machine interface |
| CN110704467A (en) * | 2019-10-12 | 2020-01-17 | 上海智引信息科技有限公司 | System and method for realizing real-time data updating processing based on B/S architecture |
| CN112859628A (en) * | 2021-01-19 | 2021-05-28 | 华南理工大学 | Intelligent home control method based on multi-mode brain-computer interface and augmented reality |
| CN113282180A (en) * | 2021-07-07 | 2021-08-20 | 中国工商银行股份有限公司 | Interaction system, method and device based on brain-computer interface |
| US20210316459A1 (en) * | 2020-04-08 | 2021-10-14 | Smart Building Tech Co., Ltd. | Cloud based computer-implemented system and method for computer-assisted planning and simulation of robot motions in construction |
| KR20220053329A (en) * | 2020-10-22 | 2022-04-29 | 조선대학교산학협력단 | Device and Method for Multi-functional Brain Computer Interface(BCI) |
-
2022
- 2022-08-08 CN CN202210944514.7A patent/CN115277665A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050155043A1 (en) * | 2004-01-08 | 2005-07-14 | Schulz Kurt S. | Human-machine interface system and method for remotely monitoring and controlling a machine |
| CN103543836A (en) * | 2013-10-28 | 2014-01-29 | 哈尔滨工业大学 | Full-automatic webpage browsing control method based on brain-computer interface |
| CN104090653A (en) * | 2014-06-16 | 2014-10-08 | 华南理工大学 | Detecting method for multi-modal brain switch based on SSVEP and P300 |
| US20170188932A1 (en) * | 2015-12-31 | 2017-07-06 | Brainscope Company, Inc. | System and methods for neurological monitoring and assisted diagnosis |
| CN106777861A (en) * | 2016-01-11 | 2017-05-31 | 北京视友科技有限责任公司 | A kind of cognitive and brain TV university data system |
| KR20180123365A (en) * | 2017-05-08 | 2018-11-16 | 고려대학교 산학협력단 | Apparatus and method for context recognizable brain-machine interface |
| CN110704467A (en) * | 2019-10-12 | 2020-01-17 | 上海智引信息科技有限公司 | System and method for realizing real-time data updating processing based on B/S architecture |
| US20210316459A1 (en) * | 2020-04-08 | 2021-10-14 | Smart Building Tech Co., Ltd. | Cloud based computer-implemented system and method for computer-assisted planning and simulation of robot motions in construction |
| KR20220053329A (en) * | 2020-10-22 | 2022-04-29 | 조선대학교산학협력단 | Device and Method for Multi-functional Brain Computer Interface(BCI) |
| CN112859628A (en) * | 2021-01-19 | 2021-05-28 | 华南理工大学 | Intelligent home control method based on multi-mode brain-computer interface and augmented reality |
| CN113282180A (en) * | 2021-07-07 | 2021-08-20 | 中国工商银行股份有限公司 | Interaction system, method and device based on brain-computer interface |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102362001B1 (en) | Method and system for providing eye tracking based information about a user behavior, client device, server and computer program product | |
| CN111343917B (en) | Method for hosting mobile access to high resolution electroencephalogram data | |
| CN211001203U (en) | Human-vehicle interaction system based on electroencephalogram signals | |
| CN103699226A (en) | Tri-modal serial brain-computer interface method based on multi-information fusion | |
| Breitwieser et al. | Proposing a standardized protocol for raw biosignal transmission | |
| US20080082020A1 (en) | System and method for biofeedback administration | |
| CN105516803B (en) | Scene state acquisition methods and system | |
| US20100094156A1 (en) | System and Method for Biofeedback Administration | |
| CN104182048A (en) | Brain-computer interface based telephone system and call method thereof | |
| CN105260025A (en) | Mobile terminal based steady-state visual evoked potential brain computer interface system | |
| Lightbody et al. | A user centred approach for developing Brain-Computer Interfaces | |
| CN103543836A (en) | Full-automatic webpage browsing control method based on brain-computer interface | |
| Sadeghi et al. | Optimization of brain mobile interface applications using IoT | |
| CN110554831A (en) | Operation synchronization method, device, equipment and storage medium | |
| CN103595715A (en) | Information sharing method and device for desktop live broadcasting | |
| Marin et al. | Drone control based on mental commands and facial expressions | |
| CN111338473A (en) | Brain electrical signal-based rehabilitation training method, computer device and computer-readable storage medium | |
| CN112380937A (en) | Mobile end eye movement tracking driven intelligent classroom teaching visual analysis method and system | |
| CN111317469A (en) | Brain wave monitoring equipment, system and monitoring method | |
| CN116360600A (en) | Space positioning system based on steady-state visual evoked potential | |
| CN115145776A (en) | Automatic testing method, device, equipment, system and storage medium | |
| CN113053492B (en) | Self-adaptive virtual reality intervention system and method based on user background and emotion | |
| CN115277665A (en) | Brain-computer interface system based on internet | |
| CN116088686B (en) | Electroencephalogram tracing motor imagery brain-computer interface training method and system | |
| CN114169366B (en) | Neural feedback training system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |