CN211001203U - Human-vehicle interaction system based on electroencephalogram signals - Google Patents
Human-vehicle interaction system based on electroencephalogram signals Download PDFInfo
- Publication number
- CN211001203U CN211001203U CN201921964304.4U CN201921964304U CN211001203U CN 211001203 U CN211001203 U CN 211001203U CN 201921964304 U CN201921964304 U CN 201921964304U CN 211001203 U CN211001203 U CN 211001203U
- Authority
- CN
- China
- Prior art keywords
- vehicle
- electroencephalogram
- electroencephalogram signal
- cursor
- signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The utility model provides a people-vehicle interactive system based on brain electrical signal, include: the display device is arranged at the position of a console in the vehicle, the display interface of the display device is arranged into a plurality of areas, each area is provided with a flickering cursor with different flickering frequencies for carrying out visual stimulation on human brain to induce different electroencephalogram signals, and each flickering cursor corresponds to a certain instruction of different vehicle-mounted subcomponents respectively; the head-wearing electroencephalogram signal acquisition equipment is used for acquiring electroencephalogram signals in real time and amplifying and converting analog signals; and the electroencephalogram signal processing unit is used for controlling the display equipment to display each flashing cursor, processing the electroencephalogram signals, analyzing the control instructions corresponding to the electroencephalogram signals, and feeding the control instructions back to the vehicle central console to control the corresponding vehicle-mounted sub-components. The utility model discloses a human-vehicle interaction control based on EEG signal.
Description
Technical Field
The utility model relates to a digital electrode technical field of biological electricity signal collection, in particular to people car interactive system based on EEG signal.
Background
The brain-computer interface is a new type of man-machine interaction technology, and is a communication control system independent of the normal output channel of peripheral nerve and muscle of human brain, and it establishes a direct communication and control channel between human brain and computer or other electronic equipment by collecting and analyzing human brain bioelectricity signals, so that human can express will or operate equipment through brain, and does not need to use language or limb action. At present, commonly used electroencephalogram signals include a P300 potential and a steady-state visual evoked potential.
The P300 event-related potential (P300-REP, hereinafter referred to as P300) is a response to an external stimulus observed from electroencephalography (EEG) recorded on the scalp of a human. The P300 response has proven to be a reliable signal that can be used to control a brain-computer interface (BCI). Steady State Visual Evoked Potential (SSVEP) is a type of evoked potential (VEP) that when a person stares at a stimulus that continuously flashes at a frequency, the brain produces an electroencephalogram signal that is the same or in a harmonic relationship to the stimulus frequency, especially at the occipital and apical areas of the brain. If the electroencephalogram signal with the characteristics can be identified, whether the person stares at the stimulation interface or not can be judged, and then the intention of the person can be read.
The brain-computer interface technology can be applied to various aspects, for example, in the application of a human-vehicle interaction system, the brain-computer interface technology provides a new interaction mode possibility for the human-vehicle interaction system, the brain-computer signal is utilized to carry out detection of a non-driving task and detection of whether the task is executed or not in a parallel mode, then the non-driving task is executed by a vehicle-mounted device, the human-vehicle system does not need a driver to have any limb movement or language related to the non-driving task, only needs the driver to carry out the corresponding brain-computer interface task, and analyzes the brain-computer signal through the system, so that the novel interaction mode of the non-driving task, namely a human and a vehicle, is realized.
SUMMERY OF THE UTILITY MODEL
In view of this, the utility model discloses a main aim at provides a people car interactive system based on brain electrical signal sees the produced brain electrical signal when different scintillation icons through gathering the driver to carry out the analysis and acquire driver's control intention, thereby realize the control to on-vehicle subcomponent, liberate driver's both hands, improved driving safety and travelling comfort.
The utility model discloses a technical scheme do, a man-car interactive system based on brain electrical signal, include:
the display device is arranged at the position of a console in the vehicle, the display interface of the display device is arranged into a plurality of areas, each area is provided with a flickering cursor with different flickering frequencies for carrying out visual stimulation on human brain to induce different electroencephalogram signals, and each flickering cursor corresponds to a certain instruction of different vehicle-mounted subcomponents respectively;
the head-wearing electroencephalogram signal acquisition equipment is used for acquiring electroencephalogram signals in real time and amplifying and converting analog signals;
and the electroencephalogram signal processing unit is used for controlling the display equipment to display each flashing cursor, processing the electroencephalogram signals, analyzing the control instructions corresponding to the electroencephalogram signals, and feeding the control instructions back to the vehicle central console to control the corresponding vehicle-mounted sub-components.
By the method, a plurality of flashing cursors with different frequencies are preset in the display device, each flashing cursor corresponds to one vehicle-mounted sub-component, when a driver wearing the electroencephalogram signal acquisition device watches one flashing cursor, an electroencephalogram signal can be generated, the electroencephalogram signal is analyzed to analyze a control instruction of the vehicle-mounted sub-component corresponding to the electroencephalogram signal, the control instruction is issued to the vehicle central console, the vehicle central console is enabled to execute control of the corresponding vehicle-mounted sub-component, human-vehicle interaction is achieved, the hands of the driver are liberated, the driver is enabled to be concentrated in driving, and driving safety is provided.
The electroencephalogram signal acquisition equipment comprises head-wearing electroencephalogram acquisition equipment, and the electroencephalogram sensor, the signal amplifier and the analog-to-digital converter are sequentially connected inside the electroencephalogram signal acquisition equipment.
The brain wave sensor is used for collecting electric signals of human brain, and because the electric signals are small, the brain wave sensor can output brain signals with large signal values after being amplified by the signal amplifier and converted by the analog-to-digital converter, and is convenient to process and analyze.
The improved vehicle-mounted Internet of things system further comprises an intelligent gateway for realizing communication between the electroencephalogram signal processing unit and vehicle-mounted Internet of things equipment.
By last, through setting up an intelligent gateway, play the effect of route transfer to other on-vehicle thing networking equipment of user installation in the vehicle, for example intelligent audio amplifier, on-vehicle clarifier etc. and realize wireless control.
The electroencephalogram signal processing unit comprises an acquisition module, a main control module and a communication module which are connected in sequence;
the acquisition module acquires the electroencephalogram signals output by the electroencephalogram signal acquisition equipment;
the main control module is pre-stored with corresponding logic of the electroencephalogram signal and the flashing cursor, processes the relevant potential of the electroencephalogram signal according to the corresponding logic, and analyzes a control instruction corresponding to the electroencephalogram signal;
and the communication module sends the control instruction to a center console.
By last, the correspondence logic of EEG signal and scintillation cursor has been prestored in the host system, this correspondence logic is usually for being applicable to current user's specific logic rule, and can carry out self-learning and self-perfecting according to user's custom, gather the EEG signal that EEG signal collection equipment output through collection module after, according to the corresponding logical analysis this EEG signal corresponds scintillation cursor and its control command, then with the control command that the analysis was gone out send to vehicle console or intelligent gateway, thereby realize the control to on-vehicle subcomponent or other on-vehicle thing networking equipment.
In a further improvement, the electroencephalogram signal processing unit further comprises a flicker control module connected with the main control module, and the flicker control module receives instructions of the main control module to control a flicker cursor and flicker frequency displayed by the display device.
By the aid of the flicker control module, the quantity and frequency of the flicker cursors on the display interface can be controlled, increase, deletion or other settings of vehicle-mounted subcomponents or vehicle-mounted internet of things equipment are supported, and user requirements are met.
In a further improvement, the electroencephalogram signal acquisition equipment realizes data communication with the electroencephalogram signal processing unit through an HDMI data wire.
By the above, the electroencephalogram signals collected by the electroencephalogram signal collecting equipment can be accurately and quickly transmitted to the signal processing unit by adopting the HDMI data lines, so that data loss or time delay is prevented.
Drawings
FIG. 1 is a schematic diagram of a human-vehicle interaction system based on electroencephalogram signals;
FIG. 2 is a schematic diagram of the module of the EEG signal acquisition device of the present invention;
fig. 3 is a schematic diagram of the module of the electroencephalogram signal processing unit of the present invention.
Detailed Description
The following describes in detail a specific embodiment of the human-vehicle interaction system based on electroencephalogram signals according to the present invention with reference to fig. 1 to 3.
As shown in fig. 1, the utility model provides a schematic diagram of a human-vehicle interaction system based on electroencephalogram signals, in a preferred embodiment of the present invention, the system includes a display device 100 disposed at a console 400 of a vehicle, a head-mounted electroencephalogram signal collecting device 200, an electroencephalogram signal processing unit 300, a vehicle-mounted sub-component 500, and an intelligent gateway 600;
the display device 100 is arranged at the position of the center console 400 of the vehicle, is connected with the center console 400, and has a display interface arranged in a plurality of areas, and flashes the flashing cursors with different frequencies respectively, wherein each flashing cursor corresponds to the control instruction of different vehicle-mounted subcomponents, which are generally an air conditioner, a vehicle lamp, a video-audio system, a socket, a key and the like connected with the center console of the vehicle;
as shown in a block schematic diagram of the brain electric signal collecting apparatus of fig. 2, an internal circuit part of the head-mounted brain electric signal collecting apparatus 200 includes a brain wave sensor 210, a signal amplifier 220 and an analog-to-digital converter 230 which are connected in sequence, when a driver tries to turn on or off a certain vehicle-mounted sub-component (such as an air conditioner) in the vehicle, the driver only needs to wear the flashing icon corresponding to the vehicle-mounted sub-component displayed on the brain wave acquisition device watching display device and keep for a period of time, the brain of the user can induce and generate an electroencephalogram signal under the visual stimulation of the flickering icon, the signal value of the electroencephalogram signal corresponds to the frequency of the flickering icon, the electroencephalogram signal is collected through the electroencephalogram sensor 210, and after being amplified in equal proportion by the signal amplifier 220, the amplified signal is sent to the analog-to-digital converter 230 for conversion, and sends the converted electroencephalogram signal to the electroencephalogram signal processing unit 300 through the HDMI data line;
as shown in the block schematic diagram of the electroencephalogram signal processing unit in fig. 3, the electroencephalogram signal processing unit 300 is configured to process the amplified and converted electroencephalogram signal, analyze a control instruction corresponding to the electroencephalogram signal, and send the control instruction to the console 400 of the vehicle;
the electroencephalogram signal processing unit 300 comprises an acquisition module 310, a main control module 320 and a communication module 330 which are connected in sequence; the acquisition module 310 is configured to acquire an electroencephalogram signal output by the electroencephalogram signal acquisition device 200; the main control module 320 is pre-stored with corresponding logic of the electroencephalogram signal and the flashing cursor, the corresponding logic is a specific logic rule generally suitable for the current user, and can acquire the use habits of the user in real time to carry out self-learning and self-perfecting, so that the corresponding logic is more intelligent and accurate and accords with the use habits of the user, the main control module 320 processes the relevant potential of the electroencephalogram signal according to the corresponding logic and analyzes the control instruction of the vehicle-mounted sub-component corresponding to the electroencephalogram signal; the communication module 330 sends the analyzed control command to the console 400, and the console 400 controls the corresponding vehicle-mounted sub-component 500;
in addition, the electroencephalogram signal processing unit 300 further includes a flicker control module 340, and the flicker control module 340 can control or modify the number of the flicker icons, the flicker frequency, or the corresponding vehicle-mounted sub-components in the display device 100 under the control of the main control module 320. In this embodiment, the user can set the relevant vehicle-mounted sub-components and the corresponding flashing icons on the APP managing the electroencephalogram signal processing unit 300, and can modify the colors, frequencies and the like of the flashing icons according to own habits, and simultaneously support the operations of adding and deleting the flashing icons so as to meet the use habits of different users.
The electroencephalogram signal processing unit 300 and the console 400 can adopt an HDMI data communication mode or a wireless communication mode to transmit related control instructions.
The intelligent gateway 600 mainly plays a role in routing transfer, and along with the development of the internet of things devices, a user generally needs to add some vehicle-mounted internet of things devices 700 in a vehicle, such as an intelligent sound box, a vehicle-mounted purifier and the like, so as to improve the comfort of the vehicle, at the moment, the intelligent gateway 600 can realize the communication between the electroencephalogram signal processing unit 300 and the vehicle-mounted internet of things devices 700, and add a flashing cursor of an associated control instruction corresponding to the vehicle-mounted internet of things devices 700 into the display device 100 for display, so as to realize the electroencephalogram control of the vehicle-mounted internet of things devices 700.
In addition, the electroencephalogram signal processing unit 300 of the present invention can also be connected to a cloud control subsystem, so as to facilitate cloud software update, database update, or user binding. The cloud control subsystem comprises an API (application programming interface) module, a user management module and a data management module; the Application Programming Interface (API) module may implement communication, programming control, or update management with the electroencephalogram signal processing unit; the user management module can be used for managing and binding the user and the equipment; the data management module can store a flashing cursor, an electroencephalogram signal and corresponding logic aiming at the system in a database, so that a user can download and update from a cloud terminal anytime and anywhere.
The above description is only a preferred embodiment of the present invention, and should not be taken as limiting the invention, and any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (6)
1. The utility model provides a people car interactive system based on brain electrical signal which characterized in that includes:
the display device is arranged at the position of a console in the vehicle, the display interface of the display device is arranged into a plurality of areas, each area is provided with a flickering cursor with different flickering frequencies for carrying out visual stimulation on human brain to induce different electroencephalogram signals, and each flickering cursor corresponds to a certain instruction of different vehicle-mounted subcomponents respectively;
the head-wearing electroencephalogram signal acquisition equipment is used for acquiring electroencephalogram signals in real time and amplifying and converting analog signals;
and the electroencephalogram signal processing unit is used for controlling the display equipment to display each flashing cursor, processing the electroencephalogram signals, analyzing the control instructions corresponding to the electroencephalogram signals, and feeding the control instructions back to the vehicle central console to control the corresponding vehicle-mounted sub-components.
2. The system according to claim 1, wherein the brain wave signal collecting device comprises a head-mounted brain wave collecting device, and the brain wave sensor, the signal amplifier and the analog-to-digital converter are sequentially connected inside the head-mounted brain wave collecting device.
3. The system of claim 1, further comprising an intelligent gateway for enabling the electroencephalogram signal processing unit to communicate with a vehicle-mounted internet of things device.
4. The system of claim 1, wherein the electroencephalogram signal processing unit comprises an acquisition module, a main control module and a communication module which are connected in sequence;
the acquisition module acquires the electroencephalogram signals output by the electroencephalogram signal acquisition equipment;
the main control module is pre-stored with corresponding logic of the electroencephalogram signal and the flashing cursor, processes the relevant potential of the electroencephalogram signal according to the corresponding logic, and analyzes a control instruction corresponding to the electroencephalogram signal;
and the communication module sends the control instruction to a center console.
5. The system of claim 4, wherein the electroencephalogram signal processing unit further comprises a flicker control module connected with the main control module, and the flicker control module receives instructions from the main control module to control a flicker cursor and a flicker frequency displayed by the display device.
6. The system of claim 1, wherein the brain electrical signal acquisition device is in data communication with the brain electrical signal processing unit via an HDMI data cable.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201921964304.4U CN211001203U (en) | 2019-11-13 | 2019-11-13 | Human-vehicle interaction system based on electroencephalogram signals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201921964304.4U CN211001203U (en) | 2019-11-13 | 2019-11-13 | Human-vehicle interaction system based on electroencephalogram signals |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN211001203U true CN211001203U (en) | 2020-07-14 |
Family
ID=71502209
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201921964304.4U Active CN211001203U (en) | 2019-11-13 | 2019-11-13 | Human-vehicle interaction system based on electroencephalogram signals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN211001203U (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112947455A (en) * | 2021-02-25 | 2021-06-11 | 复旦大学 | Expressway automatic driving system and method based on visual brain-computer interaction |
| CN114138107A (en) * | 2021-10-19 | 2022-03-04 | 杭州回车电子科技有限公司 | Brain-computer interaction device, system and method |
| CN114138109A (en) * | 2021-10-19 | 2022-03-04 | 杭州回车电子科技有限公司 | AR equipment based on brain-computer interaction |
| CN114237388A (en) * | 2021-12-01 | 2022-03-25 | 辽宁科技大学 | Brain-computer interface method based on multi-mode signal recognition |
| CN115309272A (en) * | 2022-10-11 | 2022-11-08 | 季华实验室 | Multi-agent control method and device and electronic equipment |
| CN116788271A (en) * | 2023-06-30 | 2023-09-22 | 北京理工大学 | Brain control driving method and system based on man-machine cooperation control |
-
2019
- 2019-11-13 CN CN201921964304.4U patent/CN211001203U/en active Active
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112947455A (en) * | 2021-02-25 | 2021-06-11 | 复旦大学 | Expressway automatic driving system and method based on visual brain-computer interaction |
| CN114138107A (en) * | 2021-10-19 | 2022-03-04 | 杭州回车电子科技有限公司 | Brain-computer interaction device, system and method |
| CN114138109A (en) * | 2021-10-19 | 2022-03-04 | 杭州回车电子科技有限公司 | AR equipment based on brain-computer interaction |
| CN114138109B (en) * | 2021-10-19 | 2024-04-12 | 杭州回车电子科技有限公司 | AR equipment based on brain-computer interaction |
| CN114237388A (en) * | 2021-12-01 | 2022-03-25 | 辽宁科技大学 | Brain-computer interface method based on multi-mode signal recognition |
| CN114237388B (en) * | 2021-12-01 | 2023-08-08 | 辽宁科技大学 | Brain-computer interface method based on multi-mode signal identification |
| CN115309272A (en) * | 2022-10-11 | 2022-11-08 | 季华实验室 | Multi-agent control method and device and electronic equipment |
| CN115309272B (en) * | 2022-10-11 | 2023-03-24 | 季华实验室 | Multi-agent control method and device and electronic equipment |
| CN116788271A (en) * | 2023-06-30 | 2023-09-22 | 北京理工大学 | Brain control driving method and system based on man-machine cooperation control |
| CN116788271B (en) * | 2023-06-30 | 2024-03-01 | 北京理工大学 | Brain control driving method and system based on man-machine cooperation control |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN211001203U (en) | Human-vehicle interaction system based on electroencephalogram signals | |
| CN100366215C (en) | Control method and system and sense organs test method and system based on electrical steady induced response | |
| Gao et al. | A BCI-based environmental controller for the motion-disabled | |
| JP5373631B2 (en) | Device for quantitative evaluation of mental status based on EEG signal processing system | |
| CN101201696B (en) | Chinese input BCI system based on P300 brain electric potential | |
| US9927872B2 (en) | Wireless input system based on steady-state visual-evoked potentials | |
| CN103699226A (en) | Tri-modal serial brain-computer interface method based on multi-information fusion | |
| CN105726045A (en) | Emotion monitoring method and mobile terminal thereof | |
| CN105595996A (en) | Driving fatigue electroencephalogram monitoring method based on electrooculogram and electroencephalogram comprehensive determination | |
| CN113227944B (en) | Brain-computer interface for augmented reality | |
| Lin et al. | A wireless BCI-controlled integration system in smart living space for patients | |
| Nielsen et al. | EEG based BCI-towards a better control. Brain-computer interface research at Aalborg University | |
| CN105595997B (en) | A kind of fatigue driving eeg monitoring method determined based on step fatigue | |
| CN105446492A (en) | Information interaction system based on brainwave sensing headset and intelligent wearable apparatus | |
| CN105929937A (en) | Mobile phone music playing system based on steady-state visual evoked potential (SSVEP) | |
| CN106344007A (en) | Monitoring system for lecture state | |
| CN104257380A (en) | Electroencephalograph collecting and processing system | |
| CN116360600A (en) | Space positioning system based on steady-state visual evoked potential | |
| CN110688013A (en) | English keyboard spelling system and method based on SSVEP | |
| Hsieh et al. | Home care by auditory Brain Computer Interface for the blind with severe physical disabilities | |
| Trivedi et al. | Brainwave enabled multifunctional, communication, controlling and speech signal generating system | |
| CN107463259B (en) | Vehicle-mounted display equipment and interaction method and device for vehicle-mounted display equipment | |
| CN204133459U (en) | A kind of equipment and system of mobile terminal monitoring electrocardiogram (ECG) data | |
| CN103637774A (en) | Human startle reflex experimental system and working method thereof | |
| CN115454238A (en) | Human-vehicle interaction control method and device based on SSVEP-MI fusion and automobile |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |