CN211094132U

CN211094132U - Multi-mode immersive synchronous acquisition system based on eye movement tracking-brain function activities

Info

Publication number: CN211094132U
Application number: CN201921925023.8U
Authority: CN
Inventors: 张鑫; 张志勇; 张楷隋
Original assignee: Zhongkebokang Beijing Medical Equipment Co ltd; Casibrain Beijing Technology Co ltd
Current assignee: Zhongkebokang Beijing Medical Equipment Co ltd; Casibrain Beijing Technology Co ltd
Priority date: 2019-11-10
Filing date: 2019-11-10
Publication date: 2020-07-28
Anticipated expiration: 2029-11-10

Abstract

The utility model discloses a multimode immersive synchronous collection system based on eye movement is tracked-brain function activity, including VR display device, the VR display device embeds there is display module, eye movement collection module, brain blood oxygen collection module and communication module, and eye movement collection module is used for gathering the image of being tried the eye, and brain blood oxygen collection module is used for gathering the brain blood oxygen signal of being tried the head, and VR display device and eye movement collection module, brain blood oxygen collection module realize data transmission and clock synchronization with external terminal equipment through communication module respectively. The utility model discloses adopt the VR display device who has virtual immersive experience in whole collection system, whole test can avoid the interference of outside to the testee with the data acquisition process completely, simultaneously the utility model discloses compromise eye movement and brain blood oxygen signal synchronous acquisition, directly carry out data transmission with external terminal equipment through communication module, adopted the synchronism problem of real-time characteristic and multimode signal to have solved in the clock synchronization mode.

Description

Multi-mode immersive synchronous acquisition system based on eye movement tracking-brain function activities

Technical Field

The utility model relates to a cognitive neuroscience technical field, concretely relates to synchronous collection system of formula is immersive to multimode based on eye movement is tracked-brain function activity detects.

Background

Electroencephalograms (EEG) are spontaneous and rhythmic electrical activities of brain cell populations recorded by electrodes, contain a large amount of physiological and pathological information, and are one of the nerve function examination methods. The electroencephalogram reflects the electrical activity and various functional states of brain tissues, the basic characteristics of the electroencephalogram comprise amplitude, period, phase and the like, and the electroencephalogram signals of specific positions can also reflect the condition of cognitive ability. The eye tracking technology is a technology for estimating the direction and position of a human visual line by measuring the motion condition of human pupils through eye movement measuring equipment. The eye tracking technology can be used for various applications, such as automobiles, and detecting the fatigue condition of drivers; in the cognitive domain, the psychological activities of a user are analyzed by tracking the gaze of the user.

In the prior art, only a single technical means is used for acquiring parameters related to brain functions, for example, a user browses a page to be evaluated during testing, eye movement data acquisition equipment is used for acquiring the fixation position of the user on the page to be evaluated and the fixation time used when fixation is performed at each fixation position, and the fixation position of the user can be recorded in a fixation coordinate form or a fixation contour form. The accuracy of brain function detection is affected by external interference when browsing the page to be evaluated.

In order to comprehensively carry out multi-parameter detection on the cognitive nerves of people, a multi-type parameter acquisition and multi-mode detection which can realize the brain function and the cognitive function of people by combining the modern electroencephalogram technology and the eye movement tracking technology is urgently needed, and more comprehensive parameters are provided for brain function analysis.

SUMMERY OF THE UTILITY MODEL

The utility model discloses to there being the interference at present when carrying out data acquisition to involving cognitive neural parameter, influence the technical problem of brain function analysis detection accuracy, the utility model provides a multi-modal immersive synchronous acquisition system based on eye movement is tracked-brain function activity detects.

The utility model adopts the following technical scheme:

the multi-mode immersive synchronous acquisition system based on eye movement tracking-brain function activity detection is characterized by comprising a VR display device worn on the head, wherein a display module, an eye movement acquisition module, a brain blood oxygen acquisition module and a communication module are arranged in the VR display device, the eye movement acquisition module is used for acquiring an image of a tested eye, the brain blood oxygen acquisition module is used for acquiring a brain blood oxygen signal of the tested head, and the VR display device, the eye movement acquisition module and the brain blood oxygen acquisition module realize data transmission and clock synchronization with an external terminal device through the communication module respectively.

The eye movement acquisition module comprises a plurality of near-infrared light lamps and a plurality of near-infrared cameras, the near-infrared light lamps surround the edge area of the display module to form a near-infrared light array, and the near-infrared cameras are located at the eye ground positions of the VR display equipment.

The cerebral blood oxygen collection module comprises a probe light source module and a probe photosite, wherein the probe light source module and the probe photosite are arranged at the forehead position of the VR display device; the probe light source module is used for irradiating infrared rays to the skin of a tested person, the light sensing points of the probe receive reflected light of human tissues irradiated by the probe light source module at different angles, optical signals are converted into electric signals, and the electric signals are transmitted to external terminal equipment through the communication module to be processed.

An electroencephalogram sensor used for collecting electroencephalogram signals of a forehead area is further arranged above a display module of the VR display device, and the electroencephalogram sensor transmits the collected electroencephalogram signals to an external terminal device through the communication module to be processed.

The probe light source emits red light and infrared light, and the light-emitting wave band is 600-900 nm.

The system further comprises an electroencephalogram acquisition device, the electroencephalogram acquisition device is connected with the VR display equipment and used for acquiring electroencephalogram signals of the head to be tested, and the electroencephalogram acquisition device is used for realizing data transmission with external terminal equipment through the communication module.

The electroencephalogram acquisition device is of a cap-type structure and comprises a plurality of electrodes and a signal processor connected with the electrodes, the electrodes acquire tested electroencephalogram information, the electroencephalogram information is subjected to hardware filtering, signal enhancement and analog-to-digital conversion through the signal processor, and the signal processor transmits data between the communication module and external terminal equipment.

The electrodes are AgCl electrodes which are distributed in a specific area of the head of a person and are used for collecting the electroencephalogram signals to be tested.

The communication module is a universal data interface for carrying out data transmission and clock synchronization with wired USB port data.

The communication module is a Bluetooth communication module, and wireless data transmission and clock synchronization can be realized between the communication module and external terminal equipment.

The utility model discloses technical scheme has following advantage:

A. the utility model discloses adopt the VR display device who has virtual immersive experience in whole collection system, whole test can avoid the interference of outside to the testee with the data acquisition process completely, simultaneously the utility model discloses compromise eye movement and brain blood oxygen signal synchronous acquisition, directly carry out data transmission with external terminal equipment through communication module, adopted the synchronism problem of real-time characteristic and multimode signal to have solved in the clock synchronization mode.

B. The utility model discloses a to the data acquisition of several aspects of EEG signal, eye movement signal, brain blood oxygen signal, external equipment can provide more comprehensive parameter for brain function analysis through the multiple brain function signal that obtains, makes the cognition to the people make more accurate aassessment.

C. The utility model discloses be in the same place eye movement collection module, brain blood oxygen collection module and brain electricity collection system and VR display device are integrated, carry out data analysis with various types of collection signal synchronous transmission to external terminal equipment through wireless or wired data transmission mode, make whole detection more convenient, efficiency is higher.

Drawings

In order to illustrate the embodiments of the present invention more clearly, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a synchronous acquisition system provided by the present invention;

FIG. 2 is a schematic structural diagram of an electroencephalogram acquisition device;

fig. 3 is a system physical topology diagram provided by the present invention.

The labels in the figure are as follows:

1-VR display device; 11-a display module, 12-an eye movement acquisition module, 121-a near-infrared light lamp, 122-a near-infrared camera, 13-a brain blood oxygen acquisition module, 131-a probe light source module and 132-a probe photosite;

2-an electroencephalogram acquisition device, 21-electrodes and 22-a signal processor;

3-an electroencephalogram sensor.

Detailed Description

The technical solution of the present invention will be described clearly and completely with reference to the accompanying drawings, and obviously, the described embodiments are some, but not all embodiments of the present invention. Based on the embodiments in the present invention, all other embodiments obtained by a person skilled in the art without creative work belong to the protection scope of the present invention.

As shown in FIG. 3, the utility model provides a synchronous collection system of multimode immersive based on eye tracking-brain function activity detects, including VR display device 1, VR display device 1 embeds there is display module 11, eye movement collection module 12, brain blood oxygen collection module 13 and communication module, and eye movement collection module 12 is used for gathering the eye image of being tried, and brain blood oxygen collection module 13 is used for gathering the brain blood oxygen signal of being tried the head, VR display device 1 and eye movement collection module 12, and brain blood oxygen collection module 13 realizes data transmission and clock synchronization through communication module and external terminal equipment respectively. The utility model adopts VR display equipment with virtual immersion experience in the whole acquisition system, the tested person watches video or pictures and other stimulating materials through the built-in color display module through the virtual reality presentation equipment worn on eyes, and the whole test and data acquisition process can completely avoid the interference of the outside to the tested person; the utility model discloses still compromise the synchronous collection of eye movement and brain blood oxygen signal, communication module directly carries out data transmission with external terminal equipment (for example the computer), through the synchronism problem that adopts the clock synchronization mode to solve real-time characteristic and multimode signal, makes various types of data realize synchronous transmission.

The eye movement collecting module 12 preferably includes a plurality of near-infrared light lamps 121 and a near-infrared camera 122, the plurality of near-infrared light lamps 121 surround the edge area of the display module 11 to form a near-infrared light array, the near-infrared camera 122 is located at the fundus position of the VR display device 1, and the collected original eye images are transmitted to a computer for processing through the communication module. Because the eye area is dark when wearing the VR display device, the eye area needs to be additionally illuminated to collect pupil information. The near infrared light is characterized by being invisible light and not affecting human eyes. Meanwhile, the screen viewed by the user is very close to the eye region, the brightness of the screen can interfere with the acquisition of eye images, the visible light wave bands are completely filtered by the near-infrared camera 22, and only the information illuminated by the near-infrared light is acquired.

The communication module can be a universal data interface, is compatible with different data formats, and can realize data transmission and clock synchronization of a wired USB port. Of course, a bluetooth communication module can be used, and wireless data transmission and clock synchronization can be realized. The communication module is compatible with common communication protocols, and the synchronization function can be performed by a built-in clock or controlled by external terminal equipment.

As shown in fig. 1, the cerebral blood oxygen collection module 13 includes a probe light source module 131 and a probe photosite 132 disposed at the forehead position of the VR display device 1; the probe light source module 131 is used for irradiating infrared rays and near infrared rays to the forehead skin position to be tested, wherein the light emitting waveband is 600-900nm, the probe light sensing point 132 receives reflected light irradiated to the skin to be tested, converts an optical signal into an electrical signal, and transmits the obtained electrical signal to an external terminal device for processing through the communication module. Certainly, as shown in fig. 1, an electroencephalogram sensor 3 for acquiring an electroencephalogram signal of a forehead area may be further disposed above the display module 11 of the VR display device, and the electroencephalogram sensor 3 transmits the acquired electroencephalogram signal to an external terminal device through a communication module for processing.

In addition, further preferably, still be equipped with brain electricity collection system 2 in the system, brain electricity collection system 2 is connected with VR display device 1, can form a whole, and portable and detection for detect the brain electricity signal of examinee's head, brain electricity collection system 2 realizes data transmission with external terminal equipment through communication module. As shown in fig. 2, the electroencephalogram acquisition device 2 is preferably of a cap-type structure, is worn on the head of a person to be tested, and specifically includes a plurality of electrodes 21 and a signal processor 22 connected to the plurality of electrodes 21, the plurality of electrodes 21 are distributed at a specific position on the head of the person to be tested, AgCl electrodes are preferably used to acquire electroencephalogram information of the specific area on the head of the person to be tested, and the electroencephalogram information is subjected to hardware filtering, signal enhancement and analog-to-digital conversion by the signal processor, the signal processor performs data transmission with an external terminal device through a communication module, processes data through the external terminal device, and assesses cognitive ability of the person to be tested.

The utility model discloses an integration VR display device with brain electricity detects, eye movement is tracked and brain blood oxygen detects function obtains the data acquisition of several aspects of brain electricity signal, eye movement signal, brain blood oxygen signal in step on external terminal equipment, and external device can provide more comprehensive parameter for brain function analysis through the multiple brain function signal that obtains, makes the cognition to the people make more accurate aassessment.

It should be understood that the above examples are only for clarity of illustration and are not intended to limit the embodiments. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. And obvious variations or modifications therefrom are within the scope of the invention.

Claims

1. The utility model provides a synchronous collection system of multimode immersive based on eye tracking-brain function activity which characterized in that, the system is including wearing VR display device (1) at the head, VR display device (1) embeds there are display module (11), eye movement collection module (12), brain blood oxygen collection module (13) and communication module, eye movement collection module (12) are used for gathering the eye image of being tried, brain blood oxygen collection module (13) are used for gathering the brain blood oxygen signal of being tried the head, VR display device (1) and eye movement collection module (12), brain blood oxygen collection module (13) respectively through communication module and external terminal equipment realize data transmission and clock synchronization.

2. The multi-modal immersive synchronous acquisition system based on eye tracking-brain function activity of claim 1, wherein the eye movement acquisition module (12) comprises a plurality of near-infrared light lamps (121) and a near-infrared camera (122), the plurality of near-infrared light lamps (121) forming a near-infrared light array around an edge region of the display module (11), the near-infrared camera (122) being located at a fundus location of the VR display device (1).

3. The multi-modal immersive synchronous acquisition system based on eye tracking-brain function activity of claim 1, wherein the brain blood oxygen acquisition module (13) comprises a probe light source module (131) and a probe photosite (132) disposed at a forehead position of the VR display device (1); the probe light source module (131) is used for irradiating infrared rays to the skin of a tested person, the probe light sensing points (132) receive reflected light of human tissues irradiated by the probe light source module (131) at different angles, convert optical signals into electric signals and transmit the electric signals to external terminal equipment for processing through the communication module.

4. The multi-modal immersive synchronous acquisition system based on eye tracking-brain function activity as claimed in claim 3, wherein an electroencephalogram sensor (3) for acquiring an electroencephalogram signal of a forehead region is further disposed above the display module (11) of the VR display device, and the electroencephalogram sensor (3) transmits the acquired electroencephalogram signal to an external terminal device for processing through the communication module.

5. The multimodal immersive synchronization acquisition system based on eye tracking-brain function activity of claim 3, wherein the probe light source module (131) emits red light and infrared light, and the light emitting wavelength band is 600-900 nm.

6. The multi-modal immersive synchronous acquisition system based on eye tracking-brain function activities according to any one of claims 1 to 5, further comprising an electroencephalogram acquisition device (2) connected to the VR display device (1) for acquiring an electroencephalogram signal of a tested head, wherein the electroencephalogram acquisition device (2) realizes data transmission with an external terminal device through the communication module.

7. The multi-modal immersive synchronous acquisition system based on eye tracking-brain function activity as claimed in claim 6, wherein the brain electrical acquisition device (2) is a cap structure, and comprises a plurality of electrodes (21) and a signal processor (22) connected to the plurality of electrodes (21), the electrodes (21) acquire the brain electrical information of the subject, and perform hardware filtering, signal enhancement and analog-to-digital conversion on the brain electrical information through the signal processor (22), and the signal processor (22) performs data transmission with an external terminal device through the communication module.

8. The multimodal immersive synchronous acquisition system based on eye tracking-brain function activity of claim 7, wherein said electrodes (21) are AgCl electrodes distributed in a specific region of human head for acquiring brain electrical signals under test.

9. The system of claim 1, wherein the communication module is a universal data interface for data transfer and clock synchronization with wired USB port data.

10. The multi-modal immersive synchronous acquisition system based on eye tracking-brain function activities of claim 1, wherein the communication module is a bluetooth communication module, and wireless data transmission and clock synchronization can be realized between the communication module and an external terminal device.