CN115024684A - Stimulation paradigm generation system, brain-computer interface system, detection method and device - Google Patents
Stimulation paradigm generation system, brain-computer interface system, detection method and device Download PDFInfo
- Publication number
- CN115024684A CN115024684A CN202210564409.0A CN202210564409A CN115024684A CN 115024684 A CN115024684 A CN 115024684A CN 202210564409 A CN202210564409 A CN 202210564409A CN 115024684 A CN115024684 A CN 115024684A
- Authority
- CN
- China
- Prior art keywords
- ring
- stimulation
- field
- fan
- visual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000000638 stimulation Effects 0.000 title claims abstract description 259
- 238000001514 detection method Methods 0.000 title claims abstract description 88
- 230000000007 visual effect Effects 0.000 claims abstract description 219
- 230000004438 eyesight Effects 0.000 claims abstract description 60
- 210000004556 brain Anatomy 0.000 claims description 130
- 238000011156 evaluation Methods 0.000 claims description 27
- 238000010219 correlation analysis Methods 0.000 claims description 26
- 238000012545 processing Methods 0.000 claims description 26
- 230000002093 peripheral effect Effects 0.000 claims description 25
- 238000000034 method Methods 0.000 claims description 22
- 238000000605 extraction Methods 0.000 claims description 17
- 230000004044 response Effects 0.000 claims description 17
- 230000000763 evoking effect Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 13
- 230000003284 homeostatic effect Effects 0.000 claims description 9
- 230000005043 peripheral vision Effects 0.000 claims description 7
- 238000000537 electroencephalography Methods 0.000 claims description 4
- 238000002582 magnetoencephalography Methods 0.000 claims description 4
- 230000004936 stimulating effect Effects 0.000 abstract description 7
- 238000013473 artificial intelligence Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 13
- 230000004382 visual function Effects 0.000 description 12
- 239000011159 matrix material Substances 0.000 description 8
- 230000007547 defect Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 6
- 230000035945 sensitivity Effects 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 230000000284 resting effect Effects 0.000 description 5
- 238000001914 filtration Methods 0.000 description 4
- 239000003550 marker Substances 0.000 description 4
- 208000002177 Cataract Diseases 0.000 description 3
- 208000010412 Glaucoma Diseases 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 210000004027 cell Anatomy 0.000 description 3
- 239000003086 colorant Substances 0.000 description 3
- 201000010099 disease Diseases 0.000 description 3
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 208000002780 macular degeneration Diseases 0.000 description 3
- 230000007433 nerve pathway Effects 0.000 description 3
- 210000001525 retina Anatomy 0.000 description 3
- 239000013598 vector Substances 0.000 description 3
- 206010047571 Visual impairment Diseases 0.000 description 2
- 230000002860 competitive effect Effects 0.000 description 2
- 230000006735 deficit Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 2
- 230000001771 impaired effect Effects 0.000 description 2
- 201000006417 multiple sclerosis Diseases 0.000 description 2
- 210000003205 muscle Anatomy 0.000 description 2
- 231100000344 non-irritating Toxicity 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000037361 pathway Effects 0.000 description 2
- 210000000578 peripheral nerve Anatomy 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 208000029257 vision disease Diseases 0.000 description 2
- 230000004393 visual impairment Effects 0.000 description 2
- 210000000239 visual pathway Anatomy 0.000 description 2
- 230000004400 visual pathway Effects 0.000 description 2
- 208000024827 Alzheimer disease Diseases 0.000 description 1
- 206010019196 Head injury Diseases 0.000 description 1
- 238000004497 NIR spectroscopy Methods 0.000 description 1
- 206010030113 Oedema Diseases 0.000 description 1
- 208000003435 Optic Neuritis Diseases 0.000 description 1
- 208000018737 Parkinson disease Diseases 0.000 description 1
- 206010047555 Visual field defect Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 206010002026 amyotrophic lateral sclerosis Diseases 0.000 description 1
- 201000007201 aphasia Diseases 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 208000010877 cognitive disease Diseases 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 230000010004 neural pathway Effects 0.000 description 1
- 210000000118 neural pathway Anatomy 0.000 description 1
- 208000015122 neurodegenerative disease Diseases 0.000 description 1
- 210000002569 neuron Anatomy 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 210000003733 optic disk Anatomy 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000007170 pathology Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000017105 transposition Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
- A61B3/024—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for determining the visual field, e.g. perimeter types
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
- A61B5/14551—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
- A61B5/14553—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases specially adapted for cerebral tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/242—Detecting biomagnetic fields, e.g. magnetic fields produced by bioelectric currents
- A61B5/245—Detecting biomagnetic fields, e.g. magnetic fields produced by bioelectric currents specially adapted for magnetoencephalographic [MEG] signals
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
Abstract
The application provides a stimulation paradigm generation system, a brain-computer interface system, a detection method and a detection device, and relates to the technical field of artificial intelligence. The stimulation paradigm generation system includes: the display device is used for displaying the first fan-shaped ring visual stimulation block in the first disc ring and/or the second fan-shaped ring visual stimulation block in the second disc ring; and the stimulation reflection device is used for reflecting the first fan-ring stimulation block image and/or the second fan-ring stimulation block image along the target direction so as to correspondingly present visual stimulation to the user in at least one first visual field fan ring of the first visual field and/or at least one second visual field fan ring of the second visual field of the user. This system can show two sets of fan ring vision amazing pieces in two disc rings through stimulating the reflect meter, realizes presenting visual stimulus respectively to user's left eye field of vision and right eye field of vision simultaneously, can shorten the length of time of visual stimulus, improves amazing detection efficiency.
Description
Technical Field
The application relates to the technical field of artificial intelligence, in particular to a stimulation paradigm generating system, a brain-computer interface system, a detection method and a detection device.
Background
The traditional visual field nerve pathway integrity detection method comprises visual field detection, visual contrast sensitivity and the like, wherein the visual field detection is a gold standard for evaluating visual function defect degree and is commonly used for detecting common ophthalmic diseases such as glaucoma, cataract, macular degeneration and the like. Visual field detection is to give light stimulation at a designated position by using a program, and measure the light difference sensitivity (d.l. sensitivity) of different sites of the retina to calculate the difference (absence) between the detected eye and the normal eye threshold. However, visual field detection is a psychophysics detection method, visual field detection has high matching requirements on the detected persons, and part of the detected persons (old people and the like) are prone to fatigue and have poor matching false positive results.
Brain-computer interface (BCI) is an alternating communication system that does not rely on the normal output pathway consisting of peripheral nerves and muscles. It can recognize specific brain signal patterns. The stimulation paradigm coding of the brain-computer interface of the related technology is simple, the time consumption of the visual stimulation process is long when the brain-computer interface is used for visual field detection, and the stimulation detection efficiency is low.
Disclosure of Invention
The embodiment of the application provides a stimulation paradigm generation system, a brain-computer interface system, a detection method and a detection device, which can shorten the duration of visual stimulation and improve the stimulation detection efficiency.
In a first aspect, an embodiment of the present application provides a stimulation paradigm generating system, including:
the display device is used for displaying the first fan-shaped ring visual stimulation blocks in the first disc ring and/or the second fan-shaped ring visual stimulation blocks in the second disc ring; the fan-shaped visual stimulation block is formed by flashing the part of the fan-shaped unit included in the circular disc ring according to the coding frequency corresponding to each fan-shaped unit;
the stimulation reflection device is used for reflecting the first fan-ring stimulation block image and/or the second fan-ring stimulation block image along the target direction so as to correspondingly present visual stimulation to the user in at least one first visual field fan ring of the first visual field and/or at least one second visual field fan ring of the second visual field of the user; the target direction is the direction of reflecting the first circle center mark or the second circle center mark by the stimulation reflection device when the stimulation reflection device enables the first circle center mark of the first circular ring and the second circle center mark of the second circular ring to be visually overlapped; the first vision field fan ring is in one-to-one correspondence with the fan ring unit position at the first fan ring vision stimulation block; the second vision field fan ring is in one-to-one correspondence with the fan ring unit at the second fan ring vision stimulation block.
The stimulation paradigm generation system that this application embodiment provided can be through showing two sets of fan ring vision stimulation pieces in two disc rings, through amazing reflect meter, realizes presenting visual stimulation respectively to user's left eye field of vision and right eye field of vision simultaneously. This amazing paradigm generation system utilizes binocular competition principle, detects the eye about simultaneously, can shorten the length of visual stimulation, improves amazing detection efficiency.
In a possible implementation manner, the first circular disc ring further includes a first closed inner ring, and the second circular disc ring further includes a second closed inner ring; the first circular disc ring and the first closed inner circular ring are marked as the circle centers by the first circle center, and the second circular disc ring and the second closed inner circular ring are marked as the circle centers by the second circle center; the sector ring unit is a graphic unit formed by intersecting the equally divided sectors with the concentric rings when the circle center of the disc ring is taken as an axis and the equally divided sectors with the first threshold value and the concentric rings with the second threshold value are divided for the part between the disc ring and the inner ring.
In the stimulation paradigm generation system provided in this embodiment, the sector ring unit is a graphic unit formed by intersecting the bisected sector with the concentric ring when the sector of the first threshold and the concentric ring of the second threshold are divided for the part between the located disc ring and the inner ring included in the located disc ring by using the center of the located disc ring as an axis. According to the system, the fan ring unit is a graphic unit outside the first closed inner ring and the second closed inner ring, so that the fan ring visual stimulation blocks are not displayed inside the first closed inner ring and inside the second closed inner ring, so that the stimulation of the central visual field area is inhibited, the influence of the stimulation of the central visual field area on brain signals of peripheral visual field areas can be prevented, and the stimulation detection efficiency is further improved.
In a possible implementation manner, for any disk ring, the number of types of the encoding frequencies corresponding to the fan ring units included in the any disk ring is not greater than the first threshold.
In the stimulation pattern generation system provided in this embodiment, for any one of the disc rings, the number of types of the encoding frequencies corresponding to the sector ring units included in the any one of the disc rings is not greater than the first threshold. The stimulation normal form generation system has the advantages that the number of the types of the coding frequencies corresponding to the fan ring units of the first disc ring and the number of the types of the coding frequencies corresponding to the fan ring units of the second disc ring are not larger than a first threshold value when the fan ring units are divided into equal sectors, so that the fan ring units are coded by using a small number of coding frequencies, the difficulty of brain signal feature extraction during simultaneous stimulation of multiple frequencies can be reduced, and the stimulation detection efficiency can be further improved.
In one possible implementation manner, in any disc ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies; in any disc circle, all the sector ring units contained in the same equal sector are configured with the same coding frequency.
In the stimulation pattern generation system provided in this embodiment, for the first circular disk ring and the second circular disk ring, the sector ring units included in different equal sectors in each circular disk ring are configured with different coding frequencies, and the sector ring units included in the same equal sector are configured with the same coding frequency. According to the stimulation paradigm generation system, in the same disc circle, the fan ring units contained in different equal-division sectors are configured with different coding frequencies, and each fan ring unit contained in the same equal-division sector is configured with the same coding frequency, so that the fan ring units are coded by using a small number of coding frequencies, the difference of the coding frequencies of the fan ring units in different equal-division sectors in the same disc circle is strengthened, the difficulty of brain signal feature extraction during multi-frequency simultaneous stimulation can be reduced, and the stimulation detection efficiency can be further improved.
In one possible implementation manner, in any disc ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies; the coding frequency of any one of the fan ring units contained in the first disc ring is different from the coding frequency of any one of the fan ring units contained in the second disc ring.
In the stimulation pattern generation system provided in this embodiment, for the first disc ring and the second disc ring, the sector units included in different equal sectors in each disc ring are configured with different encoding frequencies, and the encoding frequency of any one of the sector units included in the first disc ring is different from the encoding frequency of any one of the sector units included in the second disc ring. According to the stimulation paradigm generating system, in the same disc circle, the fan ring units contained in different equal-division sectors are configured with different coding frequencies, and the coding frequencies configured for the fan ring units contained in the equal-division sectors in different disc circles are different, so that the fan ring units are coded by using a small number of coding frequencies, the difference between the coding frequencies of the fan ring units in different disc circles is strengthened, the difficulty of brain signal feature extraction during multi-frequency simultaneous stimulation can be reduced, and the stimulation detection efficiency can be further improved.
In a second aspect, the present application provides a brain-computer interface system, including the stimulation paradigm generation system of any one of the first aspect; the brain-computer interface system further comprises:
the data acquisition device is used for acquiring brain signals generated by a subject; the brain signals are produced by the left and right eyes of the subject based on the visual stimulus of the stimulus paradigm generation system of any one of the first aspect; the brain signals comprise multifocal homeostatic visual evoked potentials mfssveps;
and the data processing device is used for acquiring the brain signals, analyzing the brain signals and generating an evaluation result of the peripheral vision of the user.
The brain-computer interface system provided by the embodiment of the application comprises a stimulation paradigm generating system which can respectively present visual stimulation to the left eye visual field and the right eye visual field of a user through two groups of fan-ring visual stimulation blocks displayed in two circular discs and a stimulation reflecting device, so that brain signals generated by the left eye and the right eye of the user based on the visual stimulation are simultaneously acquired, the brain signals are analyzed, and an evaluation result of the peripheral visual fields of the user is generated. According to the brain-computer interface system, the stimulation paradigm generation system utilizes a binocular competition principle, the left eye and the right eye are detected and brain signals are analyzed, the duration of visual stimulation can be shortened, and the stimulation detection efficiency is improved.
In one possible implementation, the brain signal is one of: electroencephalography (EEG) signals, Magnetoencephalography (MEG) signals, and functional near-infrared spectrogram (fNIRS) signals.
In a possible implementation manner, the data processing apparatus is specifically configured to:
extracting the characteristics of the brain signals to obtain characteristic signal information;
performing variable correlation analysis on the characteristic signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate the evaluation result for the user's peripheral visual field.
In the brain-computer interface system provided by this embodiment, the data processing device performs feature extraction on the brain signal to obtain feature signal information; performing variable correlation analysis on the characteristic signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate the evaluation result for the user's peripheral visual field. The brain-computer interface system provides a mechanism for extracting features of brain signals and performing variable correlation analysis to obtain correlation coefficient result information, wherein the correlation coefficient result information is used for generating the evaluation result of the peripheral visual field of a user, so that the visual stimulation duration can be shortened, and the stimulation detection efficiency can be improved.
In one possible implementation, the brain signals include a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where the visual stimulus is not applied; the second brain signal is a brain signal in a state where the visual stimulus is applied;
the data processing apparatus is specifically configured to:
performing variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and performing variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein the first characteristic signal information is obtained by performing characteristic extraction on the first brain signal; the second characteristic signal information is obtained by performing characteristic extraction on the second brain signals;
and obtaining the correlation coefficient result information according to the first correlation coefficient result information and the second correlation coefficient result information.
The brain-computer interface system according to this embodiment performs variable correlation analysis on the first brain signal in the state where the visual stimulus is not applied and the second brain signal in the state where the visual stimulus is applied, to obtain first correlation coefficient result information and second correlation coefficient result information, and combines the first correlation coefficient result information and the second correlation coefficient result information to obtain correlation coefficient result information. The brain-computer interface system can simultaneously combine the correlation coefficient result information corresponding to the brain signal in the state without applying the visual stimulation and the brain signal in the state applying the visual stimulation respectively, and can obtain more stable correlation coefficient result information, wherein the correlation coefficient result information is used for generating the evaluation result of the peripheral visual field of the user, so that the duration of the visual stimulation can be shortened, the stimulation detection efficiency can be improved, and the accuracy of the evaluation result of the peripheral visual field of the user can be improved.
In a possible implementation manner, the evaluation result of the peripheral visual field of the user is information of a sector ring of the visual field with impaired visual function in the peripheral visual field of the user.
In a third aspect, the present application provides a stimulation paradigm detection method, including:
presenting a visual stimulus to a user in at least one first field-of-view fan-ring of a first field-of-view of the user, and/or at least one second field-of-view fan-ring of a second field-of-view of the user; the visual stimulation is presented by displaying a first sector ring visual stimulation block in a first disc circle and/or a second sector ring visual stimulation block in a second disc circle and reflecting the first sector ring stimulation block image and/or the second sector ring stimulation block image along a target direction; the fan ring visual stimulation block is formed by flashing the part of a fan ring unit included in the disc ring according to the coding frequency corresponding to each fan ring unit; the target direction is the direction of reflecting the first circle center mark or the second circle center mark by the stimulation reflection device when the stimulation reflection device enables the first circle center mark of the first circular ring and the second circle center mark of the second circular ring to be visually overlapped; the first vision field fan ring corresponds to the fan ring units at the first fan ring vision stimulation block one by one; the second vision field fan ring is in one-to-one correspondence with the fan ring unit position at the second fan ring vision stimulation block;
collecting brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimuli; the brain signals comprise multifocal homeostatic visual evoked potentials mfssveps;
and acquiring the brain signals, analyzing the brain signals and generating an evaluation result of the peripheral visual field of the user.
The stimulation paradigm detection method provides a mechanism for extracting features of brain signals and performing variable correlation analysis to obtain correlation coefficient result information, and the correlation coefficient result information is used for generating the evaluation result of the peripheral visual field of a user, so that the visual stimulation duration can be shortened, and the stimulation detection efficiency can be improved.
In one possible implementation, the presenting a visual stimulus to the user in at least one first field-of-view sector of a first field of view of the user, and/or at least one second field-of-view sector of a second field of view of the user, comprises:
presenting a visual stimulus to a user in at least one first sector of a first field of view of the user and at least one second sector of a second field of view of the user in response to receiving a first stage detection instruction to detect respective first sectors of the first field of view of the user and respective second sectors of the second field of view of the user;
if a second-stage detection instruction is received, presenting visual stimulation to the user in a target vision sector of the user to detect the target vision sector of the user; the target field of view fan ring is a selected one of the first field of view fan rings in the first field of view or a selected one of the second field of view fan rings in the second field of view.
The stimulation paradigm detection method provides a distributed detection mechanism, and can detect each first field sector of the first field of view of the user and each second field sector of the second field of view of the user in response to receiving a first-stage detection instruction, locate a target field sector whose evaluation result meets a preset condition in the first field of view and the second field of view, and present a visual stimulus to the user in the target field sector of the user according to a second-stage detection instruction to detect the target field sector of the user, so that the field of view of the user can be evaluated more accurately.
In a fourth aspect, embodiments of the present application provide a stimulation paradigm detection apparatus, the apparatus including:
a stimulus paradigm generation module to present visual stimuli to a user in at least one first field sector of a user's first field of view and/or at least one second field sector of the user's second field of view; the visual stimulation is presented by displaying a first sector ring visual stimulation block in a first disc circle and/or a second sector ring visual stimulation block in a second disc circle and reflecting the first sector ring stimulation block image and/or the second sector ring stimulation block image along a target direction; the fan-shaped visual stimulation block is formed by flashing the part of the fan-shaped unit included in the circular disc ring according to the coding frequency corresponding to each fan-shaped unit; the target direction is the direction of the stimulation reflection device reflecting the first circle center mark or the second circle center mark when the stimulation reflection device enables the first circle center mark of the first circular ring and the second circle center mark of the second circular ring to be visually overlapped; the first vision field fan ring is in one-to-one correspondence with the fan ring unit position at the first fan ring vision stimulation block; the second vision field fan ring is in one-to-one correspondence with the fan ring unit position at the second fan ring vision stimulation block;
the signal acquisition module is used for acquiring brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimuli; the brain signals comprise multifocal homeostatic visual evoked potentials mfssveps;
and the data processing module is used for acquiring the brain signals, analyzing the brain signals and generating an evaluation result of the peripheral vision of the user.
In a possible implementation manner, the data processing module is specifically configured to:
extracting the characteristics of the brain signals to obtain characteristic signal information;
performing variable correlation analysis on the characteristic signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate the evaluation result for the user's peripheral vision.
In one possible implementation, the brain signals include a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where the visual stimulus is not applied; the second brain signal is a brain signal in a state where the visual stimulus is applied;
the data processing module is specifically configured to:
performing variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and performing variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; the first feature signal information is obtained by performing feature extraction on the first brain signal; the second characteristic signal information is obtained by performing characteristic extraction on the second brain signal;
and obtaining the correlation coefficient result information according to the first correlation coefficient result information and the second correlation coefficient result information.
In one possible implementation, the stimulation paradigm generating module is specifically configured to:
in response to receiving a first stage detection instruction, presenting visual stimuli to a user in at least one first field-of-view sector of a first field of view of the user and at least one second field-of-view sector of a second field of view of the user to detect respective first field-of-view sectors of the first field of view of the user and respective second field-of-view sectors of the second field of view of the user;
if a second-stage detection instruction is received, presenting visual stimulation to the user in a target vision sector of the user to detect the target vision sector of the user; the target field of view fan ring is a selected one of the first field of view fan rings in the first field of view or a selected one of the second field of view fan rings in the second field of view.
In a fifth aspect, an embodiment of the present application provides a server, including a memory and a processor, where the memory stores a computer program executable on the processor, and when the computer program is executed by the processor, the server implements the method according to any one of the third aspects.
In a sixth aspect, the present application provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the method of any one of the third aspect is implemented.
For technical effects brought by any one of the implementation manners of the fourth aspect to the sixth aspect, reference may be made to the technical effects brought by the implementation manners of the first aspect to the third aspect, and details are not described here again.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a block diagram of a stimulation paradigm generating system according to an embodiment of the present application;
fig. 2 is a schematic diagram illustrating a layout of a display fan-ring visual stimulus block of a stimulus paradigm generation system according to an embodiment of the present application;
fig. 3 is a schematic diagram of a stimulation paradigm generation system provided by an embodiment of the present application;
fig. 4 is a block diagram of a brain-computer interface system according to an embodiment of the present application;
fig. 5 is a schematic flowchart of a stimulation paradigm detection method according to an embodiment of the present disclosure;
fig. 6 is a block diagram of a stimulation paradigm detecting device according to an embodiment of the present application;
fig. 7 is a block diagram of a server according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The traditional visual field nerve pathway integrity detection method comprises visual field detection, visual contrast sensitivity and the like, wherein the visual field detection is a gold standard for evaluating visual function defect degree and is commonly used for detecting common ophthalmic diseases such as glaucoma, cataract, macular degeneration and the like. Visual field detection is to give light stimulation at a designated position by using a program, and measure the light difference sensitivity (d.l. sensitivity) of different sites of the retina to calculate the difference (absence) between the detected eye and the normal eye threshold. However, visual field detection is a psychophysics detection method, visual field detection has high matching requirements on the detected persons, and part of the detected persons (old people and the like) are prone to fatigue and have poor matching false positive results.
Brain-computer interface (BCI) is an alternating communication system that does not rely on the normal output pathway consisting of peripheral nerves and muscles. It can recognize specific brain signal patterns. The brain-computer interface of the related technology has simple stimulation paradigm coding, long time consumption in the visual stimulation process when the brain-computer interface is used for visual field detection, low stimulation detection efficiency and limitation on popularization and application of the brain-computer interface in the visual field detection.
Based on this, the embodiment of the present application provides a stimulation paradigm generating system, a brain-computer interface system, a detection method and a device. Wherein, this stimulation paradigm generation system includes: the display device is used for displaying the first fan-shaped ring visual stimulation block in the first disc ring and/or the second fan-shaped ring visual stimulation block in the second disc ring; the fan ring visual stimulation block is formed by flashing the part of the fan ring units included in the disc ring according to the coding frequency corresponding to each fan ring unit; the stimulation reflection device is used for reflecting the first fan-ring stimulation block image and/or the second fan-ring stimulation block image along the target direction so as to correspondingly present visual stimulation to the user in at least one first visual field fan ring of the first visual field according to the first fan-ring stimulation block image and/or at least one second visual field fan ring of the second visual field of the user according to the second fan-ring stimulation block image; the target direction is the direction of reflecting the first circle center mark or the second circle center mark by the stimulating and reflecting device when the stimulating and reflecting device enables the first circle center mark of the first circular ring of the disc and the second circle center mark of the second circular ring of the disc to visually coincide; the first vision field fan ring is in one-to-one correspondence with the fan ring unit position at the first fan ring vision stimulation block; the second vision field fan ring is in one-to-one correspondence with the fan ring units at the second fan ring vision stimulation block. This amazing paradigm generation system utilizes binocular competition principle, detects the eye about simultaneously, can shorten the length of visual stimulation, improves amazing detection efficiency.
In order to make the objects, technical solutions and advantages of the embodiments of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings, and it is to be understood that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 shows a block diagram of a stimulation paradigm generating system according to an embodiment of the present application, and as can be seen from the block diagram shown in fig. 1, the stimulation paradigm generating system 100 includes a display device 101 and a stimulation reflection device 102.
The display device 101 is used for displaying a first sector ring visual stimulation block in the first disc ring 1011 and/or a second sector ring visual stimulation block in the second disc ring 1012; the fan ring visual stimulation block is formed by flashing the part of the fan ring units included in the disc ring according to the coding frequency corresponding to each fan ring unit;
a stimulus reflection means 102 for reflecting the first sector ring stimulus block image and/or the second sector ring stimulus block image in a target direction to present a visual stimulus to the user in at least one first field-of-view sector ring of the first field of view and/or at least one second field-of-view sector ring of the second field of view of the user, respectively; the target direction is the direction in which the stimulation reflection device 102 reflects the first circle center marker 1013 or the second circle center marker 1014 of the first circular disk 1011 when the stimulation reflection device visually coincides with the first circle center marker 1013 of the first circular disk 1012 and the second circle center marker 1014 of the second circular disk 1012; the first vision field fan ring is in one-to-one correspondence with the fan ring unit position at the first fan ring vision stimulation block; the second vision field fan ring is in one-to-one correspondence with the fan ring units at the second fan ring vision stimulation block.
In some embodiments of the present application, the first fan-ring visual stimulation block may be a left eye stimulation, and the second fan-ring visual stimulation block may be a right eye stimulation, and correspondingly, the first visual field may be a left eye visual field and the second visual field may be a right eye visual field. In other embodiments of the present application, the first fan-ring visual stimulation block may be a right eye stimulation, the second fan-ring visual stimulation block may be a left eye stimulation, and correspondingly, the first visual field is a right eye visual field and the second visual field is a left eye visual field. This is not a specific limitation in the present application.
In the stimulation paradigm generation system 100 of fig. 1, a display device 101 is used to present left eye stimulation and right eye stimulation to a subject; and a stimulus reflecting device 102 for combining the left eye stimulus and the right eye stimulus presented by the display device 101.
In some embodiments of the stimulation paradigm generation system 100, the first circular disk ring further comprises a first closed inner ring and the second circular disk ring further comprises a second closed inner ring; the first circular disc ring and the first closed inner circular ring are marked as the circle centers by the first circle center, and the second circular disc ring and the second closed inner circular ring are marked as the circle centers by the second circle center; the sector ring unit is a graphic unit formed by intersecting the equally divided sectors with the concentric rings when the circle center of the disc ring is taken as an axis and the equally divided sectors with the first threshold value and the concentric rings with the second threshold value are divided for the part between the disc ring and the inner ring.
Fig. 2 is a schematic diagram illustrating a layout of a display fan ring visual stimulation block of a stimulation paradigm generating system provided for an embodiment of the present application, where, referring to fig. 2, a first disk ring 1011 further includes a first closed inner ring 1015, and a second disk ring 1012 further includes a second closed inner ring 1016; the first circular ring 1011 and the first closed inner circular ring 1015 take the first circle center mark 1013 as the circle center, and the second circular ring 1012 and the second closed inner circular ring 1016 take the second circle center mark 1014 as the circle center; the sector ring unit is a graphic unit formed by intersecting the equally divided sectors with the concentric rings when the circle center of the disc ring is taken as an axis and the equally divided sectors with the first threshold value and the concentric rings with the second threshold value are divided for the part between the disc ring and the inner ring. For example, taking the sector ring unit 1017 in the first circular disc ring 1011 as an example, the sector ring unit 1017 is a graphic unit formed by intersecting a sector of a first threshold value and a concentric ring of a second threshold value when a part between the first circular disc ring 1011 and a first closed inner circular ring 1015 included in the first circular disc ring 1011 is divided by taking the first circle center mark 1013 in the first circular disc ring 1011 where the sector ring unit 1017 is located as an axis, where the sector of the first threshold value corresponding to the sector ring unit 1017 in fig. 2 is taken as 8, and the second threshold value is taken as 2.
Fig. 3 is a schematic diagram of a stimulation paradigm generation system provided by an embodiment of the present application. As shown in fig. 3, the visual stimulation area corresponding to the human visual field is abstracted into a circle, such as the first circular disc 1011 of fig. 3 corresponding to the left eye visual field; the portion of the central visual field within the first closed inner circular ring 1015 is not designed for visual stimulation, assuming that this region corresponds to the central visual field α 0 (ii) a The remaining part of the visual stimulation area, from which the central visual field part was removed, was equally divided into m sectors (seg) 1 ,seg 2 ,...,seg m ) The m sectors (seg) 1 ,seg 2 ,...,seg m ) Respectively corresponding to m polar angles (theta) 1 ,θ 2 ,...,θ m ) (ii) a Using f k The frequency signals encode m sectors; dividing the remaining part of the central visual field part into n rings (rings) 1 ,ring 2 ,...,ring n ) The n rings (ring) 1 ,ring 2 ,...,ring n ) Respectively corresponding to n visual field degrees (alpha) 1 ,α 2 ,...,α n ) (ii) a Combining the equally divided sectors and rings to form m × n regions (area) 1 ,area 2 ,...,area m×n ) I.e., m n fan ring units.
In some embodiments of the stimulation pattern generation system 100, for any one of the disk rings, the number of categories of encoding frequencies corresponding to the fan ring units included in any one of the disk rings is not greater than the first threshold.
In specific practice, use is made of k The frequencies respectively code and stimulate m different sectors of the disc, wherein, f k M is less than or equal to m. When the stimulation pattern generation system 100 is tested, the utilization f can be recorded k,on Stimulation at one frequency produces a corresponding brain signal, where f k,on ≤f k 。
In some embodiments of the stimulation pattern generation system 100, different sector divisions contain sector-ring cells configured with different encoding frequencies in any one disc circle; in any disc circle, all sector ring units contained in the same equal sector are configured with the same coding frequency.
In the stimulation pattern generation system provided in this embodiment, for the first circular disk ring and the second circular disk ring, the sector ring units included in different sector divisions in each circular disk ring are configured with different coding frequencies, and the sector ring units included in the same sector division are configured with the same coding frequency. According to the stimulation paradigm generation system, in the same disc ring, the sector ring units contained in different equal sectors are configured with different coding frequencies, and the sector ring units contained in the same equal sector are configured with the same coding frequency, so that the sector ring units are coded by using a small number of coding frequencies, the difference of the coding frequencies of the sector ring units in different equal sectors in the same disc ring is strengthened, the difficulty of brain signal feature extraction during multi-frequency simultaneous stimulation can be reduced, and the stimulation detection efficiency can be further improved.
In some embodiments of the stimulation pattern generation system 100, different sector divisions contain sector-ring cells configured with different encoding frequencies in any one disc circle; the coding frequency of any fan ring unit contained in the first disc ring is different from the coding frequency of any fan ring unit contained in the second disc ring.
In the stimulation pattern generation system provided in this embodiment, for the first circular disk and the second circular disk, the sector units included in different equal sectors in each circular disk are configured with different coding frequencies, and the coding frequency of any sector unit included in the first circular disk is different from the coding frequency of any sector unit included in the second circular disk. According to the stimulation paradigm generation system, in the same disc circle, the sector units contained in different equal sectors are configured with different coding frequencies, and the coding frequencies configured for the sector units contained in the equal sectors in different disc circles are different, so that the sector units are coded by using a small number of coding frequencies, the difference between the coding frequencies of the sector units in different disc circles is strengthened, the difficulty of brain signal feature extraction during multi-frequency simultaneous stimulation can be reduced, and the stimulation detection efficiency can be further improved.
In some embodiments of the stimulation pattern generation system 100, the encoding frequency of the fan ring units included in the first disc circle is the same as the encoding frequency of the fan ring units included in the second disc circle.
Illustratively, the first circular disk ring and the second circular disk ring each utilize f k The frequencies respectively carry out coding stimulation on m different sectors of the disc, and the coding frequencies adopted by the first disc ring and the second disc ring are also the same.
It will be appreciated that in some embodiments of the stimulation pattern generation system 100, the first circular disk and the second circular disk may also employ identical encoding frequency configurations. Specifically, for the first disc ring and the second disc ring, the division of the fan ring units is completely the same, the number of frequencies is the same, the encoding frequencies are the same, and the configuration relationship between the encoding frequencies and the fan ring units is also the same. For example, the encoding frequency and the configuration relationship of the fan ring units are the same, and it may be assumed that the same encoding rule is adopted for the fan ring units in the first disk ring and the second disk ring, and the area 'is provided for any one fan ring unit of the first disk ring' i And any one of the fan ring units area of the second circular disk ring " r If the numbers of the two are the same, namely, if i ═ r is satisfied, the fan ring unit area' i And a fan ring unit area " r The configured encoding frequencies are the same.
The stimulation paradigm generation system of the present application can be used to detect peripheral visual field neural pathway functions, such as glaucoma, cataract, macular degeneration, optic neuritis, optic nerve head edema, and the like; can also be used to detect the extent of degenerative diseases such as Parkinson's disease, Alzheimer's disease, amyotrophic lateral sclerosis, head trauma, or other cognitive disorders (e.g., in aphasia, the subject confuses the order of words in a vocabulary and even the order of entire sentences, which can also be shown as apparent loss of neural analysis packets); it can also be used for the diagnosis of multiple sclerosis, where multiple sclerosis affects neurons and sometimes, but at least in the early stages of the pathology, cells tend to recover, so that the deficits in the visual field that are diagnosed move in the peripheral visual field over time, or recover transiently; when the disease progresses to a point where many visual fields are missing on the retina, the missing regions will persist and cannot be recovered.
The embodiment of the present application further provides a brain-computer interface system, which includes the stimulation paradigm generating system in any one of the above embodiments, and the brain-computer interface system and the stimulation paradigm generating system utilize the binocular competition principle to detect the left and right eyes and analyze the brain signals, so that the duration of the visual stimulation can be shortened, and the stimulation detection efficiency can be improved.
Fig. 4 shows a block diagram of a brain-computer interface system according to an embodiment of the present application. As shown in fig. 4, a brain-computer interface system 400, including the stimulation paradigm generation system 100 of any one of the above-described embodiments; further comprising:
a data acquisition device 401 for acquiring brain signals generated by the subject; brain signals are produced by the left and right eyes of the subject based on the visual stimuli of the stimulus paradigm generation system 100; brain signals include multifocal homeostatic visual evoked potential mfSSVEP;
and the data processing device 402 is used for acquiring the brain signals, analyzing the brain signals and generating an evaluation result of the peripheral visual field of the user.
According to a multifocal steady-state visual evoked potential response mechanism, the stimulation of normal eyes with healthy visual pathways to any partitioned area can generate stable and strong response; while an abnormal eye with visual impairment produces no or a weaker response at the location of the impairment compared to other areas.
In some embodiments of the present application, the evaluation result of the peripheral field of view of the user is specifically information representing whether a sector of the field of view with impaired visual function exists in the peripheral field of view of the user.
The traditional visual brain-computer interface adopts a time division multiple access or frequency division multiple access coding strategy alone. Time division multiple access allows multiple users to share the same communication channel by dividing the signal into different time slots, most commonly found in brain-computer interfaces based on event-related potentials (e.g., P300 potential, mVEP potential); frequency division multiple access divides the entire frequency band into multiple independent frequency bands, each for a different user, and the SSVEP-based brain-computer interface is a typical frequency division multiple access system.
The multi-focus steady-state visual evoked potential paradigm of the brain-computer interface system in the embodiment of the application gives consideration to frequency division multiple access and space division multiple access, and coding efficiency of instructions is remarkably improved. Where space division multiple access divides a geographic space into smaller spaces for multiple targets. The mfSSVEP paradigm designed by the application is based on SSVEP, and realizes frequency division multiple access by encoding signals with various frequencies; meanwhile, the mfSSVEP paradigm designed by the invention realizes space division multiple access by encoding a plurality of frequency signals at different positions of the same stimulation instruction; by using binocular competition equipment, the paradigm designed by the invention can stimulate the left eye and the right eye at different frequencies and different positions simultaneously, and space division multiple access is also realized. The brain-computer interface system of the embodiment of the application realizes feasibility of combining frequency division multiple access and space division multiple access of the brain-computer interface by using the mfSSVEP paradigm and binocular competitive equipment, and has important significance for improving the performance of the brain-computer interface.
In some embodiments of brain-machine interface system 400, the brain signal is one of: electroencephalography (EEG) signals, Magnetoencephalography (MEG) signals, and functional near-infrared spectrogram (fNIRS) signals.
The brain-computer interface system of the present application may employ brain signal acquisition methods including, but not limited to, electroencephalogram (EEG), Magnetoencephalogram (MEG), functional near-infrared spectroscopy (fNIRS), and the like.
In some embodiments of the brain-machine interface system 400, the data processing device 402 is specifically configured to:
extracting the characteristics of the brain signals to obtain characteristic signal information;
performing variable correlation analysis on the characteristic signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate an evaluation result of the user's peripheral visual field.
In particular implementation, brain-computer interface system 400 presents visual stimuli via a display device. The visual stimulation is coded by adopting a multi-focus steady-state visual evoked paradigm designed by the invention, and comprises a first fan-ring visual stimulation block and a second fan-ring visual stimulation block which are respectively presented on the left and the right of a screen; reflecting the first fan-ring visual stimulation block and the second fan-ring visual stimulation block presented in the display device to the subject by a stimulation reflection device by using a mirror surface; the examinee realizes the binocular competitive effect by adjusting the mirror surface of the stimulation reflection device, so that the two visual stimuli are superposed in the eyes; collecting brain signals generated along with the operation intention of a user through a data collecting device 401, and completing analog signal processing such as denoising and amplification and A/D conversion; the data processing device 402 performs feature processing and pattern recognition of the brain signals by using a brain signal decoding method. Specifically, feature extraction is carried out on brain signals to obtain feature signal information; performing variable correlation analysis on the characteristic signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate an evaluation result of the user's peripheral visual field.
In some embodiments of the present application, the variable correlation analysis specifically identifies the multifocal steady-state visual evoked potential mfSSVEP by using a Filter Band Canonical Correlation Analysis (FBCCA). The CCA (canonical correlation analysis) is a method for studying the correlation between two sets of variables, which is to find a projection matrix of two sets of high-dimensional vectors and use the projection matrix to perform dimension reduction on the high-dimensional vectors, so as to maximize the correlation between the two vectors after dimension reduction.
The following embodiments of the present application take brain signals as electroencephalogram signals as examplesThe description is given. Hypothesis electroencephalogram signal
Is a sine-cosine reference signal, where N c Is the number of leads, N p Number of sampling points, N h The sine-cosine reference signal Y includes both fundamental waves and harmonics for the number of harmonics.
The expression of Y is shown as follows:
wherein the content of the first and second substances,
f is the stimulation frequency;
s is the sampling rate;
t is a time point.
A typical correlation analysis CCA procedure is shown by the following equation:
wherein the content of the first and second substances,
x is the signal after spatial filtering of X,
y is the signal after spatial filtering of Y,
W X representing a projection matrix for reducing the dimension of the electroencephalogram signal X;
W Y representing a projection matrix for reducing the dimension of the sine and cosine reference signals Y;
e [. cndot. ] represents to take the operation of the desired value;
and performing matrix transposition operation on the T representation.
The FBCCA adopted in the embodiment of the application is an improvement on the CCA. On the basis of CCA, the design of different frequency bands of a filter is utilized to sequentially filter out fundamental frequency, second harmonic and third harmonic of stimulation frequency till fifth harmonic, and finally discriminant analysis is carried out. And performing coefficient fusion on the correlation coefficient matrix according to the following formula through the correlation coefficient matrix obtained by the FBCCA algorithm.
Wherein, N is 6, which is the total number of the filter banks;
j is the index number of the sub-filter;
k is the index number of the stimulation frequency f;
ρ k in different frequency bands, obtaining a correlation coefficient matrix through an FBCCA algorithm;
a and b are preset constants.
Performing filtering band typical correlation analysis (FBCCA) to finally obtain a series of correlation coefficient values
And selecting the maximum value as an output result.
In some embodiments of brain-machine interface system 400, the brain signals include first brain signals and second brain signals; the first brain signal is a brain signal in a state where no visual stimulus is applied; the second brain signal is a brain signal in a state of applying the visual stimulus;
the data processing device 402 is specifically configured to:
performing variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and performing variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; the first characteristic signal information is obtained by performing characteristic extraction on the first brain signal; the second characteristic signal information is obtained by performing characteristic extraction on the second brain signal;
and obtaining correlation coefficient result information according to the first correlation coefficient result information and the second correlation coefficient result information.
In specific implementation, the data of the brain signals in the task state and the data of the brain signals in the rest state can be processed respectively. Wherein the task state is a state of applying a visual stimulus; the resting state is a state in which no visual stimulus is applied. The processing process of the data of the electroencephalogram signals under the task state is specifically that firstly, the data of the original electroencephalogram signals are filtered through a Filter Bank to form a plurality of groups of filtered signal data of different frequency bands, then the signal data of the different frequency bands are subjected to CCA algorithm to calculate CCA coefficients, and the coefficients are fused by the aid of the formula to obtain the coefficients under the task state. The data processing process of the electroencephalogram signals in the resting state is the same as the data processing process of the electroencephalogram signals in the task state, filtering is carried out through a Filter Bank in sequence, CCA coefficients are calculated, and the coefficients are fused to obtain the coefficients in the resting state. And finally, obtaining correlation coefficient result information according to the coefficient in the task state and the coefficient in the rest state.
In some embodiments of the present application, correlation coefficient result information is obtained according to a coefficient in a task state and a coefficient in a rest state, specifically, a final correlation coefficient result information is obtained by subtracting the coefficient in the task state and the coefficient in the rest state.
The brain-computer interface system of the above embodiment analyzes the brain signal data in the stimulated task state and the stimulated resting state respectively by using the decoding algorithm to obtain the output results of the coefficient in the task state and the coefficient in the resting state, and combines the decoding results of the brain signal data in the two states to obtain a more stable characteristic analysis data value, thereby shortening the duration of visual stimulation, improving the stimulation detection efficiency, and improving the accuracy of the evaluation result of the peripheral visual field of the user.
The brain-computer interface system provided by the embodiment of the application can be used for monitoring the peripheral visual nerve pathway function, and the brain-computer interface system can improve the accuracy of judging the visual pathway health level and the visual function defect degree of the subject.
Based on the same inventive concept as the brain-computer interface system provided in the foregoing embodiment, the embodiment of the present application further provides a stimulation paradigm detection method, and fig. 5 is a schematic flow chart of the method. As shown in fig. 5, the stimulation paradigm detection method includes:
in step S501, a visual stimulus is presented to a user in at least one first field sector of a first field of view of the user and/or in at least one second field sector of a second field of view of the user.
Wherein, the visual stimulation is presented by displaying a first sector ring visual stimulation block in a first disc ring and/or a second sector ring visual stimulation block in a second disc ring and reflecting a first sector ring stimulation block image and/or a second sector ring stimulation block image along a target direction; the fan ring visual stimulation block is formed by flashing the part of the fan ring units included in the disc ring according to the coding frequency corresponding to each fan ring unit; the target direction is the direction of reflecting the first circle center mark or the second circle center mark by the stimulating and reflecting device when the stimulating and reflecting device enables the first circle center mark of the first circular ring of the disc and the second circle center mark of the second circular ring of the disc to visually coincide; the first vision field fan ring is in one-to-one correspondence with the fan ring unit position at the first fan ring vision stimulation block; the second vision field fan ring is in one-to-one correspondence with the fan ring units at the second fan ring vision stimulation block.
In a specific implementation, the fan-ring visual stimulation block may be formed by selecting a part of fan-ring units from the fan-ring units included in the disc ring as target fan-ring units, and flashing the target fan-ring units according to the coding frequencies corresponding to the respective fan-ring units in the target fan-ring units.
For the fan-ring unit in the fan-ring visual stimulation block, the flashing waveform needs to be periodic, and the frequency should be usually above 7 Hz. The waveform of the flicker may be in the shape of a sine wave, a square wave, a triangular wave, a sawtooth wave, etc. In the RGB space, two colors can be selected arbitrarily, the value range is [0,0,0] to [255,255 ], and the two colors correspond to the wave troughs and the wave crests in the waveform diagram. The two colors are gradually changed frame by frame and alternately appear in a certain period, and stable flicker stimulation is presented.
In the embodiment of the application, the stimulation reflection device is a binocular competition instrument. In the stimulation paradigm detection process, the subject adjusts the lens reflection angle of the binocular rivalry instrument so that the left and right stimuli presented in the display device coincide in the eye. To achieve binocular competition, embodiments of the present application may employ a variety of devices, such as red and blue glasses, binocular prisms, and the like. The embodiment of the present application does not limit the specific form of the stimulus reflection device used for realizing binocular competition.
Step S502, collecting brain signals.
Wherein, the brain signals are generated by the left and right eyes of the user based on visual stimulation; brain signals include the multifocal homeostatic visual evoked potential mfSSVEP.
Step S503, acquiring and analyzing the brain signals, and generating an evaluation result of the peripheral visual field of the user.
In some embodiments of the present application, during the stimulation paradigm detection, the brain signals of the subject may be collected through the electrodes, amplified by the amplifier, filtered to form data information, and then the data information is analyzed to generate an evaluation result of the peripheral visual field of the user.
The stimulation paradigm detection method provides a mechanism for extracting features of brain signals and performing variable correlation analysis to obtain correlation coefficient result information, wherein the correlation coefficient result information is used for generating an evaluation result of peripheral vision of a user, so that the duration of visual stimulation can be shortened, and the stimulation detection efficiency can be improved.
In an alternative embodiment, presenting a visual stimulus to the user in at least one first field-of-view sector of the user's first field of view, and/or at least one second field-of-view sector of the user's second field of view, comprises:
in response to receiving the first stage detection instruction, presenting visual stimuli to the user in at least one first field-of-view sector of the user's first field of view and at least one second field-of-view sector of the user's second field of view to detect respective first field-of-view sectors of the user's first field of view and respective second field-of-view sectors of the user's second field of view;
if a second-stage detection instruction is received, presenting visual stimulation to the user in the target view sector of the user so as to detect the target view sector of the user; the target field of view fan ring is a first field of view fan ring selected in the first field of view or a second field of view fan ring selected in the second field of view.
Illustratively, assume that the non-irritating central field of view portion of the disk annulus corresponds to a field of view of 3 (α) 0 1.5 deg.), the first threshold m is 4, the second threshold n is 2, the remaining portion excluding the central vision portion is equally divided into 4 equally divided sectors (θ) 1 ＝0°～90°,θ 2 ＝90°～180°,θ 3 ＝-180°～-90°,θ 4 (-90 to 0 deg.), 2 rings (alpha) 1 ＝3.5°,α 2 7.5) and each equally divided sector is provided with a sinusoidal stimulus of a different coding frequency, which may be, for example, θ 1 The area of the divided sector is 13Hz, theta 2 The region of the divided sector is 15Hz and theta 3 The region of the divided sector is 17Hz, theta 4 The area in which the sector is divided is 19 Hz. That is, the same frequency information codes are used in different sector ring areas of the same sector, so that the area except the non-irritating central vision part on any one disk ring is divided into 8 sector ring areas, and at the moment, the number f of the types of the coding frequencies corresponding to the sector ring units included in any one disk ring k Is 4, the first threshold m is 4, and the number of classes satisfying the encoding frequency is not greater than the first threshold. Assuming that the two disk rings are disk ring a and disk ring B, respectively, the disk ring a and disk ring B correspond to the left-eye view and the right-eye view, respectively.
In the experimental process, the visual function damaged area is positioned by using the first detection stage, and the visual function damaged area is further accurately positioned by using the second detection stage, so that the visual function damaged degree is more accurately evaluated. Specifically, in the first detection stage, the two eyes are simultaneously detected at different positions, and 4 frequency stimuli (f) are switched on simultaneously k，on 4) the response of brain signals to multifocal steady-state visual evoked potentials is recorded simultaneously, with flashes across all locations (8 fan-ring regions). The upper left part of the disc circle A is assumed to be (theta) through the analysis of the decoding algorithm of the invention 1 ＝0°～90°，α 1 ＝3.5°，α 2 The induced response is weaker in the 7.5 deg. sector ring region. Wherein (theta) 1 ＝0°～90°，α 1 ＝3.5°，α 2 7.5 deg. sector ring area, is formed by equally dividing sector (theta) 1 0-90 degree, ring (alpha) 1 3.5 °) and a ring (α) 2 7.5 deg. to define a sector ring region.
In the second detection stage, the position determined in the first detection stage, namely the position (theta) of the upper left part of the disc ring A 1 ＝0°～90°，α 1 ＝3.5°，α 2 And (7.5) performing single-frequency stimulation to eliminate the influence of other factors except visual field defect factors on the decoding result of the first detection stage. Assuming that the brain signals recorded by the stimulus of the second detection stage are analyzed by the decoding algorithm of the invention, the position response amplitude is still weak, and the (theta) of the upper left part of the disc ring A is determined 1 ＝0°～90°，α 1 ＝3.5°，α 2 7.5 degrees) the position of the fan ring area corresponds to the visual field fan ring visual function defect.
In some embodiments of the present application, the brain-computer interface system 400 may further pinpoint the extent of visual impairment. In particular, by reducing the stimulus size, for example, a fan-ring visual stimulus block (θ) is constructed n_1 ＝0°～45°，α 1 ＝3.5°，α 2 ＝7.5°；θ n_2 ＝45°～90°，α 1 ＝3.5°，α 2 7.5 °), and the experiment was continued. The decoding strategy analysis is utilized by the invention. If (theta) n_1 ，α 1 ，α 2 ) The fan ring area has weak position response (theta) n_2 ，α 1 ，α 2 ) If the fan ring region position response is strong, it is judged that n_1 ，α 1 ，α 2 ) The vision field fan ring corresponding to the fan ring area position is a visual function defect position; conversely, if (θ) n_1 ，α 1 ，α 2 ) The fan ring area has strong position response (theta) n_2 ，α 1 ，α 2 ) If the fan ring area position response is weak, the judgment is made (theta) n_2 ，α 1 ，α 2 ) The visual field fan ring corresponding to the fan ring area position is a visual function defect position; if (theta) n_1 ，α 1 ，α 2 ) Position of sector ring areaAnd (theta) n_2 ，α 1 ，α 2 ) If the fan ring area position responses are weak, the judgment is made (theta) 1 ＝0°～90°，α 1 ＝3.5°，α 2 The visual field fan ring corresponding to the 7.5 degree fan ring area position is the visual function defect position.
The stimulation paradigm detection method provides a distributed detection mechanism, can respond to and receive the first stage detection instruction, detect each first field fan ring of the first field of vision of the user and each second field fan ring of the second field of vision of the user, can position the target field fan ring that the assessment result meets the preset condition in the first field of vision and the second field of vision, and according to the second stage detection instruction, present the visual stimulation to the user in the target field fan ring of the user, in order to detect the target field fan ring of the user, can assess the user field of vision more accurately.
Based on the same inventive concept as the stimulation paradigm detection method shown in fig. 5, the present application further provides a stimulation paradigm detection apparatus disposed in a brain-computer interface system, such as the brain-computer interface system 400 shown in fig. 4. Because the device is a device corresponding to the stimulation paradigm detection method and the principle of solving the problems of the device is similar to that of the method, the implementation of the device can refer to the implementation of the method, and repeated details are not repeated.
Fig. 6 illustrates a schematic structural diagram of a stimulation paradigm detecting device provided in an embodiment of the present application, where the stimulation paradigm detecting device is arranged in a brain-computer interface system, as shown in fig. 6, and includes a stimulation paradigm generating module 601, a signal acquiring module 602, and a data processing module 603.
A stimulus paradigm generation module 601 for presenting visual stimuli to the user in at least one first field of view sector of the user's first field of view, and/or at least one second field of view sector of the user's second field of view; the visual stimulation is presented by displaying a first sector ring visual stimulation block in the first disc circle and/or a second sector ring visual stimulation block in the second disc circle and reflecting the first sector ring stimulation block image and/or the second sector ring stimulation block image along the target direction; the fan ring visual stimulation block is formed by flashing the part of the fan ring units included in the disc ring according to the coding frequency corresponding to each fan ring unit; the target direction is the direction of reflecting the first circle center mark or the second circle center mark by the stimulating and reflecting device when the stimulating and reflecting device enables the first circle center mark of the first circular ring of the disc and the second circle center mark of the second circular ring of the disc to visually coincide; the first vision field fan ring is in one-to-one correspondence with the fan ring unit position at the first fan ring vision stimulation block; the positions of the second vision sector ring and the sector ring units at the second sector ring vision stimulation block are in one-to-one correspondence;
a signal acquisition module 602, configured to acquire brain signals; brain signals are generated by the left and right eyes of a user based on visual stimulation; brain signals include multifocal homeostatic visual evoked potential mfSSVEP;
and the data processing module 603 is configured to acquire and analyze the brain signals, and generate an evaluation result of the peripheral visual field of the user.
In an alternative embodiment, the data processing module 603 is specifically configured to:
extracting the characteristics of the brain signals to obtain characteristic signal information;
performing variable correlation analysis on the characteristic signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate an evaluation result of the user's peripheral vision.
In an alternative embodiment, the brain signals include a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where no visual stimulus is applied; the second brain signal is a brain signal in a state of applying the visual stimulus;
the data processing module 603 is specifically configured to:
performing variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and performing variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; the first characteristic signal information is obtained by performing characteristic extraction on the first brain signal; the second characteristic signal information is obtained by performing characteristic extraction on the second brain signal;
and obtaining correlation coefficient result information according to the first correlation coefficient result information and the second correlation coefficient result information.
In an alternative embodiment, the stimulation paradigm generating module 601 is specifically configured to:
in response to receiving the first stage detection instruction, presenting visual stimuli to the user in at least one first field-of-view sector of the user's first field of view and at least one second field-of-view sector of the user's second field of view to detect respective first field-of-view sectors of the user's first field of view and respective second field-of-view sectors of the user's second field of view;
if a second-stage detection instruction is received, presenting visual stimulation to the user in the target view sector of the user so as to detect the target view sector of the user; the target field of view fan ring is a first field of view fan ring selected in the first field of view or a second field of view fan ring selected in the second field of view.
The electronic equipment is based on the same inventive concept as the method embodiment, and the embodiment of the application also provides the electronic equipment. The electronic device may be used for stimulation paradigm detection. In one embodiment, the electronic device may be a server or other electronic device. In this embodiment, the electronic device may be configured as shown in fig. 7, and includes a memory 701, a communication module 703 and one or more processors 702.
A memory 701 for storing a computer program executed by the processor 702. The memory 701 may mainly include a storage program area and a storage data area, where the storage program area may store an operating system, a program required for running an instant messaging function, and the like; the storage data area can store various instant messaging information, operation instruction sets and the like.
The memory 701 may be a volatile memory (volatile memory), such as a random-access memory (RAM); the memory 701 may also be a non-volatile memory (non-volatile memory) such as, but not limited to, a read-only memory (rom), a flash memory (flash memory), a Hard Disk Drive (HDD) or a solid-state drive (SSD), or any other medium which can be used to carry or store desired program code in the form of instructions or data structures and which can be accessed by a computer. Memory 701 may be a combination of the above.
The processor 702 may include one or more Central Processing Units (CPUs), or be a digital processing unit, etc. A processor 702 for implementing the above-described stimulation paradigm detection method when invoking a computer program stored in the memory 701.
The communication module 703 is used for communicating with a terminal device or other servers.
In the embodiment of the present application, the specific connection medium among the memory 701, the communication module 703 and the processor 702 is not limited. In the embodiment of the present application, the memory 701 and the processor 702 are connected through the bus 704 in fig. 7, the bus 704 is represented by a thick line in fig. 7, and the connection manner between other components is only schematically illustrated and is not limited. The bus 704 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 7, but that does not indicate only one bus or one type of bus.
The embodiment of the present application further provides a computer storage medium, in which computer executable instructions are stored, and the computer executable instructions are used to implement the stimulation paradigm detection method according to any embodiment of the present application.
According to an aspect of the application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the stimulation pattern detection method in the above embodiment. The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application.
Claims (14)
1. A stimulation paradigm generation system, the system comprising:
the display device is used for displaying the first fan-shaped ring visual stimulation blocks in the first disc ring and/or the second fan-shaped ring visual stimulation blocks in the second disc ring; the fan ring visual stimulation block is formed by flashing the part of a fan ring unit included in the disc ring according to the coding frequency corresponding to each fan ring unit;
stimulus reflection means for reflecting the first sector ring stimulus block image and/or the second sector ring stimulus block image in a target direction to present a visual stimulus to a user in at least one first field of view sector ring of a first field of view and/or at least one second field of view sector ring of a second field of view of said user, respectively; the target direction is the direction of reflecting the first circle center mark or the second circle center mark by the stimulation reflection device when the stimulation reflection device enables the first circle center mark of the first circular ring and the second circle center mark of the second circular ring to be visually overlapped; the first vision field fan ring is in one-to-one correspondence with the fan ring unit position at the first fan ring vision stimulation block; the second vision field fan ring is in one-to-one correspondence with the fan ring unit at the second fan ring vision stimulation block.
2. The system of claim 1, wherein the first disk ring further comprises a first closed inner ring, and the second disk ring further comprises a second closed inner ring; the first circular disc ring and the first closed inner circular ring are marked as the circle centers by the first circle center, and the second circular disc ring and the second closed inner circular ring are marked as the circle centers by the second circle center; the sector ring unit is a graphic unit formed by intersecting the equally divided sectors with the concentric rings when the circle center of the disc ring is taken as an axis and the equally divided sectors with the first threshold value and the concentric rings with the second threshold value are divided for the part between the disc ring and the inner ring.
3. The system of claim 2, wherein for any disk ring, the number of categories of the encoding frequencies corresponding to the sector ring cells included in said any disk ring is not greater than the first threshold.
4. The system of claim 3, wherein in any disc ring, different equal sectors contain the sector ring units configured with different encoding frequencies; in any disc circle, all the fan ring units contained in the same equal sector are configured with the same coding frequency.
5. The system of claim 3, wherein in any disc ring, different equal sectors contain the sector ring units configured with different encoding frequencies; the coding frequency of any one of the fan ring units contained in the first disc ring is different from the coding frequency of any one of the fan ring units contained in the second disc ring.
6. A brain-computer interface system comprising the stimulation paradigm generation system of any one of claims 1-5; the brain-computer interface system further comprises:
the data acquisition device is used for acquiring brain signals generated by a subject; the brain signals are generated by the visual stimuli of the stimulation paradigm generation system of any one of claims 1-5 based on the left and right eyes of the subject; the brain signals comprise multifocal homeostatic visual evoked potentials mfssveps;
and the data processing device is used for acquiring the brain signals, analyzing the brain signals and generating an evaluation result of the peripheral vision of the user.
7. The system of claim 6, wherein the brain signal is one of: electroencephalography (EEG) signals, Magnetoencephalography (MEG) signals, and functional near-infrared spectrogram (fNIRS) signals.
8. The system according to claim 6, wherein the data processing device is specifically configured to:
extracting the characteristics of the brain signals to obtain characteristic signal information;
performing variable correlation analysis on the characteristic signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate the evaluation result for the user's peripheral visual field.
9. The system of claim 8, wherein the brain signals comprise first brain signals and second brain signals; the first brain signal is a brain signal in a state where the visual stimulus is not applied; the second brain signal is a brain signal in a state where the visual stimulus is applied;
the data processing apparatus is specifically configured to:
performing variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and performing variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein the first characteristic signal information is obtained by performing characteristic extraction on the first brain signal; the second characteristic signal information is obtained by performing characteristic extraction on the second brain signal;
and obtaining the correlation coefficient result information according to the first correlation coefficient result information and the second correlation coefficient result information.
10. A method of stimulation paradigm detection, the method comprising:
presenting a visual stimulus to a user in at least one first field-of-view fan-ring of a first field-of-view of the user, and/or at least one second field-of-view fan-ring of a second field-of-view of the user; the visual stimulation is presented by displaying a first sector ring visual stimulation block in a first disc circle and/or a second sector ring visual stimulation block in a second disc circle and reflecting the first sector ring stimulation block image and/or the second sector ring stimulation block image along a target direction; the fan ring visual stimulation block is formed by flashing the part of a fan ring unit included in the disc ring according to the coding frequency corresponding to each fan ring unit; the target direction is the direction of reflecting the first circle center mark or the second circle center mark by the stimulation reflection device when the stimulation reflection device enables the first circle center mark of the first circular ring and the second circle center mark of the second circular ring to be visually overlapped; the first vision field fan ring corresponds to the fan ring units at the first fan ring vision stimulation block one by one; the second vision field fan ring corresponds to the fan ring units at the second fan ring vision stimulation block one by one;
collecting brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimuli; the brain signals comprise a multifocal homeostatic visual evoked potential mfSSVEP;
and acquiring the brain signals, analyzing the brain signals and generating an evaluation result of the peripheral visual field of the user.
11. The method of claim 10, wherein presenting visual stimuli to the user in at least one first field-of-view sector of a user's first field of view, and/or at least one second field-of-view sector of the user's second field of view, comprises:
presenting a visual stimulus to a user in at least one first sector of a first field of view of the user and at least one second sector of a second field of view of the user in response to receiving a first stage detection instruction to detect respective first sectors of the first field of view of the user and respective second sectors of the second field of view of the user;
if a second-stage detection instruction is received, presenting visual stimulation to the user in a target vision sector of the user to detect the target vision sector of the user; the target field of view fan ring is a selected one of the first field of view fan rings in the first field of view or a selected one of the second field of view fan rings in the second field of view.
12. A stimulation paradigm detection device, the device comprising:
a stimulus paradigm generation module for presenting visual stimuli to a user in at least one first field of view sector of a first field of view of the user and/or at least one second field of view sector of a second field of view of the user; the visual stimulation is presented by displaying a first sector ring visual stimulation block in a first disc circle and/or a second sector ring visual stimulation block in a second disc circle and reflecting the first sector ring stimulation block image and/or the second sector ring stimulation block image along a target direction; the fan ring visual stimulation block is formed by flashing the part of a fan ring unit included in the disc ring according to the coding frequency corresponding to each fan ring unit; the target direction is the direction of reflecting the first circle center mark or the second circle center mark by the stimulation reflection device when the stimulation reflection device enables the first circle center mark of the first circular ring and the second circle center mark of the second circular ring to be visually overlapped; the first vision field fan ring corresponds to the fan ring units at the first fan ring vision stimulation block one by one; the second vision field fan ring is in one-to-one correspondence with the fan ring unit position at the second fan ring vision stimulation block;
the signal acquisition module is used for acquiring brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimuli; the brain signals comprise multifocal homeostatic visual evoked potentials mfssveps;
and the data processing module is used for acquiring the brain signals, analyzing the brain signals and generating an evaluation result of the peripheral vision of the user.
13. A server, characterized by comprising a memory and a processor, the memory having stored thereon a computer program operable on the processor, the computer program, when executed by the processor, implementing the method of claim 10 or 11.
14. A computer-readable storage medium having a computer program stored therein, the computer program characterized by: which computer program, when being executed by a processor, carries out the method of claim 10 or 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210564409.0A CN115024684A (en) | 2022-05-23 | 2022-05-23 | Stimulation paradigm generation system, brain-computer interface system, detection method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210564409.0A CN115024684A (en) | 2022-05-23 | 2022-05-23 | Stimulation paradigm generation system, brain-computer interface system, detection method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115024684A true CN115024684A (en) | 2022-09-09 |
Family
ID=83121396
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210564409.0A Pending CN115024684A (en) | 2022-05-23 | 2022-05-23 | Stimulation paradigm generation system, brain-computer interface system, detection method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115024684A (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150282704A1 (en) * | 2012-11-26 | 2015-10-08 | The Australian National University | Clustered volley method and apparatus |
| CN106455968A (en) * | 2014-04-17 | 2017-02-22 | 加利福尼亚大学董事会 | Portable brian activity sensing platform for assessment of visual field deficits |
| DE102015217682A1 (en) * | 2015-09-16 | 2017-03-16 | Carl Zeiss Ag | Device for eye examination |
| CN106793942A (en) * | 2014-02-10 | 2017-05-31 | 华柏恩视觉诊断公司 | System, method and apparatus for measuring eye movement and pupillary reaction |
| US20170209044A1 (en) * | 2014-07-18 | 2017-07-27 | Kabushiki Kaisha Topcon | Visual function testing device and visual function testing system |
| CN107656612A (en) * | 2017-09-06 | 2018-02-02 | 天津大学 | Big instruction set brain-machine interface method based on P300 SSVEP |
| WO2018025125A1 (en) * | 2016-07-31 | 2018-02-08 | Ic Inside Ltd. | Method of retinal sensitivity mapping using near-eye display |
| KR20180134310A (en) * | 2017-06-08 | 2018-12-18 | 고려대학교 산학협력단 | Appratus for controlling integrated supervisory of pilots status and method for guiding task performance ability of pilots using the same |
| CA3142060A1 (en) * | 2019-06-04 | 2020-12-10 | The Boeing Company | Method and device for evaluating projection content in enclosed environment, and storage medium |
| US20210035665A1 (en) * | 2017-11-27 | 2021-02-04 | Advanced Telecommunications Research Institute International | Brain network activity estimation system, method of estimating activities of brain network, brain network activity estimation program, and trained brain activity estimation model |
| CN113805694A (en) * | 2021-08-26 | 2021-12-17 | 上海大学 | Auxiliary grabbing system and method based on brain-computer interface and computer vision |
| CN114081506A (en) * | 2021-09-23 | 2022-02-25 | 西安交通大学 | Steady-state visual evoked potential classification method based on long-term and short-term memory network |
| CN114167990A (en) * | 2021-12-10 | 2022-03-11 | 清华大学 | Stimulation paradigm generation system, brain-computer interface system, detection method and device |
-
2022
- 2022-05-23 CN CN202210564409.0A patent/CN115024684A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150282704A1 (en) * | 2012-11-26 | 2015-10-08 | The Australian National University | Clustered volley method and apparatus |
| CN106793942A (en) * | 2014-02-10 | 2017-05-31 | 华柏恩视觉诊断公司 | System, method and apparatus for measuring eye movement and pupillary reaction |
| CN106455968A (en) * | 2014-04-17 | 2017-02-22 | 加利福尼亚大学董事会 | Portable brian activity sensing platform for assessment of visual field deficits |
| US20170209044A1 (en) * | 2014-07-18 | 2017-07-27 | Kabushiki Kaisha Topcon | Visual function testing device and visual function testing system |
| DE102015217682A1 (en) * | 2015-09-16 | 2017-03-16 | Carl Zeiss Ag | Device for eye examination |
| WO2018025125A1 (en) * | 2016-07-31 | 2018-02-08 | Ic Inside Ltd. | Method of retinal sensitivity mapping using near-eye display |
| KR20180134310A (en) * | 2017-06-08 | 2018-12-18 | 고려대학교 산학협력단 | Appratus for controlling integrated supervisory of pilots status and method for guiding task performance ability of pilots using the same |
| CN107656612A (en) * | 2017-09-06 | 2018-02-02 | 天津大学 | Big instruction set brain-machine interface method based on P300 SSVEP |
| US20210035665A1 (en) * | 2017-11-27 | 2021-02-04 | Advanced Telecommunications Research Institute International | Brain network activity estimation system, method of estimating activities of brain network, brain network activity estimation program, and trained brain activity estimation model |
| CA3142060A1 (en) * | 2019-06-04 | 2020-12-10 | The Boeing Company | Method and device for evaluating projection content in enclosed environment, and storage medium |
| US20220273226A1 (en) * | 2019-06-04 | 2022-09-01 | The Boeing Company | Method for evaluating projection content in enclosed environment, apparatus, and storage medium |
| CN113805694A (en) * | 2021-08-26 | 2021-12-17 | 上海大学 | Auxiliary grabbing system and method based on brain-computer interface and computer vision |
| CN114081506A (en) * | 2021-09-23 | 2022-02-25 | 西安交通大学 | Steady-state visual evoked potential classification method based on long-term and short-term memory network |
| CN114167990A (en) * | 2021-12-10 | 2022-03-11 | 清华大学 | Stimulation paradigm generation system, brain-computer interface system, detection method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110801237B (en) | Cognitive ability evaluation system based on eye movement and electroencephalogram characteristics | |
| CN110765920B (en) | Motor imagery classification method based on convolutional neural network | |
| Roudaia et al. | The effect of aging on contour integration | |
| CN106455968A (en) | Portable brian activity sensing platform for assessment of visual field deficits | |
| US20090109398A1 (en) | Apparatus for Improving Visual Perception | |
| CN110464298B (en) | Electroencephalogram signal processing device and method | |
| US11642068B2 (en) | Device and method to determine objectively visual memory of images | |
| CN113288175A (en) | Electroencephalogram signal quality detection method and device, electronic equipment and storage medium | |
| Schwarz et al. | Direct comparison of supervised and semi-supervised retraining approaches for co-adaptive BCIs | |
| Collins et al. | Temporal dynamics of shape processing differentiate contributions of dorsal and ventral visual pathways | |
| CN112842360B (en) | Method and system for judging dominant eye and non-dominant eye | |
| Held et al. | Perception | |
| CN115024684A (en) | Stimulation paradigm generation system, brain-computer interface system, detection method and device | |
| Fridgeirsson et al. | Patient specific intracranial neural signatures of obsessions and compulsions in the ventral striatum | |
| Wai et al. | A study of ssvep responses in case of overt and covert visual attention with different view angles | |
| Abdelnabi et al. | Towards high-frequency SSVEP-based target discrimination with an extended alphanumeric keyboard | |
| Childers et al. | Spatio-temporal measures of cortical functioning in normal and abnormal vision | |
| Zambalde et al. | Influence of stimuli spatial proximity on a SSVEP-based BCI performance | |
| Ince et al. | Movement direction decoding with spatial patterns of local field potentials | |
| CN116421202B (en) | Brain visual function rapid detection method, device and storage medium based on electroencephalogram rapid periodic visual stimulus singular paradigm | |
| Franzén et al. | Brain potential correlates of supraliminal contrast functions and defocus | |
| Xu et al. | In this work, we investigate the effect of Parkinson's disease (PD), and common corresponding therapies on vision-based perception of motion, a critical perceptual ability required for performing a wide range of activities of daily livings. While PD has been recognized as mainly a motor disorder, sensory manifestation of PD can also play a major role in the resulting disability. In this paper, for the first time, the effect of disease | |
| Grossman | Neural mechanisms of human vision: Deterministic and spontaneous aspects of visual encoding | |
| Xu et al. | Evaluation of Steady-State Visual Evoked Potentials (SSVEP) Stimuli Design for Visual Field Assessment | |
| Acqualagna | Pushing the boundaries of Brain-Computer Interface technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |