WO2015161300A1 - Portable brian activity sensing platform for assessment of visual field deficits - Google Patents

Portable brian activity sensing platform for assessment of visual field deficits Download PDF

Info

Publication number
WO2015161300A1
WO2015161300A1 PCT/US2015/026543 US2015026543W WO2015161300A1 WO 2015161300 A1 WO2015161300 A1 WO 2015161300A1 US 2015026543 W US2015026543 W US 2015026543W WO 2015161300 A1 WO2015161300 A1 WO 2015161300A1
Authority
WO
WIPO (PCT)
Prior art keywords
visual
user
visual field
electrodes
sector
Prior art date
Application number
PCT/US2015/026543
Other languages
French (fr)
Inventor
Tzyy-Ping Jung
Yuan-Pin Lin
Yijun Wang
Felipe A. MEDEIROS
Original Assignee
The Regents Of The University Of California
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The Regents Of The University Of California filed Critical The Regents Of The University Of California
Priority to CA2946301A priority Critical patent/CA2946301A1/en
Priority to CN201580030650.3A priority patent/CN106455968B/en
Priority to EP15780001.2A priority patent/EP3131453B1/en
Priority to US15/304,803 priority patent/US20170035317A1/en
Priority to KR1020167031738A priority patent/KR20160145131A/en
Publication of WO2015161300A1 publication Critical patent/WO2015161300A1/en
Priority to US17/093,575 priority patent/US20210052182A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • A61B5/377Electroencephalography [EEG] using evoked responses
    • A61B5/378Visual stimuli
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0016Operational features thereof
    • A61B3/0025Operational features thereof characterised by electronic signal processing, e.g. eye models
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0016Operational features thereof
    • A61B3/0041Operational features thereof characterised by display arrangements
    • A61B3/005Constructional features of the display
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0091Fixation targets for viewing direction
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/02Subjective types, i.e. testing apparatus requiring the active assistance of the patient
    • A61B3/024Subjective types, i.e. testing apparatus requiring the active assistance of the patient for determining the visual field, e.g. perimeter types
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14Arrangements specially adapted for eye photography
    • A61B3/145Arrangements specially adapted for eye photography by video means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/161Flicker fusion testing
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/25Bioelectric electrodes therefor
    • A61B5/279Bioelectric electrodes therefor specially adapted for particular uses
    • A61B5/291Bioelectric electrodes therefor specially adapted for particular uses for electroencephalography [EEG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/398Electrooculography [EOG], e.g. detecting nystagmus; Electroretinography [ERG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802Sensor mounted on worn items
    • A61B5/6803Head-worn items, e.g. helmets, masks, headphones or goggles

Definitions

  • This patent document relates to systems, devices, and processes that use brain machine interface (BMI) technologies.
  • BMI brain machine interface
  • Electroencephalography is the recording of electrical activity exhibited by the brain using electrodes positioned on a subject's scalp, forming a spectral content of neural signal oscillations that comprise an EEG data set.
  • the electrical activity of the brain that is detected by EEG techniques can include voltage fluctuations, e.g., resulting from ionic current flows within the neurons of the brain.
  • EEG refers to the recording of the brain's spontaneous electrical activity over a short period of time, e.g., less than an hour.
  • EEG can be used in clinical diagnostic applications including epilepsy, coma, encephalopathies, brain death, and other diseases and defects, as well as in studies of sleep and sleep disorders. In some instances, EEG has been used for the diagnosis of tumors, stroke and other focal brain disorders
  • EEG electroencephalogram
  • mfSSVEP multifocal steady-state visual-evoked potentials
  • the disclosed techniques integrate mfSSVEPs into a portable platform using wireless EEG and a head mounted display, demonstrating ability to assess potential visual field deficits, e.g., in conditions such as glaucoma.
  • a system for monitoring brain activity associated with visual field of a user includes a sensor unit to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; visual display unit including a display screen to present visual stimuli to the user in a plurality of sectors of a visual field, in which the presented visual stimuli includes an optical flickering effect at a selected frequency mapped to each sector of the visual field, the visual stimuli configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the sensor unit; and a data processing unit in
  • a method for examining a visual field of a subject includes presenting, to a subject, visual stimuli in a plurality of sectors of a visual field of a subject, in which for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency; acquiring electroencephalogram (EEG) signals from one or more electrodes in contact with the head of the subject; processing the acquired EEG signals to extract multifocal steady-state visual-evoked potentials (mfSSVEP) data associated with the subject's EEG signal response to the presented visual stimuli; and producing a quantitative assessment of the visual field of the subject based on the MfSSVEP data.
  • EEG electroencephalogram
  • mfSSVEP multifocal steady-state visual-evoked potentials
  • a portable system for monitoring brain activity associated with visual field of a user includes a brain signal sensor device to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; a wearable visual display unit to present visual stimuli to the user and structured to include a display screen and a casing able to secure to the head of the user, in which the wearable visual display is operable to present the visual stimuli in a plurality of sectors of the user's visual field, such that for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency, and in which the visual stimuli are configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the brain signal sensor device; a data processing unit in communication with the brain signal sensor device and the wearable visual display unit to provide the visual stimuli to the wearable visual display unit and to analyze the acquired EEG signals and produce an assessment of the user
  • EEG electroencephal
  • the disclosed portable platform for assessing functional loss can facilitate detection and monitoring of visual field loss in glaucoma, the leading cause of blindness in the world.
  • the disclosed portable platform uses high-density EEG recording and mfSSVEP that can provide improved signal-to-noise ratios, increasing reproducibility and diagnostic accuracy, e.g., as compared to existing EEG-based methods for objective perimetry, such as mfVEP.
  • the disclosed methods can allow for much broader and more frequent testing of patients, e.g., as compared to existing perimetric approaches. For example, this could reduce the number of office visits necessary for patients at risk or diagnosed with glaucoma, significantly decreasing the economic burden of the disease.
  • the disclosed methods can facilitate the discrimination of true deterioration from test-retest variability, e.g., resulting in earlier diagnosis and detection of progression.
  • the disclosed portably-implemented and objective methods for visual field assessment can also allow screening for visual loss in underserved populations.
  • the disclosed technology is non-invasive and can be implemented without direct physical contact with an eye of the individual subject being assessed, and thereby avoid causing any discomfort or risk of injury through inadvertent application of force or transfer of harmful chemical or biological material to the eye.
  • FIG. 1A shows a diagram of an exemplary system to implement the techniques of the disclosed technology.
  • FIGS. IB-IE show diagrams of an exemplary method to examine visual field defects using the disclosed technology.
  • FIG. IF shows diagrams depicting an exemplary implementation using multifocal steady-state visual-evoked potentials (mfSSVEP) for assessment of visual field defects.
  • mfSSVEP multifocal steady-state visual-evoked potentials
  • FIG. 2 shows images of an exemplary EEG setup used in exemplary
  • FIG. 3A shows data plots depicting exemplary CONTROL-DEFICIT
  • FIG. 3B shows data plots depicting a BLOCK-CONTROL comparison in mfSSVEP profiles from a representative subject.
  • FIG. 4 shows an image of an exemplary portable device of the disclosed portable, objective mfSSVEP -based visual field assessment platform.
  • FIGS. 5A and 5B show images of an exemplary wearable, wireless 64-channel dry EEG system.
  • FIGS. 6A and 6B show an image and a diagram of an exemplary head-mounted display system and presentation layout to present an exemplary mfSSVEP stimulation, respectively.
  • Optic neuropathy refers to optic nerve damage that can result in significant and irreversible loss of visual function and disability.
  • glaucoma is associated with a progressive degeneration of retinal ganglion cells (RGCs) and their axons, resulting in a characteristic appearance of the optic disc and a concomitant pattern of visual field loss.
  • RRCs retinal ganglion cells
  • Loss of visual function in glaucoma is generally irreversible, and without adequate treatment the disease can progress to disability and blindness. The disease can remain relatively asymptomatic until late stages and, therefore, early detection and monitoring of functional damage is paramount to prevent functional impairment and blindness.
  • glaucoma affects more than 70 million individuals worldwide with approximately 10% being bilaterally blind, which makes it the leading cause of irreversible blindness in the world.
  • the disease can remain asymptomatic until it is severe, the number of affected individuals is likely to be much larger than the number known to have it.
  • Population-level survey data indicate that only 10% to 50% of the individuals are aware they have glaucoma.
  • Visual dysfunction appears to be a strong predictor of cognitive dysfunction in subject in a number of clinical neuroscience disorders.
  • the functional deficits of glaucoma and Alzheimer's Disease include loss in low spatial frequency ranges in contrast sensitivity, and are similar in both diseases.
  • Pattern masking has been found to be a good predictor of cognitive performance in numerous standard cognitive tests. Some tests found to correlate with pattern masking include Gollin, Stroop-Work, WAIS-PA, Stroop-Color, Geo- Complex Copy, Stroop-Mixed and RCPM, for example.
  • Losses in contrast sensitivity at the lowest spatial frequency also was predictive of cognitive losses in the seven tests. For example, AD subjects have abnormal word reading thresholds corresponding to their severity of cognitive impairment and reduced contrast sensitivity in all spatial frequencies as compared to normal subjects.
  • SAP standard automated perimetry
  • Visual field assessment with SAP requires considerable subjective input from the patient, and for some patients it is very difficult, or even impossible, to obtain reliable visual field measures.
  • SAP is also limited by large test-retest variability and a large number of tests are usually necessary in order to discriminate true disease progression from noise, even for reliable test-takers.
  • SAP testing is limited by subjectivity of patient responses and large variability, frequently requiring a large number of tests for effective detection of change over time. These tests are generally conducted in clinic -based settings and, due to limited patient availability and health care resources, an insufficient number of tests are frequently acquired over time, resulting in delayed diagnosis and detection of disease progression.
  • the requirements for highly trained technicians, cost, complexity, and lack of portability of SAP testing also preclude its use for screening of visual field loss in
  • Neurological disorders e.g., such as macular degeneration, diabetic retinopathy, optic neuritis, papilledema, anterior ischemic optic neuropathy, and tumor, can be diagnosed and tracked by SAP.
  • VEP visual evoked potential
  • multifocal VEP techniques have been limited by relatively low signal to noise ratio and have shown limited potential to assess visual field losses in the disease.
  • the conventional pattern VEP is predominantly generated by cortical elements receiving projections from the central retina, where the central 2° of visual field contributes 65% of the response. Therefore, conventional VEP possesses a limited ability to reflect field loss in non-central areas, such as those that can occur with glaucoma.
  • VEP techniques cab allow many areas of the retina to be stimulated simultaneously and separate responses from each part of the visual field to be obtained, individual differences in the anatomy of the visual cortex lead to considerable inter-individual variability of responses in normal subjects, making it difficult the identification of mfVEP abnormalities in diseased patients.
  • existing mfVEP recording techniques can only be performed with non-portable devices in clinic- or laboratory-based settings, requiring cumbersome setup for placement of electrodes (e.g., data collection requires skin preparation and gel application to ensure good electrical conductivity between sensor and skin), and such procedures are time consuming and uncomfortable for the patient.
  • the present technology includes methods, systems, and devices that acquire, process, and/or utilize steady-state visually evoked potentials (SSVEP) for monitoring, tracking, and/or diagnosing various paradigms in cognitive function (e.g., visual attention, binocular rivalry, working memory, and brain rhythms) and clinical neuroscience (e.g., aging, neurodegenerative disorders, schizophrenia, ophthalmic pathologies, migraine, autism, depression, anxiety, stress, and epilepsy), particularly for SSVEPs generated by optical stimuli.
  • cognitive function e.g., visual attention, binocular rivalry, working memory, and brain rhythms
  • clinical neuroscience e.g., aging, neurodegenerative disorders, schizophrenia, ophthalmic pathologies, migraine, autism, depression, anxiety, stress, and epilepsy
  • EEG electroencephalogram
  • the disclosed techniques integrate mfSSVEPs into a portable platform using wireless EEG and a head mounted display capable of assessing potential visual field deficits.
  • the disclosed technology can be applied to diagnose and track neurological disorders, e.g., such as macular degeneration, diabetic retinopathy, optic neuritis, papilledema, anterior ischemic optic neuropathy, and/or tumors.
  • the present technology utilizes rapid flickering stimulation to produce a brain response characterized by a "quasi-sinusoidal" waveform whose frequency components are constant in amplitude and phase, e.g., the so-called steady - state response.
  • the portable platform integrates a wearable, wireless, high-density dry EEG system and a head-mounted display allowing users to routinely monitor the electrical brain activity associated with visual field stimulation.
  • the present technology includes brain-computer interfaces using dry EEG sensor arrays, wearable/wireless data acquisition and signal processing hardware and software. These interfaces can monitor and record non-invasive, high spatiotemporal resolution brain activity of unconstrained, actively engaged human subjects.
  • the disclosed technology can be applied for ophthalmologic diagnosis of neurological complications, in particular that of major ocular pathologies including glaucoma, retinal anomalies and of sight, retinal degeneration of the retinal structure and macular degeneration, diabetic retinopathy, optic neuritis, optical neuroma, or degenerative diseases, e.g., such as Parkinson's disease, Alzheimer's disease, non-Alzheimer's dementia, multiple sclerosis, ALS, head trauma, diabetes, or other cognitive disorders, e.g., such as dyslexia. More broadly, the present technology can be used to characterize inappropriate responses to contrast sensitivity patterns, and disorders affecting the optical nerve and the visual cortex.
  • degenerative diseases e.g., such as Parkinson's disease, Alzheimer's disease, non-Alzheimer's dementia, multiple sclerosis, ALS, head trauma, diabetes, or other cognitive disorders, e.g., such as dyslexia.
  • the present technology can be used to characterize inappropriate responses to contrast sensitivity patterns,
  • MS multiple sclerosis
  • the disclosed technology includes portable platforms that can be used for accurate and convenient screening of many neuro-degenerative diseases, e.g., including Alzheimer's, non-Alzheimer's dementia, Parkinson's, multiple sclerosis, macular degeneration, ALS, diabetes, dyslexia, head trauma, and others.
  • neuro-degenerative diseases e.g., including Alzheimer's, non-Alzheimer's dementia, Parkinson's, multiple sclerosis, macular degeneration, ALS, diabetes, dyslexia, head trauma, and others.
  • the present technology utilizes electroencephalogram (EEG)-based brain sensing methods, systems, and devices for visual-field examination by using high-density EEG to associate the dynamics of multifocal steady-state visual-evoked potentials (mfSSVEP) with visual field defects, in which the use of rapid flickering stimulation can produce a brain response characterized by a "quasi-sinusoidal" waveform whose frequency components are constant in amplitude and phase, the so-called steady-state response.
  • EEG electroencephalogram
  • mfSSVEP is a form of steady-state visual-evoked potentials which reflect a frequency -tagged oscillatory EEG activity modulated by the frequency of periodic visual simulation higher than 6 Hz.
  • the mfSSVEP is a signal of multi-frequency tagged SSVEP, e.g., which can be elicited by simultaneously presenting multiple continuous, repetitive black/white reversing visual patches flickering at different frequencies.
  • a flicker sector(s) corresponding to a visual field deficit(s) will be less perceivable or unperceivable and thereby will elicit a weaker SSVEP, e.g., as compared to the brain responses to other visual stimuli presented at normal visual spots.
  • the disclosed methods, systems, and devices for visual-field examination using mfSSVEP data includes the formation of a spatial visual stimulus display having multiple regions or sectors at different spatial locations, where for each region, the particular region includes an optical effect (e.g., light flickering) that changes at a unique frequency with respect to at least a proximate region or any other region of the visual stimulus display.
  • the visual stimulus display can include twenty regions each presenting its respective optical effect at a different frequency between 8.0 Hz and 1 1.8 Hz (e.g., 8.0 in sector 1, 8.2 in sector 2, 8.4 in sector 3, ..., 1 1.8 in sector 20).
  • the optical effect can be a light modulating between an ON and OFF state at the designated frequency for the particular region.
  • the brain response to the visual stimuli e.g., as measured by at least one electrode placed on or near the head or multiple electrodes arranged in an arrangement to improve spatiotemporal resolution of the EEG signals, are acquired and processed to produce and evaluate mfSSVEP data with respect to a frequency spectrum including the designated frequencies mapped to the spatial regions of the visual stimulus display.
  • the processing includes comparing the mfSSVEP signal at the particular frequencies to a predetermined threshold, or in relation to other mfSSVEP signals, to determine if the signal falls below the predetermined threshold or is substantially lower with respect to a comparative mfSSVEP signal.
  • Determination of a mfSSVEP signal below the threshold or substantially lower than a standard at that particular frequency corresponds to a visual field deficiency to the spatial location on the visual stimulus display to which that frequency is mapped, and indicative of a visual field defect of the user in that specific region.
  • the disclosed techniques include using SSVEP and brain-computer interfaces (BCIs) to bridge the human brain with computers or external devices.
  • BCIs brain-computer interfaces
  • the users of SSVEP -based brain-computer interface can interact with or control external devices and/or environments through gazing at distinct frequency-coded targets.
  • the SSVEP -based BCI can provide a promising communication carrier for patients with disabilities due to its high signal-to-noise ratio over the visual cortex, which can be measured by EEG at the parieto-occipital region noninvasively.
  • Methods, devices and systems of the disclosed technology can implement wireless SSVEP data acquisition and processing.
  • Methods, devices and systems of the disclosed technology can include a noninvasive platform for continuously monitoring high temporal resolution brain dynamics without requiring conductive gels applied to the scalp.
  • An exemplary system can employ dry microelectromechanical system EEG sensors, low-power signal acquisition, amplification and digitization, wireless telemetry, and real-time processing.
  • the present technology can include analytical techniques, such as independent component analysis, which can improve detectability of SSVEP signals.
  • mfSSVEP multifocal techniques to SSVEP
  • mfSSVEP multifocal techniques to SSVEP
  • the exemplary results of such implementations demonstrate detection of localized and peripheral field losses, as well as show successful implementations of a portable objective method of assessment of visual field loss in opto-neurological diseases, e.g., such as glaucoma, amblyopia, age-related macular degeneration, and optic neuritis.
  • the exemplary visual field assessment methods can be used for screening in remote locations or for monitoring patients with the disease in underserved areas, as well as for use in the assessment of visual field deficits in other conditions.
  • the disclosed technology includes a portable platform that integrates a wearable, wireless EEG dry system and a head-mounted display system that allows users to routinely and continuously monitor the electrical brain activity associated with visual field in their living environments, e.g., representing a transformative way of monitoring disease progression, e.g., such as in glaucoma.
  • Such devices provide an innovative and potentially useful way of screening for the disease.
  • the disclosed technology includes portable brain-computer interfaces and methods for sophisticated analysis of EEG data, e.g., including capabilities for diagnosis and detection of disease progression.
  • the disclosed methods, systems, and devices can be implemented to improve screening, diagnosis and detection of disease progression and also enhance understanding of how the disease affects the visual pathways.
  • FIG. 1A shows a diagram of an exemplary portable EEG-based system 100 of the disclosed technology to implement the methods described in this patent document.
  • the EEG- based system 100 integrates a wearable, wireless, high-density dry EEG sensor unit 1 1 1 and a visual display unit 1 12 (e.g., such as a head-mounted display) in data communication with a data processing unit 120 allowing users to routinely monitor the electrical brain activity associated with visual field stimulation.
  • the data processing unit 120 can include various modules or units of the disclosed system for processing data extracted from the subject, e.g., via the EEG unit 1 11, based on stimulus of the subject via the visual display unit 112.
  • the visual display unit 1 12 can include an output unit that can include various types of display, speaker, and/or printing interfaces, e.g., which can be used to implement a visual stimulus technique.
  • the output unit can include cathode ray tube (CRT), light emitting diode (LED), or liquid crystal display (LCD) monitor or screen, among other visual displays, as a visual display.
  • the output unit can include various types of audio signal transducer apparatuses or other sensory inducing apparatuses to implement the sensory stimuli.
  • the data processing unit 120 can include a processor 121 that can be in communication with an input/output (LO) unit 122, an output unit 123, and a memory unit 124.
  • the data processing unit 120 can be implemented as one of various data processing systems, such as a personal computer (PC), laptop, and mobile communication device.
  • the data processing unit 120 can be included in the device structure that includes the wearable EEG sensor unit 1 11.
  • the processor 121 can be included to interface with and control operations of other components of the data processing unit 120, such as the I/O unit 122, the output unit 123, and the memory unit 124.
  • the memory unit 124 can store information and data, e.g., such as instructions, software, values, images, and other data processed or referenced by the processor 121.
  • RAM Random Access Memory
  • ROM Read Only Memory
  • Flash Memory devices and other suitable storage media can be used to implement storage functions of the memory unit 124.
  • the memory unit 124 can store data and information, which can include subject stimulus and response data, and information about other units of the system, e.g., including the EEG sensor unit 1 1 1 and the visual display unit 112, such as device system parameters and hardware constraints.
  • the memory unit 124 can store data and information that can be used to implement the portable EEG -based system 100.
  • the I/O unit 122 can be connected to an external interface, source of data storage, or display device.
  • Various types of wired or wireless interfaces compatible with typical data communication standards can be used in communications of the data processing unit 120 with the EEG sensor unit 1 11 and the visual display unit 112 and/or other units of the system, e.g., including, but not limited to, Universal Serial Bus (USB), IEEE 1394 (FireWire), Bluetooth, IEEE 802.1 11 , Wireless Local Area Network (WLAN), Wireless Personal Area Network (WPAN), Wireless Wide Area Network (WWAN), WiMAX, IEEE 802.16
  • the I/O unit 122 can interface with an external interface, source of data storage, or display device to retrieve and transfer data and information that can be processed by the processor 121, stored in the memory unit 124, or exhibited on the output unit 123.
  • the I/O unit 122 can interface with an external interface, source of data storage, or display device to retrieve and transfer data and information that can be processed by the processor 121, stored in the memory unit 124, or exhibited on the output unit 123.
  • the data processing unit 120 can include an output unit 123 that can be used to exhibit data implemented by the data processing unit 120.
  • the output unit 123 can include various types of display, speaker, or printing interfaces to implement the output unit 123.
  • the output unit 123 can include cathode ray tube (CRT), light emitting diode (LED), or liquid crystal display (LCD) monitor or screen as a visual display to implement the output unit 123.
  • CTR cathode ray tube
  • LED light emitting diode
  • LCD liquid crystal display
  • the output unit 123 can include toner, liquid inkjet, solid ink, dye sublimation, inkless (e.g., such as thermal or UV) printing apparatuses to implement the output unit 123; the output unit 123 can include various types of audio signal transducer apparatuses to implement the output unit 123.
  • the output unit 123 can exhibit data and information, such as the system data in a completely processed or partially processed form.
  • the output unit 123 can store data and information used to implement the disclosed techniques.
  • FIG. 1A also shows a block diagram of the processor 121 that can include a central processing unit (CPU) 125 and/or a graphic processing unit (GPU) 126, or both the CPU 125 and the GPU 126.
  • the CPU 125 and GPU 126 can interface with and control operations of other components of the data processing unit 120, such as the I/O unit 122, the output unit 123, and the memory unit 124.
  • FIG. IB shows a diagram of an exemplary method 180 to examine visual field defects using the disclosed technology, e.g., such as including the system 100.
  • the method 180 includes a process 182 to present, to a subject, visual stimuli in a plurality of sectors of a visual field of a subject, in which for each sector the presented visual stimuli includes an optical effect (e.g., light flickering) at a selected frequency.
  • the method 180 includes a process 184 to acquire EEG signals from one or more electrodes in contact with the head of the subject.
  • the method 180 includes a process 186 to data process (e.g., analyze) the acquired EEG signals to extract mfSSVEP data associated with the subject's EEG signal response to the presented visual stimuli.
  • the method 180 includes a process 188 to produce a quantitative assessment of the visual field of the subject based on the MfSSVEP data.
  • the quantitative assessment produced by the process 188 can provide an indication if there is a presence of a visual field defect in the user's visual field.
  • the process 188 can include a process to determine the presence of the visual field defect in a sector having a mfSSVEP signal below a predetermined threshold.
  • the visual stimuli presented by the process 182 can include multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the subject.
  • the process 182 includes a process 181 to provide the visual stimuli to the visual display unit 112 (e.g., including a wearable visual display unit) from the data processing unit 120, in which the providing can include generating the visual stimuli (e.g., produce and/or assign an optical flickering effect of the visual stimuli at a selected frequency associated with each sector of the visual field); and/or supplying a previously generated visual stimuli.
  • the visual display unit 112 e.g., including a wearable visual display unit
  • the providing can include generating the visual stimuli (e.g., produce and/or assign an optical flickering effect of the visual stimuli at a selected frequency associated with each sector of the visual field); and/or supplying a previously generated visual stimuli.
  • the process 181 to provide the visual stimuli includes forming a spatial visual stimulus display having multiple regions or sectors at different spatial locations, where for each region, the particular region includes an optical effect (e.g., light flickering) that changes at a unique frequency with respect to at least a proximate region or any other region of the visual stimulus display.
  • an optical effect e.g., light flickering
  • the process 188 can include a process 189 to analyze the mfSSVEP data with respect to a frequency spectrum including the designated frequencies mapped to the spatial regions of the visual stimulus display, in which the analyzing can include comparing the mfSSVEP signal at the particular frequencies to a predetermined threshold, or in relation to another mfSSVEP signal or other mfSSVEPs (e.g., including from an averaged population or individual group of mfSSVEP data with respect to that particular frequency), to determine if the signal falls below the predetermined threshold or is substantially lower with respect to a comparative mfSSVEP signal.
  • the analyzing can include comparing the mfSSVEP signal at the particular frequencies to a predetermined threshold, or in relation to another mfSSVEP signal or other mfSSVEPs (e.g., including from an averaged population or individual group of mfSSVEP data with respect to that particular frequency), to determine if the signal falls below the predetermined threshold or is substantially lower with respect to a
  • the method can include a process 190 to determine if the presence of a visual field defect based on the quantitative assessment, e.g., if the mfSSVEP signal for a particular frequency falls below the predetermined threshold or substantially lower than the comparative signal(s) from other mfSSVEP data at that particular frequency, in which the visual field deficiency is determined to be in the region of the visual stimulus display associated with the spatial location to which that frequency is mapped.
  • a process 190 to determine if the presence of a visual field defect based on the quantitative assessment, e.g., if the mfSSVEP signal for a particular frequency falls below the predetermined threshold or substantially lower than the comparative signal(s) from other mfSSVEP data at that particular frequency, in which the visual field deficiency is determined to be in the region of the visual stimulus display associated with the spatial location to which that frequency is mapped.
  • FIG. IF shows diagrams depicting an exemplary implementation using multifocal steady-state visual-evoked potentials (mfSSVEP) for assessment of visual field defects.
  • mfSSVEP multifocal steady-state visual-evoked potentials
  • FIG. 2 shows images of an exemplary EEG setup used in exemplary implementations of the disclosed mfSSVEP visual field loss analysis techniques. The visual experiment was conducted inside a dark, soundproof shielded room.
  • the modified 10-20 international system configuration of electrodes included 19 channels of electrodes arranged over parietal and occipital areas such as Pz, P03, POz, P04, 01, Oz, and 02.
  • the EEG electrode configurations of the EEG unit 11 1 can include a single electrode placed on the head or neck of the patient, e.g., such as on head over the occipital region of the brain.
  • the single electrode channel configuration can include 1 channel - Oz.
  • the EEG electrode configuration of the EEG unit 1 11 can include 2 electrode channels (e.g., 2 channels - 01 and 02); or in other implementations, for example, as few as 3 channels (e.g., 3 channels - 01, 02 and Oz); or in other implementations, for example, as few as 4 channels (e.g., 4 channels - POz, 01, 02 and Oz); or or in other implementations, for example, as few as 8 channels (e.g., 8 channels - P05, P03, POz, P04, P06, 01, 02 and Oz).
  • 2 electrode channels e.g., 2 channels - 01 and 02
  • 3 channels e.g., 3 channels - 01, 02 and Oz
  • 4 channels e.g., 4 channels - POz, 01, 02 and Oz
  • 8 channels e.g., 8 channels - P05, P03, POz, P04, P06, 01, 02 and Oz.
  • a layout of visual stimuli was designed to include 20 sectors in three concentric rings (e.g., subtending 6 , 15 , and 25 of the visual field). All sectors flickered concurrently at different frequencies ranging from 8 to 11.8 Hz with a frequency resolution of 0.2 Hz.
  • a visual field loss (DEFICIT) condition was mimicked by replacing the 9 Hz sector (e.g., the 0-45° patch in the middle ring as shown in the diagram of FIG. IF) with a black patch, in contrast to the CONTROL condition in which all 20 sectors flickered concurrently.
  • the exemplary dataset for each participant contained 100 5-s DEFICIT and CONTROL trials (e.g., 10 trials x 2 conditions x 5 sessions) for analysis.
  • FIG. 3A shows data plots depicting the CONTROL-DEFICIT comparison for five participants, in which the exemplary red line of the plots represent the SSVEP frequency with the lowest signal-to- noise-ratio versus other frequencies (e.g., represented by the gray lines).
  • FIG. 3B shows data plots depicting a BLOCK-CONTROL comparison in mfSSVEP profiles from a representative subject.
  • the exemplary empirical results showed that four of five participants consistently exhibited a significant deterioration of the 9 Hz ssVEP amplitude in the DEFICIT condition, e.g., as compared to the CONTROL condition.
  • the inconsistency from a participant (S3) was likely attributed to the absence of gaze-attentive fixation to the visual stimulus during the experiment, according to his self-report after the experiment.
  • the disclosed technology includes a portable, objective mfSSVEP -based visual field assessment platform, e.g., which includes and integrates a wearable, wireless dry EEG system and a head-mounted display.
  • the portable devices and systems can acquire and process measurements of reliable mfSSVEP signals that are quantitatively associated with visual field integrity of a subject.
  • the exemplary platform can quantitate the integrity of monocular visual fields by the characterization of mfSSVEP signal data. For example, by integrating a lightweight, wearable, and wireless multi-channel EEG system and a head-mounted display, the disclosed portable platform can allow assessment of visual field integrity in unconstrained situations and outside clinic environment.
  • FIG. 4 shows an image of an exemplary portable EEG unit 11 1 of the disclosed portable, objective mfSSVEP -based visual field assessment platform.
  • Exemplary characteristics of the exemplary EEG unit shown in FIG. 4 include easy-to-use and environment- free, which can avoid the burden of setting up laboratory EEG recording, enabling routine visual-field assessment or screening for visual field loss in non-clinic environments.
  • Exemplary implementations using the exemplary portable devices and systems of the disclosed technology demonstrated that the strength of mfSSVEP signals is informative to serve as an objective indicator to reflect possible deficits in a monocular visual field.
  • the following methods were performed.
  • An exemplary wearable, wireless high-density EEG unit of the portable system platform was employed, e.g., featuring dry and non-prep electrodes and wireless telemetry to sample EEG signals at 250 Hz, as depicted in FIGS. 5A and 5B.
  • FIG. 5A shows a side view image
  • FIG. 5B shows a back view image of an exemplary wearable, wireless 64-channel dry EEG unit.
  • the exemplary portable system can in some embodiments employ a 64-channel high-density EEG, while in other embodiments can employ a reduced number of channels to provide an optimal configuration or montage for portably detecting mfSSVEP, e.g., outside of a non-office based environment.
  • the exemplary portable system can employ advanced signal processing methods, e.g., such as spatial filtering and artifact removal, to improve signal-to-noise ratio of mfSSVEP from high-density recording.
  • An exemplary head-mounted display unit of the portable system platform utilized an Oculus Rift goggle (Oculus VR, Inc.) to deliver the mfSSVEP stimulation, as depicted in FIGS. 6A and 6B.
  • FIG. 6A shows an image of the exemplary head-mounted display unit to present the mfSSVEP stimulation
  • FIG. 6B shows a diagram of the exemplary layout of the mfSSVEP stimulation presentation.
  • the exemplary head-mounted display unit provides an inexpensive solution with a good image resolution of 1280x800, and also provides a whole-eye coverage allowing a controlled environment for visual-field assessment.
  • the mobility can be obtained by communicatively connecting the exemplary head-mounted display unit to one or more mobile communication devices, e.g., such as a laptop as shown in the image of FIG. 6A, or other mobile devices.
  • mobile communication devices e.g., such as a laptop as shown in the image of FIG. 6A
  • tablets, smartphones, or wearable computing devices can also be communicatively connected to the exemplary head- mounted display unit.
  • the same layout of the mfSSVEP stimulation was used as in other exemplary implementations, e.g., including 20 sectors in three rings (e.g., subtending 6 , 15 , and 25 of the visual field) flickering at frequencies from 8 to 11.8 Hz with a frequency resolution of 0.2 Hz were used (as shown in the diagram of FIG. 6B).
  • subjects can be tested under different experimental conditions, by varying testing parameters similarly to those previously described exemplary implementations.
  • a visual field loss condition can be mimicked by using black patches to replace different sectors on the visual field and evaluate mfSSVEP signal loss compared to a control condition.
  • the example portable system can be used for acquisition of mfSSVEP signals to obtain such data.
  • exemplary techniques such as independent component analysis (ICA) and differential canonical correlation analysis can be implemented successfully for blind source separation and to enhance detectability of SSVEP signals.
  • ICA independent component analysis
  • differential canonical correlation analysis can be implemented successfully for blind source separation and to enhance detectability of SSVEP signals.
  • Electrooculogram (EOG) methods of the disclosed technology can be utilized to successfully identify fixation losses and allow identification of unreliable mfSSVEP signals to be removed from further analyses.
  • EEG Electrooculogram
  • the strength of mfSSVEP in one of the five participates failed to accurately reflect the mimicked visual deficit, as depicted previously in FIG. 3 A.
  • the reason may be attributed to the absence of proper gaze fixation during the examination based on the patient's self-report.
  • subjects need to remain fixating on the central target location during the testing. Due to the short duration of testing trials, this can be achieved in most subjects, yet, the disclosed technology includes a mechanism to identify and exclude unreliable EEG signals produced by fixation losses. This is especially relevant in portable testing that may be performed without supervision.
  • the disclosed portable mfSSVEP systems can include an EOG unit.
  • the EOG unit can include two or more dry and soft electrodes to be placed proximate the outer canthus of a subject's eyes (e.g., one or more electrodes per eye) to measure corneo-retinal standing potentials, and are in communication with a signal processing and wireless communication unit of the EOG unit to process the acquired signals from the electrodes and relay the processed signals as data to the data processing unit 120 of the portable system 100.
  • the electrodes of the EOG unit can be in communication with the EEG unit 1 11 or visual display unit 112 to transfer the acquired signals from the outer canthus-placed electrodes of the EOG unit to the data processing unit 120.
  • the disclosed techniques can concurrently monitor subjects' electrooculogram (EOG) signals to evaluate the gaze fixation.
  • EOG electrooculogram
  • the electric field changes associated with eye movements e.g., such as blinks and saccades, can be monitored.
  • a calibration sequence can be used at the start of recording to determine the transformation equations.
  • an EOG-guided mfSSVEP analysis can be implemented to automatically exclude the EEG segments where the subjects do not gaze at the center of the stimulation.
  • four prefrontal electrodes can be switched to record the EOG signals, e.g., since mfSSVEP signals are presumably weak in the prefrontal regions.
  • the EOG unit includes four electrodes, two electrodes can be placed below and above the right eye and another two will be placed at the left and right outer canthus.
  • the EOG unit can be used to assess the accuracy of the portable mfSSVEP system by identifying potentially unreliable EEG signals induced by loss of fixation.
  • the data processing unit 120 can process the acquired signals from the EOG unit electrodes with the EEG data acquired from the EEG unit 11 1 to identify unreliable signals, which can then be removed from the analysis of visual field integrity.
  • the data processing unit 120 can execute analytical techniques to provide signal source separation.
  • the disclosed portable mfSSVEP systems can include an eye tracking unit to monitor losses of fixation, e.g., and can further provide a reference standard.
  • the eye tracking unit can be included, integrated, and/or incorporated into the visual display unit 1 12 (e.g., exemplary head-mounted display), for example.
  • Exemplary implementations can be performed to evaluate the reproducibility of measurements obtained with the exemplary portable platform in evaluating its ability to detect visual field loss in patients with glaucoma compared to healthy control subjects.
  • the disclosed portable systems can provide reproducible intra- and inter-visit mfSSVEP signals. mfSSVEP signals in patients with glaucomatous visual field loss will be significantly different than those in healthy control subjects.
  • measurements obtained with portable systems need to be reproducible and be able to detect visual field losses in patients with glaucoma. Good reproducibility is a fundamental requirement in order to allow detection of change over time. If a test is to be used for screening, diagnosis, and/or detection of glaucoma progression, an initial step is
  • Exemplary implementations were conducted to demonstrate the reproducibility and diagnostic accuracy studies. Such implementations included participation of a group of 10 healthy and 10 glaucomatous subjects. These subjects had not been tested previously with the system. The subjects underwent five sessions of testing per visit for five different visits, spaced at intervals of approximately 1 week apart. Reproducibility measures were obtained, e.g., including coefficients of variation and intraclass correlation coefficients for the relevant measurements obtained by the portable system. For diagnostic accuracy evaluation, for example, tests of an additional sample of 20 healthy and 20 glaucomatous subjects were performed, e.g., totaling 30 subjects in each group. Glaucomatous subjects were shown to have repeatable abnormal visual field defects on SAP (SITA 24-2). For example, assessment of diagnostic accuracy was performed using receiver operating characteristic (ROC) curves. The sample size for this experiment provided 83% power to detect a minimum difference of 0.25 in ROC curve area compared to chance.
  • ROC receiver operating characteristic
  • a system for monitoring brain activity associated with visual field of a user includes a sensor unit to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; visual display unit including a display screen to present visual stimuli to the user in a plurality of sectors of a visual field, in which the presented visual stimuli includes an optical flickering effect at a selected frequency mapped to each sector of the visual field, the visual stimuli configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the sensor unit; and a data processing unit in communication with the sensor unit and the visual display unit to analyze the acquired EEG signals and produce an assessment of the user's visual field.
  • EEG electroencephalogram
  • Example 2 includes the system as in example 1, in which the produced assessment of the user's visual field is a quantitative assessment that indicates if there is a presence of a visual field defect in the user's visual field.
  • Example 3 includes the system as in example 1, in which the one or more electrodes of the sensor unit include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the user.
  • Example 4 includes the system as in example 1, in which the one or more electrodes includes a single electrode channel Oz.
  • Example 5 includes the system as in example 1, in which the one or more electrodes include a plurality of the electrodes that are arranged at particular locations on the head of the subject according to the international 10-20 system.
  • Example 6 includes the system as in example 1, in which the system is portable to enable the user to operate the system in the user's living environment and on a routine or continuous basis.
  • Example 7 includes the system as in example 1, in which the selected frequency of the optical flickering effect for a particular sector is at a different frequency with respect to the optical flickering effect at a proximate sector or with respect to the optical flickering effects in the other sectors of the visual field.
  • Example 8 includes the system as in example 7, in which the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the user.
  • Example 9 includes the system as in example 7, in which the visual stimuli is presented in 20 sectors in three concentric rings including subtending 6 , 15 , and 25 of the visual field.
  • Example 10 includes the system as in example 7, in which the selected frequencies of the flickerings of the visual stimuli are greater than 6 Hz.
  • Example 1 1 includes the system as in example 1 , further including an
  • electrooculogram (EOG) unit including one or more electrodes to be placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals, in which the one or more electrodes of the EOG unit are in communication with the data processing unit to process the acquired CRSP signals from the one or more electrodes to determine movements of the user's eyes.
  • EOG electrooculogram
  • Example 12 includes the system as in example 1, in which the visual display unit is configured to be wearable over the user's eyes for the user to view the presented visual stimuli on the display screen.
  • Example 13 includes the system as in example 12, further including an eye tracking device including a camera employed in the wearable visual display unit and in communication with the data processing unit, in which the camera is operable to record images of the user's eyes.
  • an eye tracking device including a camera employed in the wearable visual display unit and in communication with the data processing unit, in which the camera is operable to record images of the user's eyes.
  • a method for examining a visual field of a subject includes presenting, to a subject, visual stimuli in a plurality of sectors of a visual field of a subject, in which for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency; acquiring electroencephalogram (EEG) signals from one or more electrodes in contact with the head of the subject; processing the acquired EEG signals to extract multifocal steady-state visual-evoked potentials
  • EEG electroencephalogram
  • mfSSVEP EEG signal response to the presented visual stimuli
  • Example 15 includes the method as in example 14, in which the quantitative assessment provides an indication if there is a presence of a visual field defect in the user's visual field.
  • Example 16 includes the method as in example 15, in which the producing the quantitative assessment includes determining the presence of the visual field defect in a sector having a mfSSVEP signal below a predetermined threshold.
  • Example 17 includes the method as in example 14, in which the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the subject.
  • Example 18 includes the method as in example 14, in which the one or more electrodes are included in a sensor unit wearable on the subject's head and include a single electrode channel Oz positioned over the occipital region of the head of the subject when the sensor unit is worn by the user.
  • Example 19 includes the method as in example 14, in which the one or more electrodes are included in a sensor unit wearable on the subject's head such that the electrodes are arranged at particular locations on the sensing unit to be positioned on the head of the subject when the sensor unit is worn by the user.
  • Example 20 includes the method as in example 14, in which the one or more electrodes include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the subject.
  • Example 21 includes the method as in example 14, further including monitoring movements of the user's eyes to determine instances associated with the user gazing away from the center of the visual field.
  • Example 22 includes the method as in example 14, in which the monitoring the movements of the user's eyes includes using an electrooculogram (EOG) unit including one or more electrodes placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals.
  • EOG electrooculogram
  • CRSP corneo-retinal standing potential
  • Example 23 includes the method as in example 14, in which the monitoring the movements of the user's eyes includes using an eye tracking system.
  • Example 24 includes the method as in example 14, in which the selected frequency of the optical flickering effect for a particular sector is presented at a different frequency with respect to the optical flickering effect at a proximate sector or with respect to the optical flickering effects in the other sectors of the visual field.
  • Example 25 includes the method as in example 14, further including forming a spatial visual stimulus display having the plurality of the sectors at different spatial locations on the spatial visual stimulus display, in which, for each sector, the sector includes the optical flickering effect that changes at a designated frequency with respect to at least a proximate sector or the other sectors of the visual stimulus display.
  • Example 26 includes the method as in example 14, in which the producing the quantitative assessment includes analyzing the mfSSVEP data with respect to the designated frequencies that are mapped to the sectors at the different spatial locations on the spatial visual stimulus display, in which the analyzing includes quantitatively comparing an mfSSVEP signal value at a particular frequency of the designated frequencies to a threshold value, and determining the presence of a visual field defect in the sector to which the particular frequency is mapped if the mfSSVEP signal value is less than the threshold value.
  • a portable system for monitoring brain activity associated with visual field of a user includes a brain signal sensor device to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; a wearable visual display unit to present visual stimuli to the user and structured to include a display screen and a casing able to secure to the head of the user, in which the wearable visual display is operable to present the visual stimuli in a plurality of sectors of the user's visual field, such that for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency, and in which the visual stimuli are configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the brain signal sensor device; a data processing unit in communication with the brain signal sensor device and the wearable visual display unit to provide the visual stimuli to the wearable visual display unit and to analyze the acquired EEG signals including one or more electrodes attached to a casing wearable
  • Example 28 includes the system as in example 27, in which the data processing unit is included in a computing device including a laptop or desktop computer; a mobile communication device including a smartphone, a tablet, or a wearable computing device; or a network computer system.
  • Example 29 includes the system as in example 27, in which the produced assessment of the user's visual field is a quantitative assessment that indicates if there is a presence of a visual field defect in the user's visual field.
  • Example 30 includes the system as in example 27, in which the one or more electrodes of the brain signal sensor device include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the user.
  • Example 31 includes the system as in example 27, in which the one or more electrodes includes a single electrode channel Oz.
  • Example 32 includes the system as in example 27, further including an eye tracking device including a camera employed in the wearable visual display unit and in communication with the data processing unit, in which the camera is operable to record images of the user's eyes.
  • an eye tracking device including a camera employed in the wearable visual display unit and in communication with the data processing unit, in which the camera is operable to record images of the user's eyes.
  • Example 33 includes the system as in example 27, in which the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the user, and in which the selected frequencies of the flickerings of the visual stimuli are greater than 6 Hz.
  • Example 34 includes the system as in example 27, in which the wearable visual display unit is operable to form a spatial visual stimulus display on the display screen having the plurality of the sectors at different spatial locations on the spatial visual stimulus display, in which, for each sector, the sector includes the optical flickering effect that changes at a designated frequency with respect to at least a proximate sector or the other sectors of the visual stimulus display.
  • Example 35 includes the system as in example 34, in which the data processing unit is operable to produce the quantitative assessment by analyzing the mfSSVEP data with respect to the designated frequencies that are mapped to the sectors at the different spatial locations on the spatial visual stimulus display, in which the analyzing includes quantitatively comparing an mfSSVEP signal value at a particular frequency of the designated frequencies to a threshold value, and determining the presence of a visual field defect in the sector to which the particular frequency is mapped if the mfSSVEP signal value is less than the threshold value.
  • Implementations of the subject matter and the functional operations described in this patent document can be implemented in various systems, digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them.
  • Implementations of the subject matter described in this specification can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a tangible and non-transitory computer readable medium for execution by, or to control the operation of, data processing apparatus.
  • the computer readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter effecting a machine-readable propagated signal, or a combination of one or more of them.
  • data processing apparatus encompasses all apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, or multiple processors or computers.
  • the apparatus can include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them.
  • a computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
  • a computer program does not necessarily correspond to a file in a file system.
  • a program can be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub programs, or portions of code).
  • a computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
  • the processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output.
  • the processes and logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit).
  • processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer.
  • a processor will receive instructions and data from a read only memory or a random access memory or both.
  • the essential elements of a computer are a processor for performing instructions and one or more memory devices for storing instructions and data.
  • a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto optical disks, or optical disks.
  • mass storage devices for storing data, e.g., magnetic, magneto optical disks, or optical disks.
  • a computer need not have such devices.
  • Computer readable media suitable for storing computer program instructions and data include all forms of nonvolatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices.
  • semiconductor memory devices e.g., EPROM, EEPROM, and flash memory devices.
  • the processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.

Abstract

Methods, systems, and devices are disclosed for monitoring electrical signals of the brain. In one aspect, a system for monitoring electrical brain activity associated with visual field of a user includes a sensor unit to acquire electroencephalogram (EEG) signals including a plurality of EEG sensors attached to a casing attachable to the head of a user, a visual display unit attachable to the head of the user over the user's eyes to present visual stimuli, in which the visual stimuli is configured to evoke multifocal steady-state visual- evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the sensor unit, and a data processing unit in communication with the sensor unit and the visual display unit to analyze the acquired EEG signals and produce an assessment of the user's visual field, in which the assessment indicates if there is a presence of visual field defects in the user's visual field.

Description

PORTABLE BRAIN ACTIVITY SENSING PLATFORM FOR ASSESSMENT OF VISUAL FIELD DEFICITS
CROSS REFERENCE TO RELATED APPLICATIONS
[0001] This patent document claims the benefits and priority of U.S. Provisional Patent Application No. 61/981 , 145, entitled "PORTABLE BRAIN ACTIVITY SENSING
PLATFORM FOR ASSESSMENT OF VISUAL FIELD DEFICITS", filed on April 17, 2014. The entire content of the aforementioned patent application is incorporated by reference as part of the disclosure of this application.
TECHNICAL FIELD
[0002] This patent document relates to systems, devices, and processes that use brain machine interface (BMI) technologies.
BACKGROUND
[0003] Electroencephalography (EEG) is the recording of electrical activity exhibited by the brain using electrodes positioned on a subject's scalp, forming a spectral content of neural signal oscillations that comprise an EEG data set. For example, the electrical activity of the brain that is detected by EEG techniques can include voltage fluctuations, e.g., resulting from ionic current flows within the neurons of the brain. In some contexts, EEG refers to the recording of the brain's spontaneous electrical activity over a short period of time, e.g., less than an hour. EEG can be used in clinical diagnostic applications including epilepsy, coma, encephalopathies, brain death, and other diseases and defects, as well as in studies of sleep and sleep disorders. In some instances, EEG has been used for the diagnosis of tumors, stroke and other focal brain disorders
SUMMARY
[0004] Disclosed are electroencephalogram (EEG)-based brain sensing methods, systems, and devices for visual-field examination by using high-density EEG to associate the dynamics of multifocal steady-state visual-evoked potentials (mfSSVEP) with visual field defects. In some aspects, the disclosed techniques integrate mfSSVEPs into a portable platform using wireless EEG and a head mounted display, demonstrating ability to assess potential visual field deficits, e.g., in conditions such as glaucoma.
[0005] In one aspect, a system for monitoring brain activity associated with visual field of a user includes a sensor unit to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; visual display unit including a display screen to present visual stimuli to the user in a plurality of sectors of a visual field, in which the presented visual stimuli includes an optical flickering effect at a selected frequency mapped to each sector of the visual field, the visual stimuli configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the sensor unit; and a data processing unit in
communication with the sensor unit and the visual display unit to analyze the acquired EEG signals and produce an assessment of the user's visual field.
[0006] In one aspect, a method for examining a visual field of a subject includes presenting, to a subject, visual stimuli in a plurality of sectors of a visual field of a subject, in which for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency; acquiring electroencephalogram (EEG) signals from one or more electrodes in contact with the head of the subject; processing the acquired EEG signals to extract multifocal steady-state visual-evoked potentials (mfSSVEP) data associated with the subject's EEG signal response to the presented visual stimuli; and producing a quantitative assessment of the visual field of the subject based on the MfSSVEP data.
[0007] In one aspect, a portable system for monitoring brain activity associated with visual field of a user includes a brain signal sensor device to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; a wearable visual display unit to present visual stimuli to the user and structured to include a display screen and a casing able to secure to the head of the user, in which the wearable visual display is operable to present the visual stimuli in a plurality of sectors of the user's visual field, such that for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency, and in which the visual stimuli are configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the brain signal sensor device; a data processing unit in communication with the brain signal sensor device and the wearable visual display unit to provide the visual stimuli to the wearable visual display unit and to analyze the acquired EEG signals and produce an assessment of the user's visual field; and an electrooculogram (EOG) unit including one or more electrodes to be placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals, in which the one or more electrodes of the EOG unit are in communication with the data processing unit to process the acquired CRSP signals from the one or more electrodes to determine movements of the user's eyes. [0008] The subject matter described in this patent document can be implemented in specific ways that provide one or more of the following features. For example, by removing the subjectivity inherent to standard perimetry, the disclosed portable platform for assessing functional loss can facilitate detection and monitoring of visual field loss in glaucoma, the leading cause of blindness in the world. The disclosed portable platform uses high-density EEG recording and mfSSVEP that can provide improved signal-to-noise ratios, increasing reproducibility and diagnostic accuracy, e.g., as compared to existing EEG-based methods for objective perimetry, such as mfVEP. As a portable platform that could be used for testing in unconstrained situations, the disclosed methods can allow for much broader and more frequent testing of patients, e.g., as compared to existing perimetric approaches. For example, this could reduce the number of office visits necessary for patients at risk or diagnosed with glaucoma, significantly decreasing the economic burden of the disease. In addition, by allowing more frequent testing, the disclosed methods can facilitate the discrimination of true deterioration from test-retest variability, e.g., resulting in earlier diagnosis and detection of progression. The disclosed portably-implemented and objective methods for visual field assessment can also allow screening for visual loss in underserved populations. The disclosed technology is non-invasive and can be implemented without direct physical contact with an eye of the individual subject being assessed, and thereby avoid causing any discomfort or risk of injury through inadvertent application of force or transfer of harmful chemical or biological material to the eye.
[0009] Those and other features are described in greater detail in the drawings, the description and the claims.
BRIEF DESCRIPTION OF THE DRAWINGS
[0010] FIG. 1A shows a diagram of an exemplary system to implement the techniques of the disclosed technology.
[0011] FIGS. IB-IE show diagrams of an exemplary method to examine visual field defects using the disclosed technology.
[0012] FIG. IF shows diagrams depicting an exemplary implementation using multifocal steady-state visual-evoked potentials (mfSSVEP) for assessment of visual field defects.
[0013] FIG. 2 shows images of an exemplary EEG setup used in exemplary
implementations of the disclosed techniques.
[0014] FIG. 3A shows data plots depicting exemplary CONTROL-DEFICIT
comparisons, in which the exemplary data represents the SSVEP frequency with the lowest signal-to-noise-ratio versus other frequencies.
[0015] FIG. 3B shows data plots depicting a BLOCK-CONTROL comparison in mfSSVEP profiles from a representative subject.
[0016] FIG. 4 shows an image of an exemplary portable device of the disclosed portable, objective mfSSVEP -based visual field assessment platform.
[0017] FIGS. 5A and 5B show images of an exemplary wearable, wireless 64-channel dry EEG system.
[0018] FIGS. 6A and 6B show an image and a diagram of an exemplary head-mounted display system and presentation layout to present an exemplary mfSSVEP stimulation, respectively.
DETAILED DESCRIPTION
[0019] Optic neuropathy refers to optic nerve damage that can result in significant and irreversible loss of visual function and disability. One example is glaucoma. Glaucoma is associated with a progressive degeneration of retinal ganglion cells (RGCs) and their axons, resulting in a characteristic appearance of the optic disc and a concomitant pattern of visual field loss. Loss of visual function in glaucoma is generally irreversible, and without adequate treatment the disease can progress to disability and blindness. The disease can remain relatively asymptomatic until late stages and, therefore, early detection and monitoring of functional damage is paramount to prevent functional impairment and blindness.
[0020] It is estimated that glaucoma affects more than 70 million individuals worldwide with approximately 10% being bilaterally blind, which makes it the leading cause of irreversible blindness in the world. However, as the disease can remain asymptomatic until it is severe, the number of affected individuals is likely to be much larger than the number known to have it. Population-level survey data indicate that only 10% to 50% of the individuals are aware they have glaucoma.
[0021] Visual dysfunction appears to be a strong predictor of cognitive dysfunction in subject in a number of clinical neuroscience disorders. For example, the functional deficits of glaucoma and Alzheimer's Disease include loss in low spatial frequency ranges in contrast sensitivity, and are similar in both diseases. Pattern masking has been found to be a good predictor of cognitive performance in numerous standard cognitive tests. Some tests found to correlate with pattern masking include Gollin, Stroop-Work, WAIS-PA, Stroop-Color, Geo- Complex Copy, Stroop-Mixed and RCPM, for example. Losses in contrast sensitivity at the lowest spatial frequency also was predictive of cognitive losses in the seven tests. For example, AD subjects have abnormal word reading thresholds corresponding to their severity of cognitive impairment and reduced contrast sensitivity in all spatial frequencies as compared to normal subjects.
[0022] Assessment of functional loss in the disease has traditionally been made using standard automated perimetry (SAP). SAP is the current standard for assessment of visual field loss. Visual field assessment with SAP requires considerable subjective input from the patient, and for some patients it is very difficult, or even impossible, to obtain reliable visual field measures. SAP is also limited by large test-retest variability and a large number of tests are usually necessary in order to discriminate true disease progression from noise, even for reliable test-takers. For example, SAP testing is limited by subjectivity of patient responses and large variability, frequently requiring a large number of tests for effective detection of change over time. These tests are generally conducted in clinic -based settings and, due to limited patient availability and health care resources, an insufficient number of tests are frequently acquired over time, resulting in delayed diagnosis and detection of disease progression. The requirements for highly trained technicians, cost, complexity, and lack of portability of SAP testing also preclude its use for screening of visual field loss in
underserved populations. For example, because SAP, testing is generally performed in a clinic -based setting and requires highly trained technicians, this limits the availability of this testing resource, which frequently results in patients not undergoing the necessary number of tests to allow detection of disease progression over time, and thereby resulting in late diagnosis or delayed detection of progression. Perimeters are also usually expensive and not easily transportable, which has largely impeded the use of the SAP technique for screening or assessment of visual field loss in remote settings and in underserved populations.
Neurological disorders, e.g., such as macular degeneration, diabetic retinopathy, optic neuritis, papilledema, anterior ischemic optic neuropathy, and tumor, can be diagnosed and tracked by SAP.
[0023] Objective assessment of visual field damage in glaucoma has been attempted with the use of visual evoked potential (VEP) and multifocal VEP techniques. However, these VEP techniques have been limited by relatively low signal to noise ratio and have shown limited potential to assess visual field losses in the disease. For example, the conventional pattern VEP is predominantly generated by cortical elements receiving projections from the central retina, where the central 2° of visual field contributes 65% of the response. Therefore, conventional VEP possesses a limited ability to reflect field loss in non-central areas, such as those that can occur with glaucoma. While multifocal VEP techniques cab allow many areas of the retina to be stimulated simultaneously and separate responses from each part of the visual field to be obtained, individual differences in the anatomy of the visual cortex lead to considerable inter-individual variability of responses in normal subjects, making it difficult the identification of mfVEP abnormalities in diseased patients. Further, existing mfVEP recording techniques can only be performed with non-portable devices in clinic- or laboratory-based settings, requiring cumbersome setup for placement of electrodes (e.g., data collection requires skin preparation and gel application to ensure good electrical conductivity between sensor and skin), and such procedures are time consuming and uncomfortable for the patient.
[0024] The present technology includes methods, systems, and devices that acquire, process, and/or utilize steady-state visually evoked potentials (SSVEP) for monitoring, tracking, and/or diagnosing various paradigms in cognitive function (e.g., visual attention, binocular rivalry, working memory, and brain rhythms) and clinical neuroscience (e.g., aging, neurodegenerative disorders, schizophrenia, ophthalmic pathologies, migraine, autism, depression, anxiety, stress, and epilepsy), particularly for SSVEPs generated by optical stimuli.
[0025] Disclosed are electroencephalogram (EEG)-based brain sensing methods, systems, and devices for visual-field examination by using high-density EEG to associate the dynamics of multifocal steady-state visual-evoked potentials (mfSSVEP) with visual field defects. In some aspects, the disclosed techniques integrate mfSSVEPs into a portable platform using wireless EEG and a head mounted display capable of assessing potential visual field deficits. In some implementations, for example, the disclosed technology can be applied to diagnose and track neurological disorders, e.g., such as macular degeneration, diabetic retinopathy, optic neuritis, papilledema, anterior ischemic optic neuropathy, and/or tumors.
[0026] For example, in contrast to the transient event-related potentials elicited during a conventional VEP or mfVEP examination, the present technology utilizes rapid flickering stimulation to produce a brain response characterized by a "quasi-sinusoidal" waveform whose frequency components are constant in amplitude and phase, e.g., the so-called steady - state response. In some embodiments, for example, the portable platform integrates a wearable, wireless, high-density dry EEG system and a head-mounted display allowing users to routinely monitor the electrical brain activity associated with visual field stimulation. The present technology includes brain-computer interfaces using dry EEG sensor arrays, wearable/wireless data acquisition and signal processing hardware and software. These interfaces can monitor and record non-invasive, high spatiotemporal resolution brain activity of unconstrained, actively engaged human subjects.
[0027] For example, the disclosed technology can be applied for ophthalmologic diagnosis of neurological complications, in particular that of major ocular pathologies including glaucoma, retinal anomalies and of sight, retinal degeneration of the retinal structure and macular degeneration, diabetic retinopathy, optic neuritis, optical neuroma, or degenerative diseases, e.g., such as Parkinson's disease, Alzheimer's disease, non-Alzheimer's dementia, multiple sclerosis, ALS, head trauma, diabetes, or other cognitive disorders, e.g., such as dyslexia. More broadly, the present technology can be used to characterize inappropriate responses to contrast sensitivity patterns, and disorders affecting the optical nerve and the visual cortex.
[0028] Similarly, the disclosed technology can be used for multiple sclerosis (MS). It is known that MS affects neurons and that the effect comes and goes with time. There is apparent recovery of the cells at least in early stages of the disease. One would therefore expect the diagnosed areas of loss in the visual field to move around the visual field over time, and perhaps to recovery temporarily. As the disease progresses to the point where there is a lot of loss on the retina, the areas of loss will remain lost and will not show temporary recovery. The retina and brain do parallel processing to determine relative position of adjacent objects. In the case of dyslexia, for example, this processing somehow gets reversed and the subject mixes up the order of letters in words or even the order of entire words. This too could show up as an apparent ganglion cell loss. Again, the apparent loss could be from the ganglion cells or from the feedback to the lateral geniculate nucleus. The disclosed technology includes portable platforms that can be used for accurate and convenient screening of many neuro-degenerative diseases, e.g., including Alzheimer's, non-Alzheimer's dementia, Parkinson's, multiple sclerosis, macular degeneration, ALS, diabetes, dyslexia, head trauma, and others.
[0029] The present technology utilizes electroencephalogram (EEG)-based brain sensing methods, systems, and devices for visual-field examination by using high-density EEG to associate the dynamics of multifocal steady-state visual-evoked potentials (mfSSVEP) with visual field defects, in which the use of rapid flickering stimulation can produce a brain response characterized by a "quasi-sinusoidal" waveform whose frequency components are constant in amplitude and phase, the so-called steady-state response. Steady-state VEPs have desirable properties for use in the assessment of the integrity of the visual system. For example, the disclosed techniques are faster than mfVEP, less susceptible to artifacts produced by blinks and eye movements, to electromyographic noise contamination and may present better signal to noise (SNR) ratio. mfSSVEP is a form of steady-state visual-evoked potentials which reflect a frequency -tagged oscillatory EEG activity modulated by the frequency of periodic visual simulation higher than 6 Hz. Different from the ordinary SSVEP, the mfSSVEP is a signal of multi-frequency tagged SSVEP, e.g., which can be elicited by simultaneously presenting multiple continuous, repetitive black/white reversing visual patches flickering at different frequencies. Based on the nature of mfSSVEP, a flicker sector(s) corresponding to a visual field deficit(s) will be less perceivable or unperceivable and thereby will elicit a weaker SSVEP, e.g., as compared to the brain responses to other visual stimuli presented at normal visual spots.
[0030] The disclosed methods, systems, and devices for visual-field examination using mfSSVEP data includes the formation of a spatial visual stimulus display having multiple regions or sectors at different spatial locations, where for each region, the particular region includes an optical effect (e.g., light flickering) that changes at a unique frequency with respect to at least a proximate region or any other region of the visual stimulus display. For example, the visual stimulus display can include twenty regions each presenting its respective optical effect at a different frequency between 8.0 Hz and 1 1.8 Hz (e.g., 8.0 in sector 1, 8.2 in sector 2, 8.4 in sector 3, ..., 1 1.8 in sector 20). For example, the optical effect can be a light modulating between an ON and OFF state at the designated frequency for the particular region. The brain response to the visual stimuli, e.g., as measured by at least one electrode placed on or near the head or multiple electrodes arranged in an arrangement to improve spatiotemporal resolution of the EEG signals, are acquired and processed to produce and evaluate mfSSVEP data with respect to a frequency spectrum including the designated frequencies mapped to the spatial regions of the visual stimulus display. The processing includes comparing the mfSSVEP signal at the particular frequencies to a predetermined threshold, or in relation to other mfSSVEP signals, to determine if the signal falls below the predetermined threshold or is substantially lower with respect to a comparative mfSSVEP signal. Determination of a mfSSVEP signal below the threshold or substantially lower than a standard at that particular frequency corresponds to a visual field deficiency to the spatial location on the visual stimulus display to which that frequency is mapped, and indicative of a visual field defect of the user in that specific region.
[0031] In some implementations, for example, the disclosed techniques include using SSVEP and brain-computer interfaces (BCIs) to bridge the human brain with computers or external devices. By detecting the SSVEP frequencies from the non-invasively recorded EEG, the users of SSVEP -based brain-computer interface can interact with or control external devices and/or environments through gazing at distinct frequency-coded targets. For example, the SSVEP -based BCI can provide a promising communication carrier for patients with disabilities due to its high signal-to-noise ratio over the visual cortex, which can be measured by EEG at the parieto-occipital region noninvasively. Methods, devices and systems of the disclosed technology can implement wireless SSVEP data acquisition and processing. Methods, devices and systems of the disclosed technology can include a noninvasive platform for continuously monitoring high temporal resolution brain dynamics without requiring conductive gels applied to the scalp. An exemplary system can employ dry microelectromechanical system EEG sensors, low-power signal acquisition, amplification and digitization, wireless telemetry, and real-time processing. In addition, the present technology can include analytical techniques, such as independent component analysis, which can improve detectability of SSVEP signals.
[0032] Exemplary implementations of the disclosed multifocal techniques to SSVEP (mfSSVEP) are described in this patent document. The exemplary results of such implementations demonstrate detection of localized and peripheral field losses, as well as show successful implementations of a portable objective method of assessment of visual field loss in opto-neurological diseases, e.g., such as glaucoma, amblyopia, age-related macular degeneration, and optic neuritis.
[0033] Diagnosis and detection of progression of neurological disorders remain challenging tasks. For example, a validated portable objective method for assessment of visual field loss would have numerous advantages compared to currently existing methods to assess functional loss in the disease. An objective EEG-based test would remove the subjectivity and decision-making involved when performing perimetry, potentially improving reliability of the test. A portable and objective test could be done quickly at home under unconstrained situations, decreasing the required number of office visits and the economic burden of the disease. In addition, a much larger number of tests could be obtained over time. This would greatly enhance the ability of separating true deterioration from
measurement variability, potentially allowing more accurate and earlier detection of progression. In addition, more precise estimates of rates of progression could be obtained. Even if the spatial resolution of mfSSVEP does not provide a higher resolution than SAP techniques, the increased number of tests available for analysis over time can still provide more reliable assessment of visual field defects. The exemplary visual field assessment methods can be used for screening in remote locations or for monitoring patients with the disease in underserved areas, as well as for use in the assessment of visual field deficits in other conditions.
[0034] There are few if any currently available reliable and effective portable methods for assessment of functional loss in such disorders. The disclosed technology includes a portable platform that integrates a wearable, wireless EEG dry system and a head-mounted display system that allows users to routinely and continuously monitor the electrical brain activity associated with visual field in their living environments, e.g., representing a transformative way of monitoring disease progression, e.g., such as in glaucoma. In addition, such devices provide an innovative and potentially useful way of screening for the disease. The disclosed technology includes portable brain-computer interfaces and methods for sophisticated analysis of EEG data, e.g., including capabilities for diagnosis and detection of disease progression. For example, the disclosed methods, systems, and devices can be implemented to improve screening, diagnosis and detection of disease progression and also enhance understanding of how the disease affects the visual pathways.
[0035] FIG. 1A shows a diagram of an exemplary portable EEG-based system 100 of the disclosed technology to implement the methods described in this patent document. The EEG- based system 100 integrates a wearable, wireless, high-density dry EEG sensor unit 1 1 1 and a visual display unit 1 12 (e.g., such as a head-mounted display) in data communication with a data processing unit 120 allowing users to routinely monitor the electrical brain activity associated with visual field stimulation. The data processing unit 120 can include various modules or units of the disclosed system for processing data extracted from the subject, e.g., via the EEG unit 1 11, based on stimulus of the subject via the visual display unit 112.
[0036] The visual display unit 1 12 can include an output unit that can include various types of display, speaker, and/or printing interfaces, e.g., which can be used to implement a visual stimulus technique. For example, the output unit can include cathode ray tube (CRT), light emitting diode (LED), or liquid crystal display (LCD) monitor or screen, among other visual displays, as a visual display. In some examples, the output unit can include various types of audio signal transducer apparatuses or other sensory inducing apparatuses to implement the sensory stimuli.
[0037] The data processing unit 120 can include a processor 121 that can be in communication with an input/output (LO) unit 122, an output unit 123, and a memory unit 124. The data processing unit 120 can be implemented as one of various data processing systems, such as a personal computer (PC), laptop, and mobile communication device. In some implementations, the data processing unit 120 can be included in the device structure that includes the wearable EEG sensor unit 1 11. To support various functions of the data processing unit 120, the processor 121 can be included to interface with and control operations of other components of the data processing unit 120, such as the I/O unit 122, the output unit 123, and the memory unit 124.
[0038] The memory unit 124 can store information and data, e.g., such as instructions, software, values, images, and other data processed or referenced by the processor 121.
Various types of Random Access Memory (RAM) devices, Read Only Memory (ROM) devices, Flash Memory devices, and other suitable storage media can be used to implement storage functions of the memory unit 124. The memory unit 124 can store data and information, which can include subject stimulus and response data, and information about other units of the system, e.g., including the EEG sensor unit 1 1 1 and the visual display unit 112, such as device system parameters and hardware constraints. The memory unit 124 can store data and information that can be used to implement the portable EEG -based system 100.
[0039] The I/O unit 122 can be connected to an external interface, source of data storage, or display device. Various types of wired or wireless interfaces compatible with typical data communication standards can be used in communications of the data processing unit 120 with the EEG sensor unit 1 11 and the visual display unit 112 and/or other units of the system, e.g., including, but not limited to, Universal Serial Bus (USB), IEEE 1394 (FireWire), Bluetooth, IEEE 802.1 11 , Wireless Local Area Network (WLAN), Wireless Personal Area Network (WPAN), Wireless Wide Area Network (WWAN), WiMAX, IEEE 802.16
(Worldwide Interoperability for Microwave Access (WiMAX)), 3G/4G/LTE cellular communication methods, and parallel interfaces, can be used to implement the I/O unit 122. The I/O unit 122 can interface with an external interface, source of data storage, or display device to retrieve and transfer data and information that can be processed by the processor 121, stored in the memory unit 124, or exhibited on the output unit 123.
[0040] In some implementations of the system 100, the data processing unit 120 can include an output unit 123 that can be used to exhibit data implemented by the data processing unit 120. The output unit 123 can include various types of display, speaker, or printing interfaces to implement the output unit 123. For example, the output unit 123 can include cathode ray tube (CRT), light emitting diode (LED), or liquid crystal display (LCD) monitor or screen as a visual display to implement the output unit 123. In other examples, the output unit 123 can include toner, liquid inkjet, solid ink, dye sublimation, inkless (e.g., such as thermal or UV) printing apparatuses to implement the output unit 123; the output unit 123 can include various types of audio signal transducer apparatuses to implement the output unit 123. The output unit 123 can exhibit data and information, such as the system data in a completely processed or partially processed form. The output unit 123 can store data and information used to implement the disclosed techniques.
[0041] FIG. 1A also shows a block diagram of the processor 121 that can include a central processing unit (CPU) 125 and/or a graphic processing unit (GPU) 126, or both the CPU 125 and the GPU 126. The CPU 125 and GPU 126 can interface with and control operations of other components of the data processing unit 120, such as the I/O unit 122, the output unit 123, and the memory unit 124.
[0042] FIG. IB shows a diagram of an exemplary method 180 to examine visual field defects using the disclosed technology, e.g., such as including the system 100. The method 180 includes a process 182 to present, to a subject, visual stimuli in a plurality of sectors of a visual field of a subject, in which for each sector the presented visual stimuli includes an optical effect (e.g., light flickering) at a selected frequency. The method 180 includes a process 184 to acquire EEG signals from one or more electrodes in contact with the head of the subject. The method 180 includes a process 186 to data process (e.g., analyze) the acquired EEG signals to extract mfSSVEP data associated with the subject's EEG signal response to the presented visual stimuli. The method 180 includes a process 188 to produce a quantitative assessment of the visual field of the subject based on the MfSSVEP data.
[0043] In some implementations of the method 180, for example, the quantitative assessment produced by the process 188 can provide an indication if there is a presence of a visual field defect in the user's visual field. In some implementations, for example, the process 188 can include a process to determine the presence of the visual field defect in a sector having a mfSSVEP signal below a predetermined threshold. In some implementations, for example, the visual stimuli presented by the process 182 can include multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the subject.
[0044] In some implementations of the method 180, for example, as shown in FIG. 1C, the process 182 includes a process 181 to provide the visual stimuli to the visual display unit 112 (e.g., including a wearable visual display unit) from the data processing unit 120, in which the providing can include generating the visual stimuli (e.g., produce and/or assign an optical flickering effect of the visual stimuli at a selected frequency associated with each sector of the visual field); and/or supplying a previously generated visual stimuli. In some implementations of the process 181, the process 181 to provide the visual stimuli includes forming a spatial visual stimulus display having multiple regions or sectors at different spatial locations, where for each region, the particular region includes an optical effect (e.g., light flickering) that changes at a unique frequency with respect to at least a proximate region or any other region of the visual stimulus display.
[0045] In some implementations of the method 180, for example, as shown in FIG. ID, the process 188 can include a process 189 to analyze the mfSSVEP data with respect to a frequency spectrum including the designated frequencies mapped to the spatial regions of the visual stimulus display, in which the analyzing can include comparing the mfSSVEP signal at the particular frequencies to a predetermined threshold, or in relation to another mfSSVEP signal or other mfSSVEPs (e.g., including from an averaged population or individual group of mfSSVEP data with respect to that particular frequency), to determine if the signal falls below the predetermined threshold or is substantially lower with respect to a comparative mfSSVEP signal.
[0046] In some implementations of the method 180, for example, as shown in FIG. IE, the method can include a process 190 to determine if the presence of a visual field defect based on the quantitative assessment, e.g., if the mfSSVEP signal for a particular frequency falls below the predetermined threshold or substantially lower than the comparative signal(s) from other mfSSVEP data at that particular frequency, in which the visual field deficiency is determined to be in the region of the visual stimulus display associated with the spatial location to which that frequency is mapped.
[0047] Exemplary Implementations of mfSSVEP Techniques for Assessment of Visual Field Loss
[0048] Exemplary implementations were performed using an exemplary mfSSVEP technique for assessment of visual field loss. FIG. IF shows diagrams depicting an exemplary implementation using multifocal steady-state visual-evoked potentials (mfSSVEP) for assessment of visual field defects. As shown in the diagrams of FIG. IF, by presenting multiple frequency-tagged flickering (alternating black/white) sectors in the monocular visual field, a sector(s) corresponding to a visual field deficit(s) would be less perceivable, if not totally unperceivable, and thereby would have a weaker SSVEP signal, e.g., compared to the brain responses to other visual stimuli presented at normal visual spots. For example, as illustrated in the diagrams of FIG. IF, if the visual deficit exists exactly within the 9 Hz visual sector, the 9 Hz SSVEP amplitude tends to deteriorate to some extent compared to other SSVEP frequencies.
[0049] Five healthy participants (e.g., 4 males and 1 female) with normal or corrected-to- normal vision participated in the exemplary implementations. The EEG data were recorded using a 128-channel BioSemi ActiveTwo EEG system (e.g., from Biosemi, Inc.) according to a modified 10-20 international system, as depicted in the images of FIG. 2. FIG. 2 shows images of an exemplary EEG setup used in exemplary implementations of the disclosed mfSSVEP visual field loss analysis techniques. The visual experiment was conducted inside a dark, soundproof shielded room. Visual stimuli were presented on a 19" CRT monitor in front of the participants at a distance of 50 cm with a refresh rate of 140 Hz and a resolution of 800x600 pixels. To test the monocular visual field, the left eye was occluded and the participant was instructed to maintain fixation of the right eye at the center of the mfSSVEP stimulation screen throughout the entire experiment. In one exemplary implementation, for example, the modified 10-20 international system configuration of electrodes included 19 channels of electrodes arranged over parietal and occipital areas such as Pz, P03, POz, P04, 01, Oz, and 02. In some implementations, for example, the EEG electrode configurations of the EEG unit 11 1 can include a single electrode placed on the head or neck of the patient, e.g., such as on head over the occipital region of the brain. For example, the single electrode channel configuration can include 1 channel - Oz. In some implementations, for example, the EEG electrode configuration of the EEG unit 1 11 can include 2 electrode channels (e.g., 2 channels - 01 and 02); or in other implementations, for example, as few as 3 channels (e.g., 3 channels - 01, 02 and Oz); or in other implementations, for example, as few as 4 channels (e.g., 4 channels - POz, 01, 02 and Oz); or or in other implementations, for example, as few as 8 channels (e.g., 8 channels - P05, P03, POz, P04, P06, 01, 02 and Oz).
[0050] In these exemplary implementations, a layout of visual stimuli was designed to include 20 sectors in three concentric rings (e.g., subtending 6 , 15 , and 25 of the visual field). All sectors flickered concurrently at different frequencies ranging from 8 to 11.8 Hz with a frequency resolution of 0.2 Hz. To test the exemplary mfSSVEP visual field loss analysis technique, a visual field loss (DEFICIT) condition was mimicked by replacing the 9 Hz sector (e.g., the 0-45° patch in the middle ring as shown in the diagram of FIG. IF) with a black patch, in contrast to the CONTROL condition in which all 20 sectors flickered concurrently. Each participant underwent an experiment including five 4-min sessions with a minute inter-session rest to avoid visual fatigue. Each session repeated the visual sequence of a 1-min CONTROL condition and a 1-min DEFICIT condition twice. Each condition contained at least ten 5-s visual trials interleaved with 1-s rest, and in some implementations, each condition included 100 trials of 5 seconds per trial.
[0051] The exemplary dataset for each participant contained 100 5-s DEFICIT and CONTROL trials (e.g., 10 trials x 2 conditions x 5 sessions) for analysis. FIG. 3A shows data plots depicting the CONTROL-DEFICIT comparison for five participants, in which the exemplary red line of the plots represent the SSVEP frequency with the lowest signal-to- noise-ratio versus other frequencies (e.g., represented by the gray lines). FIG. 3B shows data plots depicting a BLOCK-CONTROL comparison in mfSSVEP profiles from a representative subject. The exemplary empirical results showed that four of five participants consistently exhibited a significant deterioration of the 9 Hz ssVEP amplitude in the DEFICIT condition, e.g., as compared to the CONTROL condition. The inconsistency from a participant (S3) was likely attributed to the absence of gaze-attentive fixation to the visual stimulus during the experiment, according to his self-report after the experiment.
[0052] These exemplary results demonstrated that visual field deficits mimicked by disabling the 9 Hz sector did result in a significant SSVEP attenuation at the corresponding frequency. The exemplary results of these implementations suggest that the dynamics of mfSSVEP amplitude is capable of serving as an objective biomarker to assess potential visual field deficits.
[0053] Exemplary Embodiments and Implementations of a Portable, Objective mfSSVEP- based Visual Field Assessment Platform of the Disclosed Technology
[0054] As shown in the block diagram of FIG. 1A, the disclosed technology includes a portable, objective mfSSVEP -based visual field assessment platform, e.g., which includes and integrates a wearable, wireless dry EEG system and a head-mounted display. The portable devices and systems can acquire and process measurements of reliable mfSSVEP signals that are quantitatively associated with visual field integrity of a subject.
[0055] The exemplary platform can quantitate the integrity of monocular visual fields by the characterization of mfSSVEP signal data. For example, by integrating a lightweight, wearable, and wireless multi-channel EEG system and a head-mounted display, the disclosed portable platform can allow assessment of visual field integrity in unconstrained situations and outside clinic environment. FIG. 4 shows an image of an exemplary portable EEG unit 11 1 of the disclosed portable, objective mfSSVEP -based visual field assessment platform. Exemplary characteristics of the exemplary EEG unit shown in FIG. 4 include easy-to-use and environment- free, which can avoid the burden of setting up laboratory EEG recording, enabling routine visual-field assessment or screening for visual field loss in non-clinic environments. Exemplary implementations using the exemplary portable devices and systems of the disclosed technology demonstrated that the strength of mfSSVEP signals is informative to serve as an objective indicator to reflect possible deficits in a monocular visual field. [0056] In exemplary implementations using the exemplary portable system platform, the following methods were performed. An exemplary wearable, wireless high-density EEG unit of the portable system platform was employed, e.g., featuring dry and non-prep electrodes and wireless telemetry to sample EEG signals at 250 Hz, as depicted in FIGS. 5A and 5B. FIG. 5A shows a side view image and FIG. 5B shows a back view image of an exemplary wearable, wireless 64-channel dry EEG unit. Unlike a conventional and cumbersome EEG experiments, for example, users of the exemplary portable system can easily put on the wearable EEG unit by themselves in their living environments. For example, the exemplary portable system can in some embodiments employ a 64-channel high-density EEG, while in other embodiments can employ a reduced number of channels to provide an optimal configuration or montage for portably detecting mfSSVEP, e.g., outside of a non-office based environment. The exemplary portable system can employ advanced signal processing methods, e.g., such as spatial filtering and artifact removal, to improve signal-to-noise ratio of mfSSVEP from high-density recording.
[0057] An exemplary head-mounted display unit of the portable system platform utilized an Oculus Rift goggle (Oculus VR, Inc.) to deliver the mfSSVEP stimulation, as depicted in FIGS. 6A and 6B. FIG. 6A shows an image of the exemplary head-mounted display unit to present the mfSSVEP stimulation, and FIG. 6B shows a diagram of the exemplary layout of the mfSSVEP stimulation presentation. The exemplary head-mounted display unit provides an inexpensive solution with a good image resolution of 1280x800, and also provides a whole-eye coverage allowing a controlled environment for visual-field assessment. The mobility can be obtained by communicatively connecting the exemplary head-mounted display unit to one or more mobile communication devices, e.g., such as a laptop as shown in the image of FIG. 6A, or other mobile devices. For example, tablets, smartphones, or wearable computing devices can also be communicatively connected to the exemplary head- mounted display unit. In the exemplary implementations, for example, the same layout of the mfSSVEP stimulation was used as in other exemplary implementations, e.g., including 20 sectors in three rings (e.g., subtending 6 , 15 , and 25 of the visual field) flickering at frequencies from 8 to 11.8 Hz with a frequency resolution of 0.2 Hz were used (as shown in the diagram of FIG. 6B). For example, subjects can be tested under different experimental conditions, by varying testing parameters similarly to those previously described exemplary implementations. For example, a visual field loss condition can be mimicked by using black patches to replace different sectors on the visual field and evaluate mfSSVEP signal loss compared to a control condition. [0058] The example portable system can be used for acquisition of mfSSVEP signals to obtain such data. For example, exemplary techniques such as independent component analysis (ICA) and differential canonical correlation analysis can be implemented successfully for blind source separation and to enhance detectability of SSVEP signals.
[0059] Exemplary EOG-Guided Methods to Assess Eye-Gaze During Testing with the Exemplary Portable Platform
[0060] Electrooculogram (EOG) methods of the disclosed technology can be utilized to successfully identify fixation losses and allow identification of unreliable mfSSVEP signals to be removed from further analyses. For example, from the earlier implementations of an mfSSVEP technique for assessment of visual field loss, the strength of mfSSVEP in one of the five participates failed to accurately reflect the mimicked visual deficit, as depicted previously in FIG. 3 A. The reason, for example, may be attributed to the absence of proper gaze fixation during the examination based on the patient's self-report. In order to assure matching of SSVEP signals to corresponding visual field locations, subjects need to remain fixating on the central target location during the testing. Due to the short duration of testing trials, this can be achieved in most subjects, yet, the disclosed technology includes a mechanism to identify and exclude unreliable EEG signals produced by fixation losses. This is especially relevant in portable testing that may be performed without supervision.
[0061] In some embodiments, for example, the disclosed portable mfSSVEP systems can include an EOG unit. In one example embodiment, the EOG unit can include two or more dry and soft electrodes to be placed proximate the outer canthus of a subject's eyes (e.g., one or more electrodes per eye) to measure corneo-retinal standing potentials, and are in communication with a signal processing and wireless communication unit of the EOG unit to process the acquired signals from the electrodes and relay the processed signals as data to the data processing unit 120 of the portable system 100. In some implementations, the electrodes of the EOG unit can be in communication with the EEG unit 1 11 or visual display unit 112 to transfer the acquired signals from the outer canthus-placed electrodes of the EOG unit to the data processing unit 120.
[0062] For example, in order to remove unreliable EEG signals occurring from fixation losses, the disclosed techniques can concurrently monitor subjects' electrooculogram (EOG) signals to evaluate the gaze fixation. By placing the dry and soft electrodes of the EOG unit to the outer canthus of the eyes, the electric field changes associated with eye movements, e.g., such as blinks and saccades, can be monitored. There is a linear relationship between horizontal and vertical EOG signals and the angle of eye rotation within a limited range (e.g., approximately 30°). This relationship can be used in determining the exact coordinates of eye fixations on a visual display. In some implementations, a calibration sequence can be used at the start of recording to determine the transformation equations. Accordingly, for example, an EOG-guided mfSSVEP analysis can be implemented to automatically exclude the EEG segments where the subjects do not gaze at the center of the stimulation. To record EOG signals, four prefrontal electrodes can be switched to record the EOG signals, e.g., since mfSSVEP signals are presumably weak in the prefrontal regions. In one example in which the EOG unit includes four electrodes, two electrodes can be placed below and above the right eye and another two will be placed at the left and right outer canthus. The EOG unit can be used to assess the accuracy of the portable mfSSVEP system by identifying potentially unreliable EEG signals induced by loss of fixation. For example, the data processing unit 120 can process the acquired signals from the EOG unit electrodes with the EEG data acquired from the EEG unit 11 1 to identify unreliable signals, which can then be removed from the analysis of visual field integrity. For example, the data processing unit 120 can execute analytical techniques to provide signal source separation. Additionally, or alternatively, for example, the disclosed portable mfSSVEP systems can include an eye tracking unit to monitor losses of fixation, e.g., and can further provide a reference standard. For example, the eye tracking unit can be included, integrated, and/or incorporated into the visual display unit 1 12 (e.g., exemplary head-mounted display), for example.
[0063] Exemplary Implementations to Evaluate the Reproducibility of Measurements obtained with the Exemplary Portable Platform
[0064] Exemplary implementations can be performed to evaluate the reproducibility of measurements obtained with the exemplary portable platform in evaluating its ability to detect visual field loss in patients with glaucoma compared to healthy control subjects. The disclosed portable systems can provide reproducible intra- and inter-visit mfSSVEP signals. mfSSVEP signals in patients with glaucomatous visual field loss will be significantly different than those in healthy control subjects. For example, to have clinical applicability, measurements obtained with portable systems need to be reproducible and be able to detect visual field losses in patients with glaucoma. Good reproducibility is a fundamental requirement in order to allow detection of change over time. If a test is to be used for screening, diagnosis, and/or detection of glaucoma progression, an initial step is
demonstrating that a portable system is able to distinguish patients with glaucomatous field loss from healthy individuals.
[0065] Exemplary implementations were conducted to demonstrate the reproducibility and diagnostic accuracy studies. Such implementations included participation of a group of 10 healthy and 10 glaucomatous subjects. These subjects had not been tested previously with the system. The subjects underwent five sessions of testing per visit for five different visits, spaced at intervals of approximately 1 week apart. Reproducibility measures were obtained, e.g., including coefficients of variation and intraclass correlation coefficients for the relevant measurements obtained by the portable system. For diagnostic accuracy evaluation, for example, tests of an additional sample of 20 healthy and 20 glaucomatous subjects were performed, e.g., totaling 30 subjects in each group. Glaucomatous subjects were shown to have repeatable abnormal visual field defects on SAP (SITA 24-2). For example, assessment of diagnostic accuracy was performed using receiver operating characteristic (ROC) curves. The sample size for this experiment provided 83% power to detect a minimum difference of 0.25 in ROC curve area compared to chance.
[0066] Examples
[0067] The following examples are illustrative of several embodiments of the present technology. Other exemplary embodiments of the present technology may be presented prior to the following listed examples, or after the following listed examples.
[0068] In an example of the present technology (example 1), a system for monitoring brain activity associated with visual field of a user includes a sensor unit to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; visual display unit including a display screen to present visual stimuli to the user in a plurality of sectors of a visual field, in which the presented visual stimuli includes an optical flickering effect at a selected frequency mapped to each sector of the visual field, the visual stimuli configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the sensor unit; and a data processing unit in communication with the sensor unit and the visual display unit to analyze the acquired EEG signals and produce an assessment of the user's visual field.
[0069] Example 2 includes the system as in example 1, in which the produced assessment of the user's visual field is a quantitative assessment that indicates if there is a presence of a visual field defect in the user's visual field.
[0070] Example 3 includes the system as in example 1, in which the one or more electrodes of the sensor unit include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the user.
[0071] Example 4 includes the system as in example 1, in which the one or more electrodes includes a single electrode channel Oz. [0072] Example 5 includes the system as in example 1, in which the one or more electrodes include a plurality of the electrodes that are arranged at particular locations on the head of the subject according to the international 10-20 system.
[0073] Example 6 includes the system as in example 1, in which the system is portable to enable the user to operate the system in the user's living environment and on a routine or continuous basis.
[0074] Example 7 includes the system as in example 1, in which the selected frequency of the optical flickering effect for a particular sector is at a different frequency with respect to the optical flickering effect at a proximate sector or with respect to the optical flickering effects in the other sectors of the visual field.
[0075] Example 8 includes the system as in example 7, in which the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the user.
[0076] Example 9 includes the system as in example 7, in which the visual stimuli is presented in 20 sectors in three concentric rings including subtending 6 , 15 , and 25 of the visual field.
[0077] Example 10 includes the system as in example 7, in which the selected frequencies of the flickerings of the visual stimuli are greater than 6 Hz.
[0078] Example 1 1 includes the system as in example 1 , further including an
electrooculogram (EOG) unit including one or more electrodes to be placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals, in which the one or more electrodes of the EOG unit are in communication with the data processing unit to process the acquired CRSP signals from the one or more electrodes to determine movements of the user's eyes.
[0079] Example 12 includes the system as in example 1, in which the visual display unit is configured to be wearable over the user's eyes for the user to view the presented visual stimuli on the display screen.
[0080] Example 13 includes the system as in example 12, further including an eye tracking device including a camera employed in the wearable visual display unit and in communication with the data processing unit, in which the camera is operable to record images of the user's eyes.
[0081] In an example of the present technology (example 14), a method for examining a visual field of a subject includes presenting, to a subject, visual stimuli in a plurality of sectors of a visual field of a subject, in which for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency; acquiring electroencephalogram (EEG) signals from one or more electrodes in contact with the head of the subject; processing the acquired EEG signals to extract multifocal steady-state visual-evoked potentials
(mfSSVEP) data associated with the subject's EEG signal response to the presented visual stimuli; and producing a quantitative assessment of the visual field of the subject based on the MfSSVEP data.
[0082] Example 15 includes the method as in example 14, in which the quantitative assessment provides an indication if there is a presence of a visual field defect in the user's visual field.
[0083] Example 16 includes the method as in example 15, in which the producing the quantitative assessment includes determining the presence of the visual field defect in a sector having a mfSSVEP signal below a predetermined threshold.
[0084] Example 17 includes the method as in example 14, in which the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the subject.
[0085] Example 18 includes the method as in example 14, in which the one or more electrodes are included in a sensor unit wearable on the subject's head and include a single electrode channel Oz positioned over the occipital region of the head of the subject when the sensor unit is worn by the user.
[0086] Example 19 includes the method as in example 14, in which the one or more electrodes are included in a sensor unit wearable on the subject's head such that the electrodes are arranged at particular locations on the sensing unit to be positioned on the head of the subject when the sensor unit is worn by the user.
[0087] Example 20 includes the method as in example 14, in which the one or more electrodes include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the subject.
[0088] Example 21 includes the method as in example 14, further including monitoring movements of the user's eyes to determine instances associated with the user gazing away from the center of the visual field.
[0089] Example 22 includes the method as in example 14, in which the monitoring the movements of the user's eyes includes using an electrooculogram (EOG) unit including one or more electrodes placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals.
[0090] Example 23 includes the method as in example 14, in which the monitoring the movements of the user's eyes includes using an eye tracking system.
[0091] Example 24 includes the method as in example 14, in which the selected frequency of the optical flickering effect for a particular sector is presented at a different frequency with respect to the optical flickering effect at a proximate sector or with respect to the optical flickering effects in the other sectors of the visual field.
[0092] Example 25 includes the method as in example 14, further including forming a spatial visual stimulus display having the plurality of the sectors at different spatial locations on the spatial visual stimulus display, in which, for each sector, the sector includes the optical flickering effect that changes at a designated frequency with respect to at least a proximate sector or the other sectors of the visual stimulus display.
[0093] Example 26 includes the method as in example 14, in which the producing the quantitative assessment includes analyzing the mfSSVEP data with respect to the designated frequencies that are mapped to the sectors at the different spatial locations on the spatial visual stimulus display, in which the analyzing includes quantitatively comparing an mfSSVEP signal value at a particular frequency of the designated frequencies to a threshold value, and determining the presence of a visual field defect in the sector to which the particular frequency is mapped if the mfSSVEP signal value is less than the threshold value.
[0094] In an example of the present technology (example 27), a portable system for monitoring brain activity associated with visual field of a user includes a brain signal sensor device to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; a wearable visual display unit to present visual stimuli to the user and structured to include a display screen and a casing able to secure to the head of the user, in which the wearable visual display is operable to present the visual stimuli in a plurality of sectors of the user's visual field, such that for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency, and in which the visual stimuli are configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the brain signal sensor device; a data processing unit in communication with the brain signal sensor device and the wearable visual display unit to provide the visual stimuli to the wearable visual display unit and to analyze the acquired EEG signals and produce an assessment of the user's visual field; and an electrooculogram (EOG) unit including one or more electrodes to be placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals, in which the one or more electrodes of the EOG unit are in communication with the data processing unit to process the acquired CRSP signals from the one or more electrodes to determine movements of the user's eyes.
[0095] Example 28 includes the system as in example 27, in which the data processing unit is included in a computing device including a laptop or desktop computer; a mobile communication device including a smartphone, a tablet, or a wearable computing device; or a network computer system.
[0096] Example 29 includes the system as in example 27, in which the produced assessment of the user's visual field is a quantitative assessment that indicates if there is a presence of a visual field defect in the user's visual field.
[0097] Example 30 includes the system as in example 27, in which the one or more electrodes of the brain signal sensor device include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the user.
[0098] Example 31 includes the system as in example 27, in which the one or more electrodes includes a single electrode channel Oz.
[0099] Example 32 includes the system as in example 27, further including an eye tracking device including a camera employed in the wearable visual display unit and in communication with the data processing unit, in which the camera is operable to record images of the user's eyes.
[00100] Example 33 includes the system as in example 27, in which the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the user, and in which the selected frequencies of the flickerings of the visual stimuli are greater than 6 Hz.
[00101] Example 34 includes the system as in example 27, in which the wearable visual display unit is operable to form a spatial visual stimulus display on the display screen having the plurality of the sectors at different spatial locations on the spatial visual stimulus display, in which, for each sector, the sector includes the optical flickering effect that changes at a designated frequency with respect to at least a proximate sector or the other sectors of the visual stimulus display.
[00102] Example 35 includes the system as in example 34, in which the data processing unit is operable to produce the quantitative assessment by analyzing the mfSSVEP data with respect to the designated frequencies that are mapped to the sectors at the different spatial locations on the spatial visual stimulus display, in which the analyzing includes quantitatively comparing an mfSSVEP signal value at a particular frequency of the designated frequencies to a threshold value, and determining the presence of a visual field defect in the sector to which the particular frequency is mapped if the mfSSVEP signal value is less than the threshold value.
[00103] Implementations of the subject matter and the functional operations described in this patent document can be implemented in various systems, digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Implementations of the subject matter described in this specification can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a tangible and non-transitory computer readable medium for execution by, or to control the operation of, data processing apparatus. The computer readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter effecting a machine-readable propagated signal, or a combination of one or more of them. The term "data processing apparatus" encompasses all apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, or multiple processors or computers. The apparatus can include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them.
[00104] A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub programs, or portions of code). A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
[00105] The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit).
[00106] Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read only memory or a random access memory or both. The essential elements of a computer are a processor for performing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto optical disks, or optical disks. However, a computer need not have such devices. Computer readable media suitable for storing computer program instructions and data include all forms of nonvolatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
[00107] While this patent document contains many specifics, these should not be construed as limitations on the scope of any invention or of what may be claimed, but rather as descriptions of features that may be specific to particular embodiments of particular inventions. Certain features that are described in this patent document in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
[00108] Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Moreover, the separation of various system components in the
embodiments described in this patent document should not be understood as requiring such separation in all embodiments.
[00109] Only a few implementations and examples are described and other
implementations, enhancements and variations can be made based on what is described and illustrated in this patent document.

Claims

CLAIMS What is claimed is:
1. A system for monitoring brain activity associated with the visual field of a user, comprising:
a sensor unit to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user;
a visual display unit including a display screen to present visual stimuli to the user in a plurality of sectors of a visual field, wherein the presented visual stimuli includes an optical flickering effect at a selected frequency mapped to each sector of the visual field, the visual stimuli configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the sensor unit; and
a data processing unit in communication with the sensor unit and the visual display unit to analyze the acquired EEG signals and produce an assessment of the user's visual field.
2. The system of claim 1, wherein the produced assessment of the user's visual field is a quantitative assessment that indicates if there is a presence of a visual field defect in the user's visual field.
3. The system of claim 1, wherein the one or more electrodes of the sensor unit include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the user.
4. The system of claim 1, wherein the one or more electrodes includes a single electrode channel Oz.
5. The system of claim 1, wherein the one or more electrodes include a plurality of the electrodes that are arranged at particular locations on the head of the subject according to the international 10-20 system.
6. The system of claim 1, wherein the system is portable to enable the user to operate the system in the user's living environment and on a routine or continuous basis.
7. The system of claim 1, wherein the selected frequency of the optical flickering effect for a particular sector is at a different frequency with respect to the optical flickering effect at a proximate sector or with respect to the optical flickering effects in the other sectors of the visual field.
8. The system of claim 7, wherein the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the user.
9. The system of claim 7, wherein the visual stimuli is presented in 20 sectors in three concentric rings including subtending 6 , 15 , and 25 of the visual field.
10. The system of claim 7, wherein the selected frequencies of the flickerings of the visual stimuli are greater than 6 Hz.
11. The system of claim 1, further comprising:
an electrooculogram (EOG) unit including one or more electrodes to be placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals, wherein the one or more electrodes of the EOG unit are in communication with the data processing unit to process the acquired CRSP signals from the one or more electrodes to determine movements of the user's eyes.
12. The system of claim 1, wherein the visual display unit is configured to be wearable over the user's eyes for the user to view the presented visual stimuli on the display screen.
13. The system of claim 12, further comprising:
an eye tracking device including a camera employed in the wearable visual display unit and in communication with the data processing unit, wherein the camera is operable to record images of the user's eyes.
14. A method for examining a visual field of a subject, comprising:
presenting, to a subject, visual stimuli in a plurality of sectors of a visual field of a subject, wherein for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency;
acquiring electroencephalogram (EEG) signals from one or more electrodes in contact with the head of the subject;
processing the acquired EEG signals to extract multifocal steady-state visual-evoked potentials (mfSSVEP) data associated with the subject's EEG signal response to the presented visual stimuli; and
producing a quantitative assessment of the visual field of the subject based on the MfSSVEP data.
15. The method of claim 14, wherein the quantitative assessment provides an indication if there is a presence of a visual field defect in the user's visual field.
16. The method of claim 15, wherein the producing the quantitative assessment includes determining the presence of the visual field defect in a sector having a mfSSVEP signal below a predetermined threshold.
17. The method of claim 14, wherein the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the subject.
18. The method of claim 14, wherein the one or more electrodes are included in a sensor unit wearable on the subject's head and include a single electrode channel Oz positioned over the occipital region of the head of the subject when the sensor unit is worn by the user.
19. The method of claim 14, wherein the one or more electrodes are included in a sensor unit wearable on the subject's head such that the electrodes are arranged at particular locations on the sensing unit to be positioned on the head of the subject when the sensor unit is worn by the user.
20. The method of claim 14, wherein the one or more electrodes include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the subject.
21. The method of claim 14, further comprising:
monitoring movements of the user's eyes to determine instances associated with the user gazing away from the center of the visual field.
22. The method of claim 14, wherein the monitoring the movements of the user's eyes includes using an electrooculogram (EOG) unit including one or more electrodes placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals.
23. The method of claim 14, wherein the monitoring the movements of the user's eyes includes using an eye tracking system.
24. The method of claim 14, wherein the selected frequency of the optical flickering effect for a particular sector is presented at a different frequency with respect to the optical flickering effect at a proximate sector or with respect to the optical flickering effects in the other sectors of the visual field.
25. The method of claim 14, further comprising:
forming a spatial visual stimulus display having the plurality of the sectors at different spatial locations on the spatial visual stimulus display, wherein, for each sector, the sector includes the optical flickering effect that changes at a designated frequency with respect to at least a proximate sector or the other sectors of the visual stimulus display.
26. The method of claim 14, wherein the producing the quantitative assessment includes analyzing the mfSSVEP data with respect to the designated frequencies that are mapped to the sectors at the different spatial locations on the spatial visual stimulus display, wherein the analyzing includes quantitatively comparing an mfSSVEP signal value at a particular frequency of the designated frequencies to a threshold value, and determining the presence of a visual field defect in the sector to which the particular frequency is mapped if the mfSSVEP signal value is less than the threshold value.
27. A portable system for monitoring brain activity associated with visual field of a user, comprising:
a brain signal sensor device to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user;
a wearable visual display unit to present visual stimuli to the user and structured to include a display screen and a casing able to secure to the head of the user, wherein the wearable visual display is operable to present the visual stimuli in a plurality of sectors of a visual field, such that for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency, and wherein the visual stimuli are configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the brain signal sensor device;
a data processing unit in communication with the brain signal sensor device and the wearable visual display unit to provide the visual stimuli to the wearable visual display unit and to analyze the acquired EEG signals and produce an assessment of the user's visual field; and
an electrooculogram (EOG) unit including one or more electrodes to be placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals, wherein the one or more electrodes of the EOG unit are in communication with the data processing unit to process the acquired CRSP signals from the one or more electrodes to determine movements of the user's eyes.
28. The system of claim 27, wherein the data processing unit is included in a computing device including a laptop or desktop computer; a mobile communication device including a smartphone, a tablet, or a wearable computing device; or a network computer system.
29. The system of claim 27, wherein the produced assessment of the user's visual field is a quantitative assessment that indicates if there is a presence of a visual field defect in the user's visual field.
30. The system of claim 27, wherein the one or more electrodes of the brain signal sensor device include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the user.
31. The system of claim 27, wherein the one or more electrodes includes a single electrode channel Oz.
32. The system of claim 27, further comprising:
an eye tracking device including a camera employed in the wearable visual display unit and in communication with the data processing unit, wherein the camera is operable to record images of the user's eyes.
33. The system of claim 27, wherein the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the user, and wherein the selected frequencies of the flickerings of the visual stimuli are greater than 6 Hz.
34. The system of claim 27, wherein the wearable visual display unit is operable to form a spatial visual stimulus display on the display screen having the plurality of the sectors at different spatial locations on the spatial visual stimulus display, wherein, for each sector, the sector includes the optical flickering effect that changes at a designated frequency with respect to at least a proximate sector or the other sectors of the visual stimulus display.
35. The system of claim 34, wherein the data processing unit is operable to produce the quantitative assessment by analyzing the mfSSVEP data with respect to the designated frequencies that are mapped to the sectors at the different spatial locations on the spatial visual stimulus display, wherein the analyzing includes quantitatively comparing an mfSSVEP signal value at a particular frequency of the designated frequencies to a threshold value, and determining the presence of a visual field defect in the sector to which the particular frequency is mapped if the mfSSVEP signal value is less than the threshold value.
PCT/US2015/026543 2014-04-17 2015-04-17 Portable brian activity sensing platform for assessment of visual field deficits WO2015161300A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
CA2946301A CA2946301A1 (en) 2014-04-17 2015-04-17 Portable brain activity sensing platform for assessment of visual field deficits
CN201580030650.3A CN106455968B (en) 2014-04-17 2015-04-17 Portable brain activity sensing platform for visual field defect assessment
EP15780001.2A EP3131453B1 (en) 2014-04-17 2015-04-17 Portable brain activity sensing platform for assessment of visual field deficits
US15/304,803 US20170035317A1 (en) 2014-04-17 2015-04-17 Portable brain activity sensing platform for assessment of visual field deficits
KR1020167031738A KR20160145131A (en) 2014-04-17 2015-04-17 Portable brain activity sensing platform for assessment of visual field deficits
US17/093,575 US20210052182A1 (en) 2014-04-17 2020-11-09 Portable brain activity sensing platform for assessment of visual field deficits

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201461981145P 2014-04-17 2014-04-17
US61/981,145 2014-04-17

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US15/304,803 A-371-Of-International US20170035317A1 (en) 2014-04-17 2015-04-17 Portable brain activity sensing platform for assessment of visual field deficits
US17/093,575 Continuation US20210052182A1 (en) 2014-04-17 2020-11-09 Portable brain activity sensing platform for assessment of visual field deficits

Publications (1)

Publication Number Publication Date
WO2015161300A1 true WO2015161300A1 (en) 2015-10-22

Family

ID=54324645

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/026543 WO2015161300A1 (en) 2014-04-17 2015-04-17 Portable brian activity sensing platform for assessment of visual field deficits

Country Status (6)

Country Link
US (2) US20170035317A1 (en)
EP (1) EP3131453B1 (en)
KR (1) KR20160145131A (en)
CN (1) CN106455968B (en)
CA (1) CA2946301A1 (en)
WO (1) WO2015161300A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018085598A1 (en) * 2016-11-02 2018-05-11 Northeastern University Portable brain and vision diagnostic and therapeutic system
JP2018079294A (en) * 2016-11-08 2018-05-24 群馬電機株式会社 Exercise support device
WO2018105940A1 (en) * 2016-12-05 2018-06-14 고려대학교 산학협력단 Artificial retina system
US10345592B2 (en) 2015-03-16 2019-07-09 Magic Leap, Inc. Augmented and virtual reality display systems and methods for diagnosing a user using electrical potentials
US20200060573A1 (en) * 2017-05-02 2020-02-27 HeadsafeIP Pty Ltd Head mountable device
US11179564B2 (en) 2017-04-25 2021-11-23 Washington University Resorbable implant for stimulating tissue, systems including such implant, and methods of using
CN114161414A (en) * 2021-12-03 2022-03-11 中国科学院沈阳自动化研究所 Underwater manipulator control system and method based on electroencephalogram and vision

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9910275B2 (en) * 2015-05-18 2018-03-06 Samsung Electronics Co., Ltd. Image processing for head mounted display devices
WO2017090050A1 (en) * 2015-11-29 2017-06-01 Ramot At Tel-Aviv University Ltd. Sensing electrode and method of fabricating the same
WO2018057667A1 (en) * 2016-09-20 2018-03-29 Paradromics, Inc. Systems and methods for detecting corrupt or inaccurate sensory representations
ES2912347T3 (en) 2016-10-26 2022-05-25 Ericsson Telefon Ab L M Identification of sensory inputs that affect an individual's working memory load
CN106859645A (en) * 2017-03-06 2017-06-20 广东工业大学 Wearable device and eeg collection system based on VR technologies and SSVEP
US20200073476A1 (en) * 2017-03-15 2020-03-05 Samsung Electronics Co., Ltd. Systems and methods for determining defects in visual field of a user
WO2018237023A1 (en) * 2017-06-20 2018-12-27 The Trustees Of Columbia University In The City Of New York System, method, and computer-accessible medium for determining possibility/likelihood of mental disorder
CN107296586A (en) * 2017-06-20 2017-10-27 黄涌 Collimation error detection device/method and writing system/method based on the equipment
EP3417775B1 (en) * 2017-06-22 2020-08-19 Oticon A/s A system for capturing electrooculography signals
WO2019046799A1 (en) * 2017-08-31 2019-03-07 Zeto, Inc. Method for hosting mobile access to high-resolution electroencephalography data
EP3684463A4 (en) 2017-09-19 2021-06-23 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement
AU2018367510A1 (en) * 2017-11-14 2020-06-25 Vivid Vision, Inc. Systems and methods for visual field analysis
EP3703523B1 (en) 2017-12-01 2024-02-07 Zeto, Inc. Headset and electrodes for sensing bioelectrical potential and methods of operation thereof
US11717686B2 (en) 2017-12-04 2023-08-08 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to facilitate learning and performance
CN109938727A (en) * 2017-12-20 2019-06-28 中国科学院深圳先进技术研究院 Non-human primate 3D vision stimulation test system and method
WO2019133997A1 (en) 2017-12-31 2019-07-04 Neuroenhancement Lab, LLC System and method for neuroenhancement to enhance emotional response
CN110063727A (en) * 2018-01-24 2019-07-30 苏州维视诺电子科技有限公司 A kind of method and system judging user's visual capacity
US11445972B2 (en) 2018-04-09 2022-09-20 Massachusetts Institute Of Technology Brain-computer interface for user's visual focus detection
US11364361B2 (en) 2018-04-20 2022-06-21 Neuroenhancement Lab, LLC System and method for inducing sleep by transplanting mental states
CN108958489A (en) * 2018-07-20 2018-12-07 东南大学 A kind of interesting image regions Rapid Detection method based on brain electricity and eye tracker
CN113382683A (en) 2018-09-14 2021-09-10 纽罗因恒思蒙特实验有限责任公司 System and method for improving sleep
CN109717828A (en) * 2018-10-24 2019-05-07 中国医学科学院生物医学工程研究所 A kind of perimetry devices and detection method
CN109805923A (en) * 2019-01-29 2019-05-28 北京京东方光电科技有限公司 Wearable device, signal processing method and device
EP3716016B1 (en) * 2019-03-28 2021-04-21 National Chung-Shan Institute of Science and Technology Method and brain-computer interface system for recognizing brainwave signals
CA3136214A1 (en) * 2019-04-26 2020-10-29 Hi Llc Non-invasive system and method for product formulation assessment based on product-elicited brain state measurements
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep
CN110367981B (en) * 2019-07-10 2021-02-09 西安交通大学 Objective quantitative detection device for amblyopia electroencephalogram
CN110251065A (en) * 2019-07-17 2019-09-20 西安交通大学 Contrast sensitivity detection method based on movement vision Evoked ptential
CN110464298B (en) * 2019-07-25 2021-11-02 深圳大学 Electroencephalogram signal processing device and method
CN110611793B (en) * 2019-08-30 2020-12-01 广州奇化有限公司 Supply chain information acquisition and data analysis method and device based on industrial vision
CN113018124A (en) * 2021-03-02 2021-06-25 常州市第一人民医院 Rehabilitation device for unilateral neglect of patient
WO2023039572A1 (en) * 2021-09-11 2023-03-16 The Regents Of The University Of California Simultaneous assessment of afferent and efferent visual pathways
CN114403898B (en) * 2022-01-24 2023-07-14 北京师范大学 Noise removal method and device for electroencephalogram data and electronic equipment
DE102022201296A1 (en) 2022-02-08 2023-08-10 Carl Zeiss Meditec Ag Arrangement for obtaining diagnostic information from the eye
CN115024684A (en) * 2022-05-23 2022-09-09 天津大学 Stimulation paradigm generation system, brain-computer interface system, detection method and device
CN115120240B (en) * 2022-08-30 2022-12-02 山东心法科技有限公司 Sensitivity evaluation method, equipment and medium for special industry target perception skills
CN115714832A (en) * 2022-10-24 2023-02-24 南京航空航天大学 Operation method of telephone dialing system based on steady-state visual evoked potential

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4561448A (en) * 1984-02-02 1985-12-31 Colen-Kery, Inc. Apparatus for sensing and recording biopotential electrical signals
US20090091706A1 (en) * 2007-10-03 2009-04-09 Derr Peter H Simultaneously multi-temporal visual test and method and apparatus therefor
US20100094702A1 (en) * 2006-12-22 2010-04-15 Richard Bernard Silberstein Method for evaluating the effectiveness of commercial communication
WO2013037050A1 (en) * 2011-09-16 2013-03-21 Annidis Health Systems Corp. System and method for assessing retinal functionality and optical stimulator for use therein

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5035500A (en) * 1988-08-12 1991-07-30 Rorabaugh Dale A Automated ocular perimetry, particularly kinetic perimetry
WO2000057772A1 (en) * 1999-03-31 2000-10-05 Virtual-Eye.Com, Inc. Kinetic visual field apparatus and method
WO2001078586A1 (en) * 2000-04-17 2001-10-25 Stuart Graham Method and apparatus for objective electrophysiological assessment of visual function
US7578795B2 (en) * 2001-08-07 2009-08-25 Diopsys, Inc. System and method for vision examination utilizing fault detection
US20090153796A1 (en) * 2005-09-02 2009-06-18 Arthur Rabner Multi-functional optometric-ophthalmic system for testing diagnosing, or treating, vision or eyes of a subject, and methodologies thereof
US20080177352A1 (en) * 2007-01-22 2008-07-24 Novavision, Inc. Device for Treating Human Vision Using Combined Optical and Electrical Stimulation
US20090062680A1 (en) * 2007-09-04 2009-03-05 Brain Train Artifact detection and correction system for electroencephalograph neurofeedback training methodology
US8838226B2 (en) * 2009-12-01 2014-09-16 Neuro Wave Systems Inc Multi-channel brain or cortical activity monitoring and method
CN201926979U (en) * 2010-12-16 2011-08-10 刘国忠 Brain-computer interface equipment
US8812097B2 (en) * 2012-02-06 2014-08-19 Honeywell International Inc. Neurologically based non-invasive blood glucose concentration system and method
EP3108287A4 (en) * 2014-02-18 2017-11-08 Merge Labs, Inc. Head mounted display goggles for use with mobile computing devices

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4561448A (en) * 1984-02-02 1985-12-31 Colen-Kery, Inc. Apparatus for sensing and recording biopotential electrical signals
US20100094702A1 (en) * 2006-12-22 2010-04-15 Richard Bernard Silberstein Method for evaluating the effectiveness of commercial communication
US20090091706A1 (en) * 2007-10-03 2009-04-09 Derr Peter H Simultaneously multi-temporal visual test and method and apparatus therefor
WO2013037050A1 (en) * 2011-09-16 2013-03-21 Annidis Health Systems Corp. System and method for assessing retinal functionality and optical stimulator for use therein

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
LIN, YP ET AL.: "Assessing the quality of steady-state visual-evoked potentials for moving humans using a mobile electroencephalogram headset.", FRONTIERS IN HUMAN NEUROSCIENCE., vol. 8, 31 March 2014 (2014-03-31), pages 1 - 10, XP055359502 *
LIN, YP ET AL.: "Using Multifocal Steady-State Visual Evoked Potentials for Objective Assessment of Visual Field Loss: A Pilot Study.", INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE ., vol. 55, no. Issue 13, April 2014 (2014-04-01), pages 5126, XP055376533 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10345592B2 (en) 2015-03-16 2019-07-09 Magic Leap, Inc. Augmented and virtual reality display systems and methods for diagnosing a user using electrical potentials
WO2018085598A1 (en) * 2016-11-02 2018-05-11 Northeastern University Portable brain and vision diagnostic and therapeutic system
US11701046B2 (en) 2016-11-02 2023-07-18 Northeastern University Portable brain and vision diagnostic and therapeutic system
JP2018079294A (en) * 2016-11-08 2018-05-24 群馬電機株式会社 Exercise support device
WO2018105940A1 (en) * 2016-12-05 2018-06-14 고려대학교 산학협력단 Artificial retina system
US11179564B2 (en) 2017-04-25 2021-11-23 Washington University Resorbable implant for stimulating tissue, systems including such implant, and methods of using
US20200060573A1 (en) * 2017-05-02 2020-02-27 HeadsafeIP Pty Ltd Head mountable device
CN114161414A (en) * 2021-12-03 2022-03-11 中国科学院沈阳自动化研究所 Underwater manipulator control system and method based on electroencephalogram and vision
CN114161414B (en) * 2021-12-03 2023-09-19 中国科学院沈阳自动化研究所 Underwater manipulator control system and method based on electroencephalogram and vision

Also Published As

Publication number Publication date
CN106455968A (en) 2017-02-22
US20210052182A1 (en) 2021-02-25
KR20160145131A (en) 2016-12-19
EP3131453A1 (en) 2017-02-22
CA2946301A1 (en) 2015-10-22
US20170035317A1 (en) 2017-02-09
CN106455968B (en) 2021-08-17
EP3131453A4 (en) 2017-12-20
EP3131453B1 (en) 2021-01-20

Similar Documents

Publication Publication Date Title
US20210052182A1 (en) Portable brain activity sensing platform for assessment of visual field deficits
US11903720B2 (en) System and method for detecting neurological disease
US10258291B2 (en) Systems and methods for evaluation of neuropathologies
CA2701544C (en) Simultaneously multi-temporal visual test and method and apparatus therefor
US20200060573A1 (en) Head mountable device
JP2004537360A (en) Visual inspection systems and methods
US20150105689A1 (en) Pattern electroretinography for evaluating a neurological condition
Kubová et al. Comparison of visual information processing in school-age dyslexics and normal readers via motion-onset visual evoked potentials
KR20230051131A (en) EEG detection and nerve stimulation system including a wearable EEG headset and 3D glasses wearing a patient and method thereof
Yadav et al. Optimization of the pattern visual evoked potential (VEP) in the visually-normal and mild traumatic brain injury (mTBI) populations
Lascano et al. Increasing the diagnostic value of evoked potentials in multiple sclerosis by quantitative topographic analysis of multichannel recordings
Lebid Optical non-invasive brain-computer interface system
Mark et al. Central neuronal transmission in response to tonic cold pain is modulated in people with type 1 diabetes and severe polyneuropathy
CN117936066A (en) INPH prediction method based on visual Oddball paradigm
WO2023039572A1 (en) Simultaneous assessment of afferent and efferent visual pathways
WO2023023226A2 (en) System comprising integrated dichoptic flash and pupillometry monitoring, and method for using the same
CN117918856A (en) INPH prediction method and iNPH prediction equipment based on new and old stimulation BCI paradigm
Nowak et al. Preliminary examination of chromatic flicker light stimulation on EEG and pupil size for observing human activity levels
Schadow et al. Gestalt perception in hemianopic patients: performance measures and VEPs

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15780001

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 15304803

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2946301

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 20167031738

Country of ref document: KR

Kind code of ref document: A

REEP Request for entry into the european phase

Ref document number: 2015780001

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2015780001

Country of ref document: EP