CA3075632A1 - Eye tracking system - Google Patents

Eye tracking system Download PDF

Info

Publication number
CA3075632A1
CA3075632A1 CA3075632A CA3075632A CA3075632A1 CA 3075632 A1 CA3075632 A1 CA 3075632A1 CA 3075632 A CA3075632 A CA 3075632A CA 3075632 A CA3075632 A CA 3075632A CA 3075632 A1 CA3075632 A1 CA 3075632A1
Authority
CA
Canada
Prior art keywords
eye tracking
main column
patient
head rest
rest assembly
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA3075632A
Other languages
French (fr)
Other versions
CA3075632C (en
Inventor
Rosina Samadani
Daniel O. Sanderson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oculogica Inc
Original Assignee
Oculogica Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oculogica Inc filed Critical Oculogica Inc
Publication of CA3075632A1 publication Critical patent/CA3075632A1/en
Application granted granted Critical
Publication of CA3075632C publication Critical patent/CA3075632C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0016Operational features thereof
    • A61B3/0033Operational features thereof characterised by user input arrangements
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0016Operational features thereof
    • A61B3/0041Operational features thereof characterised by display arrangements
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0027Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the hearing sense
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0044Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense
    • A61M2021/005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense images, e.g. video

Abstract

A system for measuring eye tracking may include a chassis, which may include a main column and a head rest assembly. The head rest assembly may include a stimulus screen for displaying a video to the patient, an optical mirror, an eye tracking camera, and at least one head rest member for stabilizing the patient's head, relative to the stimulus screen. The system may also include: a base attached to a bottom of the main column to support the main column; an arm extending from the main column to support the head rest assembly; a touchscreen interface attached to the main column and configured to provide control of the system to a user; a camera computer housed in the main column for controlling the eye tracking camera; and a system computer housed in the main column for controlling the stimulus screen, data processing and other functions.

Description

EYE TRACKING SYSTEM
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is being filed on September 12, 2018, as a PCT
International patent application and claims the benefit of priority to U.S. Provisional Patent Application No. 62/558,069, filed September 13, 2017, entitled, "EYE TRACKING
SYSTEM." The disclosure of this priority application is hereby incorporated by reference in its entirety into the present application.
TECHNICAL FIELD
[0002] This application is directed to medical devices, systems and methods.
More specifically, the application is directed to eye tracking devices, systems and methods.
BACKGROUND OF THE INVENTION
[0003] Many central nervous system injuries and abnormalities can be challenging to diagnose and localize within the nervous system. The assignee of the present application has developed methods and systems that use eye tracking measurement to help diagnose and/or localize a number of different central nervous system injuries and abnormalities, such as but not limited to increased intracranial pressure, concussion, reduced or impaired cranial nerve function, and the like. Some of these methods and systems are described in U.S. Patent No. 9,642,522 and U.S. Patent Application Pub.
Nos. 2016/0278716 and 2017/0172408, all of which are hereby incorporated herein by reference.
BRIEF DESCRIPTION OF THE DRAWINGS
[0004] FIGS. 1A-1C are patient-facing, side, and technician-facing views, respectively, of a system for measuring eye tracking, according to one embodiment;
[0005] FIGS. 2A and 2B are patient-facing perspective views of the system of FIGS.
1A-1C, illustrating adjustability of a head rest assembly portion of the system in a horizontal plane (FIG. 2A) and a vertical plane (FIG. 2B);
[0006] FIG. 3 is a close-up view of a touchscreen interface of the system of FIGS.
1A-2B;
[0007] FIG. 4 is a screen shot of a sign-in display for a touchscreen interface of an eye tracking system, according to one embodiment;
[0008] FIG. 5 is a screen shot of a patient selection display for a touchscreen interface of an eye tracking system, according to one embodiment;
[0009] FIG. 6 is a screen shot of new patient display for a touchscreen interface of an eye tracking system, according to one embodiment;
[0010] FIG. 7 is a screen shot of a patient video selection display for a stimulus screen of an eye tracking system, according to one embodiment;
[0011] FIG. 8 is a camera setup display for a touchscreen interface of an eye tracking system, according to one embodiment;
[0012] FIG. 9 is a close-up illustration of a camera adjustment knob on a main column of a chassis of the eye tracking system, according to one embodiment;
[0013] FIG. 10 is a screen shot of a tracking progress display for a touchscreen interface of an eye tracking system, according to one embodiment; and
[0014] FIG. 11 is a screen shot of an eye tracking report 110 produced by the eye tracking system, according to one embodiment.
DETAILED DESCRIPTION OF THE INVENTION
[0015] Referring to FIGS. 1A-1C, 2A-2B and 3, an eye tracking and diagnostic system 10 is illustrated, according to one embodiment. System 10 is used to track a patient's eye movement and diagnose one or more eye movement abnormalities. In some embodiments, system 10 includes at least one processor, which may further analyze data related to the eye movement abnormalities to help diagnose and/or localize a neurological injury or abnormality, such as but not limited to increased intracranial pressure, concussion, reduced or impaired cranial nerve function. In use, a stimulus video is presented on system's 10 LCD stimulus screen 12, and the patient's eye movement is tracked over time by an infrared eye tracking camera 14. Fixed orientation of the patient's head, relative to the stimulus screen 12 and camera 14, is ensured by a head rest assembly 18, which adjusts to a seated or supine patient. System 10 is operated from a touchscreen interface 26. System 10 is coupled together via a wheeled chassis 20 suitable for wheeling to the examination location.
[0016] Chassis 20 includes two main parts: a main column 28 supported by a base 22, and a head rest assembly 18. Head rest assembly 18 is supported on an arm 24, which can be raised and lowered using an electrically-driven elevator in main column 28, controlled by an up/down button 38 (Figs. 1C and 3). Arm 24 moves up and down through a vertical slot 29 (Figs. 1A, 2A, 2B) in main column 28. Four locking castors 32 in base 22 allow the entire unit to be moved, with base 22 being sized to fit underneath a patient bed or gurney. A handle 30 on main column 28 is used to push and/or pull system 10 into place.
[0017] In one embodiment, main column 28 houses two computers, a power supply, the elevator mechanism, an isolation transformer, and other electrical parts, none of which is visible in the figures. Operator touchscreen interface 26 (also called "operator console 26" herein) is located on main column 28.
[0018] Head rest assembly 18 includes a chin rest 34 and a forehead rest 36, to stabilize the patient's head, stimulus screen 12, an optical mirror 16 used to fold the optical path allowing for more compact casing, and a high-speed eye tracking camera 14. As shown in Figs. 2A and 2B, the entire head rest assembly 18 can be rotated in the horizontal plane 90 degrees in either direction, for a total horizontal rotation of 180 degrees (Fig. 2A), and up to 90 degrees in the vertical direction downward to accommodate supine patients (Fig. 2B). In the illustrated embodiment, there are several discrete positions within the vertical rotation where head rest assembly 18 locks into place. Buttons 40 on the back of head rest assembly 18 activate solenoids, so assembly 18 can be rotated vertically and then locked.
[0019] A standard 110-volt medical grade cord may provide power to system's 10 elevator mechanism and a 400-watt power supply. The power supply provides regulated DC power to the computers, as well as the solenoid controls in head rest assembly 18.
[0020] System 10 includes two computers, which are housed in main column 28 of chassis 20 and thus not visible in the figures. A camera computer, which may be provided by the same manufacturer as the manufacturer of camera 14, may run the real-time software for camera 14 under a real-time operating system. It detects eye motion events, such as saccades, blinks, and fixations, and computes the gaze coordinates for each eye at 500 Hz, storing the raw data until it is needed by the application. The application computer may be a small form-factor PC that runs a system application for system 10. The system application provides the user interface, controls the logic flow, displays the stimulus video, processes the raw data from the camera computer, and stores results in persistent storage.
[0021] The user interacts with the system application through touchscreen interface 26. Stimulus screen 12 (the second monitor on system 10) displays the stimulus media to the patient. Two built-in speakers provide the audio for the stimulus media.
[0022] In some embodiments, the processor(s) in system 10 is configured to generate a score describing a patient's eye tracking ability. For example, in one embodiment, system 10 generates a score ranging from 0-20, where the score is interpreted as a binary classification for eye movement abnormalities, and where anything equal to or greater than 10 is a positive result (abnormality present) and everything below 10 is negative (no abnormality). The system's 10 operating algorithm identifies eye tracking abnormalities and computes the score.
Eye Tracking Camera
[0023] In one embodiment, eye tracking camera 14 is an EyeLink 1000 Plus USB
(SR Research, Ottawa, Canada) and is used to capture the eye movements of the patient. Camera 14 captures 500 frames of gaze data per second for each eye, with an average accuracy of 0.25 to 0.5 degrees. The illuminators are infrared, and it uses dark pupil eye tracking, in which the infrared sources are offset from camera 14.
This technique typically provides better results across ethnicities and varied lighting conditions. The gaze tracking ranges up to 32 degrees horizontally and 25 degrees vertically. The distance between the subject's eyes and the camera is 52 cm.
The specifications for camera 14, as provided by the vendor, are shown in Table 1.
Table 1: EyeLink Camera Specifications Spec Description Average accuracy of gaze Down to 0.15 degrees (0.25 degrees to 0.5 degrees typical) coordinate data sampling rate Binocular: 250, 500 hz End-to-end sample delay m < 1.8 msec, sd < 0.6 msec @ 1000 hz Blink/occlusion recovery m < 1.8 msec, sd < 0.6 msec @ 1000 hz Spatial resolution <0.01 degrees rms Eye tracking principle Dark pupil - corneal reflection Spec Description Pupil detection models Centroid or ellipse fitting Pupil size resolution 0.2% of diameter Gaze tracking range 32 degrees horizontally, 25 degrees vertically Allowed head movements 25 mm horizontal or vertical6, 10 mm depth without accuracy reduction Optimal camera-eye distance Between 40 - 70 cm Glasses compatibility The user must remove their glasses to use the system On-line event parsing Fixation / saccade / blink / fixation update Eye position cursor or position traces. Camera images and Real-time operator feedback tracking status.
Eye Tracking Computer
[0024] As mentioned above, in one embodiment, camera 14 is driven by a dedicated real-time computer running the QNX operating system. The specifications for this eye tracking computer are shown in Table 2.
Table 2: EyeLink Computer Specifications Spec Description Pico form factor; 8-layer SBC
Design PCB size: 100 mm x 72 mm Embedded CPU Intel Braswell SoC CPU
Memory Onboard 4 GB unbuffered DDR3L 1600 MHz DRAM
Expansion slot 1 full-size mini-PCIE slot SATA III port Storage M.2 M-key 2242 slot Integrated with Intel i211AT PCI-E Gigabit LAN chip LAN chip Support fast Ethernet LAN function of providing 10/100/1000 Mbps Ethernet data transfer rate Realtek ALC662 2-CH HD audio codec integrated Audio chip Audio driver and utility included BIOS 64 Mbit flash ROM
12V DC-in power jack USB 3.0 port (2) Rear I/O
Display port RJ-45 LAN port Spec Description 2-pin internal 12V DC-in power connector SATA power-out connector Front panel audio header 9-pin USB 2.0 header Internal I/O Serial port header (2) Front panel header LAN LED activity header LVDS header LVDS inverter System Application Computer
[0025] As mentioned above, in one embodiment, the system application runs on a mini-ITX board running Windows 10 Pro, configured as a kiosk device. The specifications are shown in Table 3.
Table 3: System Application Computer Specifications Spec Description Design Mini ITX form factor CPU Intel i7 (speed, etc TBD) Chipset Intel H170 Memory 16 GB dual channel DDR4 PCI Express 3.0 x16 slot Expansion slot Vertical half-size mini-PCI Express slot G Intel HD graphics, dual graphics output, DVI/HDMI max resolution raphics to 4K x 2K
Invidia GeForce 210, DVINGA/DisplayPort max resolution to Additional graphics 2560x1600 Audio 7.1 CH HD audio LAN Intel 1219V (gigabit LAN) Realtek RTL8111H (gigabit LAN) PS/2 mouse/keyboard port DVI port HDMI port Rear I/O USB 2.0 ports (2) USB 3.0 ports (6) RJ-45 LAN ports (2) HD audio jack Storage SATA 3 256GB SSD
BIOS 128 MB AMI UEFI legal BIOS
Certifications FCC, CE, WHQL

Stimulus Display
[0026] Stimulus screen 12, according to one embodiment, is used to display a video that may last any suitable length of time, such as 220 seconds in one embodiment. In one embodiment, the only purpose of stimulus screen 12 is to display the visual stimulus. The video may be one of several pre-determined videos. These videos may include music videos, clips from children's movies, sports clips, talent performances, "reality TV" clips, etc. The choice of videos may be designed to appeal to a broad group of subjects. Users of the device may choose which video to display or may ask the patient which one they would like to watch. Additional media selections may be downloaded via a UBS drive, for example. In one embodiment, the video aperture is square, with each side being approximately 1/4 the width of the visible display. The trajectory of the displayed video around stimulus screen 12 follows a predefined discrete path, such as 5 cycles along the perimeter of stimulus screen 12 with a velocity of 10 seconds per side, according to one embodiment. In one embodiment, stimulus screen 12 is an GeChic 1303 monitor, with the specifications shown below in Table 4.
Table 4: Stimulus Screen Specifications Spec Description Aspect ratio 1.78:1 Maximum resolution 1920 x 1080 Screen size 13.3 inches Display type LED
Viewing angle 890/890/890/890 Contrast ratio 700:1 Power input 5V, 2.0A
Touchscreen Interface
[0027] Touchscreen interface 26 (which may also be referred to as an "operator console" or simply "touchscreen") is used by the technician to interact with the system application. In the pictured embodiment, touchscreen interface 26 includes only a touch screen display, meaning that there is no keyboard or other input device.
Of course, alternative embodiments may include a keyboard or other input device(s). In one embodiment, touchscreen interface 26 may be a Mimo UM-1080CH-G, with the specifications set forth below in Table 5.
Table 5: Touchscreen Interface Specifications Spec Description Capacitive touchscreen Yes Maximum resolution 1280x800 Screen size 10.1 inches Viewing angle 170 x 170 Contrast ratio 800:1 Power input 6W
Head Rest Assembly Chin rest 34 and forehead rest 36 are used to stabilize the user's head and maintain appropriate distance from stimulus screen 12 during eye tracking. Chin rest 34 may be made from the non-toxic, non-hazardous biodegradable plastic Bakelite resin (polyoxybenzylmethyleneglycolanhydride), and forehead rest 36 may be constructed from aluminum covered with a thin EPDM (ethylene propylene diene terpolymer) foam pad blended with neoprene and SBR (styrene-butadiene rubber) pad with closed-cell construction, to resist liquid, solid, and gas absorbance. Both surfaces may be wiped using sterile alcohol swabs before and after each use.
System Calibration
[0028] The calibration information below in Table 6 applies to the components of system, according to one embodiment.
Table 6: System Calibration Calibration notes A focus knob on the bottom of the unit adjusts focus. Once it is set, it generally does not need any adjustment unless the knob is accidentally jarred. The user guide provides instructions for Eye tracking camera 14 adjusting focus. Gaze point calibration is not required. System 10 uses camera's 14 built-in default calibration for calculating gaze points from pupil detection and corneal reflection measurements.

Calibration notes Stimulus display 12 is surrounded by bezels to reduce the size of display 12 to effectively be 4:3 instead of 1.78:1. The software uses calibration information stored in the device configuration file to Stimulus display 12 determine what part of the display is actually visible to the user.
The configuration, once set, does not change since the bezels and display are fixed. These configuration parameters will be set at the factory before being shipped to the end user.
The aspect ratio will be set when the unit is assembled. No Operator console 26 additional calibration by the user is needed.
The computers perform a boot sequence upon startup that will run Computers diagnostic procedures to ensure correct operation. No additional calibration of the computers is necessary.
Head rest assembly 18 At assembly time, the head rest assembly 18 rotation limits are set rotation and fixed into place. No additional calibration is needed.
The user should use an alcohol wipe before and after each patient in Chin rest 34 and order to sterilize the parts of the device that come in contact with the forehead rest 36 patient. Instructions for this are included in the user guide.
At assembly time, the elevator height limits are set and fixed into El place. No additional calibration is needed. The elevator is not evator expected to require any maintenance during the normal lifetime of the device.
Dust or dirt may accumulate in the camera/mirror bay of head rest Optical mirror 16 assembly 18. User guide instructions provide information about how to remove the debris using compressed air if needed.
Principle of Operation
[0029] System 10 measures a patient's eye tracking while watching a video move around stimulus screen 12 and then analyzes the data from the eye tracking measurements, using an algorithm, to extract clinically relevant eye measures by using temporal assessment. The patient watches a video moving inside an aperture with a set trajectory for 220 seconds (in one embodiment) at a fixed distance from stimulus screen 12. The position of each pupil is recorded over time elapsed, as the video travels on its time course, enabling detection of impaired ability to move the eyes relative to time and therefore relative to each other. The algorithm inputs are measurements of the individual (left and right) eye-movements, averaged over the five cycles that the eyes move while watching the 220-second video that plays in an aperture moving around screen 12. In one embodiment, the algorithm output is a "BOX Score,"
calculated by multiplying multiple constants with different individual parameters, and summing those factors.

Method Overview
[0030] According to one embodiment, a brief summary of the key steps for use of system 10 is provided below.
1. Log in with user name and password. The user's login is validated against cached credentials.
2. Fill in patient information fields (name, DOB, gender, etc.). The patient data will be cached locally.
3. Select the video to be shown by tapping its thumbnail icon.
4. In the next screen, an image of the patient's face is shown with visual clues of where the camera is looking for the pupils and whether the pupils can be detected.
5. Tap on each eye to instruct the software to lock the pupil positions.
6. Illumination is defaulted at 75%, but it can be set to 50% or 100%
depending on ambient lighting.
7. Optional: Ask subject to look at the corners of the stimulus screen to ensure pupil capture at all points.
8. Tap the Start button to initiate the eye tracking.
9. While the eye tracking is in progress, make sure the eyes remain locked most of the time. Quality indicators show how what percentage data is being collected for each eye over the last 15 seconds.
10. Upon completion, system 10 processes the results and displays a report screen.
Green value for BOX score indicates that metric fell within normal bounds.
Red indicates outside normal.
11. Elect to save and exit, save and re-do, discard and exit, or discard and re-do.
12. Complete.
System Computer Processing Overview
[0031] Central to the operation of system 10 is how the software processes raw gaze data from the eye tracking camera and calculates a BOX score. An overview of this process is outlined below.
1. During a tracking, system 10 collects 220 seconds of binocular gaze data at 500Hz as the patient watches the video stimulus go around screen 12 five times.
The trajectory is as follows:

a. The stimulus starts in the upper left corner and remains stationary for 10 seconds.
b. The stimulus moves around the outer edges of the stimulus screen in a clockwise fashion, taking ten seconds for each side or 40 second for each cycle. The stimulus makes five cycles plus one extra side along the top for a total of 220 seconds.
2. The first and last ten seconds of data are discarded.
3. The processing first removes blink data. These data become "NaN's" (not a number) in the processing and are ignored in all subsequent processing.
4. Next, the gaze data are normalized, and several dozen metrics are computed from the normalized data, which characterize the patient's tracking. Some of the metrics are conjugate values that evaluate the differences between the left and right eye.
5. The most correlated metrics are then fed into a polynomial formula that produces a BOX score between 0 and 20. Scores less than 10 are considered normal.
6. The algorithm also computes a quality score (1 to 10 with 10 being the best) based on the percentage of NaN's that were in the raw data.
[0032] Referring now to Fig. 4, one embodiment of a sign-in display 50, which may be shown on touchscreen interface 26, is illustrated. Sign-in display 50 includes a user sign-in area 52 and a touchscreen keyboard area 54, the latter of which represents a standard keyboard on the touchscreen interface 26. The technician or other user of system 10 may sign in on this page, using keyboard 54.
[0033] Fig. 5 illustrates a patient selection display 60, which may be presented to the user after sign-in. Patient selection display 60 may include a new patient button 62 and an existing patient button 64, which the user may use to select whether to enter information for a new patient or an existing patient.
[0034] Referring to Fig. 6, a new patient display 70 is illustrated. Display 70 includes a new patient information entry area 72 and keyboard 54. The user may use keyboard 54 to enter information about the new patient. A similar display may be presented for an existing patient, if the user selects existing patient on the previous display screen 60.
[0035] Fig. 7 shows a patient video selection display 80, which may be displayed to the patient on stimulus screen 12. Video selection display 80 includes multiple rows and columns of video selection buttons 82, each of which includes an image and title of a video. The patient may select one of the video selection buttons 82 by touching stimulus screen 12.
[0036] With reference to Fig. 8, a camera setup display 90 is illustrated.
This display 90 may be shown to the user, on touchscreen interface 26, to help the user adjust camera 14. Display 90 may include a camera setup area 92, which may show an image of the patient and information regarding illumination and threshold values. As show in Fig. 9, main column 28 of chassis 20 may include a camera adjustment knob 94 for adjusting focus of camera 14.
[0037] Fig. 10 shows a tracking progress display 100, which also may be shown to the user on touchscreen interface 26. Tracking progress display 100 may include images 102 of the patient's right and left eyes, as well as patient information, tracking quality information, time elapsed for the eye tracking process and/or the like.
[0038] Finally, Fig. 11 shows an exemplary embodiment of an eye tracking report 110. Report 110 may include patient information, images representing the eye tracking of the patient, camera information, quality information, a BOX score and/or the like.
[0039] The above description is intended to be a complete description of one embodiment of a system and method for measuring eye tracking for one or more diagnostic purposes. It is meant to be a description of examples only and is not intended to limit the scope of the invention.

Claims (18)

We claim:
1. A system for measuring eye tracking in a patient and using the measured eye tracking to help diagnose an abnormality, the system comprising:
a chassis, comprising:
a main column; and a head rest assembly, comprising:
a stimulus screen for displaying a video to the patient;
an optical mirror;
an eye tracking camera; and at least one head rest member for stabilizing the patient's head, relative to the stimulus screen;
a base attached to a bottom of the main column to support the main column;
an arm extending from the main column to support the head rest assembly;
a touchscreen interface attached to the main column and configured to provide control of the system to a user;
a camera computer housed in the main column for controlling the eye tracking camera; and a system computer housed in the main column for controlling the stimulus screen, data processing and other functions of the system.
2. The system of claim 1, further comprising an elevator housed in the main column for moving the arm up and down relative to the main column.
3. The system of claim 1, further comprising multiple wheels attached to a bottom of the base to allow the system to be wheeled along the ground, wherein the base and the multiple wheels are sized to fit underneath a patient bed or gurney.
4. The system of claim 3, further comprising a handle attached to the main column for moving the system along the ground.
5. The system of claim 1, wherein the main column of the chassis further includes a slot, wherein the arm moves up and down through the slot to adjust a height of the headrest assembly, and wherein the system further comprises an elevator mechanism in the main column, attached to the arm, to move the arm up and down.
6. The system of claim 1, wherein the main column of the chassis houses multiple additional components, comprising:
a power supply;
an elevator mechanism attached to the arm, to move the arm up and down; and an isolation transformer.
7. The system of claim 1, wherein the head rest assembly is configured to rotate in a horizontal plane and a vertical plane, relative to the arm.
8. The system of claim 7, wherein the head rest assembly is configured to rotate in the horizontal plane 90 degrees in either direction, for a total horizontal rotation of 180 degrees, and 90 degrees in the vertical plane in a downward direction, to accommodate supine patients.
9. The system of claim 7, wherein the head rest assembly locks into multiple discrete positions within vertical rotation about the arm.
10. The system of claim 7, further comprising two buttons on the back of the head rest assembly, which are configured to activate solenoids to allow for vertical rotation of the head assembly.
11. The system of claim 1, further comprising two built-in speakers to provide audio to the patient along with video on the stimulus screen.
12. The system of claim 1, wherein the system computer is configured to generate a score describing the eye tracking of the patient.
13. The system of claim 12, wherein the score ranges from 0 to 20, wherein the score is interpreted as a binary classification for eye movement abnormalities, wherein if the score is equal to or greater than 10, that represents a positive result (abnormality present), and wherein if the score is below 10, that represents a negative result (no abnormality present).
14. A method for measuring eye tracking in a patient using an eye tracking system, the method comprising:
receiving user information input by a user via a touchscreen interface of the eye tracking system;
receiving patient information input by the user via the touchscreen interface;
receiving a video selection from the patient via a stimulus screen of the eye tracking system;
displaying a video to the patient on the stimulus screen, according to the video selection;
tracking movement of the patient's eyes during display of the video via an eye tracking camera of the eye tracking system; and generating, with a computer processor of the eye tracking system, a score representing an ability of the patient's eyes to track the video.
15. The method of claim 14, wherein the score ranges from 0 to 20, wherein the score is interpreted as a binary classification for eye movement abnormalities, wherein if the score is equal to or greater than 10, that represents a positive result (abnormality present), and wherein if the score is below 10, that represents a negative result (no abnormality present).
16. The method of claim 14, further comprising:
receiving an instruction from the user to adjust a height of a head rest assembly of the eye tracking system; and moving an arm attaching the head rest assembly to a main column of the eye tracking system at least one of up or down, in response to the instruction.
17. The method of claim 14, further comprising:
receiving an instruction from the user to adjust a vertical orientation of a head rest assembly of the eye tracking system; and rotating the head rest assembly in a vertical plane relative to an arm attaching the head rest assembly to a main column of the eye tracking system, in response to the instruction.
18. The method of claim 14, further comprising:
receiving an instruction from the user to adjust a horizontal orientation of a head rest assembly of the eye tracking system; and rotating the head rest assembly in a horizontal plane relative to an arm attaching the head rest assembly to a main column of the eye tracking system, in response to the instruction.
CA3075632A 2017-09-13 2018-09-12 Eye tracking system Active CA3075632C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762558069P 2017-09-13 2017-09-13
US62/558,069 2017-09-13
PCT/US2018/050650 WO2019055504A1 (en) 2017-09-13 2018-09-12 Eye tracking system

Publications (2)

Publication Number Publication Date
CA3075632A1 true CA3075632A1 (en) 2019-03-21
CA3075632C CA3075632C (en) 2024-01-02

Family

ID=63722786

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3075632A Active CA3075632C (en) 2017-09-13 2018-09-12 Eye tracking system

Country Status (7)

Country Link
US (2) US10729321B2 (en)
EP (1) EP3668403B1 (en)
JP (2) JP7247202B2 (en)
CN (2) CN111432727B (en)
AU (1) AU2018334150C1 (en)
CA (1) CA3075632C (en)
WO (1) WO2019055504A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11141095B2 (en) 2017-02-17 2021-10-12 Oculogica Inc. Method and system for detecting concussion
MY193695A (en) 2017-04-06 2022-10-25 Nissan Chemical America Corp Brine resistant silica sol
CN111432727B (en) * 2017-09-13 2022-02-18 奥库洛吉卡公司 Eye tracking system
US11903711B2 (en) 2022-06-09 2024-02-20 EarliTec Diagnostics, Inc. Assessing developmental disorders via eye tracking

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1172697A (en) * 1997-08-28 1999-03-16 Nec Corp Method and device for detecting observer's point position
US6961448B2 (en) 1999-12-30 2005-11-01 Medtronic, Inc. User authentication in medical device systems
AU2001234908A1 (en) 2000-02-11 2001-08-20 Marcio Marc Abreu System and method for communicating product recall information, product warningsor other product-related information to users of products
DE10132378A1 (en) 2001-07-06 2003-04-24 Zeiss Carl Meditec Ag Method and device for tracking eye movements
US20040032568A1 (en) * 2002-08-14 2004-02-19 Kabushiki Kaisha Topcon Subjective optometric apparatus
JP4744973B2 (en) * 2005-08-05 2011-08-10 株式会社トプコン Fundus camera
US7594728B2 (en) * 2005-12-16 2009-09-29 Novavision, Inc. Adjustable device for vision testing and therapy
US7535991B2 (en) 2006-10-16 2009-05-19 Oraya Therapeutics, Inc. Portable orthovoltage radiotherapy
CN101951990A (en) 2007-12-23 2011-01-19 Oraya治疗公司 Methods and devices for detecting, controlling, and predicting radiation delivery
US9229227B2 (en) 2010-02-28 2016-01-05 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a light transmissive wedge shaped illumination system
US8732795B2 (en) 2010-05-21 2014-05-20 Epic Systems Corporation System and method for user authentication
US9078612B2 (en) 2011-12-02 2015-07-14 Third Eye Diagnostics, Inc. Devices and methods for noninvasive measurement of intracranial pressure
US20130208952A1 (en) 2012-02-13 2013-08-15 Geoffrey Auchinleck Method and Apparatus for Improving Accuracy of Biometric Identification in Specimen Collection Applications
CA2867866C (en) 2012-03-26 2022-06-21 New York University Methods and kits for assessing central nervous system integrity
US9101312B2 (en) 2012-04-18 2015-08-11 TBI Diagnostics LLC System for the physiological evaluation of brain function
US8668337B2 (en) 2012-04-18 2014-03-11 TBI Diagnostics LLC System for the physiological evaluation of brain function
US9004687B2 (en) 2012-05-18 2015-04-14 Sync-Think, Inc. Eye tracking headset and system for neuropsychological testing including the detection of brain damage
KR102099473B1 (en) * 2012-07-31 2020-04-09 가부시키가이샤 니데크 Optometric apparatus
TWI470477B (en) * 2012-08-29 2015-01-21 Utechzone Co Ltd Eye-controlled communicating system
JP5924259B2 (en) * 2012-12-28 2016-05-25 株式会社ニデック Target presentation device
CN109124657B (en) * 2013-03-11 2021-11-23 亚特兰大儿童医疗保健公司 Systems and methods for detection of cognitive and developmental conditions
AU2014281725B2 (en) 2013-06-17 2019-10-10 New York University Methods and kits for assessing neurological and ophthalmic function and localizing neurological lesions
JP6797683B2 (en) * 2013-10-17 2020-12-09 チルドレンズ ヘルスケア オブ アトランタ, インコーポレイテッド A method for assessing infant and child development by eye tracking
US9459451B2 (en) 2013-12-26 2016-10-04 Microsoft Technology Licensing, Llc Eye tracking apparatus, method and system
WO2015164807A1 (en) 2014-04-25 2015-10-29 Texas State University Detection of brain injury and subject state with eye movement biometrics
KR102230172B1 (en) 2014-05-09 2021-03-19 아이플루언스, 인크. Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
EP3169218B1 (en) 2014-07-17 2019-11-27 I Sonic Medical Corporation S.A.S Measurement of ocular parameters using vibrations induced in the eye
CN107106006A (en) 2014-08-04 2017-08-29 纽约大学 For diagnosing, evaluating or quantifying medicine use, drug abuse and anesthesia, internuclear ophthalmoplegia, attention deficit hyperactivity disorder (ADHD), chronic traumatic encephalopathic, schizophrenia pedigree obstacle and the method and kit of alcohol consumption
US20170364732A1 (en) 2014-12-05 2017-12-21 Texas State University Eye tracking via patterned contact lenses
US20160213248A1 (en) 2015-01-22 2016-07-28 Ovard, Llc Gaze stabilization system and method
US20170091392A1 (en) 2015-05-01 2017-03-30 Steven C. White Biometric identification telemedicine software
CN108135738B (en) 2015-08-27 2021-10-08 伊奎诺克斯眼科公司 Eye-related in vivo pressure identification and correction
US11064881B2 (en) 2015-11-13 2021-07-20 Hennepin Healthcare System, Inc Method for predicting convergence disorders caused by concussion or other neuropathology
US10863902B2 (en) 2016-10-03 2020-12-15 Oculogica Inc. Method for detecting glaucoma
US10201274B2 (en) 2016-10-20 2019-02-12 Oculogica Inc Eye tracking system with biometric identification
US11141095B2 (en) 2017-02-17 2021-10-12 Oculogica Inc. Method and system for detecting concussion
CN111432727B (en) * 2017-09-13 2022-02-18 奥库洛吉卡公司 Eye tracking system

Also Published As

Publication number Publication date
WO2019055504A1 (en) 2019-03-21
US10729321B2 (en) 2020-08-04
US20190076016A1 (en) 2019-03-14
US11800974B2 (en) 2023-10-31
CA3075632C (en) 2024-01-02
AU2018334150C1 (en) 2023-05-11
JP2020533156A (en) 2020-11-19
AU2018334150A1 (en) 2020-04-09
CN114403802A (en) 2022-04-29
AU2018334150B2 (en) 2023-03-30
EP3668403A1 (en) 2020-06-24
CN111432727A (en) 2020-07-17
US20200315450A1 (en) 2020-10-08
EP3668403B1 (en) 2021-12-29
JP7247202B2 (en) 2023-03-28
CN111432727B (en) 2022-02-18
JP2023025228A (en) 2023-02-21

Similar Documents

Publication Publication Date Title
US10201274B2 (en) Eye tracking system with biometric identification
US11800974B2 (en) Eye tracking system
US8851678B2 (en) Visual perimeter measurement system and method
US9788714B2 (en) Systems and methods using virtual reality or augmented reality environments for the measurement and/or improvement of human vestibulo-ocular performance
US9706910B1 (en) Interactive system for vision assessment and correction
US11612316B2 (en) Medical system and method operable to control sensor-based wearable devices for examining eyes
US9314157B2 (en) Device to measure pupillary light reflex in infants and toddlers
US9050035B2 (en) Device to measure pupillary light reflex in infants and toddlers
RU2634682C1 (en) Portable device for visual functions examination
Vojtech et al. Integrated head-tilt and electromyographic cursor control
EP3402387B1 (en) Method, system and computer readable medium to determine a strabismus angle between the eyes of an individual
Pantanowitz et al. Addressing the eye fixation problem in gaze tracking for human computer interface using the vestibulo-ocular reflex
JP5351704B2 (en) Image sickness tolerance evaluation apparatus and program
CA3209930A1 (en) Head-mountable oculomotor assessment device and system, and method of using same
US20220240773A1 (en) Systems and methods for binocular vision evaluation and treatment
KR102292793B1 (en) Method for operating fundus camera providing customized inner target
WO2023081170A1 (en) Head-mountable assessment device, and method of using same
WO2018186251A1 (en) Head-mounted display supporting instrument and head-mounted display unit
Shrestha Gaze maps for video sequences: use of eye tracker to record the gaze of viewers of video sequences

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20230810

EEER Examination request

Effective date: 20230810

EEER Examination request

Effective date: 20230810

EEER Examination request

Effective date: 20230810

EEER Examination request

Effective date: 20230810