US6381339B1 - Image system evaluation method and apparatus using eye motion tracking - Google Patents

Image system evaluation method and apparatus using eye motion tracking Download PDF

Info

Publication number
US6381339B1
US6381339B1 US09005108 US510898A US6381339B1 US 6381339 B1 US6381339 B1 US 6381339B1 US 09005108 US09005108 US 09005108 US 510898 A US510898 A US 510898A US 6381339 B1 US6381339 B1 US 6381339B1
Authority
US
Grant status
Grant
Patent type
Prior art keywords
observer
image
gaze
eye
head
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US09005108
Inventor
Winton Emery Brown
Jeff Bennett Pelz
C. Andrew Hilgartner
Original Assignee
Winton Emery Brown
Jeff Bennett Pelz
C. Andrew Hilgartner
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date
Family has litigation

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00597Acquiring or recognising eyes, e.g. iris verification
    • G06K9/00604Acquisition
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Abstract

Image systems are compared and evaluated using an eyetracking apparatus. An observer views images made with different image systems. The eyetracking apparatus records the horizontal and vertical gaze position as a function of time.
The observer's judgments for one image system are compared to results for another image system.

Description

This application claims benefit of provisional application 60/035,516, filed Jan. 15, 1997.

This invention relates in general to image systems, and in particular to methods and apparatus for evaluating image systems.

BACKGROUND

An image system is designed to capture an image of an object and to display the captured image to a user. Image systems are used for a variety of purposes. Many image systems are based on photographic technology including well known silver halide image capture and development techniques of conventional photography. The imaging radiation may be visible light, infrared light, of x-rays. Other image systems are digital in nature and rely upon semiconductor arrays for capturing an image. Digital imaging systems include digital cameras, digital radiography (including but not limited to digital mammography), optical character/image recognition systems, and scanners. Still other imaging systems rely upon dry photography, such as electrophotography.

Any image system must reliably display the captured image. However, it is difficult to measure the reliability and accuracy of an imaging system. It is also difficult to compare on type of image system to another. For example, will a digital mammography system identify tumors as well as, better or worse than a traditional silver halide system. One measuring technique relies upon observer testing where the observer is asked to identify objects in an image. Such techniques are flawed because they fail to account for false positives.

Since 1966 others have used Receiver Operator Characteristic (ROC) for threshold level detection experiments used for making likelihood ratio discriminations between true signal and false signal presentations in detection experiments with noise present. Methods are known for estimating the ROC from detection data. Other researchers have provided a mathematical framework in which it is possible to conceive of detection imaging as a two stage process of visual abstraction followed by a signal evaluation stage). In the early '70s the ROC method was found to be deficient in radiographic detection tasks because of the identifiability problem, namely:

1) One can never be certain whether a particular response was due to a signal or whether it was spontaneously generated.

2) Even if one were assured that a response was due to some signal, and if the signals come at all close together, one cannot be certain to which signal it was due.

Still others attempted to resolve the identifiability problem by constraining the sampling window and by requiring that the observer specify the location of the detected image. Multiple signal presentations were also used. Such localization experiments were similarly considered as unsuccessful since they had the effect of reducing the scale of the problem but the same identifiability problem was operative at the reduced scale. The multiple signal detection experiments were an improvement but they pointed to the use of a still greater number of signals the number of which should be chosen randomly.

The Free Response Experiment was a great improvement in the experimental design providing for a realistic statistical interpretive framework for radiographic detection experiments. The false positive were assumed to be locally Poisson distributed which makes sense for an imaging process which generates false positive images on randomly generated fields of noise or on structured medical noise. Researchers working with the Radiological Medicine Group at the Mayo Clinic generated thousands of FROC detection data on 5 mm circles embedded in random fields of radiographic mottle. It was estimated the parameters of a FROC curve which was a non-linear relationship between the false positive rate and the corresponding fraction of true positive detected and scored with the appropriate ROC rating.

One researcher and coinventor of this invention, Winton Brown, independently noted that there were potentially serious ill-conditioned inference problems in the estimation procedures for the FROC parameters. This made it impossible to estimate the ROC parameters separate from the imaging rate parameters. Brown concluded that there were two columns of data missing which were necessary to estimate the ROC parameters from the FROC experiment. which were related to visual system affects arising from the deconvolution of image data from the radiographic mottle noise field. (True Negative imaging events and errors in the imaging of the True Positive events). Brown assumed that these were due to statistical behavior arising in the visual search and image abstraction process.. Estimating of the ROC from FROC data would require precision eyetracking, a technology which Dr. Harold Kundell was working with in tracking scan paths and saccades in teaching Radiographic Medicine.

Brown has described the problems with measuring the ROC from Free Response data and provided a formalized theoretical framework for understanding the problem of visual detection in fields of noise. He recommended using precision eyetracking to gather data in Free Response detection experiments.

SUMMARY/DETAILED DESCRIPTION/DRAWINGS

We have demonstrated the Free Response detection on his Applied Science Lab ASL 4000 SU, video based infrared LED Eyetracker. Our experiment indicated that the full range of imaging events and ROC statistics could readily be generated with the eyetracking instrument. We conducted a Threshold level Detection Experiment that is a comprehensive technique for measuring the image quality of an imaging system. That technique can be used throughout the field of Experimental Radiology and other imaging systems for determining the improvements in system detection performance.

The proposed uses for this technique are in general application of ROC type radiographic detection experiments specifically determining the detection performance as a function of the physical properties of the radiographic system. The technique has several applications:

1) Determine the suitability of the FDA standards for testing to determine the acceptability of a Mammography Radiographic System. (W. Moore, E.K. Co.)

2) Determine the effect of film contrast on the ability of a Radiologist to detect lesions in Mammography. (W. Wolski, E.K. Co.)

3)Determine the capability of computer aided Mammography when compared with human observers.

DRAWING

FIG. 1 is a photograph of a user wearing an apparatus of the invention;

FIG. 2a is a raw video from a headband mounted “eye camera” showing bright pupil and first Purkinje image;

FIG. 2b shows crosshair mark centroids of pupil and first Purkinje image computed by the tracker;

FIG. 3 is a plot of horizontal and vertical gaze positions as a function of time for a sample run of the method;

FIG. 4 is a video frame from the eyetracker scene monitor showing crosshair overlay on the image from the scene camera;

FIG. 5 is a schematic diagram of an alternate arrangement of the scene camera for reducing parallax error;

FIG. 6a illustrates a nine point calibration;

FIG. 6b illustrates a 17 point calibration;

FIG. 7 is a graph of a scan path analysis of vertical vs. horizontal gaze positions;

FIG. 8 is a graph of fixation density showing vertical vs. horizontal gaze position projected onto the image plane;

FIG. 9 is a graph of fixation density showing FROC response indicators;

FIG. 10 is a graph of the results of the demonstration of the ASL 4000 SU as described in the specification.

MONITORING GAZE POSITION

The human eye exhibits extreme anisotropy in visual acuity; the fovea, a small region in the center of the eye's visual field, has densely packed photoreceptors and high-density neural connections via the optic nerve. Outside the central fovea, resolution drops off sharply. As a result, human observers performing visual and/or visuo-motor tasks make frequent, rapid movements of the eye, repeatedly moving the direction of gaze to foveate a portion of the scene. Depending on the task, up to five such eye movements can be made every second, at rotational velocities approaching 1000°/sec. Because of the need to foveate items and/or details in such tasks, an externally observable marker for visual attention is available by monitoring the point of gaze.

Some method of determining an observer's point of gaze on the target is required for the disclosed process. Observers performing natural tasks typically move their point of gaze by moving their eyes and head in a coordinated sequence of movements. Artificially stabilizing the head in order to simplify the task of determining the observer's gaze direction affects performance, and can result in eye movement patterns substantially different than those made under natural viewing conditions. As a result, it is important that a method allowing natural eye and head movements be employed. Manual methods designed to determine the point of gaze such as requiring the observer to indicate his/her position of gaze on the target with a pointer are awkward, and observers are often unable to report gaze position accurately. Other methods, such as restricting the observer's field of view via a mask and/or limited illumination will not allow natural visual search.

A method of tracking the observer's gaze is therefore necessary. Many methods have been devised to achieve this, though it is only in recent years that methods allowing accurate measurements of gaze direction during natural behavior have become available. Among the methods available for monitoring the orientation of the eye in the head are:

Direct observation—The experimenter views the observer's eye (or views a film or video record of the observer's eye) and attempts to determine the gaze direction. Only rough estimates of gaze position are possible (e.g., quadrant determination).

Scleral coils—A small coil of wire is attached to a scleral contact lens and worn by the subject. Currents induced by static or dynamic magnetic fields are read and used to calculate the eye's position and orientation.

Limbus trackers—The borders between the limbus and iris are tracked, typically by IR photodiode arrays. By monitoring the position of the horizontal and vertical scleral borders, eye position can be deduced.

Purkinje image trackers—One or more of the Purkinje images (reflections from the air/cornea, cornea/aqueous humor, aqueous humor/eyelens, and/or eyelens/vitreous humor) interfaces are tracked. Tracking one image provides a measure related to the eye's rotation and translation; tracking more than one of the images allows rotation and translation movements to be separated for analysis. While very accurate and precise, the method requires that the head be artificially stabilized.

While any one of these or other methods could be used to track the eye, our current work has made use of video-based, infrared-illuminated, headband mounted eyetrackers. Combined with a method for monitoring head position and orientation in real-time, these trackers allow natural movements of the eye, head, and torso while providing adequate accuracy and precision (˜0.5/0.1°). Head movement was monitored with a six degree of freedom magnetic field tracker, though any method could be used (e.g., optical, ultrasound, video tracking, mechanical linkage employing optical, mechanical, or electrical position sensors, gyroscopic, accelerometer, etc.).

Monocular eye position was monitored with an Applied Science Laboratories (‘ASL’) Model E4000SU eyetracker and a lab computer. The ASL is a headband mounted, video-based, IR reflection eyetracker (FIG. 1 shows the eyetracker in use). A collimated infrared emitting diode (IRED) illuminates the eye, resulting in a ‘bright-pupil’ retroreflection from the subject's retina, and a first surface reflection at the cornea (the first Purkinje image). A monochrome CCD camera (without the standard IR rejection filter) is aligned coaxially with the illuminator to image the eye. FIG. 2a) shows the bright-pupil and first Purkinje images as captured by the eye-camera. The eye-camera image is digitized and thresholded at two levels in real-time by the eyetracker's control unit. The two threshold levels are adjusted manually so that pixels within the bright pupil are above threshold at one level, while only those pixels within the corneal reflection are above threshold at the second level. The centroid of the pupil and first Purkinje image are then computed by the lab computer. The control unit overlays crosshairs indicating the pupil and first Purkinje centroids on the image from the eye camera FIG. 2b) shows the resulting image as displayed on the ‘eye monitor.’

Tracking both pupil and first Purkinje images makes the system less sensitive to movement of the tracker with respect to the head because translation of the eye's image (caused by headband movement) causes both pupil and first Purkinje images to move together, while rotation causes differential motion of the two centroids. To reduce eye movement artefacts due to headband movement, eye-in-head position is calculated based on the relative location of the two centroids whenever both are present in the eye-camera image. If the system loses the first Purkinje image, eye position is calculated based on the pupil image alone until the first Purkinje image is re-acquired.

Because the system is video-based, eye position signals are limited to 60 Hz when a single interlace field is used for each eye position computation, or 30 Hz when a full frame (odd and even interlace fields) is used.

Gaze position (integrated eye-in-head and head-position and orientation) is calculated by using the eye-in-head signal described above and a head position/orientation signal from a magnetic field head-tracker that monitors the position and orientation of the head. An Ascension Technology magnetic field tracker (Model 6DFOB) was used to monitor the position and orientation of the head and the hand. The transmitter unit was mounted above and in front of the subject's head. The transmitter contains three orthogonal coils that are energized in turn. The receiver unit contains three orthogonal ‘antennae’ coils which detect the transmitters' signals. Position and orientation of the receiver are determined from the absolute and relative strengths of the transmitter/receiver coil pairs. The position of the sensor is reported as the (x, y, z) position with respect to the transmitter, and orientation as azimuth, elevation, and roll angles.

The eyetracker reports gaze position as the (x,y) intersection of the line-of-sight with the working plane. The digital data stream containing eye-in-head, head orientation and position, and gaze intercept are read from the eyetracker. The digital data stream is collected on a computer for storage and analysis. FIG. 3 shows a plot of horizontal and vertical gaze position as a function of time for a sample run of the disclosed process.

In addition to this digital data stream, the eyetracker provides a video record of eye position. The headband holds a miniature “scene-camera” to the side of the subject's head, aimed at the scene (see FIG. 1). The eyetracker creates a crosshair overlay indicating eye-in-head position that is merged with the video from the scene-camera, providing a video record of the scene from the subject's perspective on the scene-monitor, along with a crosshair indicating the intersection of the subject's gaze with the working plane (see FIG. 4). Because the scene-camera moves with the head, the eye-in-head signal indicates the gaze point with respect to the world. Head movements appear on the record as full field image motion. The scene-camera can be fitted with a range of lenses to match the field of view to the specific task.

If the scene camera is not coaxial with the line of sight, calibration of the video signal is strictly correct for only a single distance. All gaze points are in the plane of the working board, and subjects typically do not change their distance from the board substantially, so the parallax error is not significant in this task, though it can be significant in tasks not constrained to a near-vertical plane. The parallax error can be eliminated by repositioning the scene-camera below the visor so that it is collinear with the eye-camera (see FIG. 5). While this orientation eliminates parallax error, it severely restricts the field of view of the scene-camera. In addition, image contrast and chroma are reduced due to the poor reflectance within the visible spectrum and flare from the IRED illuminator.

The eye-in-space signal calculated by the eyetracker by integrating the eye-in-head and head position/orientation signals is not affected by parallax—the scene camera is used only during calibration when the distance to the scene is fixed. After initial calibration, the gaze intersection is calculated by projecting the eye-in-head position onto a ‘virtual calibration plane’ at the same distance as the calibration plane during calibration. The vector defined by the eye center and the intersection with the ‘virtual plane’ is then rotated based on the head position/orientation signal, and projected onto the working plane.

The eyetracker must be calibrated for each subject before each trial session to ensure optimal accuracy. Calibrating the eyetracker requires three steps—1) entering the position of the calibration plane's reference points, 2) locating the calibration points (9 or 17 points; see FIG. 6), and 3) recording the subject's pupil and first Purkinje centroids as each point in the calibration target is fixated.

In the final step, the observer's head is steadied and s/he is instructed to fixate each calibration target in turn, so that raw pupil and first Purkinje images can be collected at each point. The calibration function is determined by an algorithm based on the known target positions and the raw pupil and corneal reflection positions. The calibration can be performed with 9 or 17 points, as shown in FIG. 6. The 17-point calibration target increases accuracy by allowing the target points to cover a larger area while reducing the area over which eye-position data must be interpolated. The 17-point target is especially critical when the scene-camera is fitted with a wide-angle lens that suffers from barrel distortion.

For each trial, the subject was seated, fitted with the eyetracker, and calibrated. The image under test (the ‘plate’) was placed on a light box approx 50 cm from the observer. The observer was instructed to view the plate at his/her own pace, and to report to the experimenters any targets. Along with reporting that a target had been located, the observer reported a ‘confidence’ measure (1,2,3, or 4 in this experiment, though any scale could be used). In addition to reporting the signal detection verbally, the observer also pressed a key on the computer, which caused the value to be stored in the digital data stream. While a keypress was used in this case, any method of signaling the detection confidence could be used (e.g., rotary encoder, joystick position, slider, etc.).

FIG. 3 shows the horizontal and vertical eye position as a function of time for a 60 second trial. FIG. 7 shows the same data plotted as a scanpath—vertical vs. horizontal gaze in the plane. FIG. 8 shows the same data plotted in terms of the fixation density throughout the trial. The regions that attracted the longest fixations are more easily identified in such a plot. FIG. 9 shows the fixation density, along with a graphical indication of the FROC confidence rankings entered during this period of the trial.

A demonstration of the Applied Science Laboratory ASL 4000 SU, video based, infrared LED Eyetracker with demonstration FROC plates from our previous work in 1982 was made. The eyetracking instrument was calibrated and demonstrated on the #1 FROC plate. Plate #1 had four true signal presentations of a five millimeter circle with 0″ of obscurating lucite for maximum observation clarity of the image. The experiment succeeded in searching out and abstracting all of the four true signal on the plate and scoring them with an ROC value coded as Blue: High likelihood, Green: Medium likelihood, Brown: Low Likelihood, Red: Marginal likelihood. (see FIG. 10). The dot distributions show eye gaze locations for every {fraction (1/10)}th of a second interval throughout the observation session. The dot patterns tend to cluster around imaging events which tend to attract foveal visual attention. The registration tends to be slightly off and is due to calibration error. There are two areas of dot clusters on the right side indicated with a Red ROC mark indicating a marginal likelihood of true signal presentation. These are categorized as false positive detection events. The cluster located at (−8, −3) we considered to be a true negative event. The other cluster at (0,5) is also possibly a true negative event. On this plate there was no false negatives or negative imaging events of a true signal presentation.

Another experiment used Plate #3 which has nine true signal presentations and has 2″ of obscurating lucite which raises the noise level and tends to obscure the 5 mm circles. That experiment found five of the true signal presentations and generated four false positives.

A third experiment again tried Plate #3. The head gear was readjusted and a recalibration of the system was performed. The observer learned how to use the equipment with very little practice and proceeded to find four of the true signal presentations and also generated four false positives.

OTHER APPLICATIONS

The invention may be applied to a number of imaging applications. These include but are not limited to:

(1) calibration of computer image enhancement algorithms;

(2) measurement of image quality;

(3) analysis of photo-interpretation of reconnaissance imagery;

(4) industrial radiology;

(5) measuring how image data affects a visual search process;

(6) measuring how a person processes visual information;

(7) training individuals to perform visual inspection and/or tasks based on visual inspection;

(8) treating a research on metal illness, especially testing a treatment of illnesses such a schizophrenia where visual image identification is and tracking is a measure of the illness.

Claims (1)

What we claim is:
1. A method for using an eyetracking apparatus for comparing a first imaging system to a second imaging system by comparing an observer's judgements about one or more targets imaged in the first imaging system with the observer's judgements about the targets imaged in the second imaging system, including the steps of:
providing the observer with first and second images of first and second targets imaged by corresponding first and second imaging systems, each image containing target signal data and noise;
tracking the movements of the eyes and head of the observer with an eyetracking apparatus in order to generate data on the horizontal and vertical gaze positions as a function of time for the gaze of the observer on the images;
recording observer judgments on where the image contains true target signal data;
comparing the observer judgements to reference target signal data locations to determine whether the observer has made one or more true positive, false positive, true negative, or false negative judgements;
correlating the observer judgments to data on the horizontal and vertical gaze positions as a function of time for the gaze of the observer on the images in order to identify the gaze data that correspond to the true positive, false positive, true negative, or false negative judgements of the observer;
comparing results of one image system to the other.
US09005108 1997-01-15 1998-01-09 Image system evaluation method and apparatus using eye motion tracking Expired - Lifetime US6381339B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US3551697 true 1997-01-15 1997-01-15
US09005108 US6381339B1 (en) 1997-01-15 1998-01-09 Image system evaluation method and apparatus using eye motion tracking

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US09005108 US6381339B1 (en) 1997-01-15 1998-01-09 Image system evaluation method and apparatus using eye motion tracking

Publications (1)

Publication Number Publication Date
US6381339B1 true US6381339B1 (en) 2002-04-30

Family

ID=26673941

Family Applications (1)

Application Number Title Priority Date Filing Date
US09005108 Expired - Lifetime US6381339B1 (en) 1997-01-15 1998-01-09 Image system evaluation method and apparatus using eye motion tracking

Country Status (1)

Country Link
US (1) US6381339B1 (en)

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030086061A1 (en) * 2001-10-01 2003-05-08 Ernst Pfleger Method for detecting, evaluating, and analyzing look sequences
US20030156304A1 (en) * 2002-02-19 2003-08-21 Eastman Kodak Company Method for providing affective information in an imaging system
US20040001614A1 (en) * 2002-06-26 2004-01-01 Russon Virgil Kay Image correction system and method
US6687530B2 (en) * 2001-12-21 2004-02-03 General Electric Company Method and system for tracking small coils using magnetic resonance
WO2005076590A1 (en) * 2004-02-10 2005-08-18 Smallteck S.N.C. Di F. Maringelli & Co. Method and device for the transmission of images to devices provided with small displays
US20050195165A1 (en) * 2004-03-02 2005-09-08 Mitchell Brian T. Simulated training environments based upon foveated object events
US20050225723A1 (en) * 2004-03-25 2005-10-13 Maurizio Pilu Self-calibration for an eye tracker
US20060290663A1 (en) * 2004-03-02 2006-12-28 Mitchell Brian T Simulated training environments based upon fixated objects in specified regions
FR2891725A1 (en) * 2005-10-06 2007-04-13 Synapsys Sa Procedure for analysing a person's eye movements from image acquisition to determine effect of head movements on semi-ciircular channels of inner ear
US20070093930A1 (en) * 2003-10-17 2007-04-26 Griggs Anthony J Machine system in which measuring-machine instructions are translated into machine-tool instructions
US7401920B1 (en) 2003-05-20 2008-07-22 Elbit Systems Ltd. Head mounted eye tracking and display system
US7649536B1 (en) * 2006-06-16 2010-01-19 Nvidia Corporation System, method, and computer program product for utilizing natural motions of a user to display intuitively correlated reactions
US20100121812A1 (en) * 2008-11-11 2010-05-13 Oracle International Corporation Using dotplots for comparing and finding patterns in sequences of data points
US20100141380A1 (en) * 2007-05-08 2010-06-10 Davar Pishva Spectroscopic method and system for multi-factor biometric authentication
US8020993B1 (en) 2006-01-30 2011-09-20 Fram Evan K Viewing verification systems
US20110275959A1 (en) * 2006-08-30 2011-11-10 Henry Eloy Sand Casali Portable system for monitoring the position of a patient's head during videonystagmography tests (vng) or electronystagmography (eng)
US8180209B2 (en) * 2010-05-19 2012-05-15 Eastman Kodak Company Determining camera activity from a steadiness signal
US8180208B2 (en) * 2010-05-19 2012-05-15 Eastman Kodak Company Identifying a photographer
US8200076B2 (en) * 2010-05-19 2012-06-12 Eastman Kodak Company Estimating gender or age of a photographer
JP2013210909A (en) * 2012-03-30 2013-10-10 Dainippon Printing Co Ltd Viewpoint guidance device and electronic book terminal
JP2013210907A (en) * 2012-03-30 2013-10-10 Dainippon Printing Co Ltd Viewpoint guidance device and electronic book terminal
US8736692B1 (en) 2012-07-09 2014-05-27 Google Inc. Using involuntary orbital movements to stabilize a video
US20140146156A1 (en) * 2009-01-26 2014-05-29 Tobii Technology Ab Presentation of gaze point data detected by an eye-tracking unit
JP2014149794A (en) * 2013-02-04 2014-08-21 Tokai Univ Visual line analysis device
US8885882B1 (en) 2011-07-14 2014-11-11 The Research Foundation For The State University Of New York Real time eye tracking for human computer interaction
US20150063635A1 (en) * 2012-03-22 2015-03-05 Sensomotoric Instruments Gesellschaft Fur Innovati Sensorik Mbh Method and apparatus for evaluating results of gaze detection
US9207760B1 (en) * 2012-09-28 2015-12-08 Google Inc. Input detection
US20170007118A1 (en) * 2013-11-29 2017-01-12 Universiteit Van Amsterdam Apparatus and method for estimating gaze from un-calibrated eye measurement points

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3883235A (en) * 1971-09-17 1975-05-13 John R Lynn Automatic visual field examination including fixation monitoring compensation
US4479784A (en) * 1981-03-03 1984-10-30 The Singer Company Eye line-of-sight responsive wide angle visual system
US4789235A (en) * 1986-04-04 1988-12-06 Applied Science Group, Inc. Method and system for generating a description of the distribution of looking time as people watch television commercials
US4859050A (en) * 1986-04-04 1989-08-22 Applied Science Group, Inc. Method and system for generating a synchronous display of a visual presentation and the looking response of many viewers
US4931865A (en) * 1988-08-24 1990-06-05 Sebastiano Scarampi Apparatus and methods for monitoring television viewers
US4973149A (en) * 1987-08-19 1990-11-27 Center For Innovative Technology Eye movement detector
US5220361A (en) * 1991-06-05 1993-06-15 Allergan Humphrey Gaze tracking for field analyzer
US5341181A (en) * 1992-11-20 1994-08-23 Godard Roger R Systems and methods for capturing and presentng visual information
US5345944A (en) * 1992-08-12 1994-09-13 Atr Auditory And Visual Perception Research Laboratories Apparatus for medical diagnosis utilizing masking of fixation point
US5491757A (en) * 1993-12-22 1996-02-13 Humphrey Instruments, Inc. Field tester gaze tracking using content addressable memories to improve image data analysis speed

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3883235A (en) * 1971-09-17 1975-05-13 John R Lynn Automatic visual field examination including fixation monitoring compensation
US4479784A (en) * 1981-03-03 1984-10-30 The Singer Company Eye line-of-sight responsive wide angle visual system
US4789235A (en) * 1986-04-04 1988-12-06 Applied Science Group, Inc. Method and system for generating a description of the distribution of looking time as people watch television commercials
US4859050A (en) * 1986-04-04 1989-08-22 Applied Science Group, Inc. Method and system for generating a synchronous display of a visual presentation and the looking response of many viewers
US4973149A (en) * 1987-08-19 1990-11-27 Center For Innovative Technology Eye movement detector
US4931865A (en) * 1988-08-24 1990-06-05 Sebastiano Scarampi Apparatus and methods for monitoring television viewers
US5220361A (en) * 1991-06-05 1993-06-15 Allergan Humphrey Gaze tracking for field analyzer
US5345944A (en) * 1992-08-12 1994-09-13 Atr Auditory And Visual Perception Research Laboratories Apparatus for medical diagnosis utilizing masking of fixation point
US5341181A (en) * 1992-11-20 1994-08-23 Godard Roger R Systems and methods for capturing and presentng visual information
US5491757A (en) * 1993-12-22 1996-02-13 Humphrey Instruments, Inc. Field tester gaze tracking using content addressable memories to improve image data analysis speed

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
Bunch, P. C. Hamilton, J.F., Sanderson, G. K., Simmons, A.H.: "A Free-Response Approach to the Measurement and Characterization of Radiographic-Observer Performance," Journal of Applied Photographic Engineering, 1978, vol. 4, No. 4, pp. 166-171.
Green, D.M., Swets, J.A.: "Signal Detection Theory and Psychophysics," 1966, New York, Wiley.
Hilgartner, C.A., Randolph, J.F.: "Psycho-Logics, An Axiomatic System Describing Human Behavior," Journal of Theoretical Biology, 1969, vol. 23, pt. 1, pp. 285-337, pt. 2, pp. 347-374.
Krupinski, E.A., Nodine, C.F., Kundel, H.L.: "Enchancing Recognition of Lesions in Radiographic Images Using Perceptual Feedback", Society of Photo-Optical Instrumentation Engineers, Mar., 1998, vol. 37(3), pp. 813-818.
Kundel, H.L., Nodine, C.F., Krupinski, E.A.: "Computer-Displayed Eye Position as an Aid to Pulmonary Nodule Interpretation," Investigative Radiology, 1990, vol. 25, pp. 890-896.
Marr, David: "Vision, A Computational Investigation into the Human Representation and Processing of Visual Information," W.H. Freeman & Company, San Francisco, 1982, pp. 3-36, 41-101.
Noton et al, Eye Movements and Visual Perception, Scientific American, pp. 34-43, Jun, 19.* *
Phillips, R.A.: "Information for Manufacturers Seeking Marketing Clearance of Digital Mammography Systems", Computed Imaging Devices, Office of Device Branch, Division of Reproductive, Abdominal, Ear, Nose, Throat, and Radiological Devices Evaluation, Jun. 19, 1996.

Cited By (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030086061A1 (en) * 2001-10-01 2003-05-08 Ernst Pfleger Method for detecting, evaluating, and analyzing look sequences
US6997556B2 (en) * 2001-10-01 2006-02-14 Ernst Pfleger Method for detecting, evaluating, and analyzing look sequences
US6687530B2 (en) * 2001-12-21 2004-02-03 General Electric Company Method and system for tracking small coils using magnetic resonance
US7327505B2 (en) * 2002-02-19 2008-02-05 Eastman Kodak Company Method for providing affective information in an imaging system
US20030156304A1 (en) * 2002-02-19 2003-08-21 Eastman Kodak Company Method for providing affective information in an imaging system
US20040001614A1 (en) * 2002-06-26 2004-01-01 Russon Virgil Kay Image correction system and method
US7177449B2 (en) * 2002-06-26 2007-02-13 Hewlett-Packard Development Company, L.P. Image correction system and method
US7401920B1 (en) 2003-05-20 2008-07-22 Elbit Systems Ltd. Head mounted eye tracking and display system
US20070093930A1 (en) * 2003-10-17 2007-04-26 Griggs Anthony J Machine system in which measuring-machine instructions are translated into machine-tool instructions
WO2005076590A1 (en) * 2004-02-10 2005-08-18 Smallteck S.N.C. Di F. Maringelli & Co. Method and device for the transmission of images to devices provided with small displays
US9652032B2 (en) * 2004-03-02 2017-05-16 Brian T. Mitchell Simulated training environments based upon fixated objects in specified regions
US20060290663A1 (en) * 2004-03-02 2006-12-28 Mitchell Brian T Simulated training environments based upon fixated objects in specified regions
US20050195165A1 (en) * 2004-03-02 2005-09-08 Mitchell Brian T. Simulated training environments based upon foveated object events
US8721341B2 (en) * 2004-03-02 2014-05-13 Optimetrics, Inc. Simulated training environments based upon foveated object events
US20050225723A1 (en) * 2004-03-25 2005-10-13 Maurizio Pilu Self-calibration for an eye tracker
US7657062B2 (en) * 2004-03-25 2010-02-02 Hewlett-Packard Development Company, L.P. Self-calibration for an eye tracker
FR2891725A1 (en) * 2005-10-06 2007-04-13 Synapsys Sa Procedure for analysing a person's eye movements from image acquisition to determine effect of head movements on semi-ciircular channels of inner ear
US8020993B1 (en) 2006-01-30 2011-09-20 Fram Evan K Viewing verification systems
US8696121B1 (en) 2006-01-30 2014-04-15 Evan K. Fram Viewing verification systems
US7649536B1 (en) * 2006-06-16 2010-01-19 Nvidia Corporation System, method, and computer program product for utilizing natural motions of a user to display intuitively correlated reactions
US20110275959A1 (en) * 2006-08-30 2011-11-10 Henry Eloy Sand Casali Portable system for monitoring the position of a patient's head during videonystagmography tests (vng) or electronystagmography (eng)
US8284019B2 (en) * 2007-05-08 2012-10-09 Davar Pishva Spectroscopic method and system for multi-factor biometric authentication
US20100141380A1 (en) * 2007-05-08 2010-06-10 Davar Pishva Spectroscopic method and system for multi-factor biometric authentication
US8463733B2 (en) 2008-11-11 2013-06-11 Oracle International Corporation Using dotplots for comparing and finding patterns in sequences of data points
US20100118030A1 (en) * 2008-11-11 2010-05-13 Oracle International Corporation Radial vector plots for paths
US20100119111A1 (en) * 2008-11-11 2010-05-13 Oracle International Corporation Time expansion for displaying path information
US20100118267A1 (en) * 2008-11-11 2010-05-13 Oracle International Corporation Finding sequential matches in eye tracking data
US20100118032A1 (en) * 2008-11-11 2010-05-13 Oracle International Corporation Radial histograms for depicting path information
US20100119112A1 (en) * 2008-11-11 2010-05-13 Oracle International Corporation Graphical representations for aggregated paths
US8390626B2 (en) * 2008-11-11 2013-03-05 Oracle International Corporation Radial histograms for depicting path information
US8432399B2 (en) * 2008-11-11 2013-04-30 Oracle International Corporation Radial vector plots for paths
US20100121812A1 (en) * 2008-11-11 2010-05-13 Oracle International Corporation Using dotplots for comparing and finding patterns in sequences of data points
US8434867B2 (en) 2008-11-11 2013-05-07 Oracle International Corporation Finding sequential matches in eye tracking data
US8451272B2 (en) 2008-11-11 2013-05-28 Oracle International Corporation Time expansion for displaying path information
US8436859B2 (en) * 2008-11-11 2013-05-07 Oracle International Corporation Graphical representations for aggregated paths
US9037528B2 (en) 2008-11-11 2015-05-19 Oracle International Corporation Using dotplots for comparing and finding patterns in sequences of data points
US9779299B2 (en) * 2009-01-26 2017-10-03 Tobii Ab Method for displaying gaze point data based on an eye-tracking unit
US20140146156A1 (en) * 2009-01-26 2014-05-29 Tobii Technology Ab Presentation of gaze point data detected by an eye-tracking unit
US8180209B2 (en) * 2010-05-19 2012-05-15 Eastman Kodak Company Determining camera activity from a steadiness signal
US8180208B2 (en) * 2010-05-19 2012-05-15 Eastman Kodak Company Identifying a photographer
US8200076B2 (en) * 2010-05-19 2012-06-12 Eastman Kodak Company Estimating gender or age of a photographer
US8885882B1 (en) 2011-07-14 2014-11-11 The Research Foundation For The State University Of New York Real time eye tracking for human computer interaction
US9639745B2 (en) * 2012-03-22 2017-05-02 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Method and apparatus for evaluating results of gaze detection
US20150063635A1 (en) * 2012-03-22 2015-03-05 Sensomotoric Instruments Gesellschaft Fur Innovati Sensorik Mbh Method and apparatus for evaluating results of gaze detection
JP2013210909A (en) * 2012-03-30 2013-10-10 Dainippon Printing Co Ltd Viewpoint guidance device and electronic book terminal
JP2013210907A (en) * 2012-03-30 2013-10-10 Dainippon Printing Co Ltd Viewpoint guidance device and electronic book terminal
US8736692B1 (en) 2012-07-09 2014-05-27 Google Inc. Using involuntary orbital movements to stabilize a video
US9207760B1 (en) * 2012-09-28 2015-12-08 Google Inc. Input detection
JP2014149794A (en) * 2013-02-04 2014-08-21 Tokai Univ Visual line analysis device
US20170007118A1 (en) * 2013-11-29 2017-01-12 Universiteit Van Amsterdam Apparatus and method for estimating gaze from un-calibrated eye measurement points
US9924865B2 (en) * 2013-11-29 2018-03-27 Universiteit Van Amsterdam Apparatus and method for estimating gaze from un-calibrated eye measurement points

Similar Documents

Publication Publication Date Title
Perrone Model for the computation of self-motion in biological systems
US5870167A (en) Apparatus and method for imaging anterior structures of the eye
US5125730A (en) Portable dynamic fundus instrument
US5784145A (en) Apparatus for determining pupil dimensions
US4834528A (en) Infrared photoretinoscope
US6260968B1 (en) Pupilometer with pupil irregularity detection capability
US20110230755A1 (en) Single camera motion measurement and monitoring for magnetic resonance applications
US8824779B1 (en) Apparatus and method for determining eye gaze from stereo-optic views
US5094521A (en) Apparatus for evaluating eye alignment
Young et al. Survey of eye movement recording methods
US5838420A (en) Method and apparatus for ocular motility testing
US3724932A (en) Eye tracker and method
US6580448B1 (en) Process and device for the parallel capture of visual information
US20050094099A1 (en) Apparatus and method for diagnosis of optically identifiable ophthalmic conditions
Ji et al. Real time visual cues extraction for monitoring driver vigilance
Zhu et al. Robust pupil center detection using a curvature algorithm
US6276799B1 (en) Stereo optic disc analyzer
US5311879A (en) Medical diagnostic apparatus utilizing line-of-sight detection
US20110228975A1 (en) Methods and apparatus for estimating point-of-gaze in three dimensions
US7538744B1 (en) Method and apparatus for computer-aided determination of viewer's gaze direction
US20030206272A1 (en) Ocular fundus auto imager
US5668622A (en) Device for measuring the position of the fixing point of an eye on a target, method for illuminating the eye and application for displaying images which change according to the movements of the eye
US5891060A (en) Method for evaluating a human joint
Young et al. Eye-movement measurement techniques.
US20080278682A1 (en) Systems and methods For Improving Visual Discrimination

Legal Events

Date Code Title Description
FPAY Fee payment

Year of fee payment: 4

REMI Maintenance fee reminder mailed
FPAY Fee payment

Year of fee payment: 8

SULP Surcharge for late payment

Year of fee payment: 7

FPAY Fee payment

Year of fee payment: 12