WO1986001963A1 - Ameliorations relatives a un procede et appareil de commande par la direction du regard - Google Patents

Ameliorations relatives a un procede et appareil de commande par la direction du regard Download PDF

Info

Publication number
WO1986001963A1
WO1986001963A1 PCT/AU1985/000232 AU8500232W WO8601963A1 WO 1986001963 A1 WO1986001963 A1 WO 1986001963A1 AU 8500232 W AU8500232 W AU 8500232W WO 8601963 A1 WO8601963 A1 WO 8601963A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
eye
calibration
viewing
eye gaze
Prior art date
Application number
PCT/AU1985/000232
Other languages
English (en)
Inventor
Andrew Richard Downing
Original Assignee
The University Of Adelaide
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The University Of Adelaide filed Critical The University Of Adelaide
Priority to GB8612298A priority Critical patent/GB2177276A/en
Publication of WO1986001963A1 publication Critical patent/WO1986001963A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor

Definitions

  • This invention relates to a method and apparatus associated with control through direction of eye gaze.
  • this invention addresses to provide reliable means by which reasonable alignment can be maintained.
  • the problem is to interpret whether a user has a temporary difficulty such as for instance a tremor, or whether a major shift to relative positions has occurred so that original alignment characteristics no longer apply.
  • An object of this invention accordingly is to provide means which will maintain through even difficult situations, good correspondence between a viewing direction of a user and a screen based cursor.
  • a source of radiant energy providing a beam of light which when directed into a person ' s eye will result in a reflection and the position of this reflection with respect to the eye is responsive to the direction of gaze of that person.
  • a beam of radiant energy is shone into a person's eye, it is possible to identify the reflection of that radiant energy from an appropriate portion of the eye and by knowing the position and direction of the beam of radiant energy, it then becomes possible by determining the location of intersection onto a target which has a known relationship with respect to the source of the beam, some assumptions as to the gaze direction of the eye.
  • the purpose of this invention is to provide a technique for effecting a calibration procedure so as to provide for any proposed user and a system either a higher accuracy than has hitherto been available or a method to achieve such accuracy which has advantage over any system that has hitherto been used.
  • the techniques involve both computers, hardware items of appropriate type, and software control of the hardware items.
  • the invention can be said to reside in an eye gaze direction control arrangement including ⁇
  • such an activation signal as can be effected by the user can include interrupting the reflected light pathway a selected number of times within a selected time period. This can simply mean the closing of the eyelids twice within a two-second period which would not be a normal closure and opening rate, but is something that a user can easily and quickly achieve even in most extreme circumstances.
  • a turning away of the eye so that reflection communication is entirely lost, can also be used to achieve this result.
  • any limb movement can be used either to intersect a communicating beam or in another instance such movement can be used to activate a switch which can be interrogated from time to time in any controlling programme.
  • Assistance can be achieved by using a second calibration viewing target location and then comparing correction factors that need to be applied in the case of one location as compared to the second, and if there is not a sufficiently close correlation, proceed to a further calibration viewing target location and comparing again a correction factor with previous results.
  • recalibration is effected by a first calibration viewing target location to be caused to be noticeable by a user, and causing information to be stored identifying the angular direction then detected of a reflection of the radiant beam from the eye when it is to be expected to be viewing the calibration viewing target location then causing a second calibration viewing target location to be noticeable by the user, at a position different from the first said calibration position and such as to cause the eye of a user to assume a different angular relationship with respect to the detection equipment and causing information identifying such second angular position to be stored and then effecting a correction factor to be used for maintaining alignment of the position of the cursor on the screen with a viewing direction of the user.
  • the calibration viewing targets are located in a non axial alignment such as along a horizontal axis, or in a further case along a vertical axis.
  • the said means are adapted to compare the correction factor calculated for the first of the target locations with a correction factor calculated for the second target locations and if the difference between the two is larger than a selected allowable difference, provide for a further target location to be offered to the user and continue the calculation of correction factor and comparison until at least two target locations provide a correction factor within the selected range.
  • target locations needed to be offered exceeds a selected number, then there will be provided an enlargement of the range of acceptable difference in correction factor and a continuing offering of target locations.
  • the method of this invention can be said to reside in the method of determining eye gaze direction control which includes the steps of directing a light source through a user's eye and detecting such reflection with means to enable the viewing direction of the eye to then be determinable subject to calibration, and providing a calibration of a cursor viewing direction alignment upon an activating signal being effected by the user.
  • FIG. 1 is a schematic drawing showing a user arranged with a viewing screen and with a target light being directed through the eye of the user and being detected by a video type camera.
  • the user 1 is positioned facing a video screen 2 with eyes 3 in approximate horizontal alignment.
  • a small target light 4 radiates light onto the eyes 3 so that the position of the reflection of this light from the eyes is detectable within the video camera 5.
  • Such an arrangement is a known arrangement.
  • a calibration technique in which a first calibration viewing target location 7 is displayed on the video screen 2 this comprising a cross which is rotated about its centre fast enough to be noticeable but not too fast as to be indistinguishable.
  • a rotation speed can be two rotations each second.
  • the programme provides for the first calibration viewing target location 7 to be maintained for a sufficient period of time for calculation of a new correction factor, and also to ensure consistent viewing direction during a first calibration period of time.
  • Such a period for the first location 7 can be three seconds after which a second location at 8 is then used, after which a third location 9 is used, after which a fourth location 10 is used.
  • a further correction factor is calculated, such a correction factor being a discernible difference between a first standard x and y co-ordinate position of a cursor and the difference that would appear to be necessary to bring the cursor to a new position being the actual viewing impact position of the eye of the user 3.
  • the programme is adapted to compare the respective correction factors and if necessary compare any difference between the two correction factors to a preselected maximum tolerance.
  • the average of the two correction factors can be calculated and placed in memory for then afterwards continuing application to each of the incoming detected reflected eye angular relationships.
  • the cutting off of reflection can be achieved in any of many different ways, but according to this embodiment this is achieved by the eyelids of the user being closed within the time constraint of two times within a two-second period.
  • the apparatus will not be able to readily interpret whether the shut-off of reflection is by way of an eyelid or by way of a full turning of the head away from the viewing apparatus, but of course the result can be the same provided the same time restraint is achieved.
  • a separately activated switch can be operated and can be discernible to call for a recalibration attempt sequence in a further embodiment.
  • the apparatus is intended to be of value to even the most highly handicapped persons and it is well understood that in some instances accuracy of alignment of eye direction is less important than continuing ability to control the position of a cursor and activities controlled by such position, even though such control within an adequate correction factor might be quite approximate.
  • the appartus and techniques are applied by computer programmes.
  • a further signal can include detection of a selected eye movement of the user, or sequence of movements.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Biophysics (AREA)
  • Multimedia (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Position Input By Displaying (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

Un agencement de commande par la direction du regard utilise une source de lumière (4) et un détecteur (5) qui donne la direction du regard en détectant la position sur l'oeil (3) d'un utilisateur de la réflexion de la source de lumière et en utilisant cette information pour situer la position d'un curseur sur un écran vidéo (2) et fournir une initialisation de recalibrage pouvant être effectuée par l'utilisateur afin d'assurer l'alignement constant de ce curseur avec la direction réelle du regard. L'utilisateur (1) peut initialiser le calibrage en créant des interruptions multiples de la lumière incidente pendant une période prédéterminée de temps (par exemple en clignotant des yeux). L'utilisateur (1) est ensuite sensé diriger son regard sur divers endroits prédéterminés (7, 8, 9, 10) dont la moyenne fournit le calibrage.
PCT/AU1985/000232 1984-09-24 1985-09-24 Ameliorations relatives a un procede et appareil de commande par la direction du regard WO1986001963A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB8612298A GB2177276A (en) 1984-09-24 1985-09-24 Improvements relating to an apparatus and method related to control through eye gaze direction

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AUPG729284 1984-09-24
AUPG7292 1984-09-24

Publications (1)

Publication Number Publication Date
WO1986001963A1 true WO1986001963A1 (fr) 1986-03-27

Family

ID=3770772

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU1985/000232 WO1986001963A1 (fr) 1984-09-24 1985-09-24 Ameliorations relatives a un procede et appareil de commande par la direction du regard

Country Status (3)

Country Link
JP (1) JPS62500493A (fr)
GB (1) GB2177276A (fr)
WO (1) WO1986001963A1 (fr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1987007497A1 (fr) * 1986-06-04 1987-12-17 P Lsg Rd Goete Dispositif optique
EP0294812A2 (fr) * 1987-06-10 1988-12-14 Research Development Foundation Contrôleur de calibration pour contrôler des machines actionnées électriquement
FR2648243A1 (fr) * 1989-06-09 1990-12-14 Metrovision Sarl Procede d'asservissement des moyens de reglage d'un appareil optique, moyens pour la mise en oeuvre de ce procede et appareils equipes de ces moyens
WO1991006263A1 (fr) * 1989-11-07 1991-05-16 Paalsgaard Goete Dispositif de communication
US5621424A (en) * 1992-08-24 1997-04-15 Olympus Optical Co., Ltd. Head mount display apparatus allowing easy switching operation from electronic image to external field image
US5767821A (en) * 1989-11-07 1998-06-16 Paalsgaard; Goete Communication device
DE19906706A1 (de) * 1999-02-18 2000-08-24 Bayerische Motoren Werke Ag Instrumentenfeld mit virtuellem Display
US7158097B2 (en) 2002-10-09 2007-01-02 Canon Kabushiki Kaisha Gaze tracking system

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3186072B2 (ja) * 1991-01-08 2001-07-11 キヤノン株式会社 視線検出装置を有する機器
DE69323115T2 (de) * 1992-06-02 1999-08-05 Canon K.K., Tokio/Tokyo Optisches gerät mit Blickrichtungserfassung
GB2273991B (en) * 1992-09-07 1996-04-17 Canon Kk Optical equipment with device for detecting direction of visual axis
DE4330265B4 (de) * 1992-09-07 2004-07-29 Canon K.K. Vorrichtung zum Erfassen der Sehachse eines Auges einer ein optisches Gerät bedienenden Person
US6035054A (en) * 1992-10-29 2000-03-07 Canon Kabushiki Kaisha Visual axis detection apparatus and optical apparatus provided therewith
GB2369673B (en) * 2000-06-09 2004-09-15 Canon Kk Image processing apparatus
GB2412431B (en) * 2004-03-25 2007-11-07 Hewlett Packard Development Co Self-calibration for an eye tracker

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1175945A (en) * 1967-08-23 1970-01-01 Honeywell Inc Improvements in or relating to Optical Systems
US3986030A (en) * 1975-11-03 1976-10-12 Teltscher Erwin S Eye-motion operable keyboard-accessory
US4034401A (en) * 1975-04-22 1977-07-05 Smiths Industries Limited Observer-identification of a target or other point of interest in a viewing field
US4109145A (en) * 1974-05-20 1978-08-22 Honeywell Inc. Apparatus being controlled by movement of the eye
FR2382056A1 (fr) * 1977-02-28 1978-09-22 Inst Nat Sante Rech Med Procede et dispositif de determination de la position du globe oculaire
AU544490B2 (en) * 1980-12-31 1985-05-30 Ibm Corp. Eye controlled information transfer

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1175945A (en) * 1967-08-23 1970-01-01 Honeywell Inc Improvements in or relating to Optical Systems
US4109145A (en) * 1974-05-20 1978-08-22 Honeywell Inc. Apparatus being controlled by movement of the eye
US4034401A (en) * 1975-04-22 1977-07-05 Smiths Industries Limited Observer-identification of a target or other point of interest in a viewing field
US3986030A (en) * 1975-11-03 1976-10-12 Teltscher Erwin S Eye-motion operable keyboard-accessory
FR2382056A1 (fr) * 1977-02-28 1978-09-22 Inst Nat Sante Rech Med Procede et dispositif de determination de la position du globe oculaire
AU544490B2 (en) * 1980-12-31 1985-05-30 Ibm Corp. Eye controlled information transfer

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, Vol. BME-21, No. 4, July 1974, New York (US), J. MERCHANT et al.: "Remote Measurement Of Eye Direction Allowing Subject Motion Over One Cubic Foot Of Space", pages 309-317 *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1987007497A1 (fr) * 1986-06-04 1987-12-17 P Lsg Rd Goete Dispositif optique
EP0294812A2 (fr) * 1987-06-10 1988-12-14 Research Development Foundation Contrôleur de calibration pour contrôler des machines actionnées électriquement
EP0294812A3 (fr) * 1987-06-10 1989-10-25 Research Development Foundation Contrôleur de calibration pour contrôler des machines actionnées électriquement
FR2648243A1 (fr) * 1989-06-09 1990-12-14 Metrovision Sarl Procede d'asservissement des moyens de reglage d'un appareil optique, moyens pour la mise en oeuvre de ce procede et appareils equipes de ces moyens
US5094522A (en) * 1989-06-09 1992-03-10 Philippe Sourdille Method of automatic control of means for adjusting an apparatus for observing a subject, means for performing the method, and apparatus equipped with these means
WO1991006263A1 (fr) * 1989-11-07 1991-05-16 Paalsgaard Goete Dispositif de communication
US5767821A (en) * 1989-11-07 1998-06-16 Paalsgaard; Goete Communication device
US5621424A (en) * 1992-08-24 1997-04-15 Olympus Optical Co., Ltd. Head mount display apparatus allowing easy switching operation from electronic image to external field image
DE19906706A1 (de) * 1999-02-18 2000-08-24 Bayerische Motoren Werke Ag Instrumentenfeld mit virtuellem Display
US7158097B2 (en) 2002-10-09 2007-01-02 Canon Kabushiki Kaisha Gaze tracking system

Also Published As

Publication number Publication date
JPS62500493A (ja) 1987-03-05
GB2177276A (en) 1987-01-14
GB8612298D0 (en) 1986-06-25

Similar Documents

Publication Publication Date Title
WO1986001963A1 (fr) Ameliorations relatives a un procede et appareil de commande par la direction du regard
EP3486752B1 (fr) Procédé de mise à jour d'une interface utilisateur sur un système informatique
US6901561B1 (en) Apparatus and method for using a target based computer vision system for user interaction
US5138304A (en) Projected image light pen
US6417969B1 (en) Multiple viewer headset display apparatus and method with second person icon display
US20020118339A1 (en) Eye tracking display apparatus
US6367932B1 (en) Apparatus and method for visual field testing
US7600873B2 (en) Method of determining the spatial relationship of an eye of a person with respect to a camera device
US6152563A (en) Eye gaze direction tracker
US7365738B2 (en) Guides and indicators for eye movement monitoring systems
CN103020983B (zh) 一种用于目标跟踪的人机交互装置及方法
US6401050B1 (en) Non-command, visual interaction system for watchstations
CN105279459A (zh) 一种终端防偷窥方法及移动终端
US20040046711A1 (en) User-controlled linkage of information within an augmented reality system
CA3020401C (fr) Systeme et methode de reception d`entrees d`utilisateur dans un systeme de realite virtuelle et augmentee
Brouwer et al. The role of memory in visually guided reaching
WO2021244145A1 (fr) Procédé d'interaction de dispositif de visiocasque, dispositif terminal et support de stockage
US6426740B1 (en) Visual-axis entry transmission apparatus and method therefor
KR20020031188A (ko) 화상회의, 기타 카메라에 기반한 시스템 애플리케이션들에있어서의 지시 방향 교정
WO1999056274A1 (fr) Procede et appareil de pointage par le regard
EP1069855A4 (fr) Procede et appareil servant a exercer les capacites d'attention visuelle d'un sujet
US5550601A (en) Method and apparatus for ocular motility testing
JP2010151951A (ja) 特定方向画像表示システム
JPH0651901A (ja) 視線認識によるコミュニケーション装置
JPH074345B2 (ja) 注視点マスキングによる医療診断装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AU CH DE DK FI GB JP NO SE US

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642