WO1986003863A1 - Ameliorations concernant un appareil commande par la direction du regard - Google Patents

Ameliorations concernant un appareil commande par la direction du regard Download PDF

Info

Publication number
WO1986003863A1
WO1986003863A1 PCT/AU1985/000324 AU8500324W WO8603863A1 WO 1986003863 A1 WO1986003863 A1 WO 1986003863A1 AU 8500324 W AU8500324 W AU 8500324W WO 8603863 A1 WO8603863 A1 WO 8603863A1
Authority
WO
WIPO (PCT)
Prior art keywords
eye
gaze
target
controlled apparatus
signal
Prior art date
Application number
PCT/AU1985/000324
Other languages
English (en)
Inventor
Andrew Richard Downing
Original Assignee
The University Of Adelaide
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The University Of Adelaide filed Critical The University Of Adelaide
Priority to GB08620269A priority Critical patent/GB2179147A/en
Priority to JP86500458A priority patent/JPS62501802A/ja
Publication of WO1986003863A1 publication Critical patent/WO1986003863A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F4/00—Methods or devices enabling patients or disabled persons to operate an apparatus or a device not forming part of the body 

Definitions

  • This invention relates to eye-gaze-direction controlled apparatus and to a method of controlling such apparatus.
  • eye-gaze-direction determining means which include a substantially point reference source of light and detection means which are adapted to detect the reflections of the reference light from the retina and cornea or from other parts of the eye of 10. the user and then use this to measure and ascertain a relative viewing direction of the eye of the user.
  • a difficulty associated with such a technique is to determine with reasonable certainty at what and when a user has aligned his or her sight on a target, or at least in the target direction, and ultimately intends that such alignment effect a result,
  • the aim is to therefore achieve as many options as is possible within a viewing area, while, at the same time providing a user with as rapid and consistent a response as is practicable, taking into account the need to minimise the chance of error through the
  • the object of this invention therefore is to propose an arrangement and method which will assist in increasing accuracy and speed of selection.
  • the invention accordingly resides in an eye-gaze- direction controlled apparatus including eye-gaze- direction determining means to detect a direction of gaze of an eye of a user, which means are also adapted to determine a relative position of the direction
  • said means further adapted to measure and record a plurality of eye gaze directions, each measure being taken between sequentially selected intervals of time and adapted to provide an "activate” or "identify” signal upon at
  • the target and its range are displayed on a video display unit and the direction of eye gaze is determined with reference to the said display target on the video display unit.
  • form the target forms to which this invention applies includes three dimensional targets of variable shape, and both moving and stationary targets.
  • At least one of the target areas 15. includes a control activation which will indeed change the menu or the results of activation of any of these so that the user not only can activate from the first visible screen, but can in fact change the visible screen from time to time so that a vast range of possibilities 20. becomes then open for controlling outside occurrences using nothing but an intended persistence of eye-gaze- direction with respect to a target area.
  • the invention in its broadest sense is not limited to such an arrangement, it is most convenient in the eye-gaze-direction determining means to include a 35. substantially point reference source of light, and detection means, which comprise a vidicon television camera, which is adapted to detect the reflections of the reference light from the retina and cornea of the eye of the user.
  • detection means which comprise a vidicon television camera, which is adapted to detect the reflections of the reference light from the retina and cornea of the eye of the user.
  • the scan rate is such that a reading of eye direction can be achieved from each frame of picture information so that either 50 such readings can be made per second in one system or 60 5. such readings can be made per second in another.
  • the invention in a further form can be said to reside in a method of determining a required target by determination of an eye-gaze-direction which includes,
  • the number of measured and recorded eye-gaze-directions used to determine a proportion to effect an "activate" signal is within the range of 3 to 20. 200, depending on the nature of the action which is to follow.
  • the number of measured and recorded eye-gaze-directions used to determine a proportion 25. to effect an "activate" signal is such that they are taken within the time range 3/50ths to 200/50ths of a second.
  • the proportion of the number of 30. measured and recorded eye-gaze-directions which are within a selected range of the position of the target is within the range of 0.5 to 0.9, depending on the nature of the action which is to follow.
  • the selected range of the position of the target should be equivalent to angles subtended to the user's eye of at least 1 degree in each direction.
  • the number of measured and recorded eye-gaze- directions and the required proportion of that number, and the range of position of the target may be varied dynamically to suit the individual user, or the operating conditions of the eye gaze monitor to further optimise the speed and accuracy of selections.
  • the user can modify one or more of these parameters, by separate control functions or by eye gaze selection.
  • FIG. 1 shows in schematic manner the arrangement of the eye of a user and a target and means forming 15. part of the arrangement for determining the eye-gaze- direction.
  • FIG. 2 illustrates a target, a unique range boundary of such a target and expected typical detected 20. Eye-gaze-direction locations relative to the target in the range and FIG, 3 is a flow chart for determining the aiming point of the eye-gaze-direction.
  • FIG. 1 there is seen a representation of an eye of a user at 1, a substantially point source of light 2 and a vidicon television camera 3 detecting the relative position of the pupil 4 by virtue of light reflected by the retina 4a with respect to the reflection
  • the substantially point source of light is provided by a filament 2 in front of a reflector 2a, the light from the filament 2 being directed through a filter 2b onto a mirror 2c and then onto a beam splitter 2d so as 5. to be directed into the direction of the eye 1.
  • the reflection is directed back to the beam splitter 2d through filter 2e and into the vidicon television camera 3.
  • the filters 2b and 2e are each of an identical type and are selected to admit only a narrow band width of light in the near infra red region. The effect of this of course, is to reduce the possiblity of external light
  • the camera 3 in this embodiment is a monochrome television camera 625 line 50 cycles per second
  • 2:1 interlace raster scan system synchronized to signals derived from crystal oscillator locked column (pixel) and row counters used to detect the positions of the boundaries of the features of the eye seen by the camera.
  • Such an arrangement provides that a reading and recording of an eye-gaze-direction can be made 50 times every second.
  • the target 7 is part of the screen of a video display unit which is divided into a number of separate and uniquely identified ranges each of which includes an appropriate target therewithin.
  • the screen is divided into 49 different areas and in this embodiment, the unique range for each target, is the range shown by the dividing lines being therefore approximately l/49th of the -5. total area bounded by the rectangular boundaries shown.
  • FIG. 2 there is shown the target 8 which is bounded by the shown rectangular lines 9, 10, 11 and 12.
  • (a) is within the unique target area range, (b) is just outside, (c) is within, (d) is within, 20. (e) is just outside, (f) is in and (g) and (h) are both in.
  • the selected number of sequential readings can be 20 with a proportion of 0.8 whereby to indicate after the cursor has indicated that the said target 8 has been that chosen, so that a further action can then be initiated.
  • a factor in the proportion is the degree of accuracy required, and the distance of the screen 15. and the size of the screen should be such that no greater accuracy is required than 1 degree in the vertical direction and 1 degree in the horizontal direction.
  • FIG. 3 is a flow chart for determining the aiming point of the eye-gaze-direction.
  • Step 13 after the computer has been appropriately set up includes the testing of information from the 25.
  • eye-gaze-direction determining apparatus such information being head position, loss of eye location, blinks, or saccades, in addition to the eye gaze direction itself.
  • the next test at 14 is a check of head position 30. and supplying a warning if realignment is desirable.
  • -. 17 is the test for continuous action or single event and if continuous action the flow chart continues to the left and if a single event, to the right.
  • the test at 18 is whether for any target, the
  • the flow chart path continues to the right - jn through a test at 20 to ascertain whether the action associated with that target is enabled, an execute or continue action at 21 and then through an enable or disable other actions if appropriate step through 22.
  • the person can use eye gaze to identify a target, and then use a supplementary means 10. such as a switch or key pad or any other distinctly separate device to cause some action to occur relative to that target.
  • a supplementary means 10 such as a switch or key pad or any other distinctly separate device to cause some action to occur relative to that target.
  • control it is useful to provide a second stronger, form of visual feed-back (such as the whole target area being highlighted rather than a small central portion while identificat-ion is in progress) to confirm that the action took place.
  • Other forms of feedback expecially auditory 20. feedback, may be used as well as or in place of the visual feedback.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • General Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Physics & Mathematics (AREA)
  • Vascular Medicine (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Eye Examination Apparatus (AREA)
  • Automatic Focus Adjustment (AREA)

Abstract

Appareil commandé par la direction du regard comprenant des moyens déterminant la direction du regard pour détecter la direction de tout oeil d'utilisateur, lesdits moyens sont également adaptés pour déterminer une position relative de la direction du regard par rapport à la direction (8) d'une cible, lesdits moyens sont en outre adaptés pour mesurer et enregistrer une pluralité de directions de regard (a-h), chaque mesure étant prise à des intervalles de temps choisis séquentiellement et pour fournir un signal ''activer'' ou ''identifier pour action ultérieure'' lors de la détection d'au moins une partie choisie antérieurement d'un certain nombre présélectionné de directions mesurées séquentiellement qui font partie d'une gamme présélectionnée de positions par rapport à la direction de la cible délimitée par les limites (9, 10, 11, 12).
PCT/AU1985/000324 1984-12-24 1985-12-24 Ameliorations concernant un appareil commande par la direction du regard WO1986003863A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
GB08620269A GB2179147A (en) 1984-12-24 1985-12-24 Improvements relating to eye-gaze-direction controlled apparatus
JP86500458A JPS62501802A (ja) 1984-12-24 1985-12-24 凝視方向制御装置の改良

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AUPG8702 1984-12-24
AU870284 1984-12-24

Publications (1)

Publication Number Publication Date
WO1986003863A1 true WO1986003863A1 (fr) 1986-07-03

Family

ID=3699418

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU1985/000324 WO1986003863A1 (fr) 1984-12-24 1985-12-24 Ameliorations concernant un appareil commande par la direction du regard

Country Status (4)

Country Link
JP (1) JPS62501802A (fr)
AU (1) AU5237786A (fr)
GB (1) GB2179147A (fr)
WO (1) WO1986003863A1 (fr)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1987007497A1 (fr) * 1986-06-04 1987-12-17 P Lsg Rd Goete Dispositif optique
GB2236874A (en) * 1989-08-04 1991-04-17 Marconi Gec Ltd Control system.
WO1996030822A1 (fr) * 1995-03-27 1996-10-03 Forest Donald K Procede et appareil d'entree de donnees
US6005549A (en) * 1995-07-24 1999-12-21 Forest; Donald K. User interface method and apparatus
WO2000016185A2 (fr) * 1998-09-01 2000-03-23 Synthetic Environments, Inc. Systeme et procede de controle d'une interface systeme hote avec des donnees point d'interet
US6903723B1 (en) 1995-03-27 2005-06-07 Donald K. Forest Data entry method and apparatus
US9841813B2 (en) 2015-12-22 2017-12-12 Delphi Technologies, Inc. Automated vehicle human-machine interface system based on glance-direction
US10146303B2 (en) 2015-01-20 2018-12-04 Microsoft Technology Licensing, Llc Gaze-actuated user interface with visual feedback
US10372203B2 (en) 2013-05-30 2019-08-06 Tobii Ab Gaze-controlled user interface with multimodal input
US10852822B2 (en) 2019-05-01 2020-12-01 Aptiv Technologies Limited Display method

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6152563A (en) * 1998-02-20 2000-11-28 Hutchinson; Thomas E. Eye gaze direction tracker
US6574352B1 (en) * 1999-05-18 2003-06-03 Evans & Sutherland Computer Corporation Process for anticipation and tracking of eye movement
US7891818B2 (en) 2006-12-12 2011-02-22 Evans & Sutherland Computer Corporation System and method for aligning RGB light in a single modulator projector
US8358317B2 (en) 2008-05-23 2013-01-22 Evans & Sutherland Computer Corporation System and method for displaying a planar image on a curved surface
US8702248B1 (en) 2008-06-11 2014-04-22 Evans & Sutherland Computer Corporation Projection method for reducing interpixel gaps on a viewing surface
US8077378B1 (en) 2008-11-12 2011-12-13 Evans & Sutherland Computer Corporation Calibration system and method for light modulation device
US9641826B1 (en) 2011-10-06 2017-05-02 Evans & Sutherland Computer Corporation System and method for displaying distant 3-D stereo on a dome surface

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3864030A (en) * 1972-07-11 1975-02-04 Acuity Syst Eye position measuring technique
US3986030A (en) * 1975-11-03 1976-10-12 Teltscher Erwin S Eye-motion operable keyboard-accessory
US4034401A (en) * 1975-04-22 1977-07-05 Smiths Industries Limited Observer-identification of a target or other point of interest in a viewing field
US4109145A (en) * 1974-05-20 1978-08-22 Honeywell Inc. Apparatus being controlled by movement of the eye
AU544490B2 (en) * 1980-12-31 1985-05-30 Ibm Corp. Eye controlled information transfer

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3864030A (en) * 1972-07-11 1975-02-04 Acuity Syst Eye position measuring technique
US4109145A (en) * 1974-05-20 1978-08-22 Honeywell Inc. Apparatus being controlled by movement of the eye
US4034401A (en) * 1975-04-22 1977-07-05 Smiths Industries Limited Observer-identification of a target or other point of interest in a viewing field
US3986030A (en) * 1975-11-03 1976-10-12 Teltscher Erwin S Eye-motion operable keyboard-accessory
AU544490B2 (en) * 1980-12-31 1985-05-30 Ibm Corp. Eye controlled information transfer

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1987007497A1 (fr) * 1986-06-04 1987-12-17 P Lsg Rd Goete Dispositif optique
GB2236874A (en) * 1989-08-04 1991-04-17 Marconi Gec Ltd Control system.
US9535494B2 (en) * 1995-03-27 2017-01-03 Donald K. Forest Apparatus and method for selecting from a display
US6903723B1 (en) 1995-03-27 2005-06-07 Donald K. Forest Data entry method and apparatus
GB2314186B (en) * 1995-03-27 1999-08-18 Donald K Forest User Interface
GB2314186A (en) * 1995-03-27 1997-12-17 Donald K Forest Method of and apparatus for data entry
WO1996030822A1 (fr) * 1995-03-27 1996-10-03 Forest Donald K Procede et appareil d'entree de donnees
US6005549A (en) * 1995-07-24 1999-12-21 Forest; Donald K. User interface method and apparatus
WO2000016185A2 (fr) * 1998-09-01 2000-03-23 Synthetic Environments, Inc. Systeme et procede de controle d'une interface systeme hote avec des donnees point d'interet
GB2357948A (en) * 1998-09-01 2001-07-04 Synthetic Environments Inc System and method for controlling host system interface with point-of-interest data
GB2357948B (en) * 1998-09-01 2003-02-12 Synthetic Environments Inc System and method for controlling host system interface with point-of-interest data
US6243076B1 (en) 1998-09-01 2001-06-05 Synthetic Environments, Inc. System and method for controlling host system interface with point-of-interest data
WO2000016185A3 (fr) * 1998-09-01 2000-05-25 Synthetic Environments Inc Systeme et procede de controle d'une interface systeme hote avec des donnees point d'interet
US10372203B2 (en) 2013-05-30 2019-08-06 Tobii Ab Gaze-controlled user interface with multimodal input
US10146303B2 (en) 2015-01-20 2018-12-04 Microsoft Technology Licensing, Llc Gaze-actuated user interface with visual feedback
US9841813B2 (en) 2015-12-22 2017-12-12 Delphi Technologies, Inc. Automated vehicle human-machine interface system based on glance-direction
US10852822B2 (en) 2019-05-01 2020-12-01 Aptiv Technologies Limited Display method

Also Published As

Publication number Publication date
GB2179147A (en) 1987-02-25
GB8620269D0 (en) 1986-10-01
AU5237786A (en) 1986-07-22
JPS62501802A (ja) 1987-07-16

Similar Documents

Publication Publication Date Title
WO1986003863A1 (fr) Ameliorations concernant un appareil commande par la direction du regard
EP1024738B1 (fr) Appareil et procede permettant de tester le champ visuel
US4109145A (en) Apparatus being controlled by movement of the eye
US3864030A (en) Eye position measuring technique
Beverley et al. The relation between discrimination and sensitivity in the perception of motion in depth.
US4034401A (en) Observer-identification of a target or other point of interest in a viewing field
EP0543932B1 (fr) Appareil doppler a laser pour la retine
US6669651B1 (en) Non-invasive brain function examination
EP0055338A1 (fr) Communication au moyen d'un appareil commandé par l'oeil humain
US3450466A (en) Eye movement recorder
JPH08105B2 (ja) 固視微動検査装置
CN109634431B (zh) 无介质浮空投影视觉追踪互动系统
CN106200926B (zh) 控制方法、控制装置及电子装置
US6324420B1 (en) Blood vessel tracking apparatus
US4293199A (en) Apparatus for detecting astigmatic axes and measuring refractive powers
US5585872A (en) Ophthalmic measuring apparatus for determining the shape of the cornea of an eye
CN112987910B (zh) 眼球追踪设备的测试方法、装置、设备及存储介质
Lambert et al. High-speed data processing and unobtrusive monitoring of eye movements
US4761070A (en) Eye refractometer
Scobey et al. Displacement thresholds for unidirectional and oscillatory movement
Carmody et al. Performance of a computer system for recording eye fixations using limbus reflection
US3837734A (en) Method of and apparatus for measuring visual latency
CN109875498B (zh) 一种基于反应时间的动态视力测量系统
JPH035810B2 (fr)
JP2941832B2 (ja) 眼屈折力計

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AU CH DE DK FI GB JP NO SE US

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642