WO1998036348A2 - Eye controlled opto-electric input/output interface - Google Patents

Eye controlled opto-electric input/output interface Download PDF

Info

Publication number
WO1998036348A2
WO1998036348A2 PCT/SE1998/000272 SE9800272W WO9836348A2 WO 1998036348 A2 WO1998036348 A2 WO 1998036348A2 SE 9800272 W SE9800272 W SE 9800272W WO 9836348 A2 WO9836348 A2 WO 9836348A2
Authority
WO
WIPO (PCT)
Prior art keywords
lens
light
optical
optical apparatus
eye
Prior art date
Application number
PCT/SE1998/000272
Other languages
English (en)
French (fr)
Other versions
WO1998036348A3 (en
Inventor
Jonas Ericsson
Original Assignee
Ect Ab Eye Control Technique
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from SE9700557A external-priority patent/SE9700557D0/
Priority claimed from SE9700556A external-priority patent/SE9700556D0/xx
Application filed by Ect Ab Eye Control Technique filed Critical Ect Ab Eye Control Technique
Priority to PL98336150A priority Critical patent/PL336150A1/xx
Priority to JP10535674A priority patent/JP2001503177A/ja
Priority to EP98904505A priority patent/EP0976024A2/en
Priority to AU62355/98A priority patent/AU6235598A/en
Publication of WO1998036348A2 publication Critical patent/WO1998036348A2/en
Publication of WO1998036348A3 publication Critical patent/WO1998036348A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Definitions

  • the present invention relates to an eye controlled optoelectric input/output interface.
  • the eye is presented with a picture which in different realizations may be a projection of a real object or a picture shown on a display or monitor.
  • the eye perceives a virtual picture as if it was located at a certain distance from the eye on an optical axis going through the focal point of the eye.
  • These applications require a detection of a picture of the eye by means of some kind of photodetector, e.g. a CCD-matrix or a video camera, concurrently with the eye's registration of the presented picture.
  • This eye picture detector should in most applications be located outside the visual field of the eye, which in accordance with prior art is achieved by means of a system of lenses and mirrors such that the picture of the eye is projected on the eye picture detector at the same time as another picture is presented to the eye itself.
  • the picture presented to the eye i.e. the retina
  • the picture of the eye on the focal plane of the photodetector.
  • certain distances are required between picture source, lenses, eye and photodetector.
  • a drawback in such apparatuses according to prior art is that the distance requirements entail incon- venientiy large arrangements.
  • Another drawback is the fact that these known apparatuses are not adapted to general input or output of information, for example image information.
  • the problem to be solved by the present invention is to provide an eye controlled input/output interface for inputting and/or outputting information to and/or from an information handling apparatus.
  • An aspect of the problem is to provide a general input/output interface for inputting control commands as well as text and image information.
  • Fig 1 a general view of an optical component comprised in embodiments of the invention
  • Fig 2 a general view of a second embodiment of the optical component according to fig 1:
  • Fig 3 a general view of an embodiment of an eye controlled input/output interface according to the invention
  • Fig 4 a general view of the beam path in an embodiment of the invention according to fig
  • FIG. 5 A, 5B and 6 a general view of a further embodiment of an eye controlled input/output interface according to the invention.
  • the possibility to achieve an interface according to the invention of acceptable size is highly dependent on the design of the optical system.
  • the figures 1-4 show an optical component 9 having light refractive as well as light reflective properties, which advantageously can be comprised in different embodiments of the invention.
  • Fig 1 shows a first embodiment of an optical device 9, in which a positive, collimating lens 10 is arranged to co-operate with a reflecting member 12, herein also called a reflector.
  • the lens 10 is preferably composed of two or more sublenses. and is arranged to accomplish a parallel light beam from diverging light falling into the lens and coming from a light source 6 located in one of the foci 5 or focal planes 30 of the lens.
  • the reflector 12 is in fig 1 placed at a distance A from the surface of the lens 10 that is turned away from the light source.
  • the optical device 9 may also comprise distance organs 7, generally shown in fig 1, arranged to keep the reflector on the distance A from the lens 10.
  • the reflector 12 has a reflective surface 32 having the same bending curve as the surface of the lens that is turned away from the light source.
  • a light beam, coming from the light source and falling into the lens, is refracted in the lens a first time and is then reflected back into the lens by the reflector 12.
  • Fig 2 shows a second embodiment of the optical device 9, in which the reflector 12 is applied in immediate contact with the surface of the lens 10 that is turned away from the light source. This is particularly advantageous since the reflective surface of the reflector follows the surface of the lens and thereby the curve of the reflector can be suited to the lens with precision.
  • the reflector can for example be made of or comprise metalic or dielectric materials, and can be applied to the surface of the lens for example by a vaporizing procedure.
  • the reflector is devised to be partly permeable, and thus transmits a certain amount of the light falling into the lens while the remaining part of the light is reflected back into the lens.
  • the reflector may also be devised such that it is permeable for one or more selected and predetermined light wavelengths, while other light wavelengths are reflected back into the lens.
  • the reflector may be permeable for light in the infrared wavelength range and reflecting for other wavelengths.
  • the reflector may also be impermeable for all light.
  • the optical device 9 according to the invention is for the sake of simplicity hereinafter also called reflector lens.
  • the above described reflector lens 9 is useful in different apparatuses that require a collimating device, particularly in such applications that require small dimensions and/or low weight.
  • Fig 3 shows the invention incorporated in a apparatus 2 for detection of the gaze direction of an eye, more exactly in an eye controlled input/output device 2 e.g. for communication apparatuses, computers and cameras.
  • a partly transparent beam splitter 8, here in the shape of a mirror, is arranged between the light source 6 and the reflector lens 9.
  • a light sensitive device 13,14 comprising an image recording device 14 e.g. in the shape of a CCD, a vidicon tube or an emulsion based film (e.g.
  • the apparatus 2 comprises an optional member 3 for collecting light reflected by the beam splitter 8.
  • the member 3 is absent in some embodiments of the apparatus 2, but may in other embodiments be another light sensitive device similar to the device 13,14 or a finder in the shape of an aperture with or without a light refractive lens.
  • the light source 6, the image recording device 14 and/or the member 3 are electrically controllable or can produce an electric output signal, said devices are provided with inputs and/or outputs for electric signals.
  • a picture is presented on the light source 6 which is situated in the focal plane of the reflector lens 9.
  • Light beams from the picture goes through the beam splitter 8 and are collimatingly refracted in the reflector lens 9, whereupon at least a part of the light quantity first is re-reflected through the reflector lens 9 and is then reflected by the beam splitter 8 towards an aperture 3.
  • a user's eye gazing through the aperture 3 sees the picture reflected from the beam splitter 8 and concurrently an image of the eye is reflected by the beam splitter 8 towards the light sensitive device 13.14.
  • the gaze direction of the eye can be determined in a manner known e.g. through the above mentioned prior art documents and thereby can also the part of the picture being gazed at be determined.
  • the beam path in a device according to fig 3 is generally shown in fig 4.
  • a diverging light beam having its origin in a point of the light source situated on the optical axis of the reflector lens 9 and being drawn with fully drawn lines, goes through the beam splitter 8 and falls into the reflector lens 9.
  • the light beam is collimated by the light refractive part 10 of the reflector lens 9.
  • the diverging light beam is then reflected by the reflecting organ 12 of the reflector lens 9 back through the light refractive part 10.
  • the light being reflected into the reflector lens 9 goes out from the lens in collimated form, i.e. as a parallel light beam, and is again reflected by the beam splitter 8 towards an eye 1 drawn in fig 4.
  • Light from another point of the light source is collimated and reflected in an analogue manner, an example of which is drawn with intermittent lines. Parallel light is thus falling on the eye and the eye perceives a presented picture as if it was situated at a larger distance from the eye.
  • Fig 5A, 5B, 6, 7A, 7B and 8 shows an eye controlled input/output interface 2, in addition to the above mentioned components further comprising an objective for projection of an object image on an image plane.
  • the object image is projected on the same image recording device 14 as the one which is used for the detection of an image of an eye.
  • the image recording device 14 is pivotable around an axis 16, such that the organ 14 can be switched between recording of an image of an eye (fig 5 A) and recording of an image projected through the objective 18, i.e. used as a camera.
  • the embodiment according to fig 7 comprises a mirror 20 that is pivotable around an axis 22, such that either an image of an eye (fig 7 A) or an image of another object can be projected on the image recording device 14.
  • a picture presentation device 6 e.g. in the shape of an LCD-display in order to present the picture to the eye.
  • the interface will then operate as a camera with a finder, and the user can by means of a trigger 36 (fig 5 A, 7 A) grab an image for storage or for transmission through telecommunication.
  • Fig 9 shows in perspective an embodiment of the inventive interface 2, in which the picture presentation device 6 and the image recording device 13,14 are placed in mutually perpendicular first and second planes.
  • the beam splitter 8 is arranged such that it reflects light in a direction having an axis perpendicularly intersecting a third plane, which in its turn is perpendicular to the first and second planes.
  • An objective 18 is placed in a fourth plane being parallel to the third plane.
  • the interface 2 further comprises a mirror 24 being pivotably arranged on an axis 38. In a first position (as in fig 9) an image of an eye is reflected into the image recording device 14. In a second position, when the mirror 24 is turned 90 degrees around the axis 38, an image from the objective is instead reflected into the image recording device 14. As for the rest, the same functions as described above are found in this embodiment of the interface 2.
  • Fig 10 shows in a side view the mirror 24 that is suspended on an axis 38
  • fig 11 shows the relative position of the members 6, 14, 18 in relation to the gaze direction of a users eye 1.
  • Fig 12 shows the use of an interface 2 communicatively coupled to a telecommunication device 40 and/or an information processing apparatus 42.
  • the objective 18 reproduces an object 39.
  • light catching member e.g. an aperture or a detector

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Image Input (AREA)
PCT/SE1998/000272 1997-02-17 1998-02-16 Eye controlled opto-electric input/output interface WO1998036348A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
PL98336150A PL336150A1 (en) 1998-02-16 1998-02-16 Optically controlled optoelectric i/o interface
JP10535674A JP2001503177A (ja) 1998-02-16 1998-02-16 目で制御された光電入出力インタフェース
EP98904505A EP0976024A2 (en) 1998-02-16 1998-02-16 Eye controlled opto-electric input/output interface
AU62355/98A AU6235598A (en) 1997-02-17 1998-02-16 Eye controlled opto-electric input/output interface

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
SE9700557A SE9700557D0 (sv) 1997-02-17 1997-02-17 Optisk anordning
SE9700557-3 1997-02-17
SE9700556A SE9700556D0 (sv) 1997-02-18 1997-02-18 Optoelektrisk input-/outputgränssnitt
SE9700556-5 1997-02-18

Publications (2)

Publication Number Publication Date
WO1998036348A2 true WO1998036348A2 (en) 1998-08-20
WO1998036348A3 WO1998036348A3 (en) 1998-12-10

Family

ID=26662908

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE1998/000272 WO1998036348A2 (en) 1997-02-17 1998-02-16 Eye controlled opto-electric input/output interface

Country Status (3)

Country Link
AU (1) AU6235598A (cs)
CZ (1) CZ289121B6 (cs)
WO (1) WO1998036348A2 (cs)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002091062A1 (en) * 2001-05-10 2002-11-14 Försvarets Materielverk Display device with multiple focal planes

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1987007497A1 (en) * 1986-06-04 1987-12-17 P Lsg Rd Goete An optical device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1987007497A1 (en) * 1986-06-04 1987-12-17 P Lsg Rd Goete An optical device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002091062A1 (en) * 2001-05-10 2002-11-14 Försvarets Materielverk Display device with multiple focal planes

Also Published As

Publication number Publication date
CZ373399A3 (cs) 2000-03-15
WO1998036348A3 (en) 1998-12-10
CZ289121B6 (cs) 2001-11-14
AU6235598A (en) 1998-09-08

Similar Documents

Publication Publication Date Title
US5684497A (en) Twice folded compound magnified virtual image electronic display
US11256086B2 (en) Eye tracking based on waveguide imaging
US5625372A (en) Compact compound magnified virtual image electronic display
US11128847B2 (en) Information display device and information display method
US5771124A (en) Compact display system with two stage magnification and immersed beam splitter
JP3429320B2 (ja) 眼鏡及びフェースマスクに対するイメージコンバイニングシステム
US8582206B2 (en) Laser-scanning virtual image display
US5815741A (en) Image observing apparatus and imaging apparatus utilizing the image observing apparatus
US20040070839A1 (en) Wide field of view head mounted display device
CN107797290B (zh) 虚拟现实显示光学系统及虚拟现实眼镜
JP2000231060A5 (cs)
CN113424085A (zh) 用于通过光波导的倾斜表面的光耦合的色散补偿
US6055109A (en) Head-mounted display apparatus with a single image display device
WO1998036348A2 (en) Eye controlled opto-electric input/output interface
EP0976024A2 (en) Eye controlled opto-electric input/output interface
US4188102A (en) Mirror reflex camera with electronic rangefinder
WO1998013720A1 (en) Method and apparatus for optical scanning
KR20000077394A (ko) 광학 뷰파인더를 통해 이미지를 디스플레이하는 디지털카메라 시스템 및 방법
JPH09262210A (ja) 光学システム
JP2001108933A (ja) ヘッドマウントディスプレイ装置
WO2023209710A1 (en) Eye-tracking via lightguides
CN118311778A (zh) 光学装置及其成像方法
CN117043663A (zh) 图像显示设备
JP3266294B2 (ja) ビデオカメラ
CN110147028A (zh) 投影装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH HU IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG

AK Designated states

Kind code of ref document: A3

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH HU IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

ENP Entry into the national phase

Ref country code: JP

Ref document number: 1998 535674

Kind code of ref document: A

Format of ref document f/p: F

NENP Non-entry into the national phase

Ref country code: CA

WWE Wipo information: entry into national phase

Ref document number: PV1999-3733

Country of ref document: CZ

WWE Wipo information: entry into national phase

Ref document number: 1998904505

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 09402431

Country of ref document: US

WWP Wipo information: published in national office

Ref document number: 1998904505

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: PV1999-3733

Country of ref document: CZ

WWG Wipo information: grant in national office

Ref document number: PV1999-3733

Country of ref document: CZ

WWW Wipo information: withdrawn in national office

Ref document number: 1998904505

Country of ref document: EP