WO1998036348A2 - Eye controlled opto-electric input/output interface - Google Patents
Eye controlled opto-electric input/output interface Download PDFInfo
- Publication number
- WO1998036348A2 WO1998036348A2 PCT/SE1998/000272 SE9800272W WO9836348A2 WO 1998036348 A2 WO1998036348 A2 WO 1998036348A2 SE 9800272 W SE9800272 W SE 9800272W WO 9836348 A2 WO9836348 A2 WO 9836348A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- lens
- light
- optical
- optical apparatus
- eye
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Definitions
- the present invention relates to an eye controlled optoelectric input/output interface.
- the eye is presented with a picture which in different realizations may be a projection of a real object or a picture shown on a display or monitor.
- the eye perceives a virtual picture as if it was located at a certain distance from the eye on an optical axis going through the focal point of the eye.
- These applications require a detection of a picture of the eye by means of some kind of photodetector, e.g. a CCD-matrix or a video camera, concurrently with the eye's registration of the presented picture.
- This eye picture detector should in most applications be located outside the visual field of the eye, which in accordance with prior art is achieved by means of a system of lenses and mirrors such that the picture of the eye is projected on the eye picture detector at the same time as another picture is presented to the eye itself.
- the picture presented to the eye i.e. the retina
- the picture of the eye on the focal plane of the photodetector.
- certain distances are required between picture source, lenses, eye and photodetector.
- a drawback in such apparatuses according to prior art is that the distance requirements entail incon- venientiy large arrangements.
- Another drawback is the fact that these known apparatuses are not adapted to general input or output of information, for example image information.
- the problem to be solved by the present invention is to provide an eye controlled input/output interface for inputting and/or outputting information to and/or from an information handling apparatus.
- An aspect of the problem is to provide a general input/output interface for inputting control commands as well as text and image information.
- Fig 1 a general view of an optical component comprised in embodiments of the invention
- Fig 2 a general view of a second embodiment of the optical component according to fig 1:
- Fig 3 a general view of an embodiment of an eye controlled input/output interface according to the invention
- Fig 4 a general view of the beam path in an embodiment of the invention according to fig
- FIG. 5 A, 5B and 6 a general view of a further embodiment of an eye controlled input/output interface according to the invention.
- the possibility to achieve an interface according to the invention of acceptable size is highly dependent on the design of the optical system.
- the figures 1-4 show an optical component 9 having light refractive as well as light reflective properties, which advantageously can be comprised in different embodiments of the invention.
- Fig 1 shows a first embodiment of an optical device 9, in which a positive, collimating lens 10 is arranged to co-operate with a reflecting member 12, herein also called a reflector.
- the lens 10 is preferably composed of two or more sublenses. and is arranged to accomplish a parallel light beam from diverging light falling into the lens and coming from a light source 6 located in one of the foci 5 or focal planes 30 of the lens.
- the reflector 12 is in fig 1 placed at a distance A from the surface of the lens 10 that is turned away from the light source.
- the optical device 9 may also comprise distance organs 7, generally shown in fig 1, arranged to keep the reflector on the distance A from the lens 10.
- the reflector 12 has a reflective surface 32 having the same bending curve as the surface of the lens that is turned away from the light source.
- a light beam, coming from the light source and falling into the lens, is refracted in the lens a first time and is then reflected back into the lens by the reflector 12.
- Fig 2 shows a second embodiment of the optical device 9, in which the reflector 12 is applied in immediate contact with the surface of the lens 10 that is turned away from the light source. This is particularly advantageous since the reflective surface of the reflector follows the surface of the lens and thereby the curve of the reflector can be suited to the lens with precision.
- the reflector can for example be made of or comprise metalic or dielectric materials, and can be applied to the surface of the lens for example by a vaporizing procedure.
- the reflector is devised to be partly permeable, and thus transmits a certain amount of the light falling into the lens while the remaining part of the light is reflected back into the lens.
- the reflector may also be devised such that it is permeable for one or more selected and predetermined light wavelengths, while other light wavelengths are reflected back into the lens.
- the reflector may be permeable for light in the infrared wavelength range and reflecting for other wavelengths.
- the reflector may also be impermeable for all light.
- the optical device 9 according to the invention is for the sake of simplicity hereinafter also called reflector lens.
- the above described reflector lens 9 is useful in different apparatuses that require a collimating device, particularly in such applications that require small dimensions and/or low weight.
- Fig 3 shows the invention incorporated in a apparatus 2 for detection of the gaze direction of an eye, more exactly in an eye controlled input/output device 2 e.g. for communication apparatuses, computers and cameras.
- a partly transparent beam splitter 8, here in the shape of a mirror, is arranged between the light source 6 and the reflector lens 9.
- a light sensitive device 13,14 comprising an image recording device 14 e.g. in the shape of a CCD, a vidicon tube or an emulsion based film (e.g.
- the apparatus 2 comprises an optional member 3 for collecting light reflected by the beam splitter 8.
- the member 3 is absent in some embodiments of the apparatus 2, but may in other embodiments be another light sensitive device similar to the device 13,14 or a finder in the shape of an aperture with or without a light refractive lens.
- the light source 6, the image recording device 14 and/or the member 3 are electrically controllable or can produce an electric output signal, said devices are provided with inputs and/or outputs for electric signals.
- a picture is presented on the light source 6 which is situated in the focal plane of the reflector lens 9.
- Light beams from the picture goes through the beam splitter 8 and are collimatingly refracted in the reflector lens 9, whereupon at least a part of the light quantity first is re-reflected through the reflector lens 9 and is then reflected by the beam splitter 8 towards an aperture 3.
- a user's eye gazing through the aperture 3 sees the picture reflected from the beam splitter 8 and concurrently an image of the eye is reflected by the beam splitter 8 towards the light sensitive device 13.14.
- the gaze direction of the eye can be determined in a manner known e.g. through the above mentioned prior art documents and thereby can also the part of the picture being gazed at be determined.
- the beam path in a device according to fig 3 is generally shown in fig 4.
- a diverging light beam having its origin in a point of the light source situated on the optical axis of the reflector lens 9 and being drawn with fully drawn lines, goes through the beam splitter 8 and falls into the reflector lens 9.
- the light beam is collimated by the light refractive part 10 of the reflector lens 9.
- the diverging light beam is then reflected by the reflecting organ 12 of the reflector lens 9 back through the light refractive part 10.
- the light being reflected into the reflector lens 9 goes out from the lens in collimated form, i.e. as a parallel light beam, and is again reflected by the beam splitter 8 towards an eye 1 drawn in fig 4.
- Light from another point of the light source is collimated and reflected in an analogue manner, an example of which is drawn with intermittent lines. Parallel light is thus falling on the eye and the eye perceives a presented picture as if it was situated at a larger distance from the eye.
- Fig 5A, 5B, 6, 7A, 7B and 8 shows an eye controlled input/output interface 2, in addition to the above mentioned components further comprising an objective for projection of an object image on an image plane.
- the object image is projected on the same image recording device 14 as the one which is used for the detection of an image of an eye.
- the image recording device 14 is pivotable around an axis 16, such that the organ 14 can be switched between recording of an image of an eye (fig 5 A) and recording of an image projected through the objective 18, i.e. used as a camera.
- the embodiment according to fig 7 comprises a mirror 20 that is pivotable around an axis 22, such that either an image of an eye (fig 7 A) or an image of another object can be projected on the image recording device 14.
- a picture presentation device 6 e.g. in the shape of an LCD-display in order to present the picture to the eye.
- the interface will then operate as a camera with a finder, and the user can by means of a trigger 36 (fig 5 A, 7 A) grab an image for storage or for transmission through telecommunication.
- Fig 9 shows in perspective an embodiment of the inventive interface 2, in which the picture presentation device 6 and the image recording device 13,14 are placed in mutually perpendicular first and second planes.
- the beam splitter 8 is arranged such that it reflects light in a direction having an axis perpendicularly intersecting a third plane, which in its turn is perpendicular to the first and second planes.
- An objective 18 is placed in a fourth plane being parallel to the third plane.
- the interface 2 further comprises a mirror 24 being pivotably arranged on an axis 38. In a first position (as in fig 9) an image of an eye is reflected into the image recording device 14. In a second position, when the mirror 24 is turned 90 degrees around the axis 38, an image from the objective is instead reflected into the image recording device 14. As for the rest, the same functions as described above are found in this embodiment of the interface 2.
- Fig 10 shows in a side view the mirror 24 that is suspended on an axis 38
- fig 11 shows the relative position of the members 6, 14, 18 in relation to the gaze direction of a users eye 1.
- Fig 12 shows the use of an interface 2 communicatively coupled to a telecommunication device 40 and/or an information processing apparatus 42.
- the objective 18 reproduces an object 39.
- light catching member e.g. an aperture or a detector
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Image Input (AREA)
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PL98336150A PL336150A1 (en) | 1998-02-16 | 1998-02-16 | Optically controlled optoelectric i/o interface |
JP10535674A JP2001503177A (ja) | 1998-02-16 | 1998-02-16 | 目で制御された光電入出力インタフェース |
EP98904505A EP0976024A2 (en) | 1998-02-16 | 1998-02-16 | Eye controlled opto-electric input/output interface |
AU62355/98A AU6235598A (en) | 1997-02-17 | 1998-02-16 | Eye controlled opto-electric input/output interface |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
SE9700557A SE9700557D0 (sv) | 1997-02-17 | 1997-02-17 | Optisk anordning |
SE9700557-3 | 1997-02-17 | ||
SE9700556A SE9700556D0 (sv) | 1997-02-18 | 1997-02-18 | Optoelektrisk input-/outputgränssnitt |
SE9700556-5 | 1997-02-18 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO1998036348A2 true WO1998036348A2 (en) | 1998-08-20 |
WO1998036348A3 WO1998036348A3 (en) | 1998-12-10 |
Family
ID=26662908
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/SE1998/000272 WO1998036348A2 (en) | 1997-02-17 | 1998-02-16 | Eye controlled opto-electric input/output interface |
Country Status (3)
Country | Link |
---|---|
AU (1) | AU6235598A (cs) |
CZ (1) | CZ289121B6 (cs) |
WO (1) | WO1998036348A2 (cs) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002091062A1 (en) * | 2001-05-10 | 2002-11-14 | Försvarets Materielverk | Display device with multiple focal planes |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1987007497A1 (en) * | 1986-06-04 | 1987-12-17 | P Lsg Rd Goete | An optical device |
-
1998
- 1998-02-16 CZ CZ19993733A patent/CZ289121B6/cs not_active IP Right Cessation
- 1998-02-16 WO PCT/SE1998/000272 patent/WO1998036348A2/en not_active Application Discontinuation
- 1998-02-16 AU AU62355/98A patent/AU6235598A/en not_active Abandoned
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1987007497A1 (en) * | 1986-06-04 | 1987-12-17 | P Lsg Rd Goete | An optical device |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002091062A1 (en) * | 2001-05-10 | 2002-11-14 | Försvarets Materielverk | Display device with multiple focal planes |
Also Published As
Publication number | Publication date |
---|---|
CZ373399A3 (cs) | 2000-03-15 |
WO1998036348A3 (en) | 1998-12-10 |
CZ289121B6 (cs) | 2001-11-14 |
AU6235598A (en) | 1998-09-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5684497A (en) | Twice folded compound magnified virtual image electronic display | |
US11256086B2 (en) | Eye tracking based on waveguide imaging | |
US5625372A (en) | Compact compound magnified virtual image electronic display | |
US11128847B2 (en) | Information display device and information display method | |
US5771124A (en) | Compact display system with two stage magnification and immersed beam splitter | |
JP3429320B2 (ja) | 眼鏡及びフェースマスクに対するイメージコンバイニングシステム | |
US8582206B2 (en) | Laser-scanning virtual image display | |
US5815741A (en) | Image observing apparatus and imaging apparatus utilizing the image observing apparatus | |
US20040070839A1 (en) | Wide field of view head mounted display device | |
CN107797290B (zh) | 虚拟现实显示光学系统及虚拟现实眼镜 | |
JP2000231060A5 (cs) | ||
CN113424085A (zh) | 用于通过光波导的倾斜表面的光耦合的色散补偿 | |
US6055109A (en) | Head-mounted display apparatus with a single image display device | |
WO1998036348A2 (en) | Eye controlled opto-electric input/output interface | |
EP0976024A2 (en) | Eye controlled opto-electric input/output interface | |
US4188102A (en) | Mirror reflex camera with electronic rangefinder | |
WO1998013720A1 (en) | Method and apparatus for optical scanning | |
KR20000077394A (ko) | 광학 뷰파인더를 통해 이미지를 디스플레이하는 디지털카메라 시스템 및 방법 | |
JPH09262210A (ja) | 光学システム | |
JP2001108933A (ja) | ヘッドマウントディスプレイ装置 | |
WO2023209710A1 (en) | Eye-tracking via lightguides | |
CN118311778A (zh) | 光学装置及其成像方法 | |
CN117043663A (zh) | 图像显示设备 | |
JP3266294B2 (ja) | ビデオカメラ | |
CN110147028A (zh) | 投影装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH HU IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG |
|
AK | Designated states |
Kind code of ref document: A3 Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH HU IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A3 Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
ENP | Entry into the national phase |
Ref country code: JP Ref document number: 1998 535674 Kind code of ref document: A Format of ref document f/p: F |
|
NENP | Non-entry into the national phase |
Ref country code: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: PV1999-3733 Country of ref document: CZ |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1998904505 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 09402431 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 1998904505 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: PV1999-3733 Country of ref document: CZ |
|
WWG | Wipo information: grant in national office |
Ref document number: PV1999-3733 Country of ref document: CZ |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 1998904505 Country of ref document: EP |