EP0769176A1 - Dispositif et procede servant a transmettre des informations a un systeme de commande ou a un ordinateur - Google Patents

Dispositif et procede servant a transmettre des informations a un systeme de commande ou a un ordinateur

Info

Publication number
EP0769176A1
EP0769176A1 EP95923468A EP95923468A EP0769176A1 EP 0769176 A1 EP0769176 A1 EP 0769176A1 EP 95923468 A EP95923468 A EP 95923468A EP 95923468 A EP95923468 A EP 95923468A EP 0769176 A1 EP0769176 A1 EP 0769176A1
Authority
EP
European Patent Office
Prior art keywords
space
electromagnetic radiation
source
computer
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP95923468A
Other languages
German (de)
English (en)
Inventor
Christoph Dobrusskin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Central Research Laboratories Ltd
Original Assignee
Central Research Laboratories Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Central Research Laboratories Ltd filed Critical Central Research Laboratories Ltd
Publication of EP0769176A1 publication Critical patent/EP0769176A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means

Definitions

  • This invention relates to apparatus for providing information to a control system or computer, the apparatus comprising:- a) display means for producing a viewable image, and b) sensing means for sensing the presence and/or position of an object in a given region of space in the vicinity of the viewable image, this information for communication to the control system or computer, the sensing means having at least one detector element sensitive to electromagnetic radiation.
  • the invention also relates to a method for providing information to a control system or a computer.
  • apparatus as defined in the first paragraph above characterized in that the display means is arranged to produce a real image being suspended in space, and the sensing means senses from which of a plurality of sub-regions of the given region of space electromagnetic radiation, being emitted by or reflected from the object, emanates.
  • This arrangement makes interaction with a 3 dimensional and/or suspended real image more convenient and intuitive.
  • the apparatus preferably includes a source of electromagnetic radiation for scattering and/or reflection by the object, the source being arranged such that electromagnetic radiation emitted therefrom will not impinge directly upon any said detector element sensitive to such radiation, the source being further arranged to sequentially illuminate successive sub-regions of the given region of space.
  • the sensing means may advantageously comprise a plurality of arrays of detector elements sensitive to electromagnetic radiation. This can enable the sensing of the object in a three dimensional space without the requirement of sensors located round the periphery of the space.
  • the electromagnetic radiation emanating from the object can conveniently have been scattered and/or reflected from the display means. This eliminates the necessity for additional sources of electromagnetic radiation and can reduce power consumption of the apparatus.
  • the electromagnetic radiation may be modulated. This can give the advantage of making the signal easier to extract from background noise caused by ambient lighting which may be constant or modulated in a different manner.
  • a method of providing information to a control system or computer having a display comprising the steps of a) placing an object into a given region of space (having a plurality of sub- regions) in the vicinity of a real viewable image from the display being suspended in space, b) sensing into which sub-region the object has been placed by means of electromagnetic radiation scattered and/or reflected by the presence of the object or emitted by the object, and c) communicating this information to the control system or computer.
  • This method has the advantage that it can enable interaction between, for example, a human or animal and a real suspended image or virtual reality apparatus without the necessity of electrical connections or cabling.
  • Figure 1 is a perspective view of an apparatus for providing a real image suspended in space
  • Figures 2 and 3 are cross-sectional side views of the apparatus of Figure 1
  • Figure 4 shows a first embodiment of the apparatus according to the invention
  • Figure 5 shows a second embodiment of the apparatus according to the invention
  • FIG. 6 shows a flow diagram of a method according to the invention.
  • like integers are assigned the same number whenever possible in subsequent drawings.
  • beamsplitter 4 is mounted for example in an aperture in an opaque surface 2.
  • retroreflector means comprising an array of retroreflectors, such as a sheet 6 of corner-cubes, is positioned in a path for light which has been reflected by the beamsplitter 4. In this example it is positioned at an acute angle thereto, which is about 45°, so as to form the second side of a triangle therewith.
  • An object 8 as a picture displayed on a VDU screen is positioned along the third side of the triangle, at approximately 90° to the beamsplitter.
  • the screen 8 may be positioned at an angle in the range from 70 to 110° to the beamsplitter 4.
  • means for screening the retroreflector 6 from the object 8 is provided, such as a louvre film 12 in front of the object 8.
  • the beamsplitter 4 reflects light from the object 8 towards the retroreflector 6.
  • some of the light is transmitted by the beamsplitter 4 and is "lost".
  • the beamsplitter 4 also transmits light reflected from the retroreflector 6 to form the suspended image 14 opposing the object 8 with respect to the beamsplitter 4.
  • some of the light is reflected by the beamsplitter back towards the original image 8.
  • a further array of retroreflectors 16 is positioned in a path for light which has been transmitted by the beamsplitter.
  • the further array opposes the retroreflector 6 with respect to the beamsplitter 4; that is, it forms a triangular arrangement with the beamsplitter 4 and the suspended image 14.
  • the further array of retroreflectors 16 directs light which is transmitted by the beamsplitter 4 directly from the original image 8 back towards the beamsplitter 4 to prevent 'loss' of this light.
  • the array of retroreflectors 6 in a path for light which is reflected by the beamsplitter 4 could be omitted, leaving only the array in the path of transmitted light.
  • the object 8 is a projection screen, and an image is formed thereon by a projector 18.
  • the projector 18 is shown positioned in the gap 10 between the retroreflector array 6 and the object 8, but may have other positions. For example it may be positioned in an aperture in the retroreflector array 6.
  • the beamsplitter may be polarization selective, transmitting light having one type of circular polarization and reflecting light having the other type.
  • it may comprise layers of cholesteric liquid crystal polymers reflecting different spectral regions of circularly polarized light of one sense so as to reflect white light (i.e. the whole visible spectrum) of this sense.
  • the object may be arranged to emit circularly polarized light, in which case one of the arrays 6, 16 may be omitted, since all of the light from the object could be of the type which is either reflected or is transmitted by the selective beamsplitter.
  • a transmissive such screen is disclosed in GB 1509180.
  • Figures 4 and 5 show such an image together with an input device according to the present invention.
  • apparatus for providing information to a control system or computer comprises display means (51) as described above for producing a viewable image (14), and sensing means (53, 54) for sensing the presence and/or position of an object (55) in a given region of space (56) in the vicinity of the viewable image, this information for communication to the control system or computer (57), the sensing means having at least one detector element sensitive to electromagnetic radiation.
  • the sensing means (53, 54) senses from which of a plurality of sub-regions of the given region of space electromagnetic radiation, emanating from the object, is emitted.
  • the sensing means comprises two 2-dimensional photosensitive element arrays (53, 54) for sensing the presence and/or position of an object (e.g.
  • the elements are sensitive to infra-red radiation which is scattered and/or reflected via the object (55) from a source (58) of infra-red radiation which illuminates the space.
  • the detector elements and source are arranged so that infra-red light does not illuminate the detector elements directly.
  • the detector element arrays identify which possible sub-region of the given space the infra-red signal associated with the object emanates.
  • the sensing means may be made as described in US patent number 5,196,900, which is incorporated herein by reference.
  • the display means (51) in the present embodiment comprises apparatus as described above and shown in Figures 1 and 2 which display means projects a real image (14) suspended in space (56) above the display means.
  • the display means includes a transparent sheet (2) which isolates the light sources from the space in which the image is formed.
  • the image is formed by visible light which passes through the transparent sheet from the display means.
  • electromagnetic radiation in the form of infra-red rays scattered by the object of interest (55) from the source (58) passes through the transparent sheet to be detected by the photosensitive element arrays (53, 54).
  • These arrays each have an optical system (60), in the present embodiment comprising a converging lens which makes each detector element sensitive to light incident from a narrow range of solid angles.
  • intersection of these solid angles from each of the two detector element arrays define a lattice of sub- regions of the given space in the vicinity of the image (14).
  • Each sub-region excites a different pair of detector elements, making the position of the object (55) in space correspond to a unique sub-region identified by the pair of addresses of the excited elements in the two arrays (53, 54).
  • infra-red sources are used to illuminate the given space
  • a single source may be used as an alternative.
  • no infra-red sources are present and the detector element arrays detect the infra-red radiation emitted passively by the object (such as for example a part of the human or animal body).
  • the infra-red source can be modulated at a given frequency so as to enable the detector elements to discriminate against ambient infra-red light.
  • the optical system (60) is separate from the two arrays, the optical systems may be made integral with the arrays if desired.
  • the light emanating from the display means to form the image may be scattered and/or reflected by the object when it intersects or penetrates the image, this light being detected by the sensing means. Because this light is likely to be visible Ught, ambient light present close to the real image may result in interference when using the last alternative. This disadvantage can be mitigated by causing the intensity of the light source to fluctuate periodically. In order to make this less disturbing for the viewer, it is advantageous if the fluctuations occur at a frequency higher than a critical fusion frequency dependent upon local illumination conditions.
  • two two-dimensional arrays of detector elements have been used, two one-dimensional arrays at an oblique angle to one another can be used, as can a one-dimensional array together with a two-dimensional array to provide sensing of the object in a more restricted given space or with reduced precision in one direction. It is preferable to use one-dimensional arrays in which the detector elements have acceptance angles which are wide in a direction orthogonal to the line of array elements to give adequate position triangulation.
  • the sensing means comprises a single photosensitive element (64) which can sense the presence of incident electromagnetic radiation over a large acceptance angle, together with means to sequentially illuminate sub-regions of the given space.
  • the means comprise two one-dimensional LED arrays (65, 66) coupled to respective converging lenses (67, 68). Each LED in (65) is illuminated in turn for a given time whilst the photosensitive element is ready to receive a scattered or reflected signal from the object (55). Each LED is controlled to emit light in a specific time interval so that the output from the photosensitive element may be identified with a specific LED.
  • the LEDs in 65 When all the LEDs in 65 have been illuminated, the LEDs in 66 are illuminated one at a time in turn as before.
  • each LED may be assigned a specific time so that a signal from the photosensitive element may be unambiguously be identified. If no signals are present the procedure starts over again and no data need be communicated to the computer. If an object is present, two signals at respective times will be generated. These signals wUl have a one-to-one correspondence with one LED in 65 and one LED in 66, and triangulation techniques may be employed to identify in which sub-region of space the object was present. This information is then communicated to the computer. As an alternative the computer may perform the triangulation analysis itself from the detected information - in this case the identity of the relevant LEDs.
  • any method of generating two sets of Uluminated stripes which intersect may be used, for example two sets of raster scanned laser beams.
  • a two dimensional array of detector elements together with a raster scanned laser beam may be employed to determine the position of any object in a given sub-region of space.
  • point Ught sources may be used. In order to minimize the number of such light sources, one may share each lens in the above example, but shine Ught perpendicular to the arrays. In this case a beam spUtter is used to deflect the Ught through the lens without illuminating the arrays directly. Using this arrangement electromagnetic radiation reflected directly back towards its source may be partially transmitted towards the detector elements by the beam-spUtter.
  • the intensity of the VDU (or source of Ught for iUuminating the object 8 such as a fluorescent lamp) in the examples above fluctuates at a frequency of approximately 100 Hz. This regular fluctuation may be used to discriminate between stray illumination to give a better signal to noise ratio for the Ught signals scattered by the presence of a finger, provided that the ambient Ught fluctuates at a different frequency or does not fluctuate. Non-regular pulsed fluctuations may be used provided there is means to identify when the scattered signal is due. Other methods of modulating the electromagnetic radiation in the above examples may be used - specifically modulating the intensity, frequency, polarization state or phase relationship. An object comprising a retroreflective portion at the end of a wand may be used to increase the signal reflected towards the detector elements if they are close to the optical position of the source.
  • Block 40 denotes placing an object into a given region of space (having a pluraUty of sub-regions) in the vicinity of the suspended image from the display,
  • Block 41 denotes sensing into which sub-region the object has been placed by means of electromagnetic radiation scattered and/or reflected by the presence of the object or emitted by the object, and
  • Block 42 denotes communicating this information to the control system or computer.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Position Input By Displaying (AREA)

Abstract

Dispositif servant à transmettre des informations à un ordinateur et comprenant un écran visuel (51) produisant une image pouvant être visualisée (14) et qui est suspendue dans l'espace, ainsi qu'un détecteur possédant deux ensembles d'éléments photosensibles (53, 54), afin de détecter la présence et/ou la position d'un objet (par exemple, un doigt) (55) dans un espace donné à proximité de l'image, ces informations étant transférées à l'ordinateur. Les éléments sont sensibles au rayonnement infrarouge, qui est soit émis passivement, soit diffusé et/ou réfléchi par l'intermédiaire de l'objet depuis une source (58) de rayonnement infrarouge éclairant l'espace. Les éléments du détecteur et la source sont disposés de telle manière que la lumière n'éclaire pas directement lesdits éléments. Les ensembles d'éléments du détecteur permettent d'identifier de quelle sous-région éventuelle de l'espace donné émane le signal infrarouge associé à l'objet. L'invention permet de réaliser une interaction avec une image en suspension ou avec un système de réalité virtuelle sans entourer l'espace par des sources lumineuses et/ou des détecteurs.
EP95923468A 1994-07-01 1995-06-29 Dispositif et procede servant a transmettre des informations a un systeme de commande ou a un ordinateur Withdrawn EP0769176A1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
GB9413214A GB9413214D0 (en) 1994-07-01 1994-07-01 Apparatus and method for providing information to a control system or computer
GB9413214 1994-07-01
PCT/GB1995/001547 WO1996001455A1 (fr) 1994-07-01 1995-06-29 Dispositif et procede servant a transmettre des informations a un systeme de commande ou a un ordinateur

Publications (1)

Publication Number Publication Date
EP0769176A1 true EP0769176A1 (fr) 1997-04-23

Family

ID=10757617

Family Applications (1)

Application Number Title Priority Date Filing Date
EP95923468A Withdrawn EP0769176A1 (fr) 1994-07-01 1995-06-29 Dispositif et procede servant a transmettre des informations a un systeme de commande ou a un ordinateur

Country Status (3)

Country Link
EP (1) EP0769176A1 (fr)
GB (1) GB9413214D0 (fr)
WO (1) WO1996001455A1 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3258562B2 (ja) * 1996-05-21 2002-02-18 富士通株式会社 空中像入出力装置及び方法
US5965860A (en) * 1996-05-28 1999-10-12 Fujitsu Limited Management system for using IC card with registered personal information
FR2773894B1 (fr) * 1998-01-22 2001-08-31 Eastman Kodak Co Interface interactive
EP2488933A4 (fr) * 2009-10-12 2014-07-23 Hewlett Packard Development Co Affichage avec capteur optique

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NO164946C (no) * 1988-04-12 1990-11-28 Metronor As Opto-elektronisk system for punktvis oppmaaling av en flates geometri.
JPH05127809A (ja) * 1991-04-19 1993-05-25 Sharp Corp 三次元空間座標入力装置
FR2686439A1 (fr) * 1992-01-20 1993-07-23 Data Stream Corp Element peripherique d'entree sans fil pour ordinateur.
WO1995002163A1 (fr) * 1993-07-08 1995-01-19 Science Accessories Corp. Determination de position et d'angle en utilisant la lumiere

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO9601455A1 *

Also Published As

Publication number Publication date
WO1996001455A1 (fr) 1996-01-18
GB9413214D0 (en) 1994-08-24

Similar Documents

Publication Publication Date Title
CN209543393U (zh) 屏下光学指纹识别系统、指纹识别显示装置及电子设备
US6175679B1 (en) Optical keyboard
US7705835B2 (en) Photonic touch screen apparatus and method of use
US6441362B1 (en) Stylus for optical digitizer
US7050048B2 (en) Coordinate input and detection device and information display and input apparatus
US5159322A (en) Apparatus to digitize graphic and scenic information and to determine the position of a stylus for input into a computer or the like
US20090103853A1 (en) Interactive Surface Optical System
US6948820B2 (en) Interactive display system having an optical channeling element
CN102053763B (zh) 光学位置检测装置及带位置检测功能的显示装置
US20080089090A1 (en) Interactive display using planar radiation guide
KR20080044017A (ko) 터치 스크린
CN102449584A (zh) 光学位置检测设备
CN106104443A (zh) 交互系统
CN101390041A (zh) 交互式显示面板的均匀照明
NO841823L (no) Optisk posisjonsindikeringsapparat
WO2016132568A1 (fr) Dispositif et procédé de saisie sans contact
US20120249480A1 (en) Interactive input system incorporating multi-angle reflecting structure
GB2263765A (en) Touch screen systems
AU695151B2 (en) Viewing device and method for ascertaining simultaneously optical color shift characteristics of an optically variable device
JP2016154035A5 (fr)
JPWO2018216619A1 (ja) 非接触入力装置
US20240019715A1 (en) Air floating video display apparatus
CN101807131A (zh) 侦测模块及包含此侦测模块的光学侦测系统
KR950012199A (ko) 중간 주파수에서 작동하는 광원으로 모니터를 사용하는 터치스크린 입력 장치
WO1996029677A1 (fr) Dispositif interactif d'affichage et d'entree

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 19970107

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): DE FR GB

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 19980103