WO2004086210A1 - Wireless device for controlling a display - Google Patents

Wireless device for controlling a display Download PDF

Info

Publication number
WO2004086210A1
WO2004086210A1 PCT/EP2003/003185 EP0303185W WO2004086210A1 WO 2004086210 A1 WO2004086210 A1 WO 2004086210A1 EP 0303185 W EP0303185 W EP 0303185W WO 2004086210 A1 WO2004086210 A1 WO 2004086210A1
Authority
WO
WIPO (PCT)
Prior art keywords
wireless device
radiation
subbeam
emitting means
deflector
Prior art date
Application number
PCT/EP2003/003185
Other languages
French (fr)
Inventor
Martin GÖBEL
Sergey MATVEYEV
Pavel FROLOV
Original Assignee
Fraunhofer Ges Forschung
Goebel Martin
Matveev Serguei
Frolov Pavel
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Ges Forschung, Goebel Martin, Matveev Serguei, Frolov Pavel filed Critical Fraunhofer Ges Forschung
Priority to PCT/EP2003/003185 priority Critical patent/WO2004086210A1/en
Priority to AU2003226721A priority patent/AU2003226721A1/en
Publication of WO2004086210A1 publication Critical patent/WO2004086210A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/0875—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more refracting elements
    • G02B26/0883—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more refracting elements the refracting element being a prism
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10—Beam splitting or combining systems
    • G02B27/106—Beam splitting or combining systems for splitting or combining a plurality of identical beams or images, e.g. image replication
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10—Beam splitting or combining systems
    • G02B27/1086—Beam splitting or combining systems operating by diffraction only
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0386—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry for light pen

Definitions

  • Wireless device for controlling a display
  • the present invention relates to a hand-held wireless device for controlling a display so as to interact with a computer.
  • Wireless devices for controlling a display are basically known as mice which emit infrared signals received by a receiver connected to a computer associated with the display.
  • mice which emit infrared signals received by a receiver connected to a computer associated with the display.
  • a cursor or the like symbol By means of these known mice it is merely possible to control movement of a cursor or the like symbol over the display.
  • the wireless device comprises a hand-held electromagnetic radiation emitting means for emitting at least two radiation beams towards a surface, the radiation beams forming a defined angle between each other, a detector for detecting the points of impingement of the at least two radiation beams on the surface, a calculation means for calculating the position and/or orientation and/or movement of the radiation emitting means relative to the surface based on the relative arrangement of the points of impingement and the angle between the at least two radiation beams, and - a controller for controlling the display and/or a cursor on the display in accordance with the position and/or orientation and/or movement of the radiation emitting means as determined relative to the surface by the calculation means.
  • the impingement points of at least two radiation beams on a surface are detected i.e. by means of a camera receiving radiation reflected at the impingement points in case of a reflective surface or transmitted through the surface at the impingement points in case of a transmissive surface.
  • the at least two radiation beams are emitted by a handheld electronic radiation emitting means i.e. a IR-radiation source and form a defined angle between each other. Based on this angle and the distance of the impingement points and the relative arrangement thereof as detected, a calculation means calculates the position and/or orientation and/or movement of the radiation emitting means relative to the surface.
  • the signal of the calculation means is received by a controller for controlling the display and/or a cursor on the display in accordance with the position and/or orientation and/or movement of the radiation emitting means as determined relative to the surface by the calculation means.
  • the hand-held electromagnetic radiation emitting means By means of the hand-held electromagnetic radiation emitting means one can point at different locations of the surface wherein a cursor which is represented by for example a dot is shown on a screen or the like display at a location corresponding to the locations of the impingement points of the radiation beams on the surface.
  • a cursor which is represented by for example a dot is shown on a screen or the like display at a location corresponding to the locations of the impingement points of the radiation beams on the surface.
  • the wireless device like a laser-pointer with the additional feature that the user not merely can point to specific locations of the surface but can also control a display.
  • the angle between the at least two radiation beams can be changed by the user. This is possible i.e. by means of a tiltable deflector arranged along the optical path of one of the radiation beams. The tilting movement can be performed between a first and a second position.
  • the deflector is a prism or a reflector.
  • the hand-held electromagnetic radiation emitting means can comprise several radiation emitting sources for emitting separated radiation beams.
  • at least two radiation beams forming a defined angle between each other can also be generated by a single radiation emitting source.
  • a beam splitter is arranged within the optical path of the single radiation beam generating two radiation beams.
  • the beam splitter partially is arranged in the optical path of the radiation emitting means such that a first part of the radiation beam (first subbeam) laterally passes the beam splitter while a second subbeam passes through the beam splitter and is deflected thereby so as to generate a subbeam having a defined angle with regard to the first subbeam.
  • the beam splitter can comprise a first optical grating generating subbeams of at least zero and first orders.
  • first optical grating generating subbeams of at least zero and first orders.
  • three impingement points are generated on the surface towards which the radiation is emitted.
  • the beam splitter in addition to the first optical grating the beam splitter comprises a second optical grating which is rotated by 90° relative to the first optical grating for generating subbeams of at least zero and first orders from each subbeam resulting from the first grating. With this arrangement, nine impingement points are generated on the surface.
  • the detector preferably comprises a digital camera or the like image sensor as well as an image data processor for processing the image data of the camera or sensor for detecting and calculating the locations of the points of impingement of the at least two radiation beams on the surface.
  • the data of the detector are processed in a natural hand tremor smoothing module for compensating the detected oscillation movements of the points of impingement due to natural hand tremor.
  • a natural hand tremor smoothing module for compensating the detected oscillation movements of the points of impingement due to natural hand tremor.
  • An example of such a module is described in FROLOV P., MATVEYEV S., GOBEL M. AND KLIMENKO S. Using Kalman Filter for Natural Hand Tremor Smooting during the Interaction with the Projection Screen, in Workshop Proceedings VEonPC'2002, pp. 94 - 101, Protvino, Russia, 2002.
  • the surface can be reflective or transmissive.
  • the camera is arranged in front of the surface, if a projector for projecting an image onto the surface is provided, the projector is also arranged in front of the surface.
  • the camera is arranged behind the surface while the radiation emitting means is arranged and hand-held in front of the surface. If the surface is transflective, i.e. partially transmissive and partially reflective, the camera and the radiation emitting device as well as the projector can be arranged on either side of the surface.
  • Fig. 1 shows the basis scheme of the system according to the invention
  • Fig. 2 shows the optical elements of a wireless device according to a first embodiment of the present invention using an optical prism as a beam splitter
  • Fig. 3 explains how movements in the z-direction with regard to a surface can be detected
  • Fig. 4 shows a wireless device according to a second embodiment using a first optical prism as a beam splitter for generating two subbeams and using a tiltable second optical prism as another beam splitter for variating the angle between both subbeams, generating from one of these subbeams a further subbeam with the angle of that subbeam being changeable,
  • Fig. 5 shows a wireless device according to a third embodiment of the present invention using a grating as a beam splitter
  • Figs. 6 and 7 show perspective and side views of a wireless device according to a fourth embodiment of the present invention including an optical grating as a beam splitter and an optical prism tiltable for varying the angle of a subbeam laterally passing the optical grating with respect to the other subbeams passing through the optical grating, and
  • Fig. 8 shows a wireless device according to a fifth embodiment of the present invention comprising two optical gratings rotated relative to each other by 90°.
  • the overall system for which the wireless device according to the invention can be used is shown schematically in Fig. 1.
  • the system 10 comprises a handheld radiation emitting means 12 which is shown in more detail in Fig. 2 referred to later.
  • the radiation emitting means 12 emits two IR beams 14,16 which impinges on a surface 18 and generates thereon two points of impingement 20,22 invisible for a person looking at the surface 18.
  • This surface 18 in this embodiment is transmissive so that the image of the surface 18 and, in particular, the two points of impingement 20,22 can be detected by a camera 24 arranged behind the surface 18.
  • the camera 24 is a detector for detecting the location and relative arrangement of the points of impingement 20,22.
  • a calculating means 26 calculates the position and/or orientation and/or movement of the radiation emitting means 12 relative to the surface 18. Based on these information a projector 28 controlled by a computer 30 and projecting an image onto the surface 18 can be further controlled in that a cursor or the like i.e. a visible light dot is shown on the surface 18 wherein the position of the cursor corresponds to the position of the radiation emitting means 12 relative to the surface 18.
  • the calculation by the calculating means 26 is performed based on the fixed angle ofbetween the two radiation beams 14,16.
  • Fig. 3 shows how it is possible to detect the distance L between the radiation emitting means 12 and the surface 18. Namely depending on that distance L the distance d between the two points of impingement 20,22 will vary.
  • the radiation emitting means 12 comprises an IR laser source 32 emitting IR radiation focused by a focusing lens 36 so as to generate radiation beam 34. Behind the focusing lens 36 there is arranged an IR beam splitter 38 provided as an optical prism 40 which partially interfere with the optical path of the radiation beam 34.
  • the optical prism 40 is fixedly arranged and slightly tilted.
  • a first subbeam 42 of the radiation beam 34 laterally passes the optical prism 40 while the remaining part (second subbeam) of the focused radiation beam of the laser source 32 passes through the optical prism 40 so as to generate a second subbeam 44 forming an angle relative to the first subbeam 42.
  • FIG. 4 Another example of a wireless device is shown in Fig. 4 wherein parts and components of that wireless device identical or similar to those of the wireless device according to Fig. 2 are referred to by the same reference numerals.
  • the wireless device 12 is similar to that of Fig. 2 and, accordingly, comprises an IR laser source 32 and a focusing lens 36 as well as an optical prism 40.
  • This wireless device 12 generates a first subbeam 42 and a second subbeam 44 with a fixed angle ⁇ formed therewith.
  • a deflecting element 46 comprising another optical prism 48 in this embodiment.
  • This optical prism 48 can be tilted around an axis 50 of a holder 51 wherein the axis 50 is transversely arranged with regard to the optical axis of the first subbeam 42.
  • the first subbeam 42 partially passes through the optical prism 48 generating a further subbeam 49.
  • the angle by which the further subbeam 49 is deflected can be changed from an initial value ⁇ by plus/minus ⁇ . Tilting the optical prism 48 results in a variation of the distance between the points of impingement of subbeams 42 and 49 on the surface. This variation in distance can be detected by the camera and correspondingly evaluated in the calculating means 26 and/or the computer 30 like a mouse- button function. Accordingly, by tilting the prism 48 a user can select a specific task provided by the user interface of the system 10.
  • FIG. 5 another embodiment of the wireless device 12 is shown. Also here as well as in Figs. 6 to 8 the same parts and elements of the device 12 are referred to by the same reference numerals as in the preceding Figs.
  • an IR light source 32 generates a radiation beam 34 which is focused by a focusing lens 36.
  • the generation of several subbeams 42,44, and 52 is performed by means of an optical grating 54.
  • three subbeams 42,44, and 52 of zero order and first order are generated providing impingement points 20,22, and 56 on the surface 18.
  • Figs. 6 and 7 show a device 12 similar to that of Fig. 5 and modified by the arrangement of the optical grating and by the provision of a tiltable part 51 similar to that according to Fig. 4 and arranged along the optical path between the device 12 and the surface 18.
  • the radiation beam 34 in its part 55 passes along the optical grating 54 wherein the remaining part of the radiation beam 34 passes through the optical grating 54 for generating the three subbeams 42,44, and 52 of zero and first orders.
  • the tiltable part 51 comprises an optical prism 48 for deflecting part 55 of radiation beam 34. Without tilting part 51 the optical prism 48 deflects the radiation beam part 55 by an angle ⁇ so as to result in deflected subbeam 57. Similar to the wireless device according to Fig. 4, by tilting the holding part 51 the angle ⁇ can be changed by e.g. plus/minus ⁇ so that it is possible to realize a mouse button function.
  • FIG. 8 Another embodiment of a wireless device 12 is shown in Fig. 8.
  • This embodiment is similar to that of Fig. 5 and comprises an IR laser source 32 and a focusing lens 36 for focusing the IR radiation beam 34 of the IR laser source 32.
  • Two gratings 54,58 are arranged along the optical path of the IR radiation beam 34. These two optical gratings 54 are rotated by 90°.
  • Each of the gratings 54,58 generates subbeams of zero and first orders so that a pattern of nine subbeams is generated causing nine impingement points on the surface 18. Due to the shape and orientation of the impingement point pattern the distance and orientation of the wireless device 12 relative to the surface 18 can be detected.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Position Input By Displaying (AREA)

Abstract

The wireless device for controlling a display comprising a hand-held electromagnetic radiation emitting means (12) for emitting at least two radiation beams (42,44,52) towards a surface, the radiation beams (42,44,52) forming a defined angle (a) between each other, a detector (24) for detecting the points of impingement (20,22,56) of the at least two radiation beams (42,44,52) on the surface (18), a calculation means (26) for calculating the position and/or orientation and/or movement of the radiation emitting means (12) relative to the surface (18) based on the relative arrangement of the points of impingement (20,22,52) and the angle (a) between the at least two radiation beams (42,44,52), and a controller (30) for controlling the display and/or a cursor on the display in accordance with the position and/or orientation and/or movement of the radiation emitting means (12) as determined relative to the surface (18) by the calculation means (26).

Description

Wireless device for controlling a display
The present invention relates to a hand-held wireless device for controlling a display so as to interact with a computer.
Wireless devices for controlling a display are basically known as mice which emit infrared signals received by a receiver connected to a computer associated with the display. However, by means of these known mice it is merely possible to control movement of a cursor or the like symbol over the display.
It is an object of the present invention to provide a wireless device for controlling a display which operation is very convenient and allows the user direct access to a user interface presented on the display.
For solving this problem a wireless device for controlling a display is provided wherein the wireless device comprises a hand-held electromagnetic radiation emitting means for emitting at least two radiation beams towards a surface, the radiation beams forming a defined angle between each other, a detector for detecting the points of impingement of the at least two radiation beams on the surface, a calculation means for calculating the position and/or orientation and/or movement of the radiation emitting means relative to the surface based on the relative arrangement of the points of impingement and the angle between the at least two radiation beams, and - a controller for controlling the display and/or a cursor on the display in accordance with the position and/or orientation and/or movement of the radiation emitting means as determined relative to the surface by the calculation means.
According to the invention, the impingement points of at least two radiation beams on a surface are detected i.e. by means of a camera receiving radiation reflected at the impingement points in case of a reflective surface or transmitted through the surface at the impingement points in case of a transmissive surface. The at least two radiation beams are emitted by a handheld electronic radiation emitting means i.e. a IR-radiation source and form a defined angle between each other. Based on this angle and the distance of the impingement points and the relative arrangement thereof as detected, a calculation means calculates the position and/or orientation and/or movement of the radiation emitting means relative to the surface.
The signal of the calculation means is received by a controller for controlling the display and/or a cursor on the display in accordance with the position and/or orientation and/or movement of the radiation emitting means as determined relative to the surface by the calculation means.
By means of the hand-held electromagnetic radiation emitting means one can point at different locations of the surface wherein a cursor which is represented by for example a dot is shown on a screen or the like display at a location corresponding to the locations of the impingement points of the radiation beams on the surface. By this technique it is possible to use the wireless device like a laser-pointer with the additional feature that the user not merely can point to specific locations of the surface but can also control a display.
By the invention it is possible to calculate the position of the radiation emitting means in x-, y-, and z-direction and rotational movements of the radiation emitting means around the x-, y- and z-axes. In order to realize a function like a mouse button, in accordance with a preferred embodiment of the invention, the angle between the at least two radiation beams can be changed by the user. This is possible i.e. by means of a tiltable deflector arranged along the optical path of one of the radiation beams. The tilting movement can be performed between a first and a second position. By more or less deflecting at least one of the radiation beams the distance between the impingement points on the surface is changed which can be detected by the detector and interpreted as a selection operation of the user or other operation of the user. Preferably the deflector is a prism or a reflector.
The hand-held electromagnetic radiation emitting means can comprise several radiation emitting sources for emitting separated radiation beams. As an alternative thereof, at least two radiation beams forming a defined angle between each other can also be generated by a single radiation emitting source. Tn such a case, within the optical path of the single radiation beam a beam splitter is arranged generating two radiation beams. In this embodiment, the beam splitter partially is arranged in the optical path of the radiation emitting means such that a first part of the radiation beam (first subbeam) laterally passes the beam splitter while a second subbeam passes through the beam splitter and is deflected thereby so as to generate a subbeam having a defined angle with regard to the first subbeam.
As an alternative embodiment, the beam splitter can comprise a first optical grating generating subbeams of at least zero and first orders. In this embodiment for example three impingement points are generated on the surface towards which the radiation is emitted.
In a further embodiment, in addition to the first optical grating the beam splitter comprises a second optical grating which is rotated by 90° relative to the first optical grating for generating subbeams of at least zero and first orders from each subbeam resulting from the first grating. With this arrangement, nine impingement points are generated on the surface.
As already mentioned above, the detector preferably comprises a digital camera or the like image sensor as well as an image data processor for processing the image data of the camera or sensor for detecting and calculating the locations of the points of impingement of the at least two radiation beams on the surface.
In another aspect of the present invention the data of the detector are processed in a natural hand tremor smoothing module for compensating the detected oscillation movements of the points of impingement due to natural hand tremor. An example of such a module is described in FROLOV P., MATVEYEV S., GOBEL M. AND KLIMENKO S. Using Kalman Filter for Natural Hand Tremor Smooting during the Interaction with the Projection Screen, in Workshop Proceedings VEonPC'2002, pp. 94 - 101, Protvino, Russia, 2002.
As already mentioned above, the surface can be reflective or transmissive. In case of a reflective surface, the camera is arranged in front of the surface, if a projector for projecting an image onto the surface is provided, the projector is also arranged in front of the surface. In case of a projection system comprising a transmissive surface the camera is arranged behind the surface while the radiation emitting means is arranged and hand-held in front of the surface. If the surface is transflective, i.e. partially transmissive and partially reflective, the camera and the radiation emitting device as well as the projector can be arranged on either side of the surface.
The invention will be described in more detail herein below referring to the drawing in which:
Fig. 1 shows the basis scheme of the system according to the invention, Fig. 2 shows the optical elements of a wireless device according to a first embodiment of the present invention using an optical prism as a beam splitter,
Fig. 3 explains how movements in the z-direction with regard to a surface can be detected,
Fig. 4 shows a wireless device according to a second embodiment using a first optical prism as a beam splitter for generating two subbeams and using a tiltable second optical prism as another beam splitter for variating the angle between both subbeams, generating from one of these subbeams a further subbeam with the angle of that subbeam being changeable,
Fig. 5 shows a wireless device according to a third embodiment of the present invention using a grating as a beam splitter,
Figs. 6 and 7 show perspective and side views of a wireless device according to a fourth embodiment of the present invention including an optical grating as a beam splitter and an optical prism tiltable for varying the angle of a subbeam laterally passing the optical grating with respect to the other subbeams passing through the optical grating, and
Fig. 8 shows a wireless device according to a fifth embodiment of the present invention comprising two optical gratings rotated relative to each other by 90°.
The overall system for which the wireless device according to the invention can be used, is shown schematically in Fig. 1. The system 10 comprises a handheld radiation emitting means 12 which is shown in more detail in Fig. 2 referred to later. The radiation emitting means 12 emits two IR beams 14,16 which impinges on a surface 18 and generates thereon two points of impingement 20,22 invisible for a person looking at the surface 18. This surface 18 in this embodiment is transmissive so that the image of the surface 18 and, in particular, the two points of impingement 20,22 can be detected by a camera 24 arranged behind the surface 18. The camera 24 is a detector for detecting the location and relative arrangement of the points of impingement 20,22. A calculating means 26 calculates the position and/or orientation and/or movement of the radiation emitting means 12 relative to the surface 18. Based on these information a projector 28 controlled by a computer 30 and projecting an image onto the surface 18 can be further controlled in that a cursor or the like i.e. a visible light dot is shown on the surface 18 wherein the position of the cursor corresponds to the position of the radiation emitting means 12 relative to the surface 18.
The calculation by the calculating means 26 is performed based on the fixed angle ofbetween the two radiation beams 14,16.
Fig. 3 shows how it is possible to detect the distance L between the radiation emitting means 12 and the surface 18. Namely depending on that distance L the distance d between the two points of impingement 20,22 will vary.
Also rotation of the radiation emitting means 12 around the optical axis of radiation beam 14 can be detected as being evident from Fig. 3 and the other embodiments of the wireless device as shown in Figs. 4 to 7.
In Fig. 2 the construction of the radiation emitting means 12 according to a first embodiment of the invention is shown. The radiation emitting means 12 comprises an IR laser source 32 emitting IR radiation focused by a focusing lens 36 so as to generate radiation beam 34. Behind the focusing lens 36 there is arranged an IR beam splitter 38 provided as an optical prism 40 which partially interfere with the optical path of the radiation beam 34. The optical prism 40 is fixedly arranged and slightly tilted. A first subbeam 42 of the radiation beam 34 laterally passes the optical prism 40 while the remaining part (second subbeam) of the focused radiation beam of the laser source 32 passes through the optical prism 40 so as to generate a second subbeam 44 forming an angle relative to the first subbeam 42.
Another example of a wireless device is shown in Fig. 4 wherein parts and components of that wireless device identical or similar to those of the wireless device according to Fig. 2 are referred to by the same reference numerals.
The wireless device 12 according to Fig. 4 is similar to that of Fig. 2 and, accordingly, comprises an IR laser source 32 and a focusing lens 36 as well as an optical prism 40. This wireless device 12 generates a first subbeam 42 and a second subbeam 44 with a fixed angle α formed therewith. Within a part of the optical path of the first subbeam 42 there is arranged a deflecting element 46 comprising another optical prism 48 in this embodiment. This optical prism 48 can be tilted around an axis 50 of a holder 51 wherein the axis 50 is transversely arranged with regard to the optical axis of the first subbeam 42. The first subbeam 42 partially passes through the optical prism 48 generating a further subbeam 49. By tilting the optical prism 48 the angle by which the further subbeam 49 is deflected can be changed from an initial value α by plus/minus Δα. Tilting the optical prism 48 results in a variation of the distance between the points of impingement of subbeams 42 and 49 on the surface. This variation in distance can be detected by the camera and correspondingly evaluated in the calculating means 26 and/or the computer 30 like a mouse- button function. Accordingly, by tilting the prism 48 a user can select a specific task provided by the user interface of the system 10.
In Fig. 5 another embodiment of the wireless device 12 is shown. Also here as well as in Figs. 6 to 8 the same parts and elements of the device 12 are referred to by the same reference numerals as in the preceding Figs. In the embodiment according to Fig. 5, an IR light source 32 generates a radiation beam 34 which is focused by a focusing lens 36. The generation of several subbeams 42,44, and 52 is performed by means of an optical grating 54. In this embodiment three subbeams 42,44, and 52 of zero order and first order are generated providing impingement points 20,22, and 56 on the surface 18.
Figs. 6 and 7 show a device 12 similar to that of Fig. 5 and modified by the arrangement of the optical grating and by the provision of a tiltable part 51 similar to that according to Fig. 4 and arranged along the optical path between the device 12 and the surface 18. The radiation beam 34 in its part 55 passes along the optical grating 54 wherein the remaining part of the radiation beam 34 passes through the optical grating 54 for generating the three subbeams 42,44, and 52 of zero and first orders. The tiltable part 51 comprises an optical prism 48 for deflecting part 55 of radiation beam 34. Without tilting part 51 the optical prism 48 deflects the radiation beam part 55 by an angle α so as to result in deflected subbeam 57. Similar to the wireless device according to Fig. 4, by tilting the holding part 51 the angle α can be changed by e.g. plus/minus Δα so that it is possible to realize a mouse button function.
Finally, another embodiment of a wireless device 12 is shown in Fig. 8. This embodiment is similar to that of Fig. 5 and comprises an IR laser source 32 and a focusing lens 36 for focusing the IR radiation beam 34 of the IR laser source 32. Two gratings 54,58 are arranged along the optical path of the IR radiation beam 34. These two optical gratings 54 are rotated by 90°. Each of the gratings 54,58 generates subbeams of zero and first orders so that a pattern of nine subbeams is generated causing nine impingement points on the surface 18. Due to the shape and orientation of the impingement point pattern the distance and orientation of the wireless device 12 relative to the surface 18 can be detected.

Claims

1. Wireless device for controlling a display, comprising a hand-held electromagnetic radiation emitting means (12) for emitting at least two radiation beams (42,44,52) towards a surface, the radiation beams (42,44,52) forming a defined angle (α) between each other, a detector (24) for detecting the points of impingement (20,22,56) of the at least two radiation beams (42,44,52) on the surface (18), a calculation means (26) for calculating the position and/or orientation and/or movement of the radiation emitting means (12) relative to the surface (18) based on the relative arrangement of the points of impingement (20,22,52) and the angle (α) between the at least two radiation beams (42,44,52), and a controller (30) for controlling the display and/or a cursor on the display in accordance with the position and/or orientation and/or movement of the radiation emitting means (12) as determined relative to the surface (18) by the calculation means (26).
2. Wireless device according to claim 1, wherein the radiation emitting means (12) emits infrared radiation.
3. Wireless device according to claim 1 or 2, further characterized by a tiltable deflector (46) arranged along the optical path of at least one of the radiation beams (42,44,52) for selectively deflecting the radiation beam.
4. Wireless device according to claim 3, wherein the deflector (46) is a prism (48) or a reflector.
5. Wireless device according to any one of claims 1 to 4, wherein the radiation emitting means (12) comprises an emitter (32) emitting a radiation beam (34) and a beam splitter (38) for splitting the beam (34) into at least two subbeams (42,44,52) having a defined angle (α) between each other.
6. Wireless device according to claim 5 and 3 and/or 4, wherein the deflector (46) is arranged behind the beam splitter (38).
7. Wireless device according to claim 5 or 6, wherein the beam splitter (38) comprises a prism (40) arranged relative to the emitter (32) such that the radiation beam (34) partially impinges on the prism (40) resulting in a first subbeam (42) laterally passing the prism (40) and a second subbeam (42) passing through the prism (40).
8. Wireless device according to claim 7, wherein the first subbeam (42) partially laterally passes the deflector (46) and partially passes through the deflector (46) resulting in a further subbeam (49) deflected with regard to the part of the first subbeam (42) laterally passing the deflector (46).
9. Wireless device according to claim 5 or 6, wherein the beam splitter comprises a first optical grating (54) generating subbeams (42,44,52) of at least zero and first orders.
10. Wireless device according to claim 9, wherein the radiation beam (34) of the radiation emitter (32) (i) partially passes through the first optical grating (54) for generating the subbeams (42,44,52) of at least zero and first orders and (ii) partially laterally passes the optical grating (54) and impinges on the deflector (46) resulting in a further subbeam (57) deflected with regard to the subbeams (42,44,52) of at least zero and first orders of the first optical grating (54).
11. Wireless device according to claim 10, wherein the beam splitter comprises a second optical grating (58) rotated relative to the first optical grating (54) by 90° and generating from each subbeam (42,44,52) resulting from the first grating (54) subbeams of at least zero and first orders.
12. Wireless device according to any one of claims 1 to 11, wherein the detector comprises a camera (24) and an image data processor (26) for processing image data of the camera for detecting and calculating the locations of the points of impingement (20,22,54) of the at least two radiation beams (42,44,52) on the surface (18).
13. Wireless device according to claim 12, wherein the image data processor (26) comprises a natural hand tremor smoothing module for calculating the location of the points of impingement (20,22,54) of the at least two radiation beams (42,44,52) on the surface (18) based on the detected oscillation movements thereof due to natural hand tremor.
14. Wireless device according to claim 13, wherein the natural hand tremor smoothing module comprises a Kalman filter.
15. Wireless device according to any one of claims 1 to 14, wherein the surface (18) is reflective and wherein the radiation emitting means (12) and the detector (24) and a projector (28), if provided, are arranged in front of the surface (18).
16. Wireless device according to any one of claims 1 to 14, wherein the surface (18) is at least partially transmissive and wherein the radiation emitting means (12) is arranged in front of the surface (18) and the detector (24) as well as a projector (28), if provided, are arranged behind the surface (18).
PCT/EP2003/003185 2003-03-27 2003-03-27 Wireless device for controlling a display WO2004086210A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/EP2003/003185 WO2004086210A1 (en) 2003-03-27 2003-03-27 Wireless device for controlling a display
AU2003226721A AU2003226721A1 (en) 2003-03-27 2003-03-27 Wireless device for controlling a display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2003/003185 WO2004086210A1 (en) 2003-03-27 2003-03-27 Wireless device for controlling a display

Publications (1)

Publication Number Publication Date
WO2004086210A1 true WO2004086210A1 (en) 2004-10-07

Family

ID=33040882

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2003/003185 WO2004086210A1 (en) 2003-03-27 2003-03-27 Wireless device for controlling a display

Country Status (2)

Country Link
AU (1) AU2003226721A1 (en)
WO (1) WO2004086210A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007172585A (en) * 2005-11-25 2007-07-05 Sega Corp Coordinate input device
WO2009153688A1 (en) * 2008-06-19 2009-12-23 Koninklijke Philips Electronics N. V. Remote control pointing technology
EP2186348A1 (en) * 2007-09-06 2010-05-19 Silicon Communications Technology CO., LTD. Remote controller transceiver
WO2017100475A1 (en) * 2015-12-09 2017-06-15 Integrated-X, Inc. Systems and methods for inspection using electromagnetic radiation

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01124019A (en) * 1987-11-09 1989-05-16 Fujitsu Ltd Three-dimensional coordinate specifying device
US5025314A (en) * 1990-07-30 1991-06-18 Xerox Corporation Apparatus allowing remote interactive use of a plurality of writing surfaces
JPH05265637A (en) * 1992-03-16 1993-10-15 Toshiba Corp Three-dimensional pointing device
JPH07134270A (en) * 1993-11-10 1995-05-23 Sony Corp Beam axis correcting device for laser pointer
US5502459A (en) * 1989-11-07 1996-03-26 Proxima Corporation Optical auxiliary input arrangement and method of using same
US5627565A (en) * 1994-05-26 1997-05-06 Alps Electric Co., Ltd. Space coordinates detecting device and input apparatus using same
DE19620332A1 (en) * 1996-05-21 1997-11-27 Dirk H Dipl Ing Steinhaeuser Wireless cursor remote control for multi-media system
WO1999026189A1 (en) * 1997-11-14 1999-05-27 Vlg Virtual Laser Games Gmbh Device for identifying and marking spots on a surface
US5929444A (en) * 1995-01-31 1999-07-27 Hewlett-Packard Company Aiming device using radiated energy
US6331848B1 (en) * 1996-04-27 2001-12-18 U.S. Philips Corporation Projection display system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01124019A (en) * 1987-11-09 1989-05-16 Fujitsu Ltd Three-dimensional coordinate specifying device
US5502459A (en) * 1989-11-07 1996-03-26 Proxima Corporation Optical auxiliary input arrangement and method of using same
US5025314A (en) * 1990-07-30 1991-06-18 Xerox Corporation Apparatus allowing remote interactive use of a plurality of writing surfaces
JPH05265637A (en) * 1992-03-16 1993-10-15 Toshiba Corp Three-dimensional pointing device
JPH07134270A (en) * 1993-11-10 1995-05-23 Sony Corp Beam axis correcting device for laser pointer
US5627565A (en) * 1994-05-26 1997-05-06 Alps Electric Co., Ltd. Space coordinates detecting device and input apparatus using same
US5929444A (en) * 1995-01-31 1999-07-27 Hewlett-Packard Company Aiming device using radiated energy
US6331848B1 (en) * 1996-04-27 2001-12-18 U.S. Philips Corporation Projection display system
DE19620332A1 (en) * 1996-05-21 1997-11-27 Dirk H Dipl Ing Steinhaeuser Wireless cursor remote control for multi-media system
WO1999026189A1 (en) * 1997-11-14 1999-05-27 Vlg Virtual Laser Games Gmbh Device for identifying and marking spots on a surface

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
"WIRELESS POINTING DEVICE", IBM TECHNICAL DISCLOSURE BULLETIN, IBM CORP. NEW YORK, US, vol. 36, no. 6B, 1 June 1993 (1993-06-01), pages 345 - 346, XP000377409, ISSN: 0018-8689 *
FROLOV P., MATVEYEV S., GÖBEL M.: "Using Kalman Filter for Natural Hand Tremor Smoothing during the Interaction with the Projection Screen", WORKSHOP PROCEEDINGS VEONPC 2002, Protvino, Russia 2002, XP008023256 *
PATENT ABSTRACTS OF JAPAN vol. 013, no. 368 (P - 919) 16 August 1989 (1989-08-16) *
PATENT ABSTRACTS OF JAPAN vol. 018, no. 039 (P - 1679) 20 January 1994 (1994-01-20) *
PATENT ABSTRACTS OF JAPAN vol. 1995, no. 08 29 September 1995 (1995-09-29) *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007172585A (en) * 2005-11-25 2007-07-05 Sega Corp Coordinate input device
EP2186348A1 (en) * 2007-09-06 2010-05-19 Silicon Communications Technology CO., LTD. Remote controller transceiver
EP2186348A4 (en) * 2007-09-06 2013-01-09 Silicon Comm Technology Co Ltd Remote controller transceiver
WO2009153688A1 (en) * 2008-06-19 2009-12-23 Koninklijke Philips Electronics N. V. Remote control pointing technology
WO2017100475A1 (en) * 2015-12-09 2017-06-15 Integrated-X, Inc. Systems and methods for inspection using electromagnetic radiation
US11029263B2 (en) 2015-12-09 2021-06-08 Integrated-X, Inc. Systems and methods for inspection using electromagnetic radiation

Also Published As

Publication number Publication date
AU2003226721A1 (en) 2004-10-18

Similar Documents

Publication Publication Date Title
US8436836B2 (en) Method and apparatus for forming, projecting and detecting a coded pattern image with a camera and recognition system
CN104081156B (en) There is the instrument of surveying and mapping of scan function and spot measurement pattern
US6164546A (en) Optical reader controlling operation between different scanning modes
JP5425368B2 (en) Method and apparatus for determining the absolute position of the tip of a long object on a plane with invariant features
EP0786117B1 (en) Apparatus and method for controlling the position of a graphical pointer
EP1030163B1 (en) reflective prism device
JP2012118076A (en) Range finder
CN101366001A (en) Transmitter, receiver, ans system with relative position detecting functionality between transmitters and receivers
JP2005091044A (en) Spatial position detection method, information inputting method, spatial position detector, and information inputting device
JP2004069611A (en) Optical wave distance measurement device
US9652085B2 (en) Spatial input device
JP2000353048A (en) Optical unit for detecting object, and position coordinate input device using the unit
US20040061680A1 (en) Method and apparatus for computer control
CN111879295A (en) Coordinate measuring and/or lofting apparatus
US5296838A (en) Wireless input system for computer
US20100073289A1 (en) 3d control of data processing through handheld pointing device
WO2004086210A1 (en) Wireless device for controlling a display
US6034764A (en) Portable electronic distance and vertical angle instrument
JPWO2014076993A1 (en) Interface device and input receiving method
JP4758667B2 (en) Pointer remote control device
JP2004110184A (en) Optical coordinate input system
CN112867907B (en) Laser graticule instrument with posture control function
JP2006134362A (en) Light emission detector and coordinate detector
US20160146592A1 (en) Spatial motion sensing device and spatial motion sensing method
WO2024071413A1 (en) Point cloud information generating system, point cloud information generating system control method, and point cloud information generating system control program

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP