EP2126673A2 - Positionsbestimmung in optischen schnittstellensystemen - Google Patents

Positionsbestimmung in optischen schnittstellensystemen

Info

Publication number
EP2126673A2
EP2126673A2 EP07858984A EP07858984A EP2126673A2 EP 2126673 A2 EP2126673 A2 EP 2126673A2 EP 07858984 A EP07858984 A EP 07858984A EP 07858984 A EP07858984 A EP 07858984A EP 2126673 A2 EP2126673 A2 EP 2126673A2
Authority
EP
European Patent Office
Prior art keywords
radiation
emitter
detector
transmissive element
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP07858984A
Other languages
English (en)
French (fr)
Other versions
EP2126673A4 (de
Inventor
Daniel D. YOUNG
Jens Wagenblast Stubbe Ostergaard
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FlatFrog Laboratories AB
Original Assignee
FlatFrog Laboratories AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FlatFrog Laboratories AB filed Critical FlatFrog Laboratories AB
Publication of EP2126673A2 publication Critical patent/EP2126673A2/de
Publication of EP2126673A4 publication Critical patent/EP2126673A4/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • G06F3/0423Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen using sweeping light beams, e.g. using rotating or vibrating mirror
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/0418Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04109FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location

Definitions

  • the present invention relates to optical interface systems, such as touch pads and touch screens, comprising a radiation-transmissive element that guides radiation by internal reflection, and in particular to techniques for determining the position of a point-of-touch on such an element based on radiation reflected/scattered/emitted into the element at the point of touch.
  • Optical interface systems are previously known.
  • WO 03/0077192, WO 2005/026938 and WO 2007/003196 describe different techniques for determining the position of the point-of-touch on an optical touch pad.
  • the present invention relates to a system for determining the position of an object adapted to reflect/scatter radiation, the system comprising: a radiation-transmissive element having a first surface being adapted to be engaged by the object so as to reflect/scatter radiation into the element and a second surface opposite the first surface, the radiation-transmissive element being adapted to guide radiation by internal reflection; a first radiation emitter being arranged to emit a pulse of radiation into the element and towards the first/second surface; a first detector arranged to detect radiation emitted into the radiation-transmissive element and reflected/scattered by the reflecting/scattering object, the first detector being adapted to output a first signal relating to the detected radiation; at least one of: a second radiation emitter being arranged to emit a pulse of radiation into the element and towards the first/second surface, and a second detector arranged to detect radiation emitted into the radiation-transmissive element and reflected/scattered by the reflecting/scattering object, the second detector
  • radiation is emitted into the radiation-transmissive element by means of the first (and possibly the second) emitter, such that the radiation propagates inside the radiation-transmissive element by being reflected between the first and the second surface.
  • An object touching the first surface at a point-of-touch may reflect/scatter said radiation such that it propagates in a plurality of different angles relative to the normal of the first and/or second surface. Radiation propagating above a predetermined angle relative to the normal of the first and/or second surface will be reflected by said surfaces whereby the radiation will bounce between the first and second surface. A part of said radiation may propagate in the direction of the first (and possibly the second) detector, which may detect the radiation.
  • the first (and possibly the second) emitter By determining the point in time of emission of radiation by the first (and possibly the second) emitter and by determining the point in time of detection of the reflected/scattered radiation by the first (and possibly the second) detector, it is possible to determine the time elapsed between emission and detection.
  • the elapsed time corresponds to the distance from the emitter to the detector via the point-of-touch. Accordingly, for each combination of an emitter and a detector it is possible to determine a plurality of possible positions of the point- of-touch.
  • the possible points of touch define a circle with the emitter/detector in the centre. If the emitter and the detector are spaced apart the possible points-of-touch define an ellipse, as the sum of the distance from the emitter to the point-of-touch and the distance from the point-of-touch to the detector is constant, as the sum is determined by the time between emission and detection. Accordingly, the emitter and detector are located in the focus-points of the ellipse.
  • first emitter and detector and at least a second emitter or detector, it is possible to determine at least two ellipses (circles), as will be further described below with reference to Fig. 4A-4C.
  • the point-of-touch may be determined as the point(s) of intersection of the ellipses.
  • the system comprises a first emitter El and a first and second detector Dl, D2, directly or indirectly connected to a determining means C. At least a part of the radiation emitted by the first emitter El, will propagate in the radiation- transmissive element P towards the reflecting/scattering object O which reflects/scatters the radiation. The first and the second detector Dl, D2 may subsequently detect the reflected/scattered radiation.
  • a first ellipse 10 having the first emitter El and the first detector Dl in the focus-points may be determined and a second ellipse 12 having the first emitter El and the second detector D2 in the focus-points may be determined.
  • the point-of-touch may be determined as the point(s)-of-intersection of the first and the second ellipses 10,12.
  • the system comprises a first and second emitter El, E2 and a first detector Dl, directly or indirectly connected to a determining means C. At least a part of the radiation emitted by the first emitter El will propagate towards the reflecting/scattering object O which reflects/scatters the radiation which, subsequently, may be detected by the first detector Dl. Analogously, at least a part of the radiation emitted by the second emitter E2 will propagate towards the reflecting/scattering object O which reflects/scatters the radiation which, subsequently, may be detected by the first detector Dl.
  • a first ellipse 14 having the first emitter El and the first detector Dl in the focus-points may be determined and a second ellipse 16 having the second emitter E2 and the first detector Dl may be determined.
  • the point-of-touch may be determined as the point(s)-of- intersection of the first and second ellipses 14,16.
  • the system comprises a first and a second emitter El, E2 and a first and second detector Dl, D2, directly or indirectly connected to a determining means C.
  • the first and second detector Dl, D2 each may detect radiation emanating from the first and the second emitter El, E2, whereby four ellipses 18,20,22,24 may be determined on the basis of one point-of- touch.
  • the two emitters may be operated out of phase and/or emit radiation at different frequencies as will be described in further detail below.
  • the determining means together with the arrangement of the emitter(s) and the detector(s) defines a plurality of range-finders. Based on a plurality of distances to the point-of-touch given by the range-finders, the system may be capable of determining the position of the point-of-touch for the object on the radiation-transmissive element.
  • the determining means may be implemented by hardware calculation circuitry, optionally in combination with controlling software. In one specific embodiment, the determining means is a software-controlled computer.
  • a first type of range-finder is one emitting a single pulse or a number of individual pulses, and which determines the range or distance by the time-of-flight of the pulse. Determining the point in time of emission of a pulse and the point in time of receipt of the reflected pulse automatically provides an estimate of the distance from the emitter to the target and further to the detector.
  • a second type of range-finder is one emitting a continuous signal, such as a sine-wave which may be seen as a number of identical pulses equally spaced in time.
  • This range-finder receives the reflected signal and compares the phase (the position of the peaks, valleys or other easily determinable positions) of the detected signal and that emitted by the emitter. This phase difference relates to a time-of-flight and will relate to the distance from the emitter to the target and further to the detector.
  • a third type of range-finder is also one emitting a continuous signal, such as a sine wave, but this range-finder varies the frequency of the signal in order to obtain a resonance between the emitted and the received signals.
  • the resonance occurs (no phase difference exists between the emitted and received signals)
  • the distance from the emitter to the detector via the target will be an integer times the wavelength of the sine wave. From this frequency, an estimate of the distance may be derived.
  • the first and the second surfaces may be parallel or substantially parallel, and the distance there-between may be known. This distance may be used in the determination the point-of- touch, as the time elapsing between emission of a radiation pulse and the detection of its reflection/scattering by the object, depends on the distance between the first and the second surface and the bouncing angle. For the same distance between the first and the second surface, the distance covered by radiation propagating at a large angle (relative to the normal of the first and/or second surface) between two points, is shorter than the distance covered by radiation propagating at a small angle (relative to the normal of the first and/or second surface) between the same two points.
  • the radiation-transmissive element may comprise an edge portion interconnecting the first and the second surface.
  • the radiation-transmissive element may define a plurality of corners such as three comers (triangular) or four comers (quadrangular).
  • the radiation-transmissive element may be a solid radiation-transmissive element made from a radiation-transmissive material such as glass or plastic or any material suitable for use in fibre optics or windows.
  • the first and/or the second surface may be coated e.g. with an antiglare coating or a protecting layer suitable for limiting scratches caused by mechanical engagement with the first and/or the second surface.
  • At least one surface of the radiation-transmissive element may be adapted to be engaged by an object adapted to reflect/scatter radiation.
  • the object may take the form of a finger, a pen, a stylus, a credit cart or the like.
  • the radiation-transmissive element may be an optical waveguide adapted to guide radiation by Total Internal Reflection (TIR), whereby at least a part of the radiation will propagate inside the transmissive element by bouncing between the first and the second surface.
  • TIR Total Internal Reflection
  • the first and/or the second surface may have a small critical TIR-angle.
  • the TIR-angle being defined as, the critical angle relative to the normal of a surface, above which TIR occurs.
  • radiation subject to internal reflection such as TIR
  • TIR radiation subject to internal reflection
  • first/second emitter and first/second detector shall be understood as “the first and/or second and/or one or more further radiation emitter(s)” and “the first and/or second and/or one or more further detector(s)”, respectively.
  • the first/second emitter is adapted to emit radiation into the radiation-transmissive element. Said radiation may be emitted into the element through the first and/or second surface of the transmissive element. Alternatively, or as a supplement, the radiation may be emitted into the element through the edge of the transmissive element.
  • the first/second emitter may be configured and/or arranged with respect to neighbouring/adjacent edges, such that said edges cannot be irradiated/illuminated directly. Thereby, the neighbouring/adjacent edges are shielded from direct illumination.
  • the first/second emitter may comprise an LED, a laser diode, a VCEL laser diode, an OLED, a micro bulb or any other suitable radiation providing means.
  • the radiation emitted by the first/second emitter is guided into the radiation-transmissive element by means of a wave guide.
  • the wave guide and the corresponding emitter may be manufactured as a separate element adapted to be attached to a radiation-transmissive element, such as a shop window.
  • pulse of radiation shall be understood as an emission/discharge/burst of electromagnetic energy within a predetermined period of time i.e. a rise and fall of electromagnetic energy within said period of time.
  • the first/second detector may be provided on or at the first and/or second surface of the transmissive element. Alternatively, or as a supplement, the first/second detector may be arranged on or at one of the edges of the transmissive element. The first/second detector may be arranged to detect radiation propagating in the transmissive element as a result of reflection/scattering by the reflecting/scattering object.
  • the first/second detector may be arranged with respect to neighbouring/adjacent edges, such that reflections of radiation by said edges may be detected by the detector.
  • the detector may be provided at a corner of the radiation-transmissive element.
  • the first/second detector is adapted to output a signal such as an electrical signal relating to the detected radiation.
  • the first/second detector may be electrically connected to the determining means, and the latter may be adapted to receive the outputted signal.
  • the term "detector” shall be understood as an electronic device that responds in a predictable way whereby an electrical property of the detector is changed as a function of the detected radiation.
  • the first radiation emitter and the first detector are provided adjacent to each other e.g. on one edge of the radiation-transmissive element.
  • One advantage of providing the emitter and the detector adjacent to each other is, that the detector is not dazzled by the radiation emitted by the emitter, as the emitter emits the radiation away from the emitter and the detector.
  • the first emitter and the first detector are provided on or at opposite edges of the radiation-transmissive element.
  • the first emitter and the first detector are provided at neighbouring edges of the radiation-transmissive element.
  • the system may comprise a second radiation emitter and a second detector which may be provided adjacent to each other or on opposite or neighbouring edges of the transmissive element as mentioned in relation to the first emitter and the first detector.
  • the system may comprise one or more further radiation emitters and/or one or more further detectors, such as one further emitter and two further detectors. It will be appreciated that the system may comprise any number of emitters and any number of detectors and that the number of emitters may be different form the number of detectors. Furthermore it will readily be realised, that the larger the number of detectors and emitters are the more precise the determination of the point-of-touch may be, as the number of ellipses which may be detected increases whereby the point-of-touch may be determined as the position wherein the majority of ellipses overlap.
  • the first radiation emitter and the second radiation emitter may be adapted to be operated out of phase such that they are adapted not to be operated simultaneously. Accordingly, when the first emitter is operated, the second emitter may intentionally not be operated and vice versa.
  • the advantage is that radiation from the two emitters may be distinguished from each other.
  • At least one of the radiation emitters may be adapted to emit radiation in a predetermined direction transverse to the first and/or second surface of the radiation-transmissive element.
  • the bouncing angle is known, whereby simple trigonometry may be used to determine the length of the radiation path as the distance between subsequent reflections by the two surfaces equals d/cos(a), where d is the distance between the first and second surface and a is the angle of the radiation relative to the normal of the first and/or second surface.
  • predetermined direction shall not only cover a specific direction which defines one single angle relative to a reference (e.g. the normal of the first surface) and in a predetermined plane, but also any direction within an angular segment defined between two predetermined directions relative to a reference and in the predetermined plane.
  • the radiation may be emitted at an angle below the critical TIR-angle.
  • the first/second emitter emits radiation through one of the edges of the radiation- transmissive element.
  • At least one of the detectors may be adapted to detect radiation propagating in a predetermined direction transverse to the first and/or the second surface of the radiation- transmissive element.
  • the bouncing angle of the detected radiation is known. Accordingly, the length of the radiation path of the radiation propagating from the object may be determined precisely, as shown above.
  • the emitter is adapted to emit radiation in a predetermined transverse direction and the detector is adapted to detect radiation propagating in the same predetermined transverse direction. Accordingly, the length from the emitter to the touching object may be determined precisely and the distance from the object to the detector may also be determined precisely.
  • At least one of the emitters may be adapted to emit radiation in a plurality of different predetermined directions in a plane parallel with the first surface (i.e. in the xy- direction) and to emit radiation in said predetermined directions in a predetermined sequence.
  • the emitter may be adapted to emit radiation in a number of predetermined angular segments in said plane, such as two segments, such as five segments, such as ten segments, such as fifty segments, such as one hundred segments.
  • each segment defines a predetermined angle such as one degree, such as two degrees, such as five degrees, such as 10 degrees, such as 15 degrees, such as 30 degrees, such as 45 degrees, such as 60 or 90 degrees.
  • the sum of the angular segments of an emitter is 90 degrees while in another example the sum is 180 degrees.
  • radiation may be emitted in a predetermined sequence in said segments.
  • emission into the segments may be synchronised such that radiation is only emitted into one segment at the time, while in other embodiments the system is adapted to emit radiation into two or more segments at the same time. In the latter example, the system may be adapted to avoid emission of radiation into two neighbouring segments simultaneously.
  • the emitter is adapted to emit radiation into angular segments which are separated by at least one other angular segment. The system may track points of touch and only emit radiation towards foreseen points-of-touch.
  • At least one of the detectors may be adapted to determine an angle of incidence of the detected radiation in a plane parallel with the first surface, i.e. in the xy-direction.
  • the angle of incidence of the detected radiation may be used to eliminate points-of- touch which would have a different angle of incidence, whereby the point-of-touch may be determined more precisely.
  • the radiation-transmissive element may comprise a plurality of corners, such as three, such as four, such as five, such as six.
  • the first radiation emitter and the first detector may be located in or at a first corner, while the second radiation emitter and the second detector are located in or at a second corner.
  • the first and second corners may be neighbouring corners or opposite corners.
  • the determining means may furthermore be adapted to determine the position of the reflecting/scattering object on the basis of information relating to the relative and/or absolute positions of the radiation emitters and the detectors.
  • the present invention relates to a system for determining the position of an object adapted to reflect/scatter radiation, the system comprising: a radiation-transmissive element having a first surface being adapted to be engaged by the object so as to reflect/scatter radiation into the element and a second surface opposite the first surface, the radiation-transmissive element being adapted to guide radiation by internal reflection; a radiation emitter being arranged to emit a pulse of radiation into the element and towards the first/second surface; a detector arranged to detect radiation emitted into the radiation-transmissive element and reflected/scattered by the reflecting/scattering object, the first detector being adapted to output a signal relating to the detected radiation; wherein the radiation emitter is adapted to emit radiation in a plurality of different predetermined directions in a plane parallel with the first surface, and/or the detector is adapted to determine an angle of incidence of the detected radiation in the plane, the system further comprising: a determining means being adapted to determine the position of the reflecting/s
  • the radiation emitter is adapted to emit radiation in a plurality of different predetermined directions in a plane parallel with the first surface, it is possible to focus the radiation towards specific zones on the radiation-transmissive element.
  • the determining means may be adapted to control the radiation emitter such that radiation is not emitted in all directions simultaneously, thus, making it possible to eliminate point-of-touch in non-irradiated (non-illuminated) zones.
  • the determining means may be adapted to determine the position of the reflecting/scattering object on the basis of which directions/zones were irradiated at the time of detecting of a point-of-touch, i.e. at the time of detection of a reflection by an object engaging the first surface, said reflection being a reflection of radiation emitted by the radiation emitter.
  • the detector may be adapted to determine an angle of incidence of the detected radiation in the plane.
  • the determining means may be adapted to eliminate areas on the transmissive element from which radiation has not been detected. This simplifies the detection procedure.
  • by determining the reflections/scatterings as a function of time and angle of incidence it may be possible to eliminate reflections by the edges of the radiation-transmissive element as they will be detected subsequent to detection of radiation propagating in the direct radiation path from the reflecting/scattering object and to the detector.
  • the determining means together with the configuration of the emitter and the detector defines a range-finder
  • the system may be capable of determining the position of the point-of-touch for the object on the radiation-transmissive element.
  • the emitter may be adapted to emit radiation in said predetermined directions in a predetermined sequence.
  • the radiation emitter is adapted to emit radiation in one direction/zone at the time while in other embodiments the emitter emits radiation in two or more zones at the time.
  • the emitter may be adapted to emit radiation in two or more adjacent directions/zones simultaneously.
  • the emitter may be adapted to emit radiation in directions/zones separated by at least one other zone/direction such as one zone, such as two zones, such as three zones.
  • every second emission by the emitter may be directed towards an expected or predicted point-of-touch, while the remaining emissions are directed in all directions.
  • the expected point-of-touch may be determined on the basis of one or more previous detections of the point-of-touch.
  • the radiation-transmissive element may comprise two or more edges such as two edges, such as three edges, such as four edges.
  • the radiation emitter and the radiation detector may be provided on or at different edges, such as at neighbouring edges or at opposite edges. In one embodiment the emitter and the detector are provided adjacent to each other at the same edge.
  • the radiation emitter may be adapted to emit radiation in a plurality of predetermined directions transverse to (at an angle to) the first and/or second surface of the radiation-transmissive element.
  • the bouncing angle is known, whereby simple trigonometry may be used to determine the radiation path and thus the distance to the point- of-touch.
  • the detector may be adapted to detect radiation propagating in predetermined direction transverse to the first and/or the second surface of the radiation-transmissive element.
  • the detector By adapting a detector to detect radiation in a predetermined transverse direction, the bouncing angle is known. Accordingly, the length of the radiation path of the radiation propagating from the object may be determined precisely.
  • the emitter is adapted to emit radiation in a predetermined transverse direction and the detector is adapted to detect radiation propagating in a predetermined transverse direction. Accordingly, the length from the emitter to the touching object may be determined precisely and the distance from the object to the detector may also be determined precisely.
  • the determining means may be adapted to determine the position of the reflecting/scattering object on the basis of information about relative or absolute positions of the radiation emitter and detector.
  • the invention according to the first aspect of the invention may comprise any feature or element of the invention of a second aspect of the invention, and vice versa.
  • the description of the radiation-transmissive element of the first aspect of the invention also applies to the radiation-transmissive element of the second aspect of the invention.
  • the first and second aspects may be combined to provide further improved position determination.
  • Fig. 1 is a top plan view of a radiation-transmissive element comprising two emitters and two detectors,
  • Fig. 2 is a side view of a radiation-transmissive element to illustrate smearing of radiation emitted by an emitter
  • Fig. 3 is a top plan view of a radiation-transmissive element to illustrate an object irradiated directly and by single and double reflections, and
  • Figs 4A-4C are top plan views of a radiation-transmissive element to illustrate different embodiments of the first aspect of the invention.
  • Fig. 1 illustrates a radiation-transmissive element 100 having a first surface 102 (facing upwards in the drawing) and an opposite second surface (not visible in the drawing).
  • the radiation-transmissive element comprises a first, second, third and fourth corner 104,106,108,110.
  • a first radiation emitter 112 and a first detector 114 are provided at/on the first corner 104 and a second radiation emitter 116 and a second detector 118 are provided at/on the second corner 106. Accordingly, the first emitter/detector 112,114 and the second emitter/detector 116,118 are located at adjacent corners 104,106.
  • the emitters 112,116 are adapted to emit radiation into the radiation- transmissive element 10 so as to cover an angular segment defining a 90 degree angle, i.e. each emitter emits radiation covering the full extent of the radiation-transmissive element 100. Due to the bounce angle of the emitted radiation, concentric circles 120,122 on the first surface are irradiated. The first emitter 112 irradiates a first set of concentric circles 120, while the second emitter 116 irradiates a second set of concentric circles 122. In Fig. 1, the concentric circles 120,122 are illustrated as straight lines, however, it will be appreciated that the concentric circles in a real situation may be essentially circular. The concentric circles 120,122 define an illuminating grid.
  • the detectors 114,118 are adapted to detect radiation propagating with a predetermined angle with respect to the z-axis (i.e. the axis perpendicular to the first surface), whereby radiation must be reflected from predetermined (concentric) zones of the first surface in order to be detected. These predetermined zones define a sensing grid.
  • Alignment of the emitters 112,116 relative to the radiation-transmissive element 100 may be important in order to avoid that radiation is directed towards the two element sides adjacent to each emitter 112,116 as this may result in total reflection of the radiation and thus a secondary radiation pattern on the radiation-transmissive element 100 which creates undesired noise in the detected radiation.
  • Radiation reflected/scattered by the reflecting/scattering object 124 may be spread in all directions and bounce towards the edges 126 of the radiation-transmissive element as illustrated in Fig. 3. In some embodiments this reflected/scattered radiation will be reflected by the edges 126 and some this radiation will be detectable by the sensors. The occurrence of reflection depends on the location of the point-of-touch. The closer the point-of-touch is to the edges the more TIR-reflection may occur and the further away the point-of-touch is the more Snell-reflection may occur.
  • Undesired reflections may be reduced or eliminated by providing an absorptive material on one or more of the edges of the radiation-transmissive element.
  • use of materials having lower refractive indices than the waveguide are avoided as such materials result in TIR in high angles.
  • the determining means may be adapted to determine the distance from each detector to the point-of-touch. Thus, when two detectors are provided the actual point-of-touch may be determined by triangulation.
  • Optical noise created by reflections from surface imperfections and surface contaminants such as grease, water, dirt etc. will to some extent create background noise.
  • a part of this noise will be static, and the determining means may be adapted to subtract said static noise from the received signal.
  • the non-static part may be statistical as it smears out the radiation. The effect is that bouncing angle of the reflected/scattered radiation may change whereby the optical pathway is changed.
  • surface imperfections and surface contamination may also deflect the reflected/scattered radiation.
  • the deflected radiation will normally be statistical as it propagates in its initial x,y,z direction with a smear spread.
  • Rg. 2 illustrates smearing of radiation 130 emitted by the emitter 112.
  • the bouncing angle of smeared radiation 132 differs from the bouncing angle of the emitted radiation and, thus, the optical pathway is not the same. Furthermore, as radiation is smeared out over an angular segment the irradiated areas 134,134' on the first (and second) surface increases with the distance to the emitter.
  • the distance between the concentric circles 120,122 depends on the angle at which the emitters emit radiation. The smaller the angle is (with respect to the normal of the first surface), the smaller is the distance between the circles 120,122. However, the larger the angle is, the further into the radiation-transmissive element the radiation may be emitted, as each reflection weakens the radiation. However, large angles increases the distance between the circles 120,122 whereby the size of non-irradiated zones are increased.
  • the illuminating grid (defined by the concentric circles 120,122 in Fig. 1) and the sensing grid are identical. This may be achieved by providing a beam-splitter whereby the emitted radiation and the detectable radiation is co-axial. In other embodiments, the field of view of the emitter and the detector are not exactly co-axial. However, in such embodiments only points-of-touch in overlapping grids are detectable.
  • a laser emitter is adapted to irradiate the radiation-transmissive element by scanning a beam of radiation, either across the entire surface of the element or within a limited angular segment thereof.
  • the latter approach may, e.g., be used if the location of the point-of-touch is known to some extent, e.g. as determined by prediction or by a preceding low-resolution determination step.
  • the system may thus be adapted to restrict the scanning angle/segment to a limited angle/segment corresponding to the direction of the point-of- touch, the size of the point-of-touch, the distance between emitter and point-of-touch and the scanning speed. This may serve to improve the position resolution and/or reduce the power consumption of the system.
  • the system is adapted to increase the scanning speed, so as to obtain a low photon budget, when the point-of-touch is close to the detector, and to reduce the scanning speed, so as to obtain a high photon budget, when the point-of-touch is farther away.
  • the system may be adapted to run at slow scanning speed interrupted by intervals with no scanning, which may be sufficient to handle slow moving points-of-touch especially when the point-of-touch is made with a finger, which does not require very high resolution.
  • Scanning also allows for the use of reflective edges as mirrors to create virtual viewpoints towards the touching object. If the edges where perfect mirrors, then radiation directed towards the mirrors would be reflected while preserving the z-axis bounce-angle, thus making it possible to illuminate a point-of- touch indirectly.
  • Fig. 3 illustrates an emitter arranged at a corner 104 of the radiation-transmissive element 100.
  • the emitter 112 irradiates a point-of-touch 124 directly, indirectly by single-reflections 136,136' and indirectly by double-reflection 138,138'.
  • the direct reflection irradiation will have the highest intensity and the lowest time delay, as its optical pathway is the shortest.
  • the single-reflections and the double-reflection will have longer pathways and their signals will be weaker.
  • the reflected/scattered radiation will propagate both directly and by reflection to the detector. Since the time delay will be the shortest for radiation propagating directly, the system may be adapted to distinguish between the direct and the reflected radiation on the basis of the time of receipt of the radiation.
  • the provision of scanning emitters provides the possibility of determining the size and shape of the touching object, as a bright centre and two borders of a point-of-touch may, thus, be determined.
  • a finger moving across the first surface will often change shape due to the shear forces.
  • the shape of a finger is dependent on the pressure it applies to the first surface and its angle of incidence. This may be used to determine a moving finger or a finger pushing a virtual button on a display below the radiation-transmissive element.
  • the emitter is adapted to scan in three dimensions.
  • scanning in three dimensions it is possible to irradiate the entire radiation-transmissive element whereby non- irradiated zones may be avoided, accordingly the possible scanning areas do not depend on the thickness of the radiation-transmissive element.
  • objects close to the detector may be scanned by radiation at angles which is not trapped by TIR as the Snell reflections for such close points-of- touch are strong enough to provide adequate return signal strength.
  • the emitter and detector may be provided on or at edges or surfaces of the radiation- transmissive element, provided that they are sufficiently index matched to the waveguide to avoid undesired critical angles which limit the optical pathways necessary to scan the waveguide as desired.
  • Usually simple index match between the unit and the waveguide will be preferred. If this cannot be achieved, the angle shift occurring when the radiation changes from one refractive index material to another must be compensated either by measurement and mathematical compensation or by system calibration based on fix points measurements.
  • the system of the present invention may be used in connection with existing windows such as shop-windows. As existing windows are normally optimised for visible radiation transmission, they may be poor at guiding radiation outside the visible range. In such embodiments, it may thus be advantageous to emit radiation in the visible spectrum.
  • this provides up to five times longer half-length for visible radiation than for IR radiation.
  • visible radiation may leak out of the surface due to surface imperfections and surface contamination whereby the radiation may be visible.
  • it may be advantageous to limit the amount of radiation injected into the existing window, e.g., by restricting the scanning angle and/or by reducing the scanning speed, as explained above.
  • radiation may be emitted into the window at angles above the TIR angles.
  • one or more scanning emitters are adapted to emit at least a part of the radiation above the first surface.
  • a detector may be arranged to detect radiation propagating above the first surface.
  • the determining means may be adapted to determine the position of a object hovering above the first surface on the basis of radiation reflected into the radiation-transmissive element by the hovering object.
  • the radiation may be detected through the element by means of a photo sensitive sensor, such as at least one large avalanche photo diode (APD) attached to the edges or surfaces of the radiation-transmissive element.
  • the position of the object may be determined by means of conventional range- finder equations.
EP07858984.3A 2006-12-08 2007-12-07 Positionsbestimmung in optischen schnittstellensystemen Withdrawn EP2126673A4 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US87359406P 2006-12-08 2006-12-08
PCT/IB2007/003815 WO2008068607A2 (en) 2006-12-08 2007-12-07 Position determination in optical interface systems

Publications (2)

Publication Number Publication Date
EP2126673A2 true EP2126673A2 (de) 2009-12-02
EP2126673A4 EP2126673A4 (de) 2015-03-04

Family

ID=39492682

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07858984.3A Withdrawn EP2126673A4 (de) 2006-12-08 2007-12-07 Positionsbestimmung in optischen schnittstellensystemen

Country Status (2)

Country Link
EP (1) EP2126673A4 (de)
WO (1) WO2008068607A2 (de)

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2212763A4 (de) * 2007-10-10 2012-06-20 Flatfrog Lab Ab Berührungsfeld und verfahren zum betrieb des berührungsfelds
US8941631B2 (en) 2007-11-16 2015-01-27 Qualcomm Mems Technologies, Inc. Simultaneous light collection and illumination on an active display
TW201005606A (en) 2008-06-23 2010-02-01 Flatfrog Lab Ab Detecting the locations of a plurality of objects on a touch surface
US8542217B2 (en) 2008-06-23 2013-09-24 Flatfrog Laboratories Ab Optical touch detection using input and output beam scanners
TW201013492A (en) 2008-06-23 2010-04-01 Flatfrog Lab Ab Determining the location of one or more objects on a touch surface
TW201007530A (en) 2008-06-23 2010-02-16 Flatfrog Lab Ab Detecting the location of an object on a touch surface
SE533704C2 (sv) 2008-12-05 2010-12-07 Flatfrog Lab Ab Pekkänslig apparat och förfarande för drivning av densamma
GB201020282D0 (en) * 2010-11-30 2011-01-12 Dev Ltd An improved input device and associated method
GB2485994A (en) 2010-11-30 2012-06-06 St Microelectronics Res & Dev Navigation device using a Single Photon Avalanche Diode (SPAD) detector
GB2486165A (en) 2010-11-30 2012-06-13 St Microelectronics Res & Dev Oven using a Single Photon Avalanche Diode (SPAD) array
US20120313895A1 (en) * 2011-06-10 2012-12-13 Texas Instruments Incorporated Touch screen
GB2494663A (en) 2011-09-14 2013-03-20 St Microelectronics Res & Dev A system and corresponding method for monitoring vibration isolators
US8982084B2 (en) * 2011-12-16 2015-03-17 Flatfrog Laboratories Ab Tracking objects on a touch surface
US10168835B2 (en) 2012-05-23 2019-01-01 Flatfrog Laboratories Ab Spatial resolution in touch displays
US9726803B2 (en) 2012-05-24 2017-08-08 Qualcomm Incorporated Full range gesture system
WO2014168567A1 (en) 2013-04-11 2014-10-16 Flatfrog Laboratories Ab Tomographic processing for touch detection
WO2015005847A1 (en) 2013-07-12 2015-01-15 Flatfrog Laboratories Ab Partial detect mode
WO2015108479A1 (en) 2014-01-16 2015-07-23 Flatfrog Laboratories Ab Light coupling in tir-based optical touch systems
US10126882B2 (en) 2014-01-16 2018-11-13 Flatfrog Laboratories Ab TIR-based optical touch systems of projection-type
US10161886B2 (en) 2014-06-27 2018-12-25 Flatfrog Laboratories Ab Detection of surface contamination
US9223441B1 (en) * 2014-08-07 2015-12-29 Microsoft Technology Licensing, Llc Detection surface for a computing device
EP3250993B1 (de) 2015-01-28 2019-09-04 FlatFrog Laboratories AB Dynamische berührungsquarantänerahmen
US10318074B2 (en) 2015-01-30 2019-06-11 Flatfrog Laboratories Ab Touch-sensing OLED display with tilted emitters
WO2016130074A1 (en) 2015-02-09 2016-08-18 Flatfrog Laboratories Ab Optical touch system comprising means for projecting and detecting light beams above and inside a transmissive panel
EP3265855A4 (de) 2015-03-02 2018-10-31 FlatFrog Laboratories AB Optische komponente zur lichtkopplung
EP4075246A1 (de) 2015-12-09 2022-10-19 FlatFrog Laboratories AB Stift für optisches berührungssystem
US10761657B2 (en) 2016-11-24 2020-09-01 Flatfrog Laboratories Ab Automatic optimisation of touch signal
HUE059960T2 (hu) 2016-12-07 2023-01-28 Flatfrog Lab Ab Ívelt érintésérzékelõ eszköz
EP3458946B1 (de) 2017-02-06 2020-10-21 FlatFrog Laboratories AB Optische kopplung bei berührungsempfindlichen systemen
WO2018174788A1 (en) 2017-03-22 2018-09-27 Flatfrog Laboratories Object characterisation for touch displays
EP3602259A4 (de) 2017-03-28 2021-01-20 FlatFrog Laboratories AB Berührungssensor und verfahren zur montage
CN117311543A (zh) 2017-09-01 2023-12-29 平蛙实验室股份公司 触摸感测设备
US11567610B2 (en) 2018-03-05 2023-01-31 Flatfrog Laboratories Ab Detection line broadening
US11943563B2 (en) 2019-01-25 2024-03-26 FlatFrog Laboratories, AB Videoconferencing terminal and method of operating the same
EP4104042A1 (de) 2020-02-10 2022-12-21 FlatFrog Laboratories AB Verbesserte berührungsempfindliche vorrichtung

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5691959A (en) * 1994-04-06 1997-11-25 Fujitsu, Ltd. Stylus position digitizer using acoustic waves
DE19616926A1 (de) * 1996-04-27 1997-10-30 Beiersdorf Ag Kosmetische und dermatologische Lichtschutzformulierungen mit einem Gehalt an Triazinderivaten und Monoester und Diester aus verzweigten Alkancarbonsäuren und dem Diglycerin oder Triglycerin
US6861982B2 (en) * 2001-08-16 2005-03-01 Itt Manufacturing Enterprises, Inc. System for determining position of an emitter
CN1777859B (zh) * 2003-03-12 2010-04-28 平蛙实验室股份公司 确定射线发射单元位置的系统和方法
EP1665024B1 (de) * 2003-09-12 2011-06-29 FlatFrog Laboratories AB System und verfahren zur bestimmung einer position eines strahlungsstreu-/-reflexionselements
US8218154B2 (en) * 2006-03-30 2012-07-10 Flatfrog Laboratories Ab System and a method of determining a position of a scattering/reflecting element on the surface of a radiation transmissive element

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2008068607A2 *

Also Published As

Publication number Publication date
WO2008068607A3 (en) 2008-08-07
EP2126673A4 (de) 2015-03-04
WO2008068607A2 (en) 2008-06-12

Similar Documents

Publication Publication Date Title
EP2126673A2 (de) Positionsbestimmung in optischen schnittstellensystemen
US11029783B2 (en) Optical touch system comprising means for projecting and detecting light beams above and inside a transmissive panel
US9134854B2 (en) Detecting the locations of a plurality of objects on a touch surface
US8542217B2 (en) Optical touch detection using input and output beam scanners
US9223442B2 (en) Proximity and touch sensing surface for integration with a display
US9626043B2 (en) Optical touch system and method for optical touch location
JP5552296B2 (ja) 光学式タッチ装置及び遮光物の位置検出方法
US20100309169A1 (en) Optical Touch Screen with Reflectors
KR101221676B1 (ko) 다중 터치점 인식이 가능한 적외선 터치스크린 장치
TWI496058B (zh) 光學式觸控裝置
CN101663637A (zh) 利用悬浮和点击输入法的触摸屏系统
TWI460638B (zh) 導光板觸控裝置
TWI534686B (zh) 光學式觸控裝置
TWI438669B (zh) 光學觸控模組及其方法
JP5368731B2 (ja) タッチパネル
JP5877546B2 (ja) ライト・カーテン
KR101125824B1 (ko) 적외선 터치스크린 장치
JP2013250817A (ja) 座標入力装置及び座標入力システム
KR101221677B1 (ko) 적외선 터치스크린 장치
JP2013250812A (ja) 座標入力装置、座標検出方法、及び座標入力システム
KR20130084546A (ko) 지시물체 위치인식장치
JP2013250814A (ja) 座標入力装置、及び座標入力システム
JP2014085764A (ja) 座標入力装置、及び座標入力システム

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20090624

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: FLATFROG LABORATORIES AB

A4 Supplementary search report drawn up and despatched

Effective date: 20150129

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/042 20060101AFI20150123BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180502

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20190820