WO2010006884A2 - Detecting the location of an object on a touch surface - Google Patents

Detecting the location of an object on a touch surface Download PDF

Info

Publication number
WO2010006884A2
WO2010006884A2 PCT/EP2009/057725 EP2009057725W WO2010006884A2 WO 2010006884 A2 WO2010006884 A2 WO 2010006884A2 EP 2009057725 W EP2009057725 W EP 2009057725W WO 2010006884 A2 WO2010006884 A2 WO 2010006884A2
Authority
WO
WIPO (PCT)
Prior art keywords
panel
radiation
beams
touch surface
sensing area
Prior art date
Application number
PCT/EP2009/057725
Other languages
French (fr)
Other versions
WO2010006884A3 (en
Inventor
Ola Wassvik
Tomas Christiansson
Original Assignee
Flatfrog Laboratories Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Flatfrog Laboratories Ab filed Critical Flatfrog Laboratories Ab
Priority to EP09779864A priority Critical patent/EP2318906A2/en
Priority to CA2728034A priority patent/CA2728034A1/en
Priority to AU2009272923A priority patent/AU2009272923A1/en
Priority to CN200980123716.8A priority patent/CN102067074A/en
Priority to US12/737,018 priority patent/US8890843B2/en
Publication of WO2010006884A2 publication Critical patent/WO2010006884A2/en
Publication of WO2010006884A3 publication Critical patent/WO2010006884A3/en
Priority to IL209929A priority patent/IL209929A0/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • G06F3/0423Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen using sweeping light beams, e.g. using rotating or vibrating mirror
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04109FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location

Definitions

  • the present invention relates to techniques for detecting the location of an object on a touch surface.
  • the touch surface may be part of a touch-sensitive panel.
  • touch-sensitive panels are being used for providing input data to computers, electronic measurement and test equipment, gaming devices, etc.
  • the panel may be provided with a graphical user interface (GUI) for a user to interact with using e.g. a pointer, stylus or one or more fingers.
  • GUI graphical user interface
  • the GUI may be fixed or dynamic.
  • a fixed GUI may e.g. be in the form of printed matter placed over, under or inside the panel.
  • a dynamic GUI can be provided by a display screen integrated with, or placed underneath, the panel or by an image being projected onto the panel by a projector.
  • touch sensitivity e.g. by using cameras to capture light scattered off the point(s) of touch on the panel, or by incorporating resistive wire grids, capacitive sensors, strain gauges, etc into the panel.
  • US2004/0252091 discloses an alternative technique which is based on frustrated total internal reflection (FTIR). Diverging beams from two spaced-apart light sources is coupled into a panel to propagate inside the panel by total internal reflection. The light from each light source is evenly distributed throughout the entire panel. Arrays of light sensors are located around the perimeter of the panel to detect the light from the light sources. When an object comes into contact with a surface of the panel, the light will be locally attenuated at the point of touch. The location of the object is determined by triangulation based on the attenuation of the light from each source at the array of light sensors.
  • FTIR frustrated total internal reflection
  • US 3,673,327 discloses a similar technique in which arrays of light beam transmitters are placed along two edges of a panel to set up a grid of intersecting light beams that propagate through the panel by internal reflection. Corresponding arrays of beam detectors are placed at the opposite edges of the panel. When an object touches a surface of the panel, the beams that intersect at the point of touch will be attenuated. The attenuated beams on the arrays of detectors directly identify the location of the object.
  • These known FTIR techniques suffer from being costly, i.a. since they require the use of a large number of detectors, and possibly a large number of light sources. Furthermore, they are not readily scalable since the required number of detectors/sources increases significantly with the surface area of the panel. Also, the spatial resolution of the panel is dependent on the number of detectors/sources. Still further, the energy consumption for illuminating the panel may be considerable and increases significantly with increasing surface area of the panel.
  • a first aspect of the invention is an apparatus for determining a location of at least one object on a touch surface, said apparatus comprising: a panel defining the touch surface and an opposite surface; an illumination arrangement adapted to introduce radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area; a detection arrangement adapted to measure the transmitted energy in said radiation paths; and a data processor connected to the detection arrangement and configured to determine, based on the measured energy, said location based on an attenuation of two or more radiation paths caused by the object touching the touch surface within the sensing area; wherein said illumination arrangement is configured to generate at least a subset of the radiation paths by sweeping at least one beam of radiation along the touch surface; wherein said detection arrangement comprises a fixed redirecting device configured to receive and re-
  • the illumination arrangement is configured to sweep said at least one beam with an essentially invariant main direction within the sensing area.
  • the fixed re-directing device comprises an elongate optical element that defines an output focal plane, wherein the illumination arrangement is configured such that the beam, while being swept within the sensing area, is swept along the elongate optical element at an essentially invariant angle of incidence, and wherein the radiation detector is arranged in said output focal plane.
  • the illumination arrangement is adapted to sweep at least two separate beams of radiation within the sensing area, such that each beam is swept along the elongate optical element at a respective angle of incidence
  • the detection arrangement comprises at least two radiation detectors, which are arranged at separate locations in said output focal plane to measure the energy of the respective beam.
  • the radiation detector comprises a light-sensing surface and device for increasing the effective light-sensing area of the radiation detector, said device being arranged intermediate the re-directing device and the light-sensing surface.
  • the device for increasing the effective light- sensing area is a diffusing element or a concentrator.
  • the re-directing device is arranged to extend along an edge portion of said panel.
  • the illumination arrangement is configured to inject beams that are collimated at least in the plane of the panel. In one embodiment, the illumination arrangement and the detection arrangement are configured to introduce and receive said at least one beam on opposite ends of the sensing area.
  • the illumination arrangement comprises a beam-scanning device configured to sweep an input beam around an axis of rotation, a fixed beam- directing device configured to receive the thus-swept input beam and generate at least one output beam which is translated in a principal direction while having an essentially invariant main direction, and a coupling element connected to the panel for receiving and injecting said at least one output beam into the panel, thereby forming said at least one beam that is swept along the touch surface within the sensing area.
  • the beam-directing device may comprise an elongate optical element that defines an input focal plane, wherein said axis of scanning is located in said input focal plane.
  • the beam- scanning device may be configured to sweep at least two separate input beams along the elongate optical element, each input beam being swept around a separate axis of rotation in said input focal plane, thereby causing the elongate optical element to generate output beams with separate main directions.
  • the beam-directing device may further comprise an elongate grating structure which is arranged to generate said at least one output beam as a set of diffracted beams with a predetermined angular spacing.
  • the beam- directing device may be arranged to extend along an edge portion of said panel, and the principal direction may be essentially parallel to said edge portion of said panel.
  • the illumination arrangement may comprise a plate- shaped radiation guide which is arranged underneath the panel, as seen from the touch surface, and a beam-folding system which is arranged to optically connect the radiation guide to the panel, wherein the radiation guide may be configured to guide said at least one output beam by internal reflection from the beam-directing device to the beam-folding system.
  • the illumination arrangement is configured to sweep a first set of mutually acute beams in a first principal direction across the panel, wherein the beams in the first set have a maximum mutual acute angle of ⁇ 30°, and preferably ⁇ 20°.
  • the main direction of one of the beams in the first set may be orthogonal to the first principal direction.
  • each pair of beams in the first set may have a unique mutual acute angle.
  • the illumination arrangement may be configured to sweep at least one second beam in a second principal direction across the panel.
  • the illumination arrangement may be configured to sweep a second set of mutually acute beams in a second principal direction across the panel, wherein the beams in the second set have a maximum mutual acute angle of ⁇ 30°, and preferably ⁇ 20°.
  • the first set may comprise three beams and/or the second set may comprise three beams.
  • the main direction of one of the beams in the second set may be orthogonal to the second principal direction.
  • each pair of beams in the second set may have a unique mutual acute angle.
  • first and second principal directions may be mutually orthogonal.
  • the panel may be rectangular, and the first and second principal directions may be parallel to a respective edge portion of the panel.
  • a second aspect of the invention is an apparatus for determining a location of at least one object on a touch surface, said touch surface being part of a panel that defines the touch surface and an opposite surface, said apparatus comprising: means for introducing radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area; means for measuring the transmitted energy in said radiation paths; means for identifying, based on the measured energy, at least two radiation paths that are attenuated by an object touching the touch surface; and means for determining the location of the object based on the attenuated radiation paths; wherein said means for introducing comprises means for sweeping at least one beam of radiation along the touch surface; wherein said means for measuring comprises a fixed means for receiving said at least one beam, while it is swept along the touch surface, and for re-directing said at least one beam onto a common detection point, and means for measuring the energy of said at least one beam at said common detection point.
  • a third aspect of the invention is a method of determining a location of at least one object on a touch surface, said touch surface being part of a panel that defines the touch surface and an opposite surface, said method comprising the steps of: introducing radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area; measuring the transmitted energy in said radiation paths; identifying, based on the measured energy, at least two radiation paths that are attenuated by an object touching the touch surface; and determining the location of the object based on the attenuated radiation paths; wherein the step of introducing comprises sweeping at least one beam of radiation along the touch surface; wherein the step of measuring comprises receiving said at least one beam, while it is swept along the touch surface, by a fixed redirecting device which re-directs said at least one beam onto a common detection point, and measuring the energy of said at least one beam at said common detection point.
  • a fourth aspect of the invention is a method of operating an apparatus for determining a location of at least one object on a touch surface, said touch surface being part of a panel that defines the touch surface and an opposite surface, said method comprising the steps of: operating an illumination arrangement to introduce radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area; operating a detection arrangement to measure the transmitted energy in said radiation paths; and determining, based on the transmitted energy, said location based on an attenuation of two or more radiation paths caused by the object touching the touch surface within the sensing area; wherein the step of operating the illumination arrangement comprises the step of sweeping at least one beam of radiation along the touch surface, such that said at least one beam, after passing the sensing area, is received by a fixed re-directing device which re-directs said at least one beam onto a common detection point; and wherein the step of operating the detection arrangement comprises measuring the energy of said at least one beam by a radiation detector which
  • a fifth aspect of the invention is a computer program product comprising computer code which, when executed on a data-processing system, is adapted to carry out the method of the fourth aspect. Any one of the embodiments of the first aspect can be combined with the second to fifth aspects.
  • Fig. IA is a top plan view of an embodiment of a touch-sensing system, and includes graphs of measurement signals generated in the system; and Fig. IB is a section view of the system in Fig. IA.
  • Figs 2A and 2B are top plan views of a touch-sensing system to illustrate operating principles of a detection arrangement.
  • Figs 3A-3C contain plan views (right) to illustrate re-direction of the main directions of two beams a focal plane, and graphs of corresponding spatial energy distributions (left) in the focal plane.
  • Figs 4A-4B are plan views of detection arrangements with optical fibers.
  • Figs 5 and 6 are plan views of touch-sensing systems with alternative detection arrangements.
  • Fig. 7 is a top plan view of the system of Fig. IA with two touching objects, and the corresponding measurement signals.
  • Fig. 8 is a graph of signal width as a function of touch location along a beam in a panel with a scattering surface.
  • Fig. 9 is a top plan view of another embodiment.
  • Figs 10A- 1OC are top plan views of yet another embodiment, with Fig.1OA illustrating beam sweeps, Fig. 1OB illustrating the location of different sensing portions, and Fig. 1OC illustrating the mutual beam angle between the beams.
  • Figs 1 IA and 1 IB are top plan views of still another embodiment, with Fig. 1 IA illustrating a beam arrangement and Fig. 1 IB illustrating the location of different sensing portions.
  • Fig. 12A is a variant of the embodiment in Fig. 9 resulting in a dual v-scan beam arrangement
  • Fig. 12B is a variant of the embodiment in Fig. 11 resulting in a dual ⁇ - scan beam arrangement
  • Fig. 12C illustrates an asymmetric dual ⁇ -scan beam arrangement.
  • Fig. 13 illustrates the location of different sensing portions in an embodiment with a dual v-scan beam arrangement for mutual beam angles of 6°, 12°, 20° and 40°.
  • Fig. 14 illustrates the location of different sensing portions in an embodiment with a dual ⁇ -scan beam arrangement for mutual beam angles of 6°, 12°, 20° and 40°.
  • Fig. 15A is a top plan view of an embodiment with angular beam scans; and Figs 15B-15D are front views of re-directing elements included in the embodiment of Fig. 15A.
  • Fig. 16 is a top plan view of a touch sensing system to illustrate operating principles of an illumination arrangement.
  • Fig. 17 illustrates a variant of the illumination arrangement in Fig. 16.
  • Fig. 18A illustrates a further variant of the illumination arrangement in Fig. 16, and Fig. 18B is illustrates an example of beam scanner for generating multiple angular scanning beams.
  • Fig. 19A-19C are top plan views of alternative embodiments of illumination arrangements for touch-sensing systems, and Fig. 19D is an elevated side view of the system in Fig. 19C.
  • Fig. 20A-20B are section views of embodiments with folded beam paths.
  • Figs 21A-21B are section views of embodiments that include a transportation plate underneath the touch-sensitive panel.
  • Fig. 22 is a flow chart of an exemplifying method for determining touch locations in a touch-sensing system.
  • Fig. 23 is a plan view of a recurring prism element in a prism structure for generating a set of beams of different main directions from a single swept beam.
  • the present invention relates to a technique for determining the location of an object that touches a surface of a radiation transmissive panel.
  • An example of a touch- sensing system including such a panel 1 is shown in the top plan view of Fig. IA and the section view of Fig. IB (taken along line IB-IB in Fig. IA).
  • the panel 1 defines two opposite and generally parallel surfaces 2, 3 and may be planar or curved.
  • the panel 1 is configured to allow radiation to propagate, by internal reflection, in a radiation propagation channel formed between two boundary surfaces of the panel, wherein at least one of the boundary surfaces (denoted "touch surface”) allows the propagating radiation to interact with a touching object 01.
  • part of the radiation may be scattered by the object 01, part of the radiation may be absorbed by the object 01, and part of the radiation may continue to propagate unaffected.
  • the object Ol touches a surface of the panel 1 e.g. the top surface 2
  • the energy of the transmitted radiation is decreased.
  • the location of the touching object (“touch location") may be detected, e.g. by triangulation.
  • Fig. IA radiation is introduced into the panel 1 in the form of a number of non-parallel beams Bl, B2.
  • Each beam Bl, B2 is swept or scanned across a touch-sensing area of the panel by a beam scanner BSl, BS2, for example under control of a control unit 4.
  • the touch-sensing area (“sensing area”) is defined as the surface area of the panel that is swept by at least two beams.
  • the location of an object Ol that touches the panel 1 i.e. the touch location
  • the location of an object Ol that touches the panel 1 can be determined if the object Ol affects at least two non-parallel beams Bl, B2 while these are swept across the panel.
  • Each beam Bl, B2 is preferably narrow in its sweep direction Rl, R2 and wide perpendicularly thereto, i.e. in the depth direction of the panel.
  • each beam Bl, B2 is essentially collimated in the sweep direction, i.e. in the plane of the panel, and may or may not be collimated in the depth direction (i.e. transverse to the plane of the panel.
  • the beams Bl, B2 After passing the sensing area, the beams Bl, B2 are out-coupled from the panel 1 and directed onto a respective radiation detector RDl, RD2 for measuring the beam energy during the beam sweep.
  • the system operates by causing the beam scanners BSl, BS2 to sweep one beam Bl horizontally (X direction) across the panel 1 and another beam B2 vertically (Y direction) across the panel 1.
  • the bottom portion and right-hand portion of Fig. IA contain graphs that illustrate measurement signals Sl, S2 that represent the energy of beams Bl, B2 as measured by the respective detector RDl, RD2 during a sweep.
  • the signals may indicate measured energy as a function of time, sweep angle or X/Y position in a given coordinate system with respect to the panel 1.
  • the touching object Ol results in a local decrease in measured beam energy for each sweep.
  • the detectors RDl, RD2 are connected to a data processor 8, e.g.
  • a computer which obtains the measurement signals Sl, S2 from the detectors RDl, RD2 and calculates the location of the object Ol based on the thus-obtained signals, e.g. by reconstructing the radiation paths that correspond to the local decrease in the signals and by identifying the intersection of these radiation paths.
  • the data processor 8 is configured to determine the position of one or more objects touching the panel based on the output signals of the detectors for each sensing instance.
  • a sensing instance is formed when all beams have been swept once across the sensing area.
  • the temporal resolution of the system is determined by the update frequency, which is the frequency of sensing instances. For example, for a system designed for recording of handwriting, it may be desirable to have an update frequency of at least 75 Hz, whereas other applications may require a lower or higher temporal resolution.
  • control unit 4 and the data processor 8 may be implemented on one and the same device, or on physically separate devices. Furthermore, the data processor 8 may, but need not, be connected to the control unit 4 for synchronizing the read-out of the measurement signals and the touch determination process with the operational control of the illumination arrangement.
  • the beams may be swept sequentially across the sensing area within a sensing instance.
  • two or more beams may be swept wholly or partly simultaneously across the sensing area during a sensing instance.
  • each beam is swept in a continuous movement across the sensing area.
  • the system in Fig. 1 includes an illumination arrangement for introducing radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area.
  • the system includes a detection arrangement for measuring the transmitted energy in the radiation paths, as well as a data processor for determining, based on the measured energy, the location of the object based on the attenuation of two or more radiation paths caused by the object touching the touch surface within the sensing area.
  • the illumination arrangement is configured to generate the radiation paths inside the panel by sweeping beams Bl, B2 of radiation along the touch surface 2.
  • the spatial direction and location of the beam in the sensing area during the sweep is determined by a fixed beam-directing device 1OA, 1OB which is arranged to receive the beam Bl, B2 from the beam scanner BSl, BS2 and to output a re-directed beam.
  • the design of the beam-directing device 1OA, 1OB will be discussed in more detail further below.
  • the detection arrangement comprises two fixed redirecting devices 12A, 12B, each being configured to receive and re-direct one of the beams Bl, B2 onto a common detection point Dl, D2 while the beam is swept along the touch surface.
  • a stationary radiation detector RDl, RD2 is located at, i.e. in or near, the common detection point Dl, D2 to measure the energy of the beam during the sweep.
  • beam scanners BSl, BS2 allows for a lower power consumption for a given signal- to-noise ratio since only a small part of the panel 1 is illuminated at a time.
  • the spatial resolution of the touch- sensing system is given by the sampling rate , i.e. the rate at which measurement data is sampled from each detector RDl, RD2. This means that any desired resolution could be achieved provided that sufficient amount of radiation is introduced into the panel 1. Furthermore, the spatial resolution can be varied during operation of the touch- sensing system, and different spatial resolution can be achieved in different parts of the sensing area.
  • the transmitted energy of each beam Bl, B2 can be measured with a minimum of components and without requiring any movable parts in the detection arrangement.
  • the beams Bl, B2 are generally translated across the sensing area with an essentially invariant main direction during the sweep. This may give the advantage of yielding a uniform spatial resolution within the entire sensing area, provided that the sampling rate is constant during the sweep. It may also facilitate the design of the re-directing device 12A, 12B, as will be further explained below.
  • the re-directing device 12A, 12B is an element or assembly of elements which defines an elongate front side facing the sensing area. As the beam Bl, B2 is swept within the sensing area, the beam Bl, B2 is also swept along at least part of the front side of the re-directing device 12A, 12B. To limit the footprint of the touch-sensing system, the re-directing device 12A, 12B may be placed near a periphery portion of the panel 1. For reasons of robustness and mounting precision, the re-directing device 12A, 12B may be mounted in contact with such a periphery portion.
  • the re-directing device 12A, 12B is an optical device that defines a focal plane parallel to and at a distance from the front side of the optical device.
  • all rays that impinge on the front side at one and the same angle of incidence are directed to a common point in the focal plane.
  • Rays with different angles of incidence are directed to different points in the focal plane, and rays that are normal to the front side will be directed to the focal point of the optical device, i.e. the intersection between the focal plane and the optical axis of the optical device.
  • the beam is re-directed onto a common detection point during the sweep.
  • the optical device may or may not be configured to converge the incoming radiation also in the depth direction (i.e. transverse to the touch surface).
  • Fig. 2A illustrates an embodiment in which the optical re-directing device 12B is a lens device that transmits and redirects the incoming radiation.
  • the lens device may be made up of diffractive optical elements (DOE), micro-optical elements, refractive lenses and any combination thereof.
  • DOE diffractive optical elements
  • the lens device is a Fresnel lens.
  • Fig. 2A shows three rays with equal angle of incidence that are directed onto one point in the focal plane f out , and one ray with a different angle of incidence that is directed elsewhere in the focal plane.
  • the lens device 12B also operates as an angular filter with respect to a detector arranged in the detection point, since only radiation that impinges on the front side of the lens device 12B within a confined range of angles will be directed onto the detector.
  • the range of angles defines the effective view angle of the detector and is given by the design of the lens device 12B (in particular its focal length which defines the relation between a difference in angle of incidence and the spacing between corresponding detection points in the focal plane) as well as the size of the light-sensing surface of detector.
  • the lens device 12B will limit the effective view angle of the detector, and thereby limit the amount of undesired background radiation that reaches the detector.
  • ambient radiation or radiation scattered within the panel will only reach the detector to a limited extent.
  • irregularities in the panel may cause the beam to be scattered while it propagates through the panel, causing the beam to be broadened in the plane of the panel as a function of distance from the injection site.
  • a small view angle of the detector will limit the detection to a confined region around the main direction of the beam, thereby increasing the precision in locating the energy decrease caused by the touching object.
  • the lens device 12B makes it possible to separately detect the energy of more than one beam downstream the sensing area. As will be discussed below, it may be desirable to sweep two or more non-parallel beams in the same direction across the touch surface. Such beams with different main directions will be re-directed onto different detection points by the lens device 12B.
  • Fig. 2B illustrates such an embodiment in which two beams Bl, B2 are swept along the lens device 12B. Each beam sweep results in a set of radiation paths that are directed onto a respective radiation detector RDl, RD2. Thus, the energy of the beams can be measured separately, even if the beams Bl, B2 are swept across the lens device 12B at the same time.
  • one detector RDl is arranged in the focal plane to measure the energy of more than one beam Bl, B2.
  • the desired set of beams Bl, B2 may be directed onto one and the same light-sensing surface of the detector RDl. If the energy of two or more beams Bl, B2 is to be measured by one detector RDl, the beams Bl, B2 are suitably swept sequentially across the touch surface, such that they impinge on the lens device 12B one at a time.
  • the placement of the detectors RDl, RD2 in the focal plane f out should account for the fact that beams Bl, B2 generally have an extended beam profile when they hit the lens device 12B, and that the lens device 12B thus redirects the beams to a detection area rather than a detection point in the focal plane f out .
  • This phenomenon is further illustrated in Fig. 3.
  • the right-hand portion of Fig. 3 A shows how the main directions of two beams Bl, B2 are re-directed onto a respective detection point in the focal plane f out .
  • the left- hand portion of Fig. 3A illustrates the energy distribution of the beams Bl, B2 in the focal plane, with arrows indicating the width and placement of the detectors.
  • Fig. 3B corresponds to Fig. 3A, but illustrates the use of a single detector RDl to measure the energy of both beams Bl, B2.
  • the detector RDl is capable of measuring the energy of both beams Bl, B2, albeit only a fraction of the total beam energy.
  • Fig. 3C corresponds to Fig. 3 A, but illustrates the use of a larger detector RDl to measure the energy of both beams Bl, B2. This embodiment will increase the detected fraction of the beam energy, but the increased surface area of the detector RDl may also result in increased detection of noise.
  • the lens device 12B can be arranged to re-direct the beams Bl, B2 even if the main direction of the beam varies during the sweep.
  • variations in the main direction of a beam may be caused by inaccuracies in the illumination arrangement, e.g. in the beam scanner (BSl, BS2 in Fig. 1) or the beam- directing element (1OA, 1OB in Fig. IA).
  • the detection arrangement is designed with a view angle of the detector that exceeds the expected variations.
  • the illumination arrangement may be designed to intentionally vary the main direction of one or more beams Bl, B2 during the sweep, e.g. to provide certain touch-sensing properties in certain parts of the sensing area.
  • the lens device 12B it is possible to design the lens device to 12B re-direct the main direction of the beam onto a common detection point.
  • the design of the lens device 12B is simplified if the main direction is essentially invariant during the sweep, in particular if two or more beams Bl, B2 are to be re-directed by one and the same lens device 12B.
  • the optical re-directing device 12A, 12B is a mirror device that redirects the incoming radiation by reflection.
  • the mirror device may be made up of diffractive optical elements (DOE), micro-optical elements, mirrors and any combination thereof.
  • DOE diffractive optical elements
  • Fig. 19C-19D An example of such a mirror device is shown in Fig. 19C-19D.
  • the re-directing device 12B comprises a bundle of optical fibers 14 that provide optical channels between areas at the edge of the panel and the radiation detector RD2.
  • the angle selectivity of the detection arrangement can be controlled by the numerical aperture (NA) of the receiving ends of the fibers 14, i.e. the fiber end facing the panel 1.
  • NA numerical aperture
  • the receiving ends may be designed with a small NA and be arranged perpendicularly to the main direction of the beam B2.
  • the re-directing device 12B of Fig. 4A can also be designed to direct more than one beam onto the detector RDl, provided that the NA is large enough and the beams are swept sequentially across the panel 1.
  • Fig. 4B illustrates a variant in which three separate bundles of optical fibers are arranged to re-direct three beams B1-B3 with different scan angles to a respective detector RD1-RD3.
  • the receiving ends of the fibers in the different bundles may have a small NA and be arranged perpendicularly to the main direction of the respective beam B1-B3.
  • the energy of the beams may be measured by any type of radiation detector capable of converting radiation into an electrical signal.
  • the detector may be a photo-detector with only one radiation- sensitive element, which may have a large detection surface, resulting in low detection noise.
  • photo-detectors are presently cheap in comparison with other detectors.
  • a detector is formed by appropriate binning of plural radiation- sensitive elements (pixels) of a one- or two-dimensional detector such as a CMOS or CCD sensor.
  • CMOS or CCD sensor complementary metal-sensitive diodetectors
  • each detector may be formed by one or more pixels of such a one- or two- dimensional sensor which is arranged in and parallel to the focal plane of the re-directing device.
  • the main direction of each beam is re- directed onto a single, very small detection point during a beam sweep.
  • tolerances in the optical components may cause the main direction of a beam to vary during a sweep.
  • the re-directing device 12A, 12B may be designed by assuming that the main direction is invariant during the sweep.
  • Such a mismatch between design and reality causes the main direction of the beam to be redirected onto an extended detection area around a nominal detection point in the focal plane. This means that the location of the beam profile in the focal plane (see Fig.
  • the measured energy is then dependent on the placement of the detector in relation to the nominal detection point, the size of the light- sensing surface of the detector, the width of the beam profile, and the variations in beam profile location during a sweep.
  • the measured energy may be desirable to use a detector with a small light-sensing surface.
  • variations in beam profile location may result in significant variations in measured beam energy.
  • the measured energy may be too low to allow for a sensible position determination.
  • Fig. 5 illustrates the main direction of the beam Bl at different time points during the sweep. As indicated, variations in the main direction cause the beam Bl to be directed to different points during the sweep.
  • the diffusing element 16 will transmit and scatter the incoming radiation over a large solid angle (indicated by dashed lines). Thereby, a fraction of the incoming radiation will be detected by the light-sensing surface 17 even though the light-sensing surface 17 is smaller than the detection area on the diffusing element 16.
  • Fig. 6 is a plan view of an alternative solution, in which the detector is provided with a stationary concentrator 18 (shown in cross- section).
  • the concentrator 18 is placed between the re-directing device 12A and the light- sensing surface 17 of the detector RDl.
  • the main direction of the beam Bl is illustrated at different time points during the sweep, and variations in the main direction cause the beam Bl to be directed to different points in the focal plane f out during the sweep.
  • the concentrator 18 comprises an internally reflecting cylindrical shell 19 which surrounds and is aligned with the light- sensing surface 17.
  • the shell 19 defines an opening that is arranged to receive the re-directed beam Bl, which is then directed, by one or more reflections inside the shell 19, onto the light-sensing surface 17.
  • the concentrator 18 increases the effective light-sensing area of the detector RDl.
  • the concentrator 18 allows a larger fraction of the incoming light to be detected.
  • the shell 19 is made of plastic and has an internal layer of reflective material.
  • the concentrator 18 is configured as a compound parabolic concentrator (CPC).
  • the concentrator 18 in Fig. 6 is implemented by a wide-angle lens.
  • the panel is made of solid material, in one or more layers.
  • the radiation propagates by internal reflections between the touch surface and the opposite boundary surface.
  • the reflections in the touch surface are caused by total internal reflection (TIR), resulting from a difference in refractive index between the material of the panel and the surrounding medium, typically air.
  • the reflections in the opposite boundary surface may be caused either by TIR or by a reflective coating applied to the opposite boundary surface.
  • TIR total internal reflection
  • the total internal reflection is sustained as long as the radiation is injected into the panel at an angle to the normal of the touch surface which is larger than the critical angle at the injection site of the panel.
  • the critical angle is governed by the refractive indices of the material receiving the radiation at the injection site and the surrounding material, as is well-known to the skilled person.
  • the above-mentioned process of interaction between the touching object and the propagating radiation may involve so-called frustrated total internal reflection (FTIR), in which energy is dissipated into the object from an evanescent wave formed by the propagating radiation, provided that the object has a higher refractive index than the material surrounding the panel surface material and is placed within less than several wavelengths distance from the touch surface.
  • FTIR frustrated total internal reflection
  • the panel may be made of any material that transmits a sufficient amount of radiation in the relevant wavelength range to permit a sensible measurement of transmitted energy. Such material includes glass, poly(methyl methacrylate) (PMMA) and polycarbonates (PC).
  • PMMA poly(methyl methacrylate)
  • PC polycarbonates
  • the panel may be of any shape, such as circular, elliptical or polygonal, including rectangular.
  • the panel is defined by a circumferential edge portion, which may or may not be perpendicular to the top and bottom surfaces of the panel.
  • the radiation may be coupled into and out of the panel directly via the edge portion.
  • a separate coupling element may be attached to the edge portion or to the top or bottom surface of the panel to lead the radiation into or out of the panel.
  • Such a coupling element may have the shape of a wedge (cf. Figs 20-21 below).
  • the touch-sensing system may also include an interface device 6 that provides a graphical user interface (GUI) within at least part of the sensing area.
  • GUI graphical user interface
  • the interface device may be in the form of a substrate with a fixed image that is arranged over, under or within the panel.
  • the interface device may be a screen arranged underneath or inside the system, or a projector arranged underneath or above the system to project an image onto the panel.
  • Such an interface device may provide a dynamic GUI, similar to the GUI provided by a computer screen.
  • an anti-glare surface/layer may be provided on one or both of the panel surfaces.
  • the use of an anti-glare surface/layer may be advantageous to reduce glares from external lighting on the surface of the panel. Such glares might otherwise impair the ability of an external observer to view any information provided on the panel by the aforesaid interface device.
  • the touching object is a naked finger
  • the contact between the finger and the panel normally leaves a fingerprint on the surface. On a perfectly flat surface, such fingerprints are clearly visible and usually unwanted.
  • By adding an anti-glare surface/layer to the surface the visibility of fingerprints is reduced.
  • the friction between finger and panel decreases when an anti-glare is used, thereby improving the user experience.
  • Anti-glares are specified in gloss units (GU), where lower GU values result in less glares.
  • the touch surface(s) of the panel has a GU value of 10-200, preferably 100- 120.
  • the touch-sensing system may be operated to determine the location of a plurality of objects touching the surface during a sensing instance.
  • only part of the radiation is absorbed/scattered by an object, while the remaining radiation continues to propagate along the main direction of the beam.
  • part of the beam will interact with both objects.
  • a remainder of the beam will reach the scanning detector and generate a measurement signal that allows both interactions to be identified.
  • Fig. 7 shows the system of Fig. IA where two objects 01, 02 are placed simultaneously (i.e.
  • Object Ol is attributed to signal features wl and hi in signal Sl and signal features w2 and h2 in signal S2, whereas object 02 is attributed to signal features Wl and Hl in signal Sl and signal features W2 and H2 in signal S2.
  • Signal features wl, w2, Wl, W2 width features
  • Signal features hi, h2, Hl, H2 (energy features) depend on the absorptive/scattering properties of the objects 01, 02 as well as the size of the objects.
  • the signals Sl, S2 allow the data processor 8 (Fig. 1) to distinguish between the objects, their location in the sensing area can be determined. In a system with negligible scattering, the ratio of energy absorbed by an object 01,
  • a transmission signal detected on a detector will be independent of the distance between beam scanner, object and scanning detector, with the transmission signal being defined as a measurement signal with object divided by a background signal, e.g. a measurement signal without object.
  • logarithms need not be used. If scattering is present in the system, the transmission signal of an object 01, 02 will depend on the location of the object along the main direction of a beam. Scattering is primarily caused by the beam being scattered each time it is reflected internally against one or both of the boundary surfaces. This causes the beam to be broadened in the plane of the panel as the beam travels from the injection site through the panel.
  • Sl, S2 will contain additional distance information, via the functional dependence. If the functional dependence is known or approximated, the additional distance information in the measurement signals may be utilized to facilitate and/or improve the position determination.
  • the use of the functional dependence is further described in U.S. provisional application No. 61/202,208, which was filed on February 5, 2009 and which is incorporated herein by reference.
  • an anti-glare surface/layer is provided on one or both of the panel surfaces.
  • the anti-glare surface/layer provides a diffusing structure which may enhance the scattering of the beam for each internal reflection, and which may also cause radiation to escape through the surface for each internal reflection.
  • the provision of an anti-glare surface/layer generally increases the broadening of the beam with distance from the injection site. This will cause the above-mentioned transmission signal to depend on the distance between emitter and object as discussed above and indicated in Fig. 8.
  • different beam arrangements within the panel may provide different characteristics to the touch-sensing system, e.g. with respect to the precision in detecting touch locations, the number of touch locations that can be detected within a sensing instance, the technical complexity of the system, the footprint of the system, the relative size of the multi-touch sensing area to the total surface area of the panel, etc.
  • beam directions refers to the main direction of each beam, which is a straight symmetry line that extends in the panel from the beam injection site, as seen in a plan view of the panel.
  • a "sweep direction" refers to a principal direction that includes a certain direction (R) and its opposite direction (-R).
  • a Cartesian coordinate system has been introduced, with the coordinate axes X,Y being parallel to the sides of the rectangular panel.
  • the touch locations can be represented in any type of coordinate system, e.g. polar, elliptic, parabolic, etc.
  • one or more of the beams is non-perpendicular to its sweep direction.
  • the sweep direction may be the same for both beams.
  • Fig. 9 illustrates an example of such a beam arrangement in which two non-parallel beams Bl, B2 are translated in the same sweep direction Rl across a sensing area, the main direction of each beam defining a respective angle ⁇ l, ⁇ 2 to the normal N of the sweep direction.
  • v-scan This type of beam arrangement with two non-parallel beams Bl, B2 that are swept in one and the same direction Rl across a sensing area is denoted “v-scan” in the following.
  • the beams Bl, B2 may be introduced from opposite sides of the sensing area or on the same side.
  • the sensing area (indicated by hatched lines) is a subset of the surface area of the panel 1.
  • Fig. 10A- 1OC illustrates an embodiment in which three beams B1-B3 are swept across the sensing area.
  • Fig. 1OA shows that two non-parallel beams Bl, B2 are translated in a first sweep direction Rl, and a third beam B 3 being swept in a second sweep direction R2 which is perpendicular to the first sweep direction.
  • the first and second sweep directions Rl, R2 are parallel to the sides of the panel.
  • an elongate beam- directing element e.g. 1OA, 1OB in Fig. 1
  • each sweep direction may be essentially parallel to a respective periphery portion.
  • the beams B1-B3 form a v-scan in the X direction and a single scan in the Y direction.
  • the beams Bl, B 2 have equal but opposite angles to the normal of the sweep direction.
  • the beam swept in the Y direction is orthogonal to its sweep direction.
  • the sensing area of the panel comprises a number of first sub-portions Pl, in which each point of intersection is formed by two beams, and a central second sub-portion P2, in which each point of intersection is formed by three beams.
  • the beams B1-B3 are essentially equiangular within the second sub-portion P2. Such a beam arrangement maximizes the mutual angle between the beams. A large mutual angle may improve the precision of the detected touch locations, at least in some implementations.
  • the beams may be equiangular within the sensing area, such a beam arrangement may restrict the sensing area to the central portion of the panel (cf . sub-portion P2), whereas the remainder of the total panel surface is wasted. Thus, the footprint of the touch-sensing system may become excessive in relation to the size of the sensing area.
  • sub-portions cf. sub-portion Pl
  • these sub-portions may also offer touch- sensitivity.
  • the performance may differ between the central portion and these sub-portions, e.g. with respect to the precision that can be attained in the determination of the location of each object, as well as the number of simultaneous touches that can be discriminated.
  • the overall performance of the system may be improved by increasing the number of beams that are swept across the panel, but increasing the number of beams will also increase the number of sub-portions that are swept by a different number of beams. Thus, differences in performance may prevail across the panel.
  • Fig. 1 IA illustrates a variant of the embodiment in Fig. 1OA, in which one further beam B4 is additionally swept in the X direction. In the illustrated example, this beam is orthogonal to its sweep direction R2, and thus parallel to a pair of opposite sides of the panel, whereby the sensing area is extended to the entire panel 1. As shown in Fig.
  • the sensing area comprises two first sub-portions Pl, in which each point is swept by two beams, and four adjacent second sub-portions P2, in which each intersection point is formed by three beams, as well as a central third sub-portion P3, in which each intersection point is formed by four beams.
  • the equiangular beams are supplemented by an additional beam B4 in order to expand the extent of the sensing area.
  • This expansion is achieved by sweeping a combination of a v-scan (Bl and B2) with an orthogonal beam (B4) in one direction across the panel.
  • This combination of beams is denoted " ⁇ -scan" in the following.
  • Fig. 12A illustrates a variant of the embodiment in Fig. 9, wherein each of the X and Y directions is swept by two mutually non-parallel beams, i.e. a v-scan
  • Fig. 12B illustrates a variant of the embodiment in Fig. 11, wherein each of the X and Y directions is swept by two mutually non-parallel beams and an orthogonal beam, i.e. a ⁇ -scan.
  • Fig. 13 illustrates the location of different sub-portions on a rectangular panel swept by four beams in the dual v-scan configuration shown in Fig. 12A. Specifically, Fig. 13 shows how the extent and location of these sub-portions changes when a different mutual angle is set up between the beams in each v-scan (i.e. the angle between beams Bl and B2, and between beams B3 and B4, respectively in Fig. 12A). At a mutual beam angle of about 20° (Fig. 13(a)), a major part of the panel is swept by four beams. Thus, the performance of the system is the same over a large part of the panel.
  • Fig. 14 illustrates the location of different sub-portions on a rectangular panel swept by six beams in the dual ⁇ -scan configuration shown in Fig. 12B.
  • Fig. 14 shows the influence of the maximum mutual angle between the beams in each ⁇ -scan (i.e. the angle between beams Bl and B2, and between beams B5 and B6, respectively in Fig. 12B).
  • the distribution and size of the sub-portions do not differ between Fig. 14 and Fig. 13.
  • each sub-portion is swept by two more beams, which serves to increase the performance of the system.
  • the ability of the system to detect multiple touches is enhanced, and already at a mutual angle of about 12°- 15° (cf. Fig. 14(d)), there are essentially no sub-portions that are swept by less than four beams.
  • a v/ ⁇ -scan involves sweeping at least one set of mutually acute beams in a given sweep direction across the panel, wherein the beams included in the set have a maximum mutual acute angle of ⁇ 30°, and preferably ⁇ 20°.
  • a v-scan there are two beams in each set, and in a ⁇ -scan there are three beams in each set.
  • the main direction of one of these beams is preferably orthogonal to the sweep direction.
  • One benefit of having the central beam in a ⁇ -scan orthogonal to the sweep direction is that the central beam will be swept over the whole panel, at least if the panel is rectangular.
  • the two central beams of a dual ⁇ -scan may be swept across the entire panel, and this may result in a significant improvement in performance at the periphery of the panel.
  • a general advantage of using v- and ⁇ - scans is that suitable performance of the touch-sensing system can be attained by sweeping only a few beams across the panel. Furthermore, both v- and ⁇ - scans can be realized by space-efficient, simple and robust combinations of components, for example by the illumination and/or detection arrangements as described herein.
  • an asymmetric beam arrangement may enable determination of a greater number of touch locations for a given number of beams, and/or improve the robustness in determining touch locations.
  • Such an asymmetric beam arrangement may be obtained by arranging at least three beams such that each pair of beams defines a unique mutual acute angle.
  • each pair of beams in a set of beams forming a ⁇ -scan may have a unique mutual acute angle.
  • an asymmetric beam arrangement is obtained by arranging at least two beams such that they have different angles to a common sweep direction (e.g. ⁇ l ⁇ cc2 in Fig. 9).
  • Fig. 12C illustrates a dual ⁇ -scan arrangement that may be asymmetric by proper choice of mutual acute angles between the beams B1-B6.
  • the mutual acute angles are given by ⁇ , ⁇ and (cc+ ⁇ ) in one set of beams (Bl, B2 and B4), and by ⁇ , ⁇ and ( ⁇ + ⁇ ) in the other set of beams (B3, B5 and B6).
  • a suitable asymmetric beam arrangement is obtained when ⁇ ⁇ ⁇ and/or ⁇ ⁇ ⁇ .
  • the asymmetric properties may be improved further by selecting ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ , and even further by selecting ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ( ⁇ + ⁇ ) ⁇ ( ⁇ + ⁇ ).
  • the asymmetric properties may be chosen such that the set of beams (B3, B5 and B6) that is swept orthogonally to the long sides of the panel (i.e.
  • any one of the beam arrangements described in the foregoing may be combined with further beams that do not comply with any one of the above design principles.
  • a set of equiangular beams may be combined with one or more further beams that are non-equiangular with the set of equiangular beams.
  • any one of the beam arrangements described in the foregoing e.g. a v-scan with a ⁇ -scan, equiangular beams with one or more v-scans or ⁇ -scans, etc.
  • Fig. 15A illustrates an example of such an embodiment, in which three beam scanners BS1-BS3 are arranged along one side of the panel 1 to inject a respective beam B1-B3 into the panel 1 and to sweep the beam across the sensing area.
  • Re-directing devices 12A-12C are placed along the opposite sides of the panel 1 and configured to direct each beam B1-B3 from the panel 1 onto a fixed detection point D1-D3 while the beam is swept across the sensing area.
  • the beams B1-B3 only propagate through the sensing area between the redirecting devices 12A-12C and the detection points D1-D3.
  • the beams are transported outside the sensing area, e.g. beneath the panel (for example in a transportation plate to be described below).
  • the detectors RD1-RD3 are arranged to measure the energy of the incoming beams B1-B3 in the detection points D1-D3.
  • Figs 15B-15D are front views of the re-directing devices 12A-12C in Fig. 15 A.
  • Device 12A comprises one dedicated re-directing portion 13A-13C for each beam B1-B3, with portion 13A being designed to redirect beam Bl onto detection point Dl, portion 13B being designed to redirect beam B2 onto detection point D2, and portion 13C being designed to redirect beam B3 onto detection point D3.
  • Devices 12B, 12C comprise corresponding portions configured to redirect beams B2, B3 and Bl, B3, respectively.
  • the redirecting portions 13A-13C extend along the edges of the panel 1 and are arranged on different heights in the depth direction of the panel. The system in Fig.
  • 15A also comprises coupling elements 14A-14C which are arranged intermediate the panel 1 and the re-directing devices 12A-12C and configured to direct each of the beams B1-B3 onto its corresponding portion 13A-13C.
  • the redirection may be achieved by placing correctly angled mirrors at each position along the edge. In practice, this can be done with a specially molded plastic component that is transformed into a multifaceted mirror by applying a reflective coating such as gold or aluminum to one side of the plastic component. It is also possible, if the angles of the mirrors allow it, to use the surfaces of the plastic component itself as TIR mirrors. It is to be understood that the sensing area needs to be swept by at least two beams to allow for the location of a touching object to be determined, and that the precision of this determination may be increased by increasing the number of beams.
  • touch-sensing systems with angular scan are viable, it is currently believed that touch-sensing systems with pure beam translation (such as those in Figs 1- 12) provide certain advantages. For one, the complexity of the components required to direct each beam onto a common detection point may be reduced. Furthermore, with a pure translation, the sweep speed is constant along the beam which may facilitate the analysis of the resulting measurement signals Sl, S2. Still further, with an angular scan, an object that touches the panel close to a beam scanner will interact with the beam during a major part of the sweep. This means that part of the injected radiation will be absorbed/scattered over a major part of the beam sweep, thereby reducing the system's ability to detect the location of one or more further objects touching the panel. This drawback of distance dependent beam interaction is overcome when each beam is translated with an invariant main direction across the sensing area.
  • the illumination arrangement may include a beam scanner BSl, BS2 which generates and sweeps a beam Bl, B2 along an elongate fixed beam-directing element 1OA, 1OB that is designed and arranged to output the beam with a desired main direction in the plane of the touch surface.
  • a beam scanner BSl, BS2 which generates and sweeps a beam Bl, B2 along an elongate fixed beam-directing element 1OA, 1OB that is designed and arranged to output the beam with a desired main direction in the plane of the touch surface.
  • the beam-directing device 1OA, 1OB is an element or assembly of elements which defines the output direction of the beam for a given input direction thereof.
  • the beam-directing device 1OA, 1OB may be placed near a periphery portion of the panel 1.
  • the re-directing device may be mounted in contact with such a periphery portion.
  • the beam- directing device 1OA, 1OB is an optical device that defines a focal plane parallel to and at a distance from an input side of the optical device.
  • Fig. 16 illustrates such an illumination arrangement, in which an angular scan is generated by sweeping a beam around a rotational axis C2 located in the focal plane f in of the beam- directing device 1OB.
  • the angular scan results in the beam being swept along the beam-directing device 1OB, which converts the angular scan to a linear translation of the beam in a direction parallel to the beam- directing device 1OB.
  • the angle ⁇ between the main direction of the output beam and the optical axis of the beam- directing device 1OB is given by the displacement d of the rotational axis C2 from the focal point of the optical device 1OB (given by the intersection between the focal plane f in and the optical axis of the optical device 10B).
  • the optical beam- directing device 1OB is a lens device that transmits and redirects the incoming radiation.
  • the lens device may be made up of diffractive optical elements (DOE), micro-optical elements, refractive lenses and any combination thereof.
  • the lens device is a Fresnel lens.
  • Fig. 16 can be used to sweep a plurality of beams across the touch surface in the same sweep direction but with different main directions. This can be accomplished by arranging the rotational axes of a plurality of angular scanning beams at different locations in the focal plane of the lens device.
  • Fig. 17 shows each beam B1-B3 at three time points while it is swept along the lens device 1OB, indicating that the main direction of each beam is unchanged during the sweep.
  • each of the beams B1-B3 are received by the detection arrangement and re-directed onto a respective detector RDl- RD3, as described in the foregoing.
  • the illumination arrangement in Fig. 17 may be space-efficient, simple, robust and easy to assemble while providing a well-defined mutual angle between the beams. Further, it allows the beams B1-B3 to be swept concurrently across the sensing area, if desired.
  • Fig. 18A illustrates an alternative embodiment in which a single beam scanner BS2 is configured to generate two angular scans around a corresponding number of virtual rotational axes Cl, C2.
  • the rotational axes C1-C2 are arranged in the focal plane f in of the lens device 1OB, whereby the angular scans are converted to linear translations of two non-parallel beams Bl, B2 with a well-defined mutual angle.
  • Fig. 18B illustrates an embodiment of such a beam scanner BS2 for generating two virtual rotation axes Cl, C2.
  • a stationary emitter 20 is operated to emit a beam which hits a rotating mirror 21.
  • the beam is first deflected onto and swept along mirror 22, which reflects the beam as if it was swept around virtual rotation axis Cl, and then deflected onto and swept along mirror 23, which reflects the beam as if it was swept around virtual rotation axis C2.
  • Fig. 19A illustrates an alternative or supplementary configuration of an illumination arrangement for generating a linear translation of a set of beams B 1-B3 with well-defined mutual angles.
  • an angular scan is generated around a rotation axis C2 located in the focal plane of a lens device 1OB.
  • the output beam of the lens device 1OB which suitably has an essentially invariant main direction, is received by a transmission grating 25, which generates a zero-order beam B2 as well as first-order beams Bl, B3 on the sides of the zero-order beam.
  • the grating may be designed to generate beams of higher orders as well.
  • the mutual angles between the different beams B1-B3 are determined by the properties of the grating 25 according to the well-known grating equation:
  • d s being the spacing of diffracting elements in the grating
  • O 1 being the angle of incidence of the beam that impinges on the grating
  • m being the order
  • being the wavelength of the radiation
  • ⁇ m being the angle between each the beam of order m and the normal direction of the grating.
  • Fig. 19B illustrates the main direction of the generated beams B1-B3 at three different time points during a sweep in the system of Fig. 19A.
  • Fig. 19B also illustrates that each of the beams B 1-B3 are received by the detection arrangement and re-directed onto a respective detector RD1-RD3, as described in the foregoing.
  • a grating 25 in combination with a lens device 1OB provides an illumination arrangement with the potential of being space-efficient, simple, robust and easy to assemble while providing a well-defined mutual angle between the beams. Further, it allows the beams B1-B3 to be swept concurrently across the sensing area, if desired. It is to be understood that further beam directions may be generated by providing more than one angular scan and arranging the rotational axes of the angular scans in the focal plane f in of the beam- directing device 1OB, e.g. as shown in Figs 16-18.
  • the grating 25 is arranged downstream of the lens device 1OB. This will cause the grating 25 to be swept by a beam with an essentially invariant main direction, so that the set of beams B 1-B3 generated by the grating 25 are also swept with essentially invariant main directions within the sensing area.
  • the grating 25 may alternatively be arranged upstream of the lens device 1OB, if the detection arrangement is configured to accept larger variations in the main directions of the beams Bl -B 3 during the sweep.
  • a reflective grating may be used.
  • the lens device 1OB may itself be configured to generate a set of output beams with well-defined mutual angles, based on a single input beam.
  • Such a lens device 1OB may comprise a set of elongate lens segments (not shown) arranged on top of each other in the depth direction, where each lens segment is arranged to generate an output beam in a unique direction, when swept by an input beam of at least the same width as the lens device 1OB in the depth direction.
  • the focal points of the different lens segments may be located at different positions in the input focal plane f in .
  • the lens segments may all be designed from a basic lens segment which is shifted in its longitudinal direction to form the different segments of the lens device 1OB.
  • the lens segments may be superimposed on each other in the beam- directing device 1OB.
  • an elongate prism structure may be arranged intermediate the lens device 1OB and the panel edge/coupling element, wherein the prism structure comprises a repeating prism element in the longitudinal direction.
  • Fig. 23 illustrates an example of such a prism element 26, which has five differently inclined, planar prism surfaces 27, whereby the input beam is directed in five different directions as it is swept (in direction Rl) along the prism structure.
  • the prism element 26 is formed as an indentation in a surrounding material 28.
  • the prism element 26 may be formed as a projection from the surrounding material 28.
  • the prism structure may be provided as a separate component, or it may be integrated in the panel edge or the coupling element.
  • the lens device 1OB may be replaced by a fixed mirror device that redirects the incoming radiation by reflection.
  • the mirror device may be made up of diffractive optical elements (DOE), micro-optical elements, mirrors and any combination thereof.
  • DOE diffractive optical elements
  • Fig. 19C-19D An example of such a mirror device 1OB, combined with a transmission grating 25, is shown in Fig. 19C-19D, in which an angular scan is generated around a rotational axis C2 located in the focal plane f in of the mirror device 1OB.
  • the above-mentioned grating 25 may be integrated with the beam- directing device 1OB, be it a lens device or a mirror device.
  • the beam scanner(s) may be of any known type and configuration and may operate in any suitable wavelength range, e.g. in the infrared or visible wavelength region. All beams could be generated with identical wavelength. Alternatively, different beams could be generated with radiation in different wavelength ranges, permitting differentiation between the beams based on wavelength.
  • the beam scanner(s) can output either continuous or pulsed radiation.
  • the beams could be generated by one or more radiation sources, which can be any type of device capable of emitting radiation in a desired wavelength range, for example a diode laser, a VCSEL (vertical-cavity surface-emitting laser), or alternatively an LED (light-emitting diode), an incandescent lamp, a halogen lamp, etc.
  • the illumination arrangement is configured such that the beam, when injected into the panel, is essentially collimated in the plane of the panel. This will maximize the amount of radiation that reaches the radiation detector at the opposite end of the sensing area.
  • the beam scanners and/or detectors have been placed outside the perimeter of the panel. This might be undesirable, e.g. if the touch-sensing system is to be integrated with the above-mentioned interface device, e.g. display device, such as an LCD (Liquid Crystal Display), a plasma display, an OLED (Organic Light-Emitting Diode) display or similar. If components of the touch- sensing system are arranged far from the perimeter of the display, the surface area of the complete system may become undesirably large.
  • display device such as an LCD (Liquid Crystal Display), a plasma display, an OLED (Organic Light-Emitting Diode) display or similar.
  • Fig. 2OA is a section view of an embodiment with folded beam paths, thereby allowing beam scanners and detectors to be placed underneath the panel and the interface device, if present.
  • the illustrated touch-sensing system comprises two folding systems, which are arranged on opposite sides of the panel 1.
  • a beam is emitted from emitter 20 to hit rotating mirror 21, which reflects the beam towards the first folding system.
  • the beam is first reflected in stationary mirror 30 and thereafter in stationary mirror 31, whereby the beam is folded into the plane of the panel.
  • the folded beam then passes through the beam-directing lens device 1OB and enters the panel via a coupling element 32, which may be attached to the panel 1, e.g.
  • the beam propagates through the panel by TIR and exits the panel via coupling element 32. Thereafter, the beam enters the second folding system, wherein it passes through the re- directing lens device 12B and is reflected in stationary mirrors 33, 34, such that the beam is again folded beneath the panel 1. The beam thereafter exits the second folding system and is received by the radiation detector RD2.
  • Fig. 2OB is a variant of the system in Fig. 2OA, in which a mirror device is used instead of a lens device for controlling the main direction of the beam B2 in the sensing area and for directing the beam onto the detector RD2.
  • a mirror device is used instead of a lens device for controlling the main direction of the beam B2 in the sensing area and for directing the beam onto the detector RD2.
  • one or both of stationary mirrors 30, 31 in the first folding system on the input side may be configured to implement the beam-directing functionality of the illumination arrangement
  • one or both of stationary mirrors 33, 34 in the second folding system on the output side may be configured to implement the re-directing functionality of the detection arrangement.
  • the touch-sensing system may include a transportation device, which is arranged underneath the panel to define a confined transportation channel in the illumination arrangement between the beam scanner and the beam injection site on the panel, and/or in the detection arrangement between the beam out-coupling site on the panel and the scanning detector.
  • a transportation device which is arranged underneath the panel to define a confined transportation channel in the illumination arrangement between the beam scanner and the beam injection site on the panel, and/or in the detection arrangement between the beam out-coupling site on the panel and the scanning detector.
  • the transportation device has no anti-glare structure, so as to minimize scattering of radiation inside the transportation device.
  • the panel is provided with an anti-glare structure, it is preferred to include the transportation device in the illumination arrangement, rather than in the detection arrangement, since this will minimize the width of the beam profile at the detector.
  • Figs 21A and 21B illustrate variants of the embodiment in Fig. 2OA, wherein a transportation device is incorporated in the form of a transportation plate 35, which may be made of the same material as the panel or any other sufficiently radiation-transmissive material or combination of materials.
  • the transportation plate 35 suitably has an extent to allow for the above-mentioned beams to be swept within the plate and may have essentially the same size as the panel.
  • the transportation plate 35 is spaced from the panel 1, e.g. to accommodate for an interface device 6 to be placed between the panel 1 and the plate 35.
  • the plate 35 is placed in contact with the panel 1, or may be formed as an integrated layer in the panel 1.
  • the touch-sensing system includes a distal folding system 36 that directs the beam from the transportation plate 35 into the panel 1.
  • the beam-directing device 1OB is included in the distal folding system 36. This will minimize the distance between the beam-directing device 1OB and the re-directing device 12B which may reduce the impact of inaccuracies in the beam-directing device 1OB or beam scanner BS2 on the ability of the re-directing device 12B to correctly direct the beam B2 onto the detector RD2. It may also reduce the footprint of the system.
  • a transportation plate 35 may provide a touch-sensing system, which is simple, compact, robust and easy to assemble.
  • the beam may be confined within the plate by total internal reflection, and/or by the plate being coated with one or more reflecting layers.
  • the touch-sensing system may comprise more than one transportation device.
  • the individual beams may be guided in separate transportation devices, or the system may include one or more transportation devices for guiding the beams to the panel and one or more transportation devices for guiding the beams from the panel.
  • Other types of transportation devices may alternatively be used, such as optical fibres.
  • a data processor (8 in Fig. IA) may be configured to calculate the touch locations based on measurement signals derived from the radiation detectors.
  • the skilled person will readily realize that there are numerous methods for determining the touch locations.
  • Fig. 19 is a flow chart of one such exemplifying method.
  • step 60 measurement signals are acquired from the detectors in the system. Each measurement signal represents data from k different angles, sampled at N time intervals during a sensing instance.
  • the measurement signals are pre-processed.
  • the measurement signals may be processed for noise reduction using standard filtering techniques, e.g. low-pass filtering, median filters, Fourier-plane filters, etc.
  • the measurement signals may be compensated for temporal energy fluctuations in the beam scanners.
  • the measurement signals may contain sensor readings from outside the region of interest, e.g. outside the sensing area of the panel.
  • the measurement signals may be pre- processed by extracting relevant parts thereof. It may be desired to add one or more trigger points in the measurement signal to improve/facilitate the extraction of relevant data. Such a trigger point may indicate the start or stop of a beam sweep.
  • the measurement signals may be rectified, i.e. converted to have equidistant sampling distance in the panel coordinate system.
  • a rectification may include interpolating each measurement signal with a non-linear angle variable, resulting in a data set with samples that are evenly distributed over the panel. Rectification is optional, but may simplify the subsequent computation of touch locations.
  • a transmission signal is calculated for each pre-processed measurement signal, by dividing the measurement signal with a background signal.
  • the background signal may or may not be unique to each detector or each measurement signal.
  • the background signal may be pre-set, derived during a separate calibration step, or derived from measurement signals acquired during one or more preceding iterations.
  • the calculation of transmission signals may include calculating the logarithm of the ratios between the measurement and background signals.
  • the touch locations are determined based on the transmission signals.
  • the touch-sensing systems as described herein may be modeled using known algorithms developed for transmission tomography with either a parallel scanning geometry or a fan beam geometry.
  • the touch locations may be reconstructed using any available image reconstruction algorithm, especially few-view algorithms that are used, e.g., in the field of tomography. If the system involves scattering, the reconstruction suitably also takes into account the functional dependence between signal width and position along the panel (cf. Fig. 8).
  • the determination of touch locations in step 66 may thus involve identifying peaks in the transmission signals, while possibly also separating adjacent/overlapping peaks (cf. Fig. 7); reconstructing the beams that correspond to the identified peaks, and identifying candidate intersections between the reconstructed beams in the sensing area; computing an area value indicative of the (logarithmic) integrated area under each identified peak in the transmission signals, and setting up an equation system relating the candidate intersections to the area values; and then using e.g. linear programming to identify the most likely set of touches from the set of candidates.
  • the accuracy and/or computation speed of step 66 may be increased by using a priori knowledge about the touch locations, e.g. by using information about the touch locations that were identified during preceding sensing instance(s).
  • the peaks in signal Sl may yield logarithmic areas al, a2 and the peak in S2 may yield logarithmic area a3.
  • Beam reconstruction may yield two intersections pl, p2, giving the equation system:
  • the solution is trivial, but it should be realized that the provision of multiple touches and comparatively few beam sweeps may result in an equation system that has a number of possible solutions, or no solution, requiring the use of optimization methodology to derive the most likely set of touches.
  • step 66 the determined touch locations are output and the method returns to step 60 for processing of a forthcoming sensing instance.
  • the illumination arrangement may combine sweeping of one or more beams of radiation with other means for generating radiation paths inside the panel, e.g. activating opposite pairs of fixed beam transmitters and beam detectors as disclosed in aforesaid US 3,673,327, or using a combination of fixed light sources for generation of diverging beams and arrays of light sensors arranged at the periphery of the panel as disclosed in aforesaid US2004/0252091.
  • optical components described in the foregoing may be combined into a single optical unit, or the functionality of a single optical component described in the foregoing may be provided by a combination of components.

Abstract

An apparatus is operated to determine the location of at least one object on a touch surface of a light transmissive panel (1). In the apparatus, an illumination arrangement introduces radiation into the panel (1) for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area, and a detection arrangement measures the transmitted energy in the radiation paths. A data processor (8) then determines, based on the transmitted energy, the location based on an attenuation of two or more radiation paths caused by the object (01) touching the touch surface within the sensing area. In the apparatus, the illumination arrangement generates at least a subset of the radiation paths by sweeping at least one beam (B1, B2) of radiation along the touch surface. The detection arrangement comprises a fixed re-directing device (12A, 12B) which receives and re-directs the beam (B1, B2) onto a common detection point (D1, D2) while the beam (B1, B2) is swept along the touch surface, and a radiation detector (RD1, RD2) which is located at the common detection point (D1, D2) to measure the energy of the beam(s) (B1, B2).

Description

DETECTING THE LOCATION OF AN OBJECT ON A TOUCH SURFACE
Cross-Reference to Related Applications
The present application claims the benefit of Swedish patent application No. 0801466-4, filed on June 23, 2008, U.S. provisional application No. 61/129,373, filed on June 23, 2008, Swedish patent application No. 0801467-2, filed on June 23, 2008, U.S. provisional application No. 61/129,372, filed on June 23, 2008, Swedish patent application No. 0950245-1, filed on April 15, 2009, and U.S. provisional application No. 61/202,875, filed on April 15, 2009, all of which are incorporated herein by reference.
Technical Field
The present invention relates to techniques for detecting the location of an object on a touch surface. The touch surface may be part of a touch- sensitive panel.
Background Art
To an increasing extent, touch-sensitive panels are being used for providing input data to computers, electronic measurement and test equipment, gaming devices, etc. The panel may be provided with a graphical user interface (GUI) for a user to interact with using e.g. a pointer, stylus or one or more fingers. The GUI may be fixed or dynamic. A fixed GUI may e.g. be in the form of printed matter placed over, under or inside the panel. A dynamic GUI can be provided by a display screen integrated with, or placed underneath, the panel or by an image being projected onto the panel by a projector. There are numerous known techniques for providing touch sensitivity to the panel, e.g. by using cameras to capture light scattered off the point(s) of touch on the panel, or by incorporating resistive wire grids, capacitive sensors, strain gauges, etc into the panel.
US2004/0252091 discloses an alternative technique which is based on frustrated total internal reflection (FTIR). Diverging beams from two spaced-apart light sources is coupled into a panel to propagate inside the panel by total internal reflection. The light from each light source is evenly distributed throughout the entire panel. Arrays of light sensors are located around the perimeter of the panel to detect the light from the light sources. When an object comes into contact with a surface of the panel, the light will be locally attenuated at the point of touch. The location of the object is determined by triangulation based on the attenuation of the light from each source at the array of light sensors.
US 3,673,327 discloses a similar technique in which arrays of light beam transmitters are placed along two edges of a panel to set up a grid of intersecting light beams that propagate through the panel by internal reflection. Corresponding arrays of beam detectors are placed at the opposite edges of the panel. When an object touches a surface of the panel, the beams that intersect at the point of touch will be attenuated. The attenuated beams on the arrays of detectors directly identify the location of the object. These known FTIR techniques suffer from being costly, i.a. since they require the use of a large number of detectors, and possibly a large number of light sources. Furthermore, they are not readily scalable since the required number of detectors/sources increases significantly with the surface area of the panel. Also, the spatial resolution of the panel is dependent on the number of detectors/sources. Still further, the energy consumption for illuminating the panel may be considerable and increases significantly with increasing surface area of the panel.
Summary of the Invention
It is an object of the invention to at least partly overcome one or more of the above- identified limitations of the prior art.
This and other objects, which will appear from the description below, are at least partly achieved by means of apparatus, methods and a computer program product according to the independent claims, embodiments thereof being defined by the dependent claims. A first aspect of the invention is an apparatus for determining a location of at least one object on a touch surface, said apparatus comprising: a panel defining the touch surface and an opposite surface; an illumination arrangement adapted to introduce radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area; a detection arrangement adapted to measure the transmitted energy in said radiation paths; and a data processor connected to the detection arrangement and configured to determine, based on the measured energy, said location based on an attenuation of two or more radiation paths caused by the object touching the touch surface within the sensing area; wherein said illumination arrangement is configured to generate at least a subset of the radiation paths by sweeping at least one beam of radiation along the touch surface; wherein said detection arrangement comprises a fixed redirecting device configured to receive and re-direct said at least one beam onto a common detection point while said at least one beam is swept along the touch surface; and wherein said detection arrangement further comprises a radiation detector which is located at said common detection point to measure the energy of said at least one beam.
In one embodiment, the illumination arrangement is configured to sweep said at least one beam with an essentially invariant main direction within the sensing area. In one embodiment, the fixed re-directing device comprises an elongate optical element that defines an output focal plane, wherein the illumination arrangement is configured such that the beam, while being swept within the sensing area, is swept along the elongate optical element at an essentially invariant angle of incidence, and wherein the radiation detector is arranged in said output focal plane. In one implementation, the illumination arrangement is adapted to sweep at least two separate beams of radiation within the sensing area, such that each beam is swept along the elongate optical element at a respective angle of incidence, and the detection arrangement comprises at least two radiation detectors, which are arranged at separate locations in said output focal plane to measure the energy of the respective beam.
In one embodiment, the radiation detector comprises a light-sensing surface and device for increasing the effective light-sensing area of the radiation detector, said device being arranged intermediate the re-directing device and the light-sensing surface. In one implementation, the device for increasing the effective light- sensing area is a diffusing element or a concentrator.
In one embodiment, the re-directing device is arranged to extend along an edge portion of said panel.
In one embodiment, the illumination arrangement is configured to inject beams that are collimated at least in the plane of the panel. In one embodiment, the illumination arrangement and the detection arrangement are configured to introduce and receive said at least one beam on opposite ends of the sensing area.
In one embodiment, the illumination arrangement comprises a beam-scanning device configured to sweep an input beam around an axis of rotation, a fixed beam- directing device configured to receive the thus-swept input beam and generate at least one output beam which is translated in a principal direction while having an essentially invariant main direction, and a coupling element connected to the panel for receiving and injecting said at least one output beam into the panel, thereby forming said at least one beam that is swept along the touch surface within the sensing area. The beam-directing device may comprise an elongate optical element that defines an input focal plane, wherein said axis of scanning is located in said input focal plane. Alternatively or additionally, the beam- scanning device may be configured to sweep at least two separate input beams along the elongate optical element, each input beam being swept around a separate axis of rotation in said input focal plane, thereby causing the elongate optical element to generate output beams with separate main directions. Alternatively or additionally, the beam-directing device may further comprise an elongate grating structure which is arranged to generate said at least one output beam as a set of diffracted beams with a predetermined angular spacing. Alternatively or additionally, the beam- directing device may be arranged to extend along an edge portion of said panel, and the principal direction may be essentially parallel to said edge portion of said panel. Alternatively or additionally, the illumination arrangement may comprise a plate- shaped radiation guide which is arranged underneath the panel, as seen from the touch surface, and a beam-folding system which is arranged to optically connect the radiation guide to the panel, wherein the radiation guide may be configured to guide said at least one output beam by internal reflection from the beam-directing device to the beam-folding system. In one embodiment, the illumination arrangement is configured to sweep a first set of mutually acute beams in a first principal direction across the panel, wherein the beams in the first set have a maximum mutual acute angle of <30°, and preferably <20°. The main direction of one of the beams in the first set may be orthogonal to the first principal direction. Alternatively or additionally, each pair of beams in the first set may have a unique mutual acute angle. Alternatively or additionally, the illumination arrangement may be configured to sweep at least one second beam in a second principal direction across the panel. Alternatively or additionally, the illumination arrangement may be configured to sweep a second set of mutually acute beams in a second principal direction across the panel, wherein the beams in the second set have a maximum mutual acute angle of <30°, and preferably <20°. The first set may comprise three beams and/or the second set may comprise three beams. Alternatively or additionally, the main direction of one of the beams in the second set may be orthogonal to the second principal direction. Alternatively or additionally, each pair of beams in the second set may have a unique mutual acute angle.
Alternatively or additionally, the first and second principal directions may be mutually orthogonal. Alternatively or additionally, the panel may be rectangular, and the first and second principal directions may be parallel to a respective edge portion of the panel.
A second aspect of the invention is an apparatus for determining a location of at least one object on a touch surface, said touch surface being part of a panel that defines the touch surface and an opposite surface, said apparatus comprising: means for introducing radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area; means for measuring the transmitted energy in said radiation paths; means for identifying, based on the measured energy, at least two radiation paths that are attenuated by an object touching the touch surface; and means for determining the location of the object based on the attenuated radiation paths; wherein said means for introducing comprises means for sweeping at least one beam of radiation along the touch surface; wherein said means for measuring comprises a fixed means for receiving said at least one beam, while it is swept along the touch surface, and for re-directing said at least one beam onto a common detection point, and means for measuring the energy of said at least one beam at said common detection point. A third aspect of the invention is a method of determining a location of at least one object on a touch surface, said touch surface being part of a panel that defines the touch surface and an opposite surface, said method comprising the steps of: introducing radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area; measuring the transmitted energy in said radiation paths; identifying, based on the measured energy, at least two radiation paths that are attenuated by an object touching the touch surface; and determining the location of the object based on the attenuated radiation paths; wherein the step of introducing comprises sweeping at least one beam of radiation along the touch surface; wherein the step of measuring comprises receiving said at least one beam, while it is swept along the touch surface, by a fixed redirecting device which re-directs said at least one beam onto a common detection point, and measuring the energy of said at least one beam at said common detection point.
A fourth aspect of the invention is a method of operating an apparatus for determining a location of at least one object on a touch surface, said touch surface being part of a panel that defines the touch surface and an opposite surface, said method comprising the steps of: operating an illumination arrangement to introduce radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area; operating a detection arrangement to measure the transmitted energy in said radiation paths; and determining, based on the transmitted energy, said location based on an attenuation of two or more radiation paths caused by the object touching the touch surface within the sensing area; wherein the step of operating the illumination arrangement comprises the step of sweeping at least one beam of radiation along the touch surface, such that said at least one beam, after passing the sensing area, is received by a fixed re-directing device which re-directs said at least one beam onto a common detection point; and wherein the step of operating the detection arrangement comprises measuring the energy of said at least one beam by a radiation detector which is located at the common detection point.
A fifth aspect of the invention is a computer program product comprising computer code which, when executed on a data-processing system, is adapted to carry out the method of the fourth aspect. Any one of the embodiments of the first aspect can be combined with the second to fifth aspects.
Still other objectives, features, aspects and advantages of the present invention will appear from the following detailed description, from the attached claims as well as from the drawings.
Brief Description of Drawings
Embodiments of the invention will now be described in more detail with reference to the accompanying schematic drawings. Fig. IA is a top plan view of an embodiment of a touch-sensing system, and includes graphs of measurement signals generated in the system; and Fig. IB is a section view of the system in Fig. IA.
Figs 2A and 2B are top plan views of a touch-sensing system to illustrate operating principles of a detection arrangement. Figs 3A-3C contain plan views (right) to illustrate re-direction of the main directions of two beams a focal plane, and graphs of corresponding spatial energy distributions (left) in the focal plane.
Figs 4A-4B are plan views of detection arrangements with optical fibers.
Figs 5 and 6 are plan views of touch-sensing systems with alternative detection arrangements.
Fig. 7 is a top plan view of the system of Fig. IA with two touching objects, and the corresponding measurement signals.
Fig. 8 is a graph of signal width as a function of touch location along a beam in a panel with a scattering surface. Fig. 9 is a top plan view of another embodiment.
Figs 10A- 1OC are top plan views of yet another embodiment, with Fig.1OA illustrating beam sweeps, Fig. 1OB illustrating the location of different sensing portions, and Fig. 1OC illustrating the mutual beam angle between the beams.
Figs 1 IA and 1 IB are top plan views of still another embodiment, with Fig. 1 IA illustrating a beam arrangement and Fig. 1 IB illustrating the location of different sensing portions.
Fig. 12A is a variant of the embodiment in Fig. 9 resulting in a dual v-scan beam arrangement, Fig. 12B is a variant of the embodiment in Fig. 11 resulting in a dual Ψ- scan beam arrangement, and Fig. 12C illustrates an asymmetric dual Ψ-scan beam arrangement.
Fig. 13 illustrates the location of different sensing portions in an embodiment with a dual v-scan beam arrangement for mutual beam angles of 6°, 12°, 20° and 40°. Fig. 14 illustrates the location of different sensing portions in an embodiment with a dual Ψ-scan beam arrangement for mutual beam angles of 6°, 12°, 20° and 40°.
Fig. 15A is a top plan view of an embodiment with angular beam scans; and Figs 15B-15D are front views of re-directing elements included in the embodiment of Fig. 15A.
Fig. 16 is a top plan view of a touch sensing system to illustrate operating principles of an illumination arrangement.
Fig. 17 illustrates a variant of the illumination arrangement in Fig. 16.
Fig. 18A illustrates a further variant of the illumination arrangement in Fig. 16, and Fig. 18B is illustrates an example of beam scanner for generating multiple angular scanning beams.
Fig. 19A-19C are top plan views of alternative embodiments of illumination arrangements for touch-sensing systems, and Fig. 19D is an elevated side view of the system in Fig. 19C. Fig. 20A-20B are section views of embodiments with folded beam paths.
Figs 21A-21B are section views of embodiments that include a transportation plate underneath the touch-sensitive panel.
Fig. 22 is a flow chart of an exemplifying method for determining touch locations in a touch-sensing system. Fig. 23 is a plan view of a recurring prism element in a prism structure for generating a set of beams of different main directions from a single swept beam.
Detailed Description of Example Embodiments
The following description starts by describing an embodiment of an overall touch- sensing system according to the present invention, followed by different embodiments of a detection arrangement for such a system. Thereafter, exemplifying implementation details relevant to the overall system are given, and aspects of multi-touch detection are discussed. Subsequently, different beam sweeps and mutual arrangements of beams during these sweeps are discussed in detail, and a description is given of different embodiments of an illumination arrangement for generating the beam sweeps. Finally, an exemplifying algorithm for determining touch locations in the system is given. Throughout the description, the same reference numerals are used to identify corresponding elements.
The present invention relates to a technique for determining the location of an object that touches a surface of a radiation transmissive panel. An example of a touch- sensing system including such a panel 1 is shown in the top plan view of Fig. IA and the section view of Fig. IB (taken along line IB-IB in Fig. IA). The panel 1 defines two opposite and generally parallel surfaces 2, 3 and may be planar or curved. The panel 1 is configured to allow radiation to propagate, by internal reflection, in a radiation propagation channel formed between two boundary surfaces of the panel, wherein at least one of the boundary surfaces (denoted "touch surface") allows the propagating radiation to interact with a touching object 01. In this interaction, part of the radiation may be scattered by the object 01, part of the radiation may be absorbed by the object 01, and part of the radiation may continue to propagate unaffected. Thus, when the object Ol touches a surface of the panel 1 (e.g. the top surface 2), the energy of the transmitted radiation is decreased. By measuring the energy of the radiation transmitted through the panel 1 from a plurality of different directions, the location of the touching object ("touch location") may be detected, e.g. by triangulation.
As shown in Fig. IA, radiation is introduced into the panel 1 in the form of a number of non-parallel beams Bl, B2. Each beam Bl, B2 is swept or scanned across a touch-sensing area of the panel by a beam scanner BSl, BS2, for example under control of a control unit 4. The touch-sensing area ("sensing area") is defined as the surface area of the panel that is swept by at least two beams. As will be further explained in the following, the location of an object Ol that touches the panel 1 (i.e. the touch location) can be determined if the object Ol affects at least two non-parallel beams Bl, B2 while these are swept across the panel. Each beam Bl, B2 is preferably narrow in its sweep direction Rl, R2 and wide perpendicularly thereto, i.e. in the depth direction of the panel. Preferably, each beam Bl, B2 is essentially collimated in the sweep direction, i.e. in the plane of the panel, and may or may not be collimated in the depth direction (i.e. transverse to the plane of the panel. After passing the sensing area, the beams Bl, B2 are out-coupled from the panel 1 and directed onto a respective radiation detector RDl, RD2 for measuring the beam energy during the beam sweep.
In the example of Fig. 1, the system operates by causing the beam scanners BSl, BS2 to sweep one beam Bl horizontally (X direction) across the panel 1 and another beam B2 vertically (Y direction) across the panel 1. The bottom portion and right-hand portion of Fig. IA contain graphs that illustrate measurement signals Sl, S2 that represent the energy of beams Bl, B2 as measured by the respective detector RDl, RD2 during a sweep. The signals may indicate measured energy as a function of time, sweep angle or X/Y position in a given coordinate system with respect to the panel 1. As shown, the touching object Ol results in a local decrease in measured beam energy for each sweep. The detectors RDl, RD2 are connected to a data processor 8, e.g. a computer, which obtains the measurement signals Sl, S2 from the detectors RDl, RD2 and calculates the location of the object Ol based on the thus-obtained signals, e.g. by reconstructing the radiation paths that correspond to the local decrease in the signals and by identifying the intersection of these radiation paths.
Generally, the data processor 8 is configured to determine the position of one or more objects touching the panel based on the output signals of the detectors for each sensing instance. A sensing instance is formed when all beams have been swept once across the sensing area. The temporal resolution of the system is determined by the update frequency, which is the frequency of sensing instances. For example, for a system designed for recording of handwriting, it may be desirable to have an update frequency of at least 75 Hz, whereas other applications may require a lower or higher temporal resolution.
It should be realized that the control unit 4 and the data processor 8 may be implemented on one and the same device, or on physically separate devices. Furthermore, the data processor 8 may, but need not, be connected to the control unit 4 for synchronizing the read-out of the measurement signals and the touch determination process with the operational control of the illumination arrangement.
In all embodiments, the beams may be swept sequentially across the sensing area within a sensing instance. Alternatively, two or more beams may be swept wholly or partly simultaneously across the sensing area during a sensing instance. Preferably, each beam is swept in a continuous movement across the sensing area. On a general level, the system in Fig. 1 includes an illumination arrangement for introducing radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area. Further, on a general level, the system includes a detection arrangement for measuring the transmitted energy in the radiation paths, as well as a data processor for determining, based on the measured energy, the location of the object based on the attenuation of two or more radiation paths caused by the object touching the touch surface within the sensing area.
In the example of Fig. 1, the illumination arrangement is configured to generate the radiation paths inside the panel by sweeping beams Bl, B2 of radiation along the touch surface 2. The spatial direction and location of the beam in the sensing area during the sweep is determined by a fixed beam-directing device 1OA, 1OB which is arranged to receive the beam Bl, B2 from the beam scanner BSl, BS2 and to output a re-directed beam. The design of the beam-directing device 1OA, 1OB will be discussed in more detail further below. In the example of Fig. 1, the detection arrangement comprises two fixed redirecting devices 12A, 12B, each being configured to receive and re-direct one of the beams Bl, B2 onto a common detection point Dl, D2 while the beam is swept along the touch surface. A stationary radiation detector RDl, RD2 is located at, i.e. in or near, the common detection point Dl, D2 to measure the energy of the beam during the sweep.
By using a combination of a beam scanner BSl, BS2 and a radiation detector RDl, RD2, only a small number of radiation sources and detectors are required to detect the location of the object Ol on the touch surface 2. Furthermore, the number of sources/detectors is not dependent on the surface area of the panel 1, and thus the touch- sensing system is readily scalable.
Compared to prior art techniques with constant illumination of the entire panel, the use of beam scanners BSl, BS2 allows for a lower power consumption for a given signal- to-noise ratio since only a small part of the panel 1 is illuminated at a time.
Furthermore, the spatial resolution of the touch- sensing system is given by the sampling rate , i.e. the rate at which measurement data is sampled from each detector RDl, RD2. This means that any desired resolution could be achieved provided that sufficient amount of radiation is introduced into the panel 1. Furthermore, the spatial resolution can be varied during operation of the touch- sensing system, and different spatial resolution can be achieved in different parts of the sensing area.
By using a combination of a fixed re-directing device 12A, 12B , which defines a common detection point Dl, D2 for one of the swept beams Bl, B2 , and a radiation detector RDl, RD2 , which is located in or near the common detection point Dl, D2, the transmitted energy of each beam Bl, B2 can be measured with a minimum of components and without requiring any movable parts in the detection arrangement.
Although not shown in Fig. 1, the beams Bl, B2 are generally translated across the sensing area with an essentially invariant main direction during the sweep. This may give the advantage of yielding a uniform spatial resolution within the entire sensing area, provided that the sampling rate is constant during the sweep. It may also facilitate the design of the re-directing device 12A, 12B, as will be further explained below.
DETECTION ARRANGEMENT
The structure and operation of the detection arrangement in general, and the re- directing devices 12A, 12B in particular, will now be further explained and exemplified in relation to Figs 2-6.
Generally, the re-directing device 12A, 12B is an element or assembly of elements which defines an elongate front side facing the sensing area. As the beam Bl, B2 is swept within the sensing area, the beam Bl, B2 is also swept along at least part of the front side of the re-directing device 12A, 12B. To limit the footprint of the touch-sensing system, the re-directing device 12A, 12B may be placed near a periphery portion of the panel 1. For reasons of robustness and mounting precision, the re-directing device 12A, 12B may be mounted in contact with such a periphery portion.
In one embodiment, the re-directing device 12A, 12B is an optical device that defines a focal plane parallel to and at a distance from the front side of the optical device. Thus, all rays that impinge on the front side at one and the same angle of incidence are directed to a common point in the focal plane. Rays with different angles of incidence are directed to different points in the focal plane, and rays that are normal to the front side will be directed to the focal point of the optical device, i.e. the intersection between the focal plane and the optical axis of the optical device. Thus, it should be realized that by sweeping a beam with an essentially invariant main direction along such an optical device, the beam is re-directed onto a common detection point during the sweep. Further, the optical device may or may not be configured to converge the incoming radiation also in the depth direction (i.e. transverse to the touch surface). Fig. 2A illustrates an embodiment in which the optical re-directing device 12B is a lens device that transmits and redirects the incoming radiation. The lens device may be made up of diffractive optical elements (DOE), micro-optical elements, refractive lenses and any combination thereof. In one presently preferred embodiment, the lens device is a Fresnel lens. Fig. 2A shows three rays with equal angle of incidence that are directed onto one point in the focal plane fout, and one ray with a different angle of incidence that is directed elsewhere in the focal plane.
From the above, it is to be understood that the lens device 12B also operates as an angular filter with respect to a detector arranged in the detection point, since only radiation that impinges on the front side of the lens device 12B within a confined range of angles will be directed onto the detector. The range of angles defines the effective view angle of the detector and is given by the design of the lens device 12B (in particular its focal length which defines the relation between a difference in angle of incidence and the spacing between corresponding detection points in the focal plane) as well as the size of the light-sensing surface of detector. Thus, the lens device 12B will limit the effective view angle of the detector, and thereby limit the amount of undesired background radiation that reaches the detector. For example, ambient radiation or radiation scattered within the panel will only reach the detector to a limited extent. For example, as will be discussed further below, irregularities in the panel may cause the beam to be scattered while it propagates through the panel, causing the beam to be broadened in the plane of the panel as a function of distance from the injection site. A small view angle of the detector will limit the detection to a confined region around the main direction of the beam, thereby increasing the precision in locating the energy decrease caused by the touching object.
The lens device 12B makes it possible to separately detect the energy of more than one beam downstream the sensing area. As will be discussed below, it may be desirable to sweep two or more non-parallel beams in the same direction across the touch surface. Such beams with different main directions will be re-directed onto different detection points by the lens device 12B. Fig. 2B illustrates such an embodiment in which two beams Bl, B2 are swept along the lens device 12B. Each beam sweep results in a set of radiation paths that are directed onto a respective radiation detector RDl, RD2. Thus, the energy of the beams can be measured separately, even if the beams Bl, B2 are swept across the lens device 12B at the same time.
In an alternative embodiment, shown in Figs 3B-3C, one detector RDl is arranged in the focal plane to measure the energy of more than one beam Bl, B2. In such an embodiment, if the effective view angle of the detector RDl is large enough, the desired set of beams Bl, B2 may be directed onto one and the same light-sensing surface of the detector RDl. If the energy of two or more beams Bl, B2 is to be measured by one detector RDl, the beams Bl, B2 are suitably swept sequentially across the touch surface, such that they impinge on the lens device 12B one at a time.
The placement of the detectors RDl, RD2 in the focal plane fout should account for the fact that beams Bl, B2 generally have an extended beam profile when they hit the lens device 12B, and that the lens device 12B thus redirects the beams to a detection area rather than a detection point in the focal plane fout. This phenomenon is further illustrated in Fig. 3. The right-hand portion of Fig. 3 A shows how the main directions of two beams Bl, B2 are re-directed onto a respective detection point in the focal plane fout. The left- hand portion of Fig. 3A illustrates the energy distribution of the beams Bl, B2 in the focal plane, with arrows indicating the width and placement of the detectors. As shown, with sufficient separation between the detectors RDl, RD2, it is possible to measure the energy of each beam Bl, B2 separately. It is to be noted that the beam energy can be measured even if the detectors RDl, RD2 are not be placed at center of each beam profile, i.e. at the detection point for the main direction. Further it is to be understood that the light-sensing surface area of the detectors RDl, RD2 can be optimized to maximize the amount of the total energy measured while minimizing cross-talk between the beams Bl, B2. Fig. 3B corresponds to Fig. 3A, but illustrates the use of a single detector RDl to measure the energy of both beams Bl, B2. Here, one relatively small detector is arranged between the detection points for the main directions. Due to the beam profile, the detector RDl is capable of measuring the energy of both beams Bl, B2, albeit only a fraction of the total beam energy. Fig. 3C corresponds to Fig. 3 A, but illustrates the use of a larger detector RDl to measure the energy of both beams Bl, B2. This embodiment will increase the detected fraction of the beam energy, but the increased surface area of the detector RDl may also result in increased detection of noise.
It is to be understood that the lens device 12B can be arranged to re-direct the beams Bl, B2 even if the main direction of the beam varies during the sweep. For example, variations in the main direction of a beam may be caused by inaccuracies in the illumination arrangement, e.g. in the beam scanner (BSl, BS2 in Fig. 1) or the beam- directing element (1OA, 1OB in Fig. IA). Generally, unintentional angle variations do not exceed ±2°. Suitably, the detection arrangement is designed with a view angle of the detector that exceeds the expected variations.
In a variant, the illumination arrangement may be designed to intentionally vary the main direction of one or more beams Bl, B2 during the sweep, e.g. to provide certain touch-sensing properties in certain parts of the sensing area. As long as the intended variations of the main direction along the lens device 12B is known, it is possible to design the lens device to 12B re-direct the main direction of the beam onto a common detection point. However, the design of the lens device 12B is simplified if the main direction is essentially invariant during the sweep, in particular if two or more beams Bl, B2 are to be re-directed by one and the same lens device 12B.
In an alternative embodiment, the optical re-directing device 12A, 12B is a mirror device that redirects the incoming radiation by reflection. The mirror device may be made up of diffractive optical elements (DOE), micro-optical elements, mirrors and any combination thereof. An example of such a mirror device is shown in Fig. 19C-19D. The above discussion with respect to the lens device is equally applicable to such a mirror device. In another alternative embodiment, shown in Fig. 4A, the re-directing device 12B comprises a bundle of optical fibers 14 that provide optical channels between areas at the edge of the panel and the radiation detector RD2. The angle selectivity of the detection arrangement can be controlled by the numerical aperture (NA) of the receiving ends of the fibers 14, i.e. the fiber end facing the panel 1. For example, to limit the effective view angle of the detector RD2, the receiving ends may be designed with a small NA and be arranged perpendicularly to the main direction of the beam B2. The re-directing device 12B of Fig. 4A can also be designed to direct more than one beam onto the detector RDl, provided that the NA is large enough and the beams are swept sequentially across the panel 1. Fig. 4B illustrates a variant in which three separate bundles of optical fibers are arranged to re-direct three beams B1-B3 with different scan angles to a respective detector RD1-RD3. For example, the receiving ends of the fibers in the different bundles may have a small NA and be arranged perpendicularly to the main direction of the respective beam B1-B3.
In all of the above embodiments, the energy of the beams may be measured by any type of radiation detector capable of converting radiation into an electrical signal. In certain embodiments, the detector may be a photo-detector with only one radiation- sensitive element, which may have a large detection surface, resulting in low detection noise. Furthermore, photo-detectors are presently cheap in comparison with other detectors. In another variant, a detector is formed by appropriate binning of plural radiation- sensitive elements (pixels) of a one- or two-dimensional detector such as a CMOS or CCD sensor. For example, in embodiments with plural detectors in the focal plane, each detector may be formed by one or more pixels of such a one- or two- dimensional sensor which is arranged in and parallel to the focal plane of the re-directing device.
In the foregoing, it has been assumed that the main direction of each beam is re- directed onto a single, very small detection point during a beam sweep. However, in a commercial implementation, tolerances in the optical components (e.g. in the beam scanner BSl, BS2 or the beam-directing device 1OA, 10B) may cause the main direction of a beam to vary during a sweep. For practical reasons, the re-directing device 12A, 12B may be designed by assuming that the main direction is invariant during the sweep. Such a mismatch between design and reality causes the main direction of the beam to be redirected onto an extended detection area around a nominal detection point in the focal plane. This means that the location of the beam profile in the focal plane (see Fig. 3) will vary during a beam sweep. It is realized that the measured energy is then dependent on the placement of the detector in relation to the nominal detection point, the size of the light- sensing surface of the detector, the width of the beam profile, and the variations in beam profile location during a sweep. To suppress noise, it may be desirable to use a detector with a small light-sensing surface. However, with a small light-sensing surface, variations in beam profile location may result in significant variations in measured beam energy. Although it is possible to compensate for such variations, the measured energy may be too low to allow for a sensible position determination.
In Fig. 5, this problem is ameliorated by providing the detector RDl with a stationary diffusing element or plate 16, which is arranged between the re-directing device 12A and the light- sensing surface 17 of the detector RDl, preferably in the focal plane fout of the device 12A. Fig. 5 illustrates the main direction of the beam Bl at different time points during the sweep. As indicated, variations in the main direction cause the beam Bl to be directed to different points during the sweep. The diffusing element 16 will transmit and scatter the incoming radiation over a large solid angle (indicated by dashed lines). Thereby, a fraction of the incoming radiation will be detected by the light-sensing surface 17 even though the light-sensing surface 17 is smaller than the detection area on the diffusing element 16.
Fig. 6 is a plan view of an alternative solution, in which the detector is provided with a stationary concentrator 18 (shown in cross- section). The concentrator 18 is placed between the re-directing device 12A and the light- sensing surface 17 of the detector RDl. Like in Fig. 5, the main direction of the beam Bl is illustrated at different time points during the sweep, and variations in the main direction cause the beam Bl to be directed to different points in the focal plane fout during the sweep. In the example of Fig. 6, the concentrator 18 comprises an internally reflecting cylindrical shell 19 which surrounds and is aligned with the light- sensing surface 17. The shell 19 defines an opening that is arranged to receive the re-directed beam Bl, which is then directed, by one or more reflections inside the shell 19, onto the light-sensing surface 17. Similarly to the diffusing element 16 in Fig. 5, the concentrator 18 increases the effective light-sensing area of the detector RDl. However, the concentrator 18 allows a larger fraction of the incoming light to be detected. In one implementation, the shell 19 is made of plastic and has an internal layer of reflective material. In one specific implementation, the concentrator 18 is configured as a compound parabolic concentrator (CPC). In yet another variant (not shown), the concentrator 18 in Fig. 6 is implemented by a wide-angle lens.
EXEMPLIFYING IMPLEMENTATION DETAILS
Typically, the panel is made of solid material, in one or more layers. The radiation propagates by internal reflections between the touch surface and the opposite boundary surface. The reflections in the touch surface are caused by total internal reflection (TIR), resulting from a difference in refractive index between the material of the panel and the surrounding medium, typically air. The reflections in the opposite boundary surface may be caused either by TIR or by a reflective coating applied to the opposite boundary surface. The total internal reflection is sustained as long as the radiation is injected into the panel at an angle to the normal of the touch surface which is larger than the critical angle at the injection site of the panel. The critical angle is governed by the refractive indices of the material receiving the radiation at the injection site and the surrounding material, as is well-known to the skilled person. The above-mentioned process of interaction between the touching object and the propagating radiation may involve so- called frustrated total internal reflection (FTIR), in which energy is dissipated into the object from an evanescent wave formed by the propagating radiation, provided that the object has a higher refractive index than the material surrounding the panel surface material and is placed within less than several wavelengths distance from the touch surface. Generally, the panel may be made of any material that transmits a sufficient amount of radiation in the relevant wavelength range to permit a sensible measurement of transmitted energy. Such material includes glass, poly(methyl methacrylate) (PMMA) and polycarbonates (PC). The panel may be of any shape, such as circular, elliptical or polygonal, including rectangular. The panel is defined by a circumferential edge portion, which may or may not be perpendicular to the top and bottom surfaces of the panel. The radiation may be coupled into and out of the panel directly via the edge portion. Alternatively, a separate coupling element may be attached to the edge portion or to the top or bottom surface of the panel to lead the radiation into or out of the panel. Such a coupling element may have the shape of a wedge (cf. Figs 20-21 below).
As indicated in Fig. 1, the touch-sensing system may also include an interface device 6 that provides a graphical user interface (GUI) within at least part of the sensing area. The interface device may be in the form of a substrate with a fixed image that is arranged over, under or within the panel. Alternatively, the interface device may be a screen arranged underneath or inside the system, or a projector arranged underneath or above the system to project an image onto the panel. Such an interface device may provide a dynamic GUI, similar to the GUI provided by a computer screen.
Although not shown in the drawings, an anti-glare surface/layer may be provided on one or both of the panel surfaces. The use of an anti-glare surface/layer may be advantageous to reduce glares from external lighting on the surface of the panel. Such glares might otherwise impair the ability of an external observer to view any information provided on the panel by the aforesaid interface device. Furthermore, when the touching object is a naked finger, the contact between the finger and the panel normally leaves a fingerprint on the surface. On a perfectly flat surface, such fingerprints are clearly visible and usually unwanted. By adding an anti-glare surface/layer to the surface, the visibility of fingerprints is reduced. Furthermore, the friction between finger and panel decreases when an anti-glare is used, thereby improving the user experience. Anti-glares are specified in gloss units (GU), where lower GU values result in less glares. In one embodiment, the touch surface(s) of the panel has a GU value of 10-200, preferably 100- 120.
MULTI-TOUCH DETECTION
The touch-sensing system according to embodiments of the invention may be operated to determine the location of a plurality of objects touching the surface during a sensing instance. As mentioned above, only part of the radiation is absorbed/scattered by an object, while the remaining radiation continues to propagate along the main direction of the beam. Thus, if two objects happen to be placed after each other in the main direction of a beam, part of the beam will interact with both objects. Provided that the beam energy is sufficient, a remainder of the beam will reach the scanning detector and generate a measurement signal that allows both interactions to be identified. Fig. 7 shows the system of Fig. IA where two objects 01, 02 are placed simultaneously (i.e. during one and the same sensing instance) within the sensing area of the panel 1, and the resulting measurement signals Sl, S2. Object Ol is attributed to signal features wl and hi in signal Sl and signal features w2 and h2 in signal S2, whereas object 02 is attributed to signal features Wl and Hl in signal Sl and signal features W2 and H2 in signal S2. Signal features wl, w2, Wl, W2 (width features) depend on the apparent size of the objects 01, 02. Signal features hi, h2, Hl, H2 (energy features) depend on the absorptive/scattering properties of the objects 01, 02 as well as the size of the objects. Provided that the signals Sl, S2 allow the data processor 8 (Fig. 1) to distinguish between the objects, their location in the sensing area can be determined. In a system with negligible scattering, the ratio of energy absorbed by an object 01,
02 is independent of its distance to the detector. This means that a transmission signal detected on a detector will be independent of the distance between beam scanner, object and scanning detector, with the transmission signal being defined as a measurement signal with object divided by a background signal, e.g. a measurement signal without object. The transmission signal of two objects 01, 02 on the same detection line (cf. beam B2 in Fig. 7) is equal to the product of an individual transmission signal with only one object Ol and an individual transmission signal with only the other object 02. If there are more than two objects on the same detection line, the total transmission signal is the product of all individual transmission signals: T = YJT1 . This is true for any number of objects on any detection line, provided that a remainder of the beam reaches the detector.
The position determination may be simplified by operating on logarithms, since the logarithm of the total transmission signal is then equal to the sum of the logarithms of the individual transmission signals: log T = ^ log 7] . However, logarithms need not be used. If scattering is present in the system, the transmission signal of an object 01, 02 will depend on the location of the object along the main direction of a beam. Scattering is primarily caused by the beam being scattered each time it is reflected internally against one or both of the boundary surfaces. This causes the beam to be broadened in the plane of the panel as the beam travels from the injection site through the panel. Thus, for each internal reflection with scattering, some radiation is diverted away from the main direction of the beam, and the centre of the beam looses energy with distance. Another effect is that scattered radiation from the broadened beam re-enters the beam behind a touching object. This effect is dependent on the distance between the object and the detector. The combined effects of broadening and re-entry generate a functional dependence between the signal width (cf. wl and Wl in Fig. 7) in the measurement signal and the distance between the detector and the touching object. Fig. 8 illustrates an example of such a functional dependence, i.e. the measured signal width as a function of position along the beam for an object with a given size (width). Clearly, the measurement signals (e.g. Sl, S2) will contain additional distance information, via the functional dependence. If the functional dependence is known or approximated, the additional distance information in the measurement signals may be utilized to facilitate and/or improve the position determination. The use of the functional dependence is further described in U.S. provisional application No. 61/202,208, which was filed on February 5, 2009 and which is incorporated herein by reference.
Scattering is particularly noticeable if an anti-glare surface/layer is provided on one or both of the panel surfaces. The anti-glare surface/layer provides a diffusing structure which may enhance the scattering of the beam for each internal reflection, and which may also cause radiation to escape through the surface for each internal reflection. Thus, the provision of an anti-glare surface/layer generally increases the broadening of the beam with distance from the injection site. This will cause the above-mentioned transmission signal to depend on the distance between emitter and object as discussed above and indicated in Fig. 8.
EXEMPLIFYING BEAM ARRANGEMENTS
In the following, different arrangements of the beams within the sensing area will be discussed with reference to Figs 9-14. Since these figures focus on the beam arrangement with respect to the panel, most hardware components have been omitted. It is to be understood that the illustrated systems can be implemented by the same or a similar combination of components as described above with reference to Figs 1-7.
As will be further explained below, different beam arrangements within the panel may provide different characteristics to the touch-sensing system, e.g. with respect to the precision in detecting touch locations, the number of touch locations that can be detected within a sensing instance, the technical complexity of the system, the footprint of the system, the relative size of the multi-touch sensing area to the total surface area of the panel, etc.
In the illustrated beam arrangements, it is to be understood that the beams do not physically intersect over the entire panel. Instead, radiation paths and points of intersection between the radiation paths can be reconstructed when each of the beams has been swept across the panel. Furthermore, it is to be understood that the following discussion about beam directions refers to the main direction of each beam, which is a straight symmetry line that extends in the panel from the beam injection site, as seen in a plan view of the panel. Still further, in the context of the present application, a "sweep direction" refers to a principal direction that includes a certain direction (R) and its opposite direction (-R).
In the Figures, a Cartesian coordinate system has been introduced, with the coordinate axes X,Y being parallel to the sides of the rectangular panel. This is only for the purpose of illustration, and the touch locations can be represented in any type of coordinate system, e.g. polar, elliptic, parabolic, etc. In one beam arrangement, one or more of the beams is non-perpendicular to its sweep direction. Furthermore, the sweep direction may be the same for both beams. Fig. 9 illustrates an example of such a beam arrangement in which two non-parallel beams Bl, B2 are translated in the same sweep direction Rl across a sensing area, the main direction of each beam defining a respective angle αl, α2 to the normal N of the sweep direction. This type of beam arrangement with two non-parallel beams Bl, B2 that are swept in one and the same direction Rl across a sensing area is denoted "v-scan" in the following. In the illustrated embodiment, as well as in all other embodiments, the beams Bl, B2 may be introduced from opposite sides of the sensing area or on the same side. In the illustrated v-scan embodiment, the sensing area (indicated by hatched lines) is a subset of the surface area of the panel 1.
The ability of the touch-sensing system to detect the location of a plurality of objects touching the sensing area within a sensing instance is improved by sweeping more than two beams across the sensing area. Example embodiments that enable this so- called "multi-touch" functionality will now be described with reference to Figs 10-14. Fig. 10A- 1OC illustrates an embodiment in which three beams B1-B3 are swept across the sensing area. Fig. 1OA shows that two non-parallel beams Bl, B2 are translated in a first sweep direction Rl, and a third beam B 3 being swept in a second sweep direction R2 which is perpendicular to the first sweep direction.
In the illustrated example, the first and second sweep directions Rl, R2 are parallel to the sides of the panel. This has been found to facilitate the design of the system. For example, as described in the foregoing, an elongate beam- directing element (e.g. 1OA, 1OB in Fig. 1) may be arranged along the side of the panel to define the main beam direction in the panel as a beam is swept along the beam- directing element. Thus, for a panel that is defined by linear periphery portions (sides/edges), it may generally be desirable for each sweep direction to be essentially parallel to a respective periphery portion. In Fig. 1OA, the beams B1-B3 form a v-scan in the X direction and a single scan in the Y direction. In the illustrated example, the beams Bl, B 2 have equal but opposite angles to the normal of the sweep direction. The beam swept in the Y direction is orthogonal to its sweep direction. Thereby, as shown in Fig. 1OB, the sensing area of the panel comprises a number of first sub-portions Pl, in which each point of intersection is formed by two beams, and a central second sub-portion P2, in which each point of intersection is formed by three beams. In one specific embodiment, the beams B1-B3 are essentially equiangular within the second sub-portion P2. Such a beam arrangement maximizes the mutual angle between the beams. A large mutual angle may improve the precision of the detected touch locations, at least in some implementations. By
"equiangular beams" is meant that, in each point of intersection, the main directions of the beams are equally distributed over 360°. In this example, as shown in Fig. 1OC, the beams intersect with a mutual angle of 60° (αl=cc2=30°).
Although it may be desirable for the beams to be equiangular within the sensing area, such a beam arrangement may restrict the sensing area to the central portion of the panel (cf . sub-portion P2), whereas the remainder of the total panel surface is wasted. Thus, the footprint of the touch-sensing system may become excessive in relation to the size of the sensing area.
However, as indicated above, there are sub-portions (cf. sub-portion Pl) outside the central portion that are swept by two beams, albeit not in an equiangular configuration. These sub-portions may also offer touch- sensitivity. However, the performance may differ between the central portion and these sub-portions, e.g. with respect to the precision that can be attained in the determination of the location of each object, as well as the number of simultaneous touches that can be discriminated. The overall performance of the system may be improved by increasing the number of beams that are swept across the panel, but increasing the number of beams will also increase the number of sub-portions that are swept by a different number of beams. Thus, differences in performance may prevail across the panel. Furthermore, it may be desirable to avoid sweeping more than about 6-10 beams across the panel. As the number of beams increases, so does the cost, the technical complexity and possibly the footprint of the system. Furthermore, since the sampling rate of the processing system is normally constant at a certain price point, increasing the number of beams will decrease the number of samples per beam sweep. It is also possible that the measured signal level for each sample decreases with an increased number of beams. Fig. 1 IA illustrates a variant of the embodiment in Fig. 1OA, in which one further beam B4 is additionally swept in the X direction. In the illustrated example, this beam is orthogonal to its sweep direction R2, and thus parallel to a pair of opposite sides of the panel, whereby the sensing area is extended to the entire panel 1. As shown in Fig. 1 IB, the sensing area comprises two first sub-portions Pl, in which each point is swept by two beams, and four adjacent second sub-portions P2, in which each intersection point is formed by three beams, as well as a central third sub-portion P3, in which each intersection point is formed by four beams. In this embodiment, the equiangular beams are supplemented by an additional beam B4 in order to expand the extent of the sensing area. This expansion is achieved by sweeping a combination of a v-scan (Bl and B2) with an orthogonal beam (B4) in one direction across the panel. This combination of beams is denoted "Ψ-scan" in the following. It should also be noted, by comparing Fig. 1 IB and Fig. 1OB, that the overall performance of the panel has been increased since all sub-portions are swept by a greater number of beams. However, there may still be differences in performance across the panel.
Fig. 12A illustrates a variant of the embodiment in Fig. 9, wherein each of the X and Y directions is swept by two mutually non-parallel beams, i.e. a v-scan, and Fig. 12B illustrates a variant of the embodiment in Fig. 11, wherein each of the X and Y directions is swept by two mutually non-parallel beams and an orthogonal beam, i.e. a Ψ-scan.
Fig. 13 illustrates the location of different sub-portions on a rectangular panel swept by four beams in the dual v-scan configuration shown in Fig. 12A. Specifically, Fig. 13 shows how the extent and location of these sub-portions changes when a different mutual angle is set up between the beams in each v-scan (i.e. the angle between beams Bl and B2, and between beams B3 and B4, respectively in Fig. 12A). At a mutual beam angle of about 20° (Fig. 13(a)), a major part of the panel is swept by four beams. Thus, the performance of the system is the same over a large part of the panel. Reducing the mutual beam angle further, increases the extent of the central sub-portion and decreases the size of the other sub-portions. At an angle of about 12°- 15° (cf. Fig. 13(d)), there are essentially no sub-portions that are swept by less than two beams, and thus the entire panel is touch-sensitive. At an angle of about 2°-8° (cf. Fig. 13(b)), the entire panel can be considered to present an essentially uniform performance. Although the performance of the system is reduced as the mutual angle is decreased, it has been found that adequate performance can be achieved at mutual acute angles from about 2° up to about 30°.
Fig. 14 illustrates the location of different sub-portions on a rectangular panel swept by six beams in the dual Ψ-scan configuration shown in Fig. 12B. Fig. 14 shows the influence of the maximum mutual angle between the beams in each Ψ-scan (i.e. the angle between beams Bl and B2, and between beams B5 and B6, respectively in Fig. 12B). The distribution and size of the sub-portions do not differ between Fig. 14 and Fig. 13. However, with a dual Ψ-scan, each sub-portion is swept by two more beams, which serves to increase the performance of the system. For example, the ability of the system to detect multiple touches is enhanced, and already at a mutual angle of about 12°- 15° (cf. Fig. 14(d)), there are essentially no sub-portions that are swept by less than four beams.
Generally, a v/Ψ-scan involves sweeping at least one set of mutually acute beams in a given sweep direction across the panel, wherein the beams included in the set have a maximum mutual acute angle of < 30°, and preferably < 20°. In a v-scan, there are two beams in each set, and in a Ψ-scan there are three beams in each set. In a Ψ-scan, the main direction of one of these beams is preferably orthogonal to the sweep direction. One benefit of having the central beam in a Ψ-scan orthogonal to the sweep direction is that the central beam will be swept over the whole panel, at least if the panel is rectangular. Compared to a dual v-scan, the two central beams of a dual Ψ-scan may be swept across the entire panel, and this may result in a significant improvement in performance at the periphery of the panel.
A general advantage of using v- and Ψ- scans is that suitable performance of the touch-sensing system can be attained by sweeping only a few beams across the panel. Furthermore, both v- and Ψ- scans can be realized by space-efficient, simple and robust combinations of components, for example by the illumination and/or detection arrangements as described herein.
It has surprisingly been found that an asymmetric beam arrangement may enable determination of a greater number of touch locations for a given number of beams, and/or improve the robustness in determining touch locations. Such an asymmetric beam arrangement may be obtained by arranging at least three beams such that each pair of beams defines a unique mutual acute angle. For example, each pair of beams in a set of beams forming a Ψ-scan may have a unique mutual acute angle. In another variant, an asymmetric beam arrangement is obtained by arranging at least two beams such that they have different angles to a common sweep direction (e.g. αl≠ cc2 in Fig. 9).
Fig. 12C illustrates a dual Ψ-scan arrangement that may be asymmetric by proper choice of mutual acute angles between the beams B1-B6. In the terminology of Fig. 12C, the mutual acute angles are given by α, β and (cc+β) in one set of beams (Bl, B2 and B4), and by γ, δ and (γ+δ) in the other set of beams (B3, B5 and B6). Thus, a suitable asymmetric beam arrangement is obtained when α ≠ β and/or γ ≠ δ. The asymmetric properties may be improved further by selecting α ≠ β ≠ γ ≠ δ, and even further by selecting α ≠ β ≠ γ≠ δ ≠ (α+β) ≠ (γ+δ). An even more asymmetric beam arrangement is obtained when α, β, γ and δ are selected such that all mutual acute angles defined between the beams B1-B6 are unique. In one such non-limiting example, α =6°, β=8°, γ=7° and δ=5°. If the panel is rectangular, with mutually opposite long sides and short sides, the asymmetric properties may be chosen such that the set of beams (B3, B5 and B6) that is swept orthogonally to the long sides of the panel (i.e. in direction R2) has a smaller maximum acute mutual acute angle than the other set of beams (Bl, B2 and B4), i.e. (γ+δ)<(α+β). Such a beam arrangement may increase the sensing area of the panel compared to other asymmetric dual Ψ-scan arrangements. It should also be noted that any one of the beam arrangements described in the foregoing may be combined with further beams that do not comply with any one of the above design principles. For example, a set of equiangular beams may be combined with one or more further beams that are non-equiangular with the set of equiangular beams. It is also possible to combine any one of the beam arrangements described in the foregoing, e.g. a v-scan with a Ψ-scan, equiangular beams with one or more v-scans or Ψ-scans, etc.
In yet another alternative embodiment, beams are swept angularly across the sensing area and around a respective axis of rotation ("angular scan"). Fig. 15A illustrates an example of such an embodiment, in which three beam scanners BS1-BS3 are arranged along one side of the panel 1 to inject a respective beam B1-B3 into the panel 1 and to sweep the beam across the sensing area. Re-directing devices 12A-12C are placed along the opposite sides of the panel 1 and configured to direct each beam B1-B3 from the panel 1 onto a fixed detection point D1-D3 while the beam is swept across the sensing area. Suitably, the beams B1-B3 only propagate through the sensing area between the redirecting devices 12A-12C and the detection points D1-D3. Between the beam scanners BS1-BS3 and the re-directing devices 12A-12C, the beams are transported outside the sensing area, e.g. beneath the panel (for example in a transportation plate to be described below). Similarly to Fig. 1, the detectors RD1-RD3 are arranged to measure the energy of the incoming beams B1-B3 in the detection points D1-D3.
Figs 15B-15D are front views of the re-directing devices 12A-12C in Fig. 15 A. Device 12A comprises one dedicated re-directing portion 13A-13C for each beam B1-B3, with portion 13A being designed to redirect beam Bl onto detection point Dl, portion 13B being designed to redirect beam B2 onto detection point D2, and portion 13C being designed to redirect beam B3 onto detection point D3. Devices 12B, 12C comprise corresponding portions configured to redirect beams B2, B3 and Bl, B3, respectively. The redirecting portions 13A-13C extend along the edges of the panel 1 and are arranged on different heights in the depth direction of the panel. The system in Fig. 15A also comprises coupling elements 14A-14C which are arranged intermediate the panel 1 and the re-directing devices 12A-12C and configured to direct each of the beams B1-B3 onto its corresponding portion 13A-13C. The redirection may be achieved by placing correctly angled mirrors at each position along the edge. In practice, this can be done with a specially molded plastic component that is transformed into a multifaceted mirror by applying a reflective coating such as gold or aluminum to one side of the plastic component. It is also possible, if the angles of the mirrors allow it, to use the surfaces of the plastic component itself as TIR mirrors. It is to be understood that the sensing area needs to be swept by at least two beams to allow for the location of a touching object to be determined, and that the precision of this determination may be increased by increasing the number of beams.
Although touch-sensing systems with angular scan are viable, it is currently believed that touch-sensing systems with pure beam translation (such as those in Figs 1- 12) provide certain advantages. For one, the complexity of the components required to direct each beam onto a common detection point may be reduced. Furthermore, with a pure translation, the sweep speed is constant along the beam which may facilitate the analysis of the resulting measurement signals Sl, S2. Still further, with an angular scan, an object that touches the panel close to a beam scanner will interact with the beam during a major part of the sweep. This means that part of the injected radiation will be absorbed/scattered over a major part of the beam sweep, thereby reducing the system's ability to detect the location of one or more further objects touching the panel. This drawback of distance dependent beam interaction is overcome when each beam is translated with an invariant main direction across the sensing area.
Further details about different beam arrangements, and systems for generating beam arrangements, are given in U.S. provisional application No. 61/129,372 and U.S. provisional application No. 61/129,373, which were both filed on June 23, 2008 and which are incorporated herein by reference.
ILLUMINATION ARRANGEMENT
As discussed above in relation to Fig. IA, the illumination arrangement may include a beam scanner BSl, BS2 which generates and sweeps a beam Bl, B2 along an elongate fixed beam-directing element 1OA, 1OB that is designed and arranged to output the beam with a desired main direction in the plane of the touch surface.
Generally, the beam- directing device 1OA, 1OB is an element or assembly of elements which defines the output direction of the beam for a given input direction thereof. To limit the footprint of the touch-sensing system, the beam-directing device 1OA, 1OB may be placed near a periphery portion of the panel 1. For reasons of robustness and mounting precision, the re-directing device may be mounted in contact with such a periphery portion.
In one embodiment, the beam- directing device 1OA, 1OB is an optical device that defines a focal plane parallel to and at a distance from an input side of the optical device. Thus, all rays that originate from a point in the focal plane and impinge on the input side of the optical device will be output in the same direction. Fig. 16 illustrates such an illumination arrangement, in which an angular scan is generated by sweeping a beam around a rotational axis C2 located in the focal plane fin of the beam- directing device 1OB. The angular scan results in the beam being swept along the beam-directing device 1OB, which converts the angular scan to a linear translation of the beam in a direction parallel to the beam- directing device 1OB. As indicated, the angle α between the main direction of the output beam and the optical axis of the beam- directing device 1OB is given by the displacement d of the rotational axis C2 from the focal point of the optical device 1OB (given by the intersection between the focal plane fin and the optical axis of the optical device 10B). In the example of Fig. 16, the optical beam- directing device 1OB is a lens device that transmits and redirects the incoming radiation. The lens device may be made up of diffractive optical elements (DOE), micro-optical elements, refractive lenses and any combination thereof. In one presently preferred embodiment, the lens device is a Fresnel lens. The lens device 1OB in Fig. 16 can be used to sweep a plurality of beams across the touch surface in the same sweep direction but with different main directions. This can be accomplished by arranging the rotational axes of a plurality of angular scanning beams at different locations in the focal plane of the lens device. Such an embodiment is shown in Fig. 17, in which three beam scanners BS1-BS3 are arranged with their rotational axes C1-C3 in the focal plane fin. Fig. 17 shows each beam B1-B3 at three time points while it is swept along the lens device 1OB, indicating that the main direction of each beam is unchanged during the sweep. Fig. 17 also illustrates that each of the beams B1-B3 are received by the detection arrangement and re-directed onto a respective detector RDl- RD3, as described in the foregoing. It is to be understood that the illumination arrangement in Fig. 17 may be space-efficient, simple, robust and easy to assemble while providing a well-defined mutual angle between the beams. Further, it allows the beams B1-B3 to be swept concurrently across the sensing area, if desired.
Fig. 18A illustrates an alternative embodiment in which a single beam scanner BS2 is configured to generate two angular scans around a corresponding number of virtual rotational axes Cl, C2. Like in the embodiment of Fig. 17, the rotational axes C1-C2 are arranged in the focal plane fin of the lens device 1OB, whereby the angular scans are converted to linear translations of two non-parallel beams Bl, B2 with a well-defined mutual angle.
Fig. 18B illustrates an embodiment of such a beam scanner BS2 for generating two virtual rotation axes Cl, C2. A stationary emitter 20 is operated to emit a beam which hits a rotating mirror 21. As the mirror 21 turns in the direction of the arrow around its axis of rotation, the beam is first deflected onto and swept along mirror 22, which reflects the beam as if it was swept around virtual rotation axis Cl, and then deflected onto and swept along mirror 23, which reflects the beam as if it was swept around virtual rotation axis C2.
Fig. 19A illustrates an alternative or supplementary configuration of an illumination arrangement for generating a linear translation of a set of beams B 1-B3 with well-defined mutual angles. In the embodiment of Fig. 19 A, an angular scan is generated around a rotation axis C2 located in the focal plane of a lens device 1OB. The output beam of the lens device 1OB, which suitably has an essentially invariant main direction, is received by a transmission grating 25, which generates a zero-order beam B2 as well as first-order beams Bl, B3 on the sides of the zero-order beam. Although not shown on the drawings, the grating may be designed to generate beams of higher orders as well. The mutual angles between the different beams B1-B3 are determined by the properties of the grating 25 according to the well-known grating equation:
ds -(sin θm+ sin θ,) = m-λ,
with ds being the spacing of diffracting elements in the grating, O1 being the angle of incidence of the beam that impinges on the grating, m being the order, λ being the wavelength of the radiation, and θm being the angle between each the beam of order m and the normal direction of the grating. This grating equation is generally applicable to all types of gratings.
Fig. 19B illustrates the main direction of the generated beams B1-B3 at three different time points during a sweep in the system of Fig. 19A. Fig. 19B also illustrates that each of the beams B 1-B3 are received by the detection arrangement and re-directed onto a respective detector RD1-RD3, as described in the foregoing.
The use of a grating 25 in combination with a lens device 1OB provides an illumination arrangement with the potential of being space-efficient, simple, robust and easy to assemble while providing a well-defined mutual angle between the beams. Further, it allows the beams B1-B3 to be swept concurrently across the sensing area, if desired. It is to be understood that further beam directions may be generated by providing more than one angular scan and arranging the rotational axes of the angular scans in the focal plane fin of the beam- directing device 1OB, e.g. as shown in Figs 16-18.
In the illustrated embodiments, the grating 25 is arranged downstream of the lens device 1OB. This will cause the grating 25 to be swept by a beam with an essentially invariant main direction, so that the set of beams B 1-B3 generated by the grating 25 are also swept with essentially invariant main directions within the sensing area. However, the grating 25 may alternatively be arranged upstream of the lens device 1OB, if the detection arrangement is configured to accept larger variations in the main directions of the beams Bl -B 3 during the sweep.
As an alternative to a transmission grating, a reflective grating may be used. As an alternative or complement to a grating, the lens device 1OB may itself be configured to generate a set of output beams with well-defined mutual angles, based on a single input beam. Such a lens device 1OB may comprise a set of elongate lens segments (not shown) arranged on top of each other in the depth direction, where each lens segment is arranged to generate an output beam in a unique direction, when swept by an input beam of at least the same width as the lens device 1OB in the depth direction. In one implementation, the focal points of the different lens segments may be located at different positions in the input focal plane fin. For example, the lens segments may all be designed from a basic lens segment which is shifted in its longitudinal direction to form the different segments of the lens device 1OB. Instead of being arranged on top of each other, the lens segments may be superimposed on each other in the beam- directing device 1OB. As yet another alternative or complement to a grating, an elongate prism structure may be arranged intermediate the lens device 1OB and the panel edge/coupling element, wherein the prism structure comprises a repeating prism element in the longitudinal direction. Fig. 23 illustrates an example of such a prism element 26, which has five differently inclined, planar prism surfaces 27, whereby the input beam is directed in five different directions as it is swept (in direction Rl) along the prism structure. In the illustrated example the prism element 26 is formed as an indentation in a surrounding material 28. Alternatively, the prism element 26 may be formed as a projection from the surrounding material 28. The prism structure may be provided as a separate component, or it may be integrated in the panel edge or the coupling element. It is to be noted that, in all of the above-described illumination arrangements, the lens device 1OB may be replaced by a fixed mirror device that redirects the incoming radiation by reflection. The mirror device may be made up of diffractive optical elements (DOE), micro-optical elements, mirrors and any combination thereof. An example of such a mirror device 1OB, combined with a transmission grating 25, is shown in Fig. 19C-19D, in which an angular scan is generated around a rotational axis C2 located in the focal plane fin of the mirror device 1OB. The above discussion with respect to the lens device is equally applicable to such a mirror device.
It is to be understood that the above-mentioned grating 25 may be integrated with the beam- directing device 1OB, be it a lens device or a mirror device. Further, in all illumination arrangements described herein, the beam scanner(s) may be of any known type and configuration and may operate in any suitable wavelength range, e.g. in the infrared or visible wavelength region. All beams could be generated with identical wavelength. Alternatively, different beams could be generated with radiation in different wavelength ranges, permitting differentiation between the beams based on wavelength. Furthermore, the beam scanner(s) can output either continuous or pulsed radiation. The beams could be generated by one or more radiation sources, which can be any type of device capable of emitting radiation in a desired wavelength range, for example a diode laser, a VCSEL (vertical-cavity surface-emitting laser), or alternatively an LED (light-emitting diode), an incandescent lamp, a halogen lamp, etc. Preferably, the illumination arrangement is configured such that the beam, when injected into the panel, is essentially collimated in the plane of the panel. This will maximize the amount of radiation that reaches the radiation detector at the opposite end of the sensing area.
In the hitherto illustrated embodiments, the beam scanners and/or detectors have been placed outside the perimeter of the panel. This might be undesirable, e.g. if the touch-sensing system is to be integrated with the above-mentioned interface device, e.g. display device, such as an LCD (Liquid Crystal Display), a plasma display, an OLED (Organic Light-Emitting Diode) display or similar. If components of the touch- sensing system are arranged far from the perimeter of the display, the surface area of the complete system may become undesirably large.
Fig. 2OA is a section view of an embodiment with folded beam paths, thereby allowing beam scanners and detectors to be placed underneath the panel and the interface device, if present. The illustrated touch-sensing system comprises two folding systems, which are arranged on opposite sides of the panel 1. In the system of Fig. 2OA, a beam is emitted from emitter 20 to hit rotating mirror 21, which reflects the beam towards the first folding system. After entering the first folding system, the beam is first reflected in stationary mirror 30 and thereafter in stationary mirror 31, whereby the beam is folded into the plane of the panel. The folded beam then passes through the beam-directing lens device 1OB and enters the panel via a coupling element 32, which may be attached to the panel 1, e.g. with optically clear glue or any other kind of suitable adhesive. The beam propagates through the panel by TIR and exits the panel via coupling element 32. Thereafter, the beam enters the second folding system, wherein it passes through the re- directing lens device 12B and is reflected in stationary mirrors 33, 34, such that the beam is again folded beneath the panel 1. The beam thereafter exits the second folding system and is received by the radiation detector RD2.
Fig. 2OB is a variant of the system in Fig. 2OA, in which a mirror device is used instead of a lens device for controlling the main direction of the beam B2 in the sensing area and for directing the beam onto the detector RD2. Thus, one or both of stationary mirrors 30, 31 in the first folding system on the input side may be configured to implement the beam-directing functionality of the illumination arrangement, and one or both of stationary mirrors 33, 34 in the second folding system on the output side may be configured to implement the re-directing functionality of the detection arrangement.
Although not shown on the drawings, it should be understood that other combinations of the folding systems in Fig. 2OA and 2OB are conceivable. In all embodiments, the touch-sensing system may include a transportation device, which is arranged underneath the panel to define a confined transportation channel in the illumination arrangement between the beam scanner and the beam injection site on the panel, and/or in the detection arrangement between the beam out-coupling site on the panel and the scanning detector. The use of such transportation device makes it possible to gather the bulk of components at one or a few sides of the panel. Preferably, the transportation device has no anti-glare structure, so as to minimize scattering of radiation inside the transportation device. Further, if the panel is provided with an anti-glare structure, it is preferred to include the transportation device in the illumination arrangement, rather than in the detection arrangement, since this will minimize the width of the beam profile at the detector.
Figs 21A and 21B illustrate variants of the embodiment in Fig. 2OA, wherein a transportation device is incorporated in the form of a transportation plate 35, which may be made of the same material as the panel or any other sufficiently radiation-transmissive material or combination of materials. The transportation plate 35 suitably has an extent to allow for the above-mentioned beams to be swept within the plate and may have essentially the same size as the panel. In Fig. 21A, the transportation plate 35 is spaced from the panel 1, e.g. to accommodate for an interface device 6 to be placed between the panel 1 and the plate 35. In Fig. 21B, the plate 35 is placed in contact with the panel 1, or may be formed as an integrated layer in the panel 1. In both examples, the touch-sensing system includes a distal folding system 36 that directs the beam from the transportation plate 35 into the panel 1. In the example of Fig. 21, the beam-directing device 1OB is included in the distal folding system 36. This will minimize the distance between the beam-directing device 1OB and the re-directing device 12B which may reduce the impact of inaccuracies in the beam-directing device 1OB or beam scanner BS2 on the ability of the re-directing device 12B to correctly direct the beam B2 onto the detector RD2. It may also reduce the footprint of the system.
Generally, the use of a transportation plate 35 may provide a touch-sensing system, which is simple, compact, robust and easy to assemble. The beam may be confined within the plate by total internal reflection, and/or by the plate being coated with one or more reflecting layers. In alternative embodiments (not shown), the touch-sensing system may comprise more than one transportation device. For example, the individual beams may be guided in separate transportation devices, or the system may include one or more transportation devices for guiding the beams to the panel and one or more transportation devices for guiding the beams from the panel. Other types of transportation devices may alternatively be used, such as optical fibres.
DETERMINATION OF TOUCH LOCATIONS
In all of the above-described embodiments, configurations, arrangements, alternatives and variants, a data processor (8 in Fig. IA) may be configured to calculate the touch locations based on measurement signals derived from the radiation detectors. The skilled person will readily realize that there are numerous methods for determining the touch locations. Fig. 19 is a flow chart of one such exemplifying method.
In step 60, measurement signals are acquired from the detectors in the system. Each measurement signal represents data from k different angles, sampled at N time intervals during a sensing instance.
In step 62, the measurement signals are pre-processed. For example, the measurement signals may be processed for noise reduction using standard filtering techniques, e.g. low-pass filtering, median filters, Fourier-plane filters, etc. Furthermore, if the energy of the emitted beams is measured in the system, the measurement signals may be compensated for temporal energy fluctuations in the beam scanners. Furthermore, the measurement signals may contain sensor readings from outside the region of interest, e.g. outside the sensing area of the panel. Thus, the measurement signals may be pre- processed by extracting relevant parts thereof. It may be desired to add one or more trigger points in the measurement signal to improve/facilitate the extraction of relevant data. Such a trigger point may indicate the start or stop of a beam sweep. Furthermore, the measurement signals may be rectified, i.e. converted to have equidistant sampling distance in the panel coordinate system. Such a rectification may include interpolating each measurement signal with a non-linear angle variable, resulting in a data set with samples that are evenly distributed over the panel. Rectification is optional, but may simplify the subsequent computation of touch locations.
In step 64, a transmission signal is calculated for each pre-processed measurement signal, by dividing the measurement signal with a background signal. The background signal may or may not be unique to each detector or each measurement signal. The background signal may be pre-set, derived during a separate calibration step, or derived from measurement signals acquired during one or more preceding iterations. Optionally, the calculation of transmission signals may include calculating the logarithm of the ratios between the measurement and background signals.
In step 66, the touch locations are determined based on the transmission signals. The touch-sensing systems as described herein may be modeled using known algorithms developed for transmission tomography with either a parallel scanning geometry or a fan beam geometry. Thus, the touch locations may be reconstructed using any available image reconstruction algorithm, especially few-view algorithms that are used, e.g., in the field of tomography. If the system involves scattering, the reconstruction suitably also takes into account the functional dependence between signal width and position along the panel (cf. Fig. 8).
The determination of touch locations in step 66 may thus involve identifying peaks in the transmission signals, while possibly also separating adjacent/overlapping peaks (cf. Fig. 7); reconstructing the beams that correspond to the identified peaks, and identifying candidate intersections between the reconstructed beams in the sensing area; computing an area value indicative of the (logarithmic) integrated area under each identified peak in the transmission signals, and setting up an equation system relating the candidate intersections to the area values; and then using e.g. linear programming to identify the most likely set of touches from the set of candidates. The accuracy and/or computation speed of step 66 may be increased by using a priori knowledge about the touch locations, e.g. by using information about the touch locations that were identified during preceding sensing instance(s).
To give a simplified example, based on the measurement signals in Fig. 7, the peaks in signal Sl may yield logarithmic areas al, a2 and the peak in S2 may yield logarithmic area a3. Beam reconstruction may yield two intersections pl, p2, giving the equation system:
pl = al p2 = a2 pl + p2 = a3
In this particular example, the solution is trivial, but it should be realized that the provision of multiple touches and comparatively few beam sweeps may result in an equation system that has a number of possible solutions, or no solution, requiring the use of optimization methodology to derive the most likely set of touches.
After step 66, the determined touch locations are output and the method returns to step 60 for processing of a forthcoming sensing instance.
The invention has mainly been described above with reference to a few embodiments. However, as is readily appreciated by a person skilled in the art, other embodiments than the ones disclosed above are equally possible within the scope and spirit of the invention, which is defined and limited only by the appended patent claims. For example, the illumination arrangement may combine sweeping of one or more beams of radiation with other means for generating radiation paths inside the panel, e.g. activating opposite pairs of fixed beam transmitters and beam detectors as disclosed in aforesaid US 3,673,327, or using a combination of fixed light sources for generation of diverging beams and arrays of light sensors arranged at the periphery of the panel as disclosed in aforesaid US2004/0252091.
Further, one or more of the optical components described in the foregoing may be combined into a single optical unit, or the functionality of a single optical component described in the foregoing may be provided by a combination of components. For example, it is conceivable to integrate the beam-directing device or the re-directing device into the coupling element for coupling radiation into the panel, or into the panel edge.

Claims

1. An apparatus for determining a location of at least one object on a touch surface, said apparatus comprising: a panel (1) defining the touch surface (2) and an opposite surface (3); an illumination arrangement adapted to introduce radiation into the panel (1) for propagation by internal reflection between the touch surface (2) and the opposite surface (3), so as to generate a grid of intersecting radiation paths in a sensing area; a detection arrangement adapted to measure the transmitted energy in said radiation paths; and a data processor (8) connected to the detection arrangement and configured to determine, based on the measured energy, said location based on an attenuation of two or more radiation paths caused by the object touching the touch surface (2) within the sensing area; wherein said illumination arrangement is configured to generate at least a subset of the radiation paths by sweeping at least one beam (B1-B6) of radiation along the touch surface; wherein said detection arrangement comprises a fixed re-directing device (12A, 12B) configured to receive and re-direct said at least one beam (B1-B6) onto a common detection point (Dl, D2) while said at least one beam (B1-B6) is swept along the touch surface; and wherein said detection arrangement further comprises a radiation detector (RDl, Rd2) which is located at said common detection point (Dl, D2) to measure the energy of said at least one beam (B1-B6).
2. The apparatus of claim 1, wherein the illumination arrangement is configured to sweep said at least one beam (B1-B6) with an essentially invariant main direction within the sensing area.
3. The apparatus of claim 1 or 2, wherein the fixed re-directing device comprises an elongate optical element (12A, 12B) that defines an output focal plane (fout), wherein the illumination arrangement is configured such that the beam (B1-B6), while being swept within the sensing area, is swept along the elongate optical element at an essentially invariant angle of incidence, and wherein the radiation detector (RDl, RD2) is arranged in said output focal plane (fout).
4. The apparatus of claim 3, wherein the illumination arrangement is adapted to sweep at least two separate beams (B1-B6) of radiation within the sensing area, such that each beam (B1-B6) is swept along the elongate optical element (12A, 12B) at a respective angle of incidence, and wherein the detection arrangement comprises at least two radiation detectors (RDl, RD2), which are arranged at separate locations to measure the energy of the respective beam (B1-B6).
5. The apparatus of any preceding claim, wherein the radiation detector (RDl, RD2) comprises a light-sensing surface (17) and device (16, 19) for increasing the effective light-sensing area of the radiation detector (RDl, RD2), said device (16, 19) being arranged intermediate the re-directing device (12A, 12B) and the light-sensing surface (17).
6. The apparatus of claim 5, wherein said device (16, 19) for increasing the effective light- sensing area comprises one of a diffusing element (16) and a concentrator (19).
7. The apparatus of any preceding claim, wherein the re-directing device (12A, 12B) is arranged to extend along an edge portion of said panel (1).
8. The apparatus of any preceding claim, wherein the illumination arrangement is configured to inject beams that are collimated at least in the plane of the panel (1).
9. The apparatus of any preceding claim, wherein the illumination arrangement and the detection arrangement are configured to introduce and receive said at least one beam (B1-B6) on opposite ends of the sensing area.
10. The apparatus of any preceding claim, wherein the illumination arrangement comprises a beam-scanning device (BSl, BS2) configured to sweep an input beam around an axis of rotation, a fixed beam-directing device (1OA, 10B) configured to receive the thus- swept input beam and generate at least one output beam which is translated in a principal direction (Rl, R2) while having an essentially invariant main direction, and a coupling element (32) connected to the panel (1) for receiving and injecting said at least one output beam into the panel (1), thereby forming said at least one beam (B1-B6) that is swept along the touch surface (2) within the sensing area.
11. The apparatus of claim 10, wherein the beam-directing device comprises an elongate optical element (1OA, 10B) that defines an input focal plane (fin), wherein said axis of scanning is located in said input focal plane (fin).
12. The apparatus of claim 10 or 11, wherein the beam-scanning device (BSl, BS2) is configured to sweep at least two separate input beams along the elongate optical element (1OA, 10B), each input beam being swept around a separate axis of rotation in said input focal plane (fin), thereby causing the elongate optical element (1OA, 10B) to generate output beams with separate main directions.
13. The apparatus of claim 10, 11 or 12, wherein the beam- directing device (1OA, 10B) further comprises an elongate grating structure (25) which is arranged to generate said at least one output beam as a set of diffracted beams with a predetermined angular spacing.
14. The apparatus of any one of claims 10-13, wherein the beam-directing device (1OA, 10B) is arranged to extend along an edge portion of said panel (1).
15. The apparatus of claim 14, wherein said principal direction (Rl, R2) is essentially parallel to said edge portion of said panel.
16. The apparatus of any one of claims 10-15, wherein the illumination arrangement comprises a plate-shaped radiation guide (35) which is arranged underneath the panel (1), as seen from the touch surface (2), and a beam-folding system (36) which is arranged to optically connect the radiation guide (35) to the panel (1), wherein the radiation guide (35) is configured to guide said at least one output beam by internal reflection from the beam- directing device (1OA, 10B) to the beam-folding system (36).
17. The apparatus of any one of the preceding claims, wherein the illumination arrangement is configured to sweep a first set of mutually acute beams (B 1, B2, B4) in a first principal direction (Rl) across the panel (1), wherein the beams (Bl, B2, B4) in the first set have a maximum mutual acute angle of <30°, and preferably <20°.
18. The apparatus of claim 17, wherein the main direction of one of the beams (B4) in the first set is orthogonal to the first principal direction (Rl).
19. The apparatus of claim 17 or 18, wherein each pair of beams (Bl, B2, B4) in the first set has a unique mutual acute angle.
20. The apparatus of any one of claims 17-19, wherein the illumination arrangement is configured to sweep at least one second beam (B3, B5, B6) in a second principal direction (R2) across the panel (1).
21. The apparatus of any one of claims 17-19, wherein the illumination arrangement is configured to sweep a second set of mutually acute beams (B3, B5, B6) in a second principal direction (R2) across the panel (1), wherein the beams (B3, B5, B6) in the second set have a maximum mutual acute angle of <30°, and preferably <20°.
22. The apparatus of claim 21, wherein the first set comprises three beams (Bl, B2, B4) and/or the second set comprises three beams (B3, B5, B6).
23. The apparatus of claim 21 or 22, wherein the main direction of one of the beams (B6) in the second set is orthogonal to the second principal direction (R2).
24. The apparatus of any one of claims 21-23, wherein each pair of beams (Bl, B2,
B4) in the second set has a unique mutual acute angle.
25. The apparatus of any one of claims 20-24, wherein the first and second principal directions (Rl, R2) are mutually orthogonal.
26. The apparatus of any one of claim 20-25, wherein the panel (1) is rectangular, and the first and second principal directions (Rl, R2) are parallel to a respective edge portion of the panel (1).
27. An apparatus for determining a location of at least one object on a touch surface (2), said touch surface (2) being part of a panel (1) that defines the touch surface (2) and an opposite surface (3), said apparatus comprising: means (BSl, BS2, 1OA, 1OB, 32) for introducing radiation into the panel (1) for propagation by internal reflection between the touch surface (2) and the opposite surface (3), so as to generate a grid of intersecting radiation paths in a sensing area; means (12A, 12B, RDl, RD2) for measuring the transmitted energy in said radiation paths; means (8) for identifying, based on the measured energy, at least two radiation paths that are attenuated by an object touching the touch surface (2); and means (8) for determining the location of the object based on the attenuated radiation paths; wherein said means (BSl, BS2, 1OA, 1OB, 32) for introducing comprises means (BSl, BS2) for sweeping at least one beam (B1-B6) of radiation along the touch surface (2); wherein said means (12 A, 12B, RDl, RD2) for measuring comprises a fixed means (12A, 12B) for receiving said at least one beam (B1-B6), while it is swept along the touch surface (2), and for re-directing said at least one beam (B1-B6) onto a common detection point (Dl, D2), and means (RDl, RD2) for measuring the energy of said at least one beam (B1-B6) at said common detection point (Dl, D2).
28. A method of determining a location of at least one object on a touch surface (2), said touch surface (2) being part of a panel (1) that defines the touch surface (2) and an opposite surface (3), said method comprising the steps of: introducing radiation into the panel (1) for propagation by internal reflection between the touch surface (2) and the opposite surface (3), so as to generate a grid of intersecting radiation paths in a sensing area; measuring the transmitted energy in said radiation paths; identifying, based on the measured energy, at least two radiation paths that are attenuated by an object touching the touch surface (2); and determining the location of the object based on the attenuated radiation paths; wherein the step of introducing comprises sweeping at least one beam (B1-B6) of radiation along the touch surface (2); wherein the step of measuring comprises receiving said at least one beam (B1-B6), while it is swept along the touch surface (2), by a fixed re-directing device (12A, 12B) which re-directs said at least one beam (B1-B6) onto a common detection point (Dl, D2), and measuring the energy of said at least one beam (B1-B6) at said common detection point (Dl, D2).
29. A method of operating an apparatus for determining a location of at least one object on a touch surface (2), said touch surface (2) being part of a panel (1) that defines the touch surface (2) and an opposite surface (3), said method comprising the steps of: operating an illumination arrangement to introduce radiation into the panel for propagation by internal reflection between the touch surface and the opposite surface, so as to generate a grid of intersecting radiation paths in a sensing area; operating a detection arrangement to measure the transmitted energy in said radiation paths; and determining, based on the transmitted energy, said location based on an attenuation of two or more radiation paths caused by the object touching the touch surface (2) within the sensing area; wherein the step of operating the illumination arrangement comprises the step of sweeping at least one beam (B1-B6) of radiation along the touch surface (2), such that said at least one beam (B1-B6), after passing the sensing area, is received by a fixed re- directing device (12A, 12B) which re-directs said at least one beam (B1-B6) onto a common detection point (Dl, D2); and wherein the step of operating the detection arrangement comprises measuring the energy of said at least one beam (B1-B6) by a radiation detector (RDl, RD2) which is located at the common detection point (Dl, D2).
30. A computer program product comprising computer code which, when executed on a data-processing system, is adapted to carry out the method of claim 29.
PCT/EP2009/057725 2008-06-23 2009-06-22 Detecting the location of an object on a touch surface WO2010006884A2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
EP09779864A EP2318906A2 (en) 2008-06-23 2009-06-22 Detecting the location of an object on a touch surface
CA2728034A CA2728034A1 (en) 2008-06-23 2009-06-22 Detecting the location of an object on a touch surface
AU2009272923A AU2009272923A1 (en) 2008-06-23 2009-06-22 Detecting the location of an object on a touch surface
CN200980123716.8A CN102067074A (en) 2008-06-23 2009-06-22 Detecting the location of an object on a touch surface
US12/737,018 US8890843B2 (en) 2008-06-23 2009-06-22 Detecting the location of an object on a touch surface
IL209929A IL209929A0 (en) 2008-06-23 2010-12-12 Detecting the location of an object on a touch surface

Applications Claiming Priority (12)

Application Number Priority Date Filing Date Title
US12937208P 2008-06-23 2008-06-23
US12937308P 2008-06-23 2008-06-23
SE0801467-2 2008-06-23
US61/129,372 2008-06-23
SE0801467 2008-06-23
SE0801466-4 2008-06-23
US61/129,373 2008-06-23
SE0801466 2008-06-23
US20287509P 2009-04-15 2009-04-15
US61/202,875 2009-04-15
SE0950245-1 2009-04-15
SE0950245 2009-04-15

Publications (2)

Publication Number Publication Date
WO2010006884A2 true WO2010006884A2 (en) 2010-01-21
WO2010006884A3 WO2010006884A3 (en) 2010-11-25

Family

ID=41258952

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2009/057725 WO2010006884A2 (en) 2008-06-23 2009-06-22 Detecting the location of an object on a touch surface

Country Status (8)

Country Link
US (1) US8890843B2 (en)
EP (1) EP2318906A2 (en)
CN (1) CN102067074A (en)
AU (1) AU2009272923A1 (en)
CA (1) CA2728034A1 (en)
IL (1) IL209929A0 (en)
TW (1) TW201007530A (en)
WO (1) WO2010006884A2 (en)

Cited By (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010006886A2 (en) * 2008-06-23 2010-01-21 Flatfrog Laboratories Ab Determining the location of one or more objects on a touch surface
WO2011139213A1 (en) 2010-05-03 2011-11-10 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
EP2466429A1 (en) 2010-12-16 2012-06-20 FlatFrog Laboratories AB Scanning ftir systems for touch detection
EP2466428A2 (en) 2010-12-16 2012-06-20 FlatFrog Laboratories AB Touch apparatus with separated compartments
WO2012082055A1 (en) * 2010-12-15 2012-06-21 Flatfrog Laboratories Ab Touch determination with signal enhancement
WO2012105893A1 (en) 2011-02-02 2012-08-09 Flatfrog Laboratories Ab Optical incoupling for touch-sensitive systems
WO2012121652A1 (en) * 2011-03-09 2012-09-13 Flatfrog Laboratories Ab Touch determination with signal compensation
WO2013055282A2 (en) 2011-10-11 2013-04-18 Flatfrog Laboratories Ab Improved multi-touch detection in a touch system
WO2013089622A2 (en) 2011-12-16 2013-06-20 Flatfrog Laboratories Ab Tracking objects on a touch surface
US8482547B2 (en) 2008-06-23 2013-07-09 Flatfrog Laboratories Ab Determining the location of one or more objects on a touch surface
WO2013133756A1 (en) 2012-03-09 2013-09-12 Flatfrog Laboratories Ab Efficient tomographic processing for touch determination
WO2013133757A2 (en) 2012-03-09 2013-09-12 Flatfrog Laboratories Ab Efficient tomographic processing for touch determination
US8542217B2 (en) 2008-06-23 2013-09-24 Flatfrog Laboratories Ab Optical touch detection using input and output beam scanners
WO2013165305A2 (en) 2012-05-02 2013-11-07 Flatfrog Laboratories Ab Object detection in touch systems
WO2013165306A2 (en) 2012-05-02 2013-11-07 Flatfrog Laboratories Ab Object detection in touch systems
US8692807B2 (en) 2009-09-02 2014-04-08 Flatfrog Laboratories Ab Touch surface with a compensated signal profile
WO2014098744A1 (en) * 2012-12-20 2014-06-26 Flatfrog Laboratories Ab Improvements in tir-based optical touch systems of projection-type
US8890849B2 (en) 2011-09-27 2014-11-18 Flatfrog Laboratories Ab Image reconstruction for touch determination
US8982084B2 (en) 2011-12-16 2015-03-17 Flatfrog Laboratories Ab Tracking objects on a touch surface
US9024916B2 (en) 2009-10-19 2015-05-05 Flatfrog Laboratories Ab Extracting touch data that represents one or more objects on a touch surface
WO2015076731A1 (en) * 2013-11-22 2015-05-28 Flatfrog Laboratories Ab A touch sensitive apparatus with improved spatial resolution
US9134854B2 (en) 2008-06-23 2015-09-15 Flatfrog Laboratories Ab Detecting the locations of a plurality of objects on a touch surface
US9411444B2 (en) 2010-10-11 2016-08-09 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
US9430079B2 (en) 2009-10-19 2016-08-30 Flatfrog Laboratories Ab Determining touch data for one or more objects on a touch surface
US9588619B2 (en) 2012-01-31 2017-03-07 Flatfrog Laboratories Ab Performance monitoring and correction in a touch-sensitive apparatus
US9639210B2 (en) 2011-12-22 2017-05-02 Flatfrog Laboratories Ab Touch determination with interaction compensation
US9811209B2 (en) 2012-02-21 2017-11-07 Flatfrog Laboratories Ab Touch determination with improved detection of weak interactions
US9874978B2 (en) 2013-07-12 2018-01-23 Flatfrog Laboratories Ab Partial detect mode
US9927920B2 (en) 2011-12-16 2018-03-27 Flatfrog Laboratories Ab Tracking objects on a touch surface
US10019113B2 (en) 2013-04-11 2018-07-10 Flatfrog Laboratories Ab Tomographic processing for touch detection
US10126882B2 (en) 2014-01-16 2018-11-13 Flatfrog Laboratories Ab TIR-based optical touch systems of projection-type
US10146376B2 (en) 2014-01-16 2018-12-04 Flatfrog Laboratories Ab Light coupling in TIR-based optical touch systems
US10161886B2 (en) 2014-06-27 2018-12-25 Flatfrog Laboratories Ab Detection of surface contamination
US10168835B2 (en) 2012-05-23 2019-01-01 Flatfrog Laboratories Ab Spatial resolution in touch displays
US10282035B2 (en) 2016-12-07 2019-05-07 Flatfrog Laboratories Ab Touch device
US10318074B2 (en) 2015-01-30 2019-06-11 Flatfrog Laboratories Ab Touch-sensing OLED display with tilted emitters
US10401546B2 (en) 2015-03-02 2019-09-03 Flatfrog Laboratories Ab Optical component for light coupling
US10437389B2 (en) 2017-03-28 2019-10-08 Flatfrog Laboratories Ab Touch sensing apparatus and method for assembly
US10474249B2 (en) 2008-12-05 2019-11-12 Flatfrog Laboratories Ab Touch sensing apparatus and method of operating the same
US10481737B2 (en) 2017-03-22 2019-11-19 Flatfrog Laboratories Ab Pen differentiation for touch display
US10496227B2 (en) 2015-02-09 2019-12-03 Flatfrog Laboratories Ab Optical touch system comprising means for projecting and detecting light beams above and inside a transmissive panel
US10761657B2 (en) 2016-11-24 2020-09-01 Flatfrog Laboratories Ab Automatic optimisation of touch signal
US11182023B2 (en) 2015-01-28 2021-11-23 Flatfrog Laboratories Ab Dynamic touch quarantine frames
US11256371B2 (en) 2017-09-01 2022-02-22 Flatfrog Laboratories Ab Optical component
US11301089B2 (en) 2015-12-09 2022-04-12 Flatfrog Laboratories Ab Stylus identification
US11474644B2 (en) 2017-02-06 2022-10-18 Flatfrog Laboratories Ab Optical coupling in touch-sensing systems
US11567610B2 (en) 2018-03-05 2023-01-31 Flatfrog Laboratories Ab Detection line broadening
US11893189B2 (en) 2020-02-10 2024-02-06 Flatfrog Laboratories Ab Touch-sensing apparatus
US11943563B2 (en) 2019-01-25 2024-03-26 FlatFrog Laboratories, AB Videoconferencing terminal and method of operating the same

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9471170B2 (en) 2002-11-04 2016-10-18 Neonode Inc. Light-based touch screen with shift-aligned emitter and receiver lenses
US8902196B2 (en) * 2002-12-10 2014-12-02 Neonode Inc. Methods for determining a touch location on a touch screen
US8553014B2 (en) 2008-06-19 2013-10-08 Neonode Inc. Optical touch screen systems using total internal reflection
US9092092B2 (en) * 2008-08-07 2015-07-28 Rapt Ip Limited Detecting multitouch events in an optical touch-sensitive device using touch event templates
JP5588982B2 (en) 2008-08-07 2014-09-10 ラプト アイピー リミテッド Optical control system with modulated emitter
JP5378519B2 (en) 2008-08-07 2013-12-25 ドラム,オウエン Method and apparatus for detecting multi-touch events in optical touch sensitive devices
US9063615B2 (en) 2008-08-07 2015-06-23 Rapt Ip Limited Detecting multitouch events in an optical touch-sensitive device using line images
US9158416B2 (en) 2009-02-15 2015-10-13 Neonode Inc. Resilient light-based touch surface
US9063614B2 (en) 2009-02-15 2015-06-23 Neonode Inc. Optical touch screens
EP2433204A4 (en) * 2009-05-18 2014-07-23 Flatfrog Lab Ab Determining the location of an object on a touch surface
TWI520030B (en) * 2009-05-21 2016-02-01 原相科技股份有限公司 Cmos image sensor and method of operating the same
US20110032214A1 (en) * 2009-06-01 2011-02-10 Qualcomm Mems Technologies, Inc. Front light based optical touch screen
US8866347B2 (en) 2010-01-15 2014-10-21 Idex Asa Biometric image sensing
US8421890B2 (en) 2010-01-15 2013-04-16 Picofield Technologies, Inc. Electronic imager using an impedance sensor grid array and method of making
US8791792B2 (en) 2010-01-15 2014-07-29 Idex Asa Electronic imager using an impedance sensor grid array mounted on or about a switch and method of making
TWI488090B (en) * 2010-06-28 2015-06-11 Au Optronics Corp Optical information sampling method and touch information identification method
CN104094203B (en) 2011-07-22 2017-02-15 拉普特知识产权公司 Optical coupler for use in optical touch sensitive device
US20130135255A1 (en) * 2011-11-30 2013-05-30 Qualcomm Mems Technologies, Inc. Display systems including optical touchscreen
US20130135359A1 (en) * 2011-11-30 2013-05-30 Qualcomm Mems Technologies, Inc. Display systems including illumination and optical touchscreen
KR102245293B1 (en) 2012-04-10 2021-04-28 이덱스 바이오메트릭스 아사 Biometric Sensing
US9524060B2 (en) 2012-07-13 2016-12-20 Rapt Ip Limited Low power operation of an optical touch-sensitive device for detecting multitouch events
US9405382B2 (en) 2012-07-24 2016-08-02 Rapt Ip Limited Augmented optical waveguide for use in an optical touch sensitive device
US9741184B2 (en) 2012-10-14 2017-08-22 Neonode Inc. Door handle with optical proximity sensors
US10282034B2 (en) 2012-10-14 2019-05-07 Neonode Inc. Touch sensitive curved and flexible displays
US9207800B1 (en) 2014-09-23 2015-12-08 Neonode Inc. Integrated light guide and touch screen frame and multi-touch determination method
US9164625B2 (en) 2012-10-14 2015-10-20 Neonode Inc. Proximity sensor for determining two-dimensional coordinates of a proximal object
US10324565B2 (en) 2013-05-30 2019-06-18 Neonode Inc. Optical proximity sensor
US10585530B2 (en) 2014-09-23 2020-03-10 Neonode Inc. Optical proximity sensor
US9921661B2 (en) 2012-10-14 2018-03-20 Neonode Inc. Optical proximity sensor and associated user interface
TWI582672B (en) * 2015-01-20 2017-05-11 緯創資通股份有限公司 An optical touch device and touch detecting method using the same
EP3669258A4 (en) * 2017-08-18 2021-03-24 Apple Inc. Detecting a touch input to a surface
CN115039060A (en) 2019-12-31 2022-09-09 内奥诺德公司 Non-contact touch input system
WO2022072331A1 (en) 2020-09-30 2022-04-07 Neonode Inc. Optical touch sensor

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2131544A (en) * 1982-12-07 1984-06-20 Lowbar Inc Optical position location apparatus
US20020067348A1 (en) * 1999-12-02 2002-06-06 Masters Timothy E. Apparatus and method to improve resolution of infrared touch systems
US6972753B1 (en) * 1998-10-02 2005-12-06 Semiconductor Energy Laboratory Co., Ltd. Touch panel, display device provided with touch panel and electronic equipment provided with display device
EP1752864A2 (en) * 2005-07-29 2007-02-14 Avago Technologies Fiber IP (Singapore) Pte. Ltd. Methods and systems for detecting selections on a touch screen display
WO2007112742A1 (en) * 2006-03-30 2007-10-11 Flatfrog Laboratories Ab A system and a method of determining a position of a scattering/reflecting element on the surface of a radiation transmissive element

Family Cites Families (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR1452041A (en) 1965-04-26 1966-02-25 Electronique & Automatisme Sa Communication device with an electronic calculator
US3673327A (en) * 1970-11-02 1972-06-27 Atomic Energy Commission Touch actuable data input panel assembly
US4129384A (en) * 1977-06-08 1978-12-12 Batelle Memorial Institute Optical extensometer
US4213707A (en) * 1979-04-25 1980-07-22 Eastman Kodak Company Device for improving the accuracy of optical measuring apparatus and the like
US4294543A (en) 1979-11-13 1981-10-13 Command Control & Communications Corporation Optical system for developing point coordinate information
US4420261A (en) * 1980-09-02 1983-12-13 Lowbar, Inc. Optical position location apparatus
JPS58111705A (en) * 1981-12-25 1983-07-02 Mitsutoyo Mfg Co Ltd Optical measuring device
US4507557A (en) 1983-04-01 1985-03-26 Siemens Corporate Research & Support, Inc. Non-contact X,Y digitizer using two dynamic ram imagers
US4746770A (en) 1987-02-17 1988-05-24 Sensor Frame Incorporated Method and apparatus for isolating and manipulating graphic objects on computer video monitor
JPH01195526A (en) * 1988-01-29 1989-08-07 Sony Corp Touch panel device
JPH02155023A (en) 1988-12-07 1990-06-14 Fujitsu Ltd Optical coordinate input device
CH683370A5 (en) * 1992-04-10 1994-02-28 Zumbach Electronic Ag Method and apparatus for measuring the dimension of an object.
DE69318677T2 (en) * 1992-11-25 1999-02-18 Sumitomo Electric Industries Method of detecting contaminants in molten plastic
RU2072513C1 (en) 1993-04-23 1997-01-27 Научно-исследовательский институт ядерной физики Томского политехнического университета Method for tomographic inspection of large-size cargo
US5764223A (en) 1995-06-07 1998-06-09 International Business Machines Corporation Touch-screen input device using the monitor as a light source operating at an intermediate frequency
EP0897161B1 (en) 1997-08-07 2007-10-10 Fujitsu Limited Optical scanning-type touch panel
JP3827450B2 (en) 1998-08-18 2006-09-27 富士通株式会社 Optical scanning touch panel
US7859519B2 (en) 2000-05-01 2010-12-28 Tulbert David J Human-machine interface
US6724489B2 (en) * 2000-09-22 2004-04-20 Daniel Freifeld Three dimensional scanning camera
JP4768143B2 (en) 2001-03-26 2011-09-07 株式会社リコー Information input / output device, information input / output control method, and program
US7254775B2 (en) 2001-10-03 2007-08-07 3M Innovative Properties Company Touch panel system and method for distinguishing multiple touch inputs
JP2005505075A (en) 2001-10-09 2005-02-17 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Device having touch sensitivity function
US7432893B2 (en) 2003-06-14 2008-10-07 Massachusetts Institute Of Technology Input device based on frustrated total internal reflection
US7265748B2 (en) 2003-12-11 2007-09-04 Nokia Corporation Method and device for detecting touch pad input
JP4522113B2 (en) 2004-03-11 2010-08-11 キヤノン株式会社 Coordinate input device
JP4429083B2 (en) 2004-06-03 2010-03-10 キヤノン株式会社 Shading type coordinate input device and coordinate input method thereof
JP2006039686A (en) 2004-07-22 2006-02-09 Pioneer Electronic Corp Touch panel device, touch region detecting method, and touch region detecting program
US8599140B2 (en) 2004-11-17 2013-12-03 International Business Machines Corporation Providing a frustrated total internal reflection touch interface
WO2006095320A2 (en) 2005-03-10 2006-09-14 Koninklijke Philips Electronics, N.V. System and method for detecting the location, size and shape of multiple objects that interact with a touch screen display
US7705835B2 (en) 2005-03-28 2010-04-27 Adam Eikman Photonic touch screen apparatus and method of use
US7737959B2 (en) 2005-09-08 2010-06-15 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Position detection system using laser speckle
JP4510738B2 (en) 2005-09-28 2010-07-28 株式会社 日立ディスプレイズ Display device
JP2007128497A (en) 2005-10-05 2007-05-24 Sony Corp Display apparatus and method thereof
JP4842747B2 (en) * 2006-09-20 2011-12-21 株式会社リコー Optical scanning apparatus, image forming apparatus, and color image forming apparatus
KR100782431B1 (en) 2006-09-29 2007-12-05 주식회사 넥시오 Multi position detecting method and area detecting method in infrared rays type touch screen
US20100066704A1 (en) 2006-11-30 2010-03-18 Sega Corporation Position input device
WO2008068607A2 (en) 2006-12-08 2008-06-12 Flatfrog Laboratories Ab Position determination in optical interface systems
CN101075168B (en) 2007-06-22 2014-04-02 北京汇冠新技术股份有限公司 Method for discriminating multiple points on infrared touch screen
EP2212763A4 (en) 2007-10-10 2012-06-20 Flatfrog Lab Ab A touch pad and a method of operating the touch pad
KR20100121512A (en) 2008-02-11 2010-11-17 넥스트 홀딩즈 리미티드 Systems and methods for resolving multitouch scenarios for optical touchscreens
TW201013492A (en) 2008-06-23 2010-04-01 Flatfrog Lab Ab Determining the location of one or more objects on a touch surface
TW201005606A (en) 2008-06-23 2010-02-01 Flatfrog Lab Ab Detecting the locations of a plurality of objects on a touch surface
US8542217B2 (en) 2008-06-23 2013-09-24 Flatfrog Laboratories Ab Optical touch detection using input and output beam scanners
US9317159B2 (en) 2008-09-26 2016-04-19 Hewlett-Packard Development Company, L.P. Identifying actual touch points using spatial dimension information obtained from light transceivers

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2131544A (en) * 1982-12-07 1984-06-20 Lowbar Inc Optical position location apparatus
US6972753B1 (en) * 1998-10-02 2005-12-06 Semiconductor Energy Laboratory Co., Ltd. Touch panel, display device provided with touch panel and electronic equipment provided with display device
US20020067348A1 (en) * 1999-12-02 2002-06-06 Masters Timothy E. Apparatus and method to improve resolution of infrared touch systems
EP1752864A2 (en) * 2005-07-29 2007-02-14 Avago Technologies Fiber IP (Singapore) Pte. Ltd. Methods and systems for detecting selections on a touch screen display
WO2007112742A1 (en) * 2006-03-30 2007-10-11 Flatfrog Laboratories Ab A system and a method of determining a position of a scattering/reflecting element on the surface of a radiation transmissive element

Cited By (85)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010006886A3 (en) * 2008-06-23 2011-05-26 Flatfrog Laboratories Ab Determining the location of one or more objects on a touch surface
US9134854B2 (en) 2008-06-23 2015-09-15 Flatfrog Laboratories Ab Detecting the locations of a plurality of objects on a touch surface
WO2010006886A2 (en) * 2008-06-23 2010-01-21 Flatfrog Laboratories Ab Determining the location of one or more objects on a touch surface
US8542217B2 (en) 2008-06-23 2013-09-24 Flatfrog Laboratories Ab Optical touch detection using input and output beam scanners
US8482547B2 (en) 2008-06-23 2013-07-09 Flatfrog Laboratories Ab Determining the location of one or more objects on a touch surface
US10474249B2 (en) 2008-12-05 2019-11-12 Flatfrog Laboratories Ab Touch sensing apparatus and method of operating the same
US8692807B2 (en) 2009-09-02 2014-04-08 Flatfrog Laboratories Ab Touch surface with a compensated signal profile
US9024916B2 (en) 2009-10-19 2015-05-05 Flatfrog Laboratories Ab Extracting touch data that represents one or more objects on a touch surface
US9430079B2 (en) 2009-10-19 2016-08-30 Flatfrog Laboratories Ab Determining touch data for one or more objects on a touch surface
US8780066B2 (en) 2010-05-03 2014-07-15 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
WO2011139213A1 (en) 2010-05-03 2011-11-10 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
US9996196B2 (en) 2010-05-03 2018-06-12 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
US9547393B2 (en) 2010-05-03 2017-01-17 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
EP3012721A1 (en) 2010-05-03 2016-04-27 FlatFrog Laboratories AB Touch determination by tomographic reconstruction
US9411444B2 (en) 2010-10-11 2016-08-09 Flatfrog Laboratories Ab Touch determination by tomographic reconstruction
US9274645B2 (en) 2010-12-15 2016-03-01 Flatfrog Laboratories Ab Touch determination with signal enhancement
US9594467B2 (en) 2010-12-15 2017-03-14 Flatfrog Laboratories Ab Touch determination with signal enhancement
WO2012082055A1 (en) * 2010-12-15 2012-06-21 Flatfrog Laboratories Ab Touch determination with signal enhancement
EP2466428A2 (en) 2010-12-16 2012-06-20 FlatFrog Laboratories AB Touch apparatus with separated compartments
US8872098B2 (en) 2010-12-16 2014-10-28 Flatfrog Laboratories Ab Scanning FTIR systems for touch detection
US8872801B2 (en) 2010-12-16 2014-10-28 Flatfrog Laboratories Ab Touch apparatus with separated compartments
EP2466429A1 (en) 2010-12-16 2012-06-20 FlatFrog Laboratories AB Scanning ftir systems for touch detection
EP3173914A1 (en) 2011-02-02 2017-05-31 FlatFrog Laboratories AB Optical incoupling for touch-sensitive systems
US9552103B2 (en) 2011-02-02 2017-01-24 Flatfrog Laboratories Ab Optical incoupling for touch-sensitive systems
WO2012105893A1 (en) 2011-02-02 2012-08-09 Flatfrog Laboratories Ab Optical incoupling for touch-sensitive systems
US10151866B2 (en) 2011-02-02 2018-12-11 Flatfrog Laboratories Ab Optical incoupling for touch-sensitive systems
WO2012121652A1 (en) * 2011-03-09 2012-09-13 Flatfrog Laboratories Ab Touch determination with signal compensation
US8890849B2 (en) 2011-09-27 2014-11-18 Flatfrog Laboratories Ab Image reconstruction for touch determination
US9377884B2 (en) 2011-10-11 2016-06-28 Flatfrog Laboratories Ab Multi-touch detection in a touch system
WO2013055282A2 (en) 2011-10-11 2013-04-18 Flatfrog Laboratories Ab Improved multi-touch detection in a touch system
US9927920B2 (en) 2011-12-16 2018-03-27 Flatfrog Laboratories Ab Tracking objects on a touch surface
US8982084B2 (en) 2011-12-16 2015-03-17 Flatfrog Laboratories Ab Tracking objects on a touch surface
WO2013089622A2 (en) 2011-12-16 2013-06-20 Flatfrog Laboratories Ab Tracking objects on a touch surface
EP3506069A1 (en) 2011-12-16 2019-07-03 FlatFrog Laboratories AB Tracking objects on a touch surface
US9639210B2 (en) 2011-12-22 2017-05-02 Flatfrog Laboratories Ab Touch determination with interaction compensation
US9588619B2 (en) 2012-01-31 2017-03-07 Flatfrog Laboratories Ab Performance monitoring and correction in a touch-sensitive apparatus
US10372265B2 (en) 2012-01-31 2019-08-06 Flatfrog Laboratories Ab Performance monitoring and correction in a touch-sensitive apparatus
US9811209B2 (en) 2012-02-21 2017-11-07 Flatfrog Laboratories Ab Touch determination with improved detection of weak interactions
US10031623B2 (en) 2012-02-21 2018-07-24 Flatfrog Laboratories Ab Touch determination with improved detection of weak interactions
WO2013133757A2 (en) 2012-03-09 2013-09-12 Flatfrog Laboratories Ab Efficient tomographic processing for touch determination
US9760233B2 (en) 2012-03-09 2017-09-12 Flatfrog Laboratories Ab Efficient tomographic processing for touch determination
US9684414B2 (en) 2012-03-09 2017-06-20 Flatfrog Laboratories Ab Efficient tomographic processing for touch determination
WO2013133756A1 (en) 2012-03-09 2013-09-12 Flatfrog Laboratories Ab Efficient tomographic processing for touch determination
WO2013165305A2 (en) 2012-05-02 2013-11-07 Flatfrog Laboratories Ab Object detection in touch systems
WO2013165306A2 (en) 2012-05-02 2013-11-07 Flatfrog Laboratories Ab Object detection in touch systems
US9626018B2 (en) 2012-05-02 2017-04-18 Flatfrog Laboratories Ab Object detection in touch systems
US10318041B2 (en) 2012-05-02 2019-06-11 Flatfrog Laboratories Ab Object detection in touch systems
US10168835B2 (en) 2012-05-23 2019-01-01 Flatfrog Laboratories Ab Spatial resolution in touch displays
US10365768B2 (en) 2012-12-20 2019-07-30 Flatfrog Laboratories Ab TIR-based optical touch systems of projection-type
WO2014098744A1 (en) * 2012-12-20 2014-06-26 Flatfrog Laboratories Ab Improvements in tir-based optical touch systems of projection-type
US10019113B2 (en) 2013-04-11 2018-07-10 Flatfrog Laboratories Ab Tomographic processing for touch detection
US9874978B2 (en) 2013-07-12 2018-01-23 Flatfrog Laboratories Ab Partial detect mode
US10152176B2 (en) 2013-11-22 2018-12-11 Flatfrog Laboratories Ab Touch sensitive apparatus with improved spatial resolution
WO2015076731A1 (en) * 2013-11-22 2015-05-28 Flatfrog Laboratories Ab A touch sensitive apparatus with improved spatial resolution
US10146376B2 (en) 2014-01-16 2018-12-04 Flatfrog Laboratories Ab Light coupling in TIR-based optical touch systems
US10126882B2 (en) 2014-01-16 2018-11-13 Flatfrog Laboratories Ab TIR-based optical touch systems of projection-type
US10161886B2 (en) 2014-06-27 2018-12-25 Flatfrog Laboratories Ab Detection of surface contamination
US11182023B2 (en) 2015-01-28 2021-11-23 Flatfrog Laboratories Ab Dynamic touch quarantine frames
US10318074B2 (en) 2015-01-30 2019-06-11 Flatfrog Laboratories Ab Touch-sensing OLED display with tilted emitters
US11029783B2 (en) 2015-02-09 2021-06-08 Flatfrog Laboratories Ab Optical touch system comprising means for projecting and detecting light beams above and inside a transmissive panel
US10496227B2 (en) 2015-02-09 2019-12-03 Flatfrog Laboratories Ab Optical touch system comprising means for projecting and detecting light beams above and inside a transmissive panel
US10401546B2 (en) 2015-03-02 2019-09-03 Flatfrog Laboratories Ab Optical component for light coupling
US11301089B2 (en) 2015-12-09 2022-04-12 Flatfrog Laboratories Ab Stylus identification
US10761657B2 (en) 2016-11-24 2020-09-01 Flatfrog Laboratories Ab Automatic optimisation of touch signal
US10775935B2 (en) 2016-12-07 2020-09-15 Flatfrog Laboratories Ab Touch device
US11579731B2 (en) 2016-12-07 2023-02-14 Flatfrog Laboratories Ab Touch device
US10282035B2 (en) 2016-12-07 2019-05-07 Flatfrog Laboratories Ab Touch device
US11281335B2 (en) 2016-12-07 2022-03-22 Flatfrog Laboratories Ab Touch device
US11740741B2 (en) 2017-02-06 2023-08-29 Flatfrog Laboratories Ab Optical coupling in touch-sensing systems
US11474644B2 (en) 2017-02-06 2022-10-18 Flatfrog Laboratories Ab Optical coupling in touch-sensing systems
US10606414B2 (en) 2017-03-22 2020-03-31 Flatfrog Laboratories Ab Eraser for touch displays
US11016605B2 (en) 2017-03-22 2021-05-25 Flatfrog Laboratories Ab Pen differentiation for touch displays
US10481737B2 (en) 2017-03-22 2019-11-19 Flatfrog Laboratories Ab Pen differentiation for touch display
US11099688B2 (en) 2017-03-22 2021-08-24 Flatfrog Laboratories Ab Eraser for touch displays
US11281338B2 (en) 2017-03-28 2022-03-22 Flatfrog Laboratories Ab Touch sensing apparatus and method for assembly
US11269460B2 (en) 2017-03-28 2022-03-08 Flatfrog Laboratories Ab Touch sensing apparatus and method for assembly
US10845923B2 (en) 2017-03-28 2020-11-24 Flatfrog Laboratories Ab Touch sensing apparatus and method for assembly
US10606416B2 (en) 2017-03-28 2020-03-31 Flatfrog Laboratories Ab Touch sensing apparatus and method for assembly
US10739916B2 (en) 2017-03-28 2020-08-11 Flatfrog Laboratories Ab Touch sensing apparatus and method for assembly
US10437389B2 (en) 2017-03-28 2019-10-08 Flatfrog Laboratories Ab Touch sensing apparatus and method for assembly
US11256371B2 (en) 2017-09-01 2022-02-22 Flatfrog Laboratories Ab Optical component
US11650699B2 (en) 2017-09-01 2023-05-16 Flatfrog Laboratories Ab Optical component
US11567610B2 (en) 2018-03-05 2023-01-31 Flatfrog Laboratories Ab Detection line broadening
US11943563B2 (en) 2019-01-25 2024-03-26 FlatFrog Laboratories, AB Videoconferencing terminal and method of operating the same
US11893189B2 (en) 2020-02-10 2024-02-06 Flatfrog Laboratories Ab Touch-sensing apparatus

Also Published As

Publication number Publication date
EP2318906A2 (en) 2011-05-11
WO2010006884A3 (en) 2010-11-25
TW201007530A (en) 2010-02-16
IL209929A0 (en) 2011-02-28
CA2728034A1 (en) 2010-01-21
US20110074734A1 (en) 2011-03-31
CN102067074A (en) 2011-05-18
AU2009272923A1 (en) 2010-01-21
US8890843B2 (en) 2014-11-18

Similar Documents

Publication Publication Date Title
US8890843B2 (en) Detecting the location of an object on a touch surface
US8542217B2 (en) Optical touch detection using input and output beam scanners
EP2318904B1 (en) Determining the location of one or more objects on a touch surface
US20120068973A1 (en) Determining The Location Of An Object On A Touch Surface
EP2318902B1 (en) Detecting the locations of a plurality of objects on a touch surface
US8872098B2 (en) Scanning FTIR systems for touch detection
US9740336B2 (en) Touch-sensitive device
CN104094203A (en) Optical coupler for use in optical touch sensitive device

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200980123716.8

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09779864

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 12737018

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2009272923

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 209929

Country of ref document: IL

WWE Wipo information: entry into national phase

Ref document number: 2728034

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2009272923

Country of ref document: AU

Date of ref document: 20090622

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 228/DELNP/2011

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 2009779864

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2010151555

Country of ref document: RU