GB2522249A - Active pointing device detection - Google Patents

Active pointing device detection Download PDF

Info

Publication number
GB2522249A
GB2522249A GB1400900.5A GB201400900A GB2522249A GB 2522249 A GB2522249 A GB 2522249A GB 201400900 A GB201400900 A GB 201400900A GB 2522249 A GB2522249 A GB 2522249A
Authority
GB
United Kingdom
Prior art keywords
pen
signal
display system
signals
interactive display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB1400900.5A
Other versions
GB201400900D0 (en
Inventor
Andrew Oakley
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Promethean Ltd
Original Assignee
Promethean Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Promethean Ltd filed Critical Promethean Ltd
Priority to GB1400900.5A priority Critical patent/GB2522249A/en
Publication of GB201400900D0 publication Critical patent/GB201400900D0/en
Priority to EP15700503.4A priority patent/EP3097463A1/en
Priority to PCT/EP2015/051026 priority patent/WO2015107221A1/en
Priority to US15/112,656 priority patent/US20160334921A1/en
Priority to CN201580014678.8A priority patent/CN106104428A/en
Publication of GB2522249A publication Critical patent/GB2522249A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/10Program control for peripheral devices
    • G06F13/12Program control for peripheral devices using hardware independent of the central processor, e.g. channel or peripheral processor
    • G06F13/124Program control for peripheral devices using hardware independent of the central processor, e.g. channel or peripheral processor where hardware is a sequential transfer control unit, e.g. microprocessor, peripheral processor or state-machine
    • G06F13/126Program control for peripheral devices using hardware independent of the central processor, e.g. channel or peripheral processor where hardware is a sequential transfer control unit, e.g. microprocessor, peripheral processor or state-machine and has means for transferring I/O instructions and statuses between control unit and main processor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383Signal control means within the pointing device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/04162Control or interface arrangements specially adapted for digitisers for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means

Abstract

Disclosed is a method of and system for detecting a pointing device on an interactive surface. The method starts by receiving data representing a contact point, determining if a wireless signal is received and if a signal is received identifying the data as the touch of a pen otherwise identifying the touch as finger or stylus touch. The pen may transmit a wireless signal when it is located within a set distance of the interactive surface. The interactive surface may transmit an intra-red illumination field in addition to the intra-red signal associated with detection of a contact point for enabling detection of the contact point. Also disclosed is a method for a device for an interactive surface, the device receiving a wireless signal and transmitting a wireless response to receipt of the signal.

Description

ACTIVE POINTING DEVICE DETECTION
BACKGROUND TO THE INVENTION:
Field of the Invention:
The present invention is concerned with touch input detection. systems, and the adaptation of such systems to allow for the detection of devices oroviding pen inputs. The invention particularly provides for distinction between a contact point provided by a touch input and a contact point provided by a pen input.
Description of the Related Art:
in the following description the expressions touch' and oen' are used to refer to two different types of technology for providin a contact point at an interactive surface, In a touch system a contact point may be provided by an object such as a finger, or a device such as a stylus. In a pen system a contact may be provided by an object termed a pen device or a painting device, which can interact with the system by means other than simply providing a contact point.
Interactive systems incorporating touch and/or pen technolocy are well--:Known in the art.
An exemplary touch system is illustrated in FIG. 1. The exemplary system comprises an interactive surface 10, a touch data processor 12, and a computer 14. A touch contact on the interactive surface provided by a finger of a hand 11 is detected, and data associated with that touch contact point provided as DATA in a data stream to the touch data processor 12. The touch data processor 12 processes the data in accordance with known techniques, before forwarding the processed data to the computer 14 for further processing in accordance with known techniques.
Touch systems typically rely on detecting a contact point at the display surface. provided by a touch such as a finger contact. typically touch detection systems have a number of disadvantages in comparison to a system which is arranged to detect a device such as a pen.
In a system arranged to detect a pen it is advantageously possible to distinguish between and identify multiple contact points, because a contact point may be mapped to a unique pen.
In a system arranged to detect a pen it is advantageously possible to distinguish between a contact point on a surface and a hover contact point above the surface, because a contact point may be determined to be at the display surface or proximate to the display surface.
In a system arranged to detect a pen it is advantageously possible to provide automatic switching of modes through the provision of buttons on the pen device.
Systems which are adapted to provide for detection of both touch inputs and pens can provide the benefits of both technologies in a single system. However, such a system may require a user to manually select a menu in order to switch between touch and pen modes.
It is an aim of the present invention to provide 25. adaptations to an interactive system arranged to detect touch inputs to additionally provide for detection of contact points provided by a pen, and moreover to distinguish between a contact provided by a touch and a contact provided by a pen.
SUMMARY OF THE INVENTION:
There is provided a method for detecting the presence of a pointing device at an interactive surface, which interactive surface is arranged to detect a contact point, the method S comprising: receiving data representing a contact point; determining if a wireless signal is received; and in dependence on receipt of a wireless signal identifying said data as touch data or pen data.
The interactive surface may be arranged for detection of a contact point provided by touch inputs.
If a wireless signal is received the data may be identified as pen data. If a wireless signal is not received the data may be identified as touch data. On identification, the data may be transmitted for further processing.
Transmission of said data for further processing of the data may be delayed whilst determination is made as to whether a wireless signal is received1 Identifying the data as touch data or pen data may comprise setting one or more flag bits associated with said data. One or more flag bits may be a single bit, the state of which indicates touch data or pen data.
A pen may be adapted to transmit a wireless signal when it is located within a certain proximity of the interactive surf ace. For example, the pen may transmit when it is located in an IR field close to the interactive surface. The pen may
be energised by the IR field.
The pen may transmit a wireless signal when it is located within a certain proximity of the interactive surface.
A pen may transmit a wireless signal responsive to an interrogation signal.
An interactive system associated with the interactive surface may transmit an infra-red illumination field on the interactive surface, additional to any infra-red signal associated with detection of a contact point, for enabling detection of any pen providing a contact point. A pen may be adapted:to detect an infra-red signal associated with said infra-red illumination field. A pen may be energised by an infra-red signal associated with said infra-red illumination field. A pen may transmit a wireless signal upon detection or receipt of said infra-red signal.
The method may identify data associated with multiple contact points as being provided by touch inputs or device inputs, the method further comprising determining a location of any device, and comparing the location of such device to the location of a contact point.
An interface may transmit wireless infra-red signals in a plurality of infra-red transmitters, the signals from the respective infra-red transmitters illuminating the interactive
surf ace with an infra-red illumination field.
The central axis of each infra-red transmi.tter may be offset from the central axis of each other infra-red transmitter. A pen positioned on the interactive surface may receive a signal from one or more of the infra-red transmitters, and processes the received signals. The pen may be adapted to transmit a signal to the interface, which signal is indicative of a coarse location of the pen. The signal transmitted from the pen may be an indication of the amplitude of the signal received from each transmitter.
The signal transmitted may be modulated by each transmitter with a different frequency. The time offset of each signal may be the same.
The pen may detect a composite signal being the signal detected at least one transmitter. The pen may process the composite signal to provide one or more signals indicating the coarse position of the pen. The one or more signals may be one or more amplitude signals representing the amplitude of the signals received at the pen from each transmitter. The pen may determine a coarse location of the pen based on said signals, and transmit said coarse location to the interface. The pen may transmit the one or more amplitude signals representing the amplitude of the signals received at the pen from each transmitter to the interface. The interface may determine a coarse location for the pen in dependence thereon, and compare said coarse location to an accurate location. The interface may compare the one or more amplitude signals to one or more amplitude signals of tracked positions.
An interface may modulate the signal transmitted by each transmitter with a different time off set. The frequency modulation of each signal may be the same. The pen may detect a signal being the time offset signal transmitted from each transmitter in turn. The method may comprise processing each time offset signal to provide a signal which is used to indicate the coarse position of the pen. The method may comprise generating, by the pen, in a signal sequence for each iiOibffsèt amplitude signals. One or more amplitude signals may be used, in accordance with their associated time offset, to determine a coarse location of the pen, and transmit said coarse location to the interface. The pen may transmit the one amplitude signal f or each time offset to the interface. The interface may determine a coarse location for the pen in dependence thereon, and compare said coarse location to an accurate location. The interface may compare the one or more amplitude signals to one or more amplitude signals of tracked positions.
There is also provided a method for a device for an interactive display system, the device providing a contact point at an interactive surface of the system, the device receiving a wireless signal, and transmitting a wireless signal responsive to detection of receipt of the wireless signal.
The receipt of the wireless signal may energise the device -The receipt of the wireless signal may comprise detecting a wireless signal which is provided by the system in addition to a wireless signal for detecting a contact point.
The device may receive a plurality of wireless signals.
The device may determine an approximate position relative to the display surface on detection of the plurality of wireless signals, and provides an indication of said approximate position in the transmitted wireless signal.
The device may include an indication of the received wireless signals in the transmitted wireless signals, so that the transmitted wireless signals can be used to determine a location of the device relative to the interactive surface.
There is provided an interactive display system comprising circuitry for detecting a contact point provided by a pointing input or a touch input at an interactive surface thereof, the system comprising circuitry for receiving data associated with a contact point; circuitry for determining if a wireless signal is received; circuitry for, in dependence on receipt of a wireless signal, identifying said data as touch data or pen data.
There is provided circuitry, including a system, apparatus or device, for providing the feature of any of the above method definitions.
There is provided a device f or an interactive display system, the device adapted to provide a contact point at an interactive surface of the system, the device adapted to receive a wireless signal, and transmit a wireless signal responsive to detection of receipt of the wireless signal, The receipt of the wireless signal may energise the device. The receipt of the wireless signal may comprise detecting a wireless signal which is provided by the system in addition to a wireless signal for detecting a contact point.
The device may receive a plurality of wireless signals.
The device may determine an aptroximate position relative to the display surface on detection of the plurality of wireless sionals, and provides an indication of said approximate position in the transmitted wireless signal. The device may include an indication of the received wireless signals in the transmitted wireless signals, so that the transmitted wireless signals can be used to determine a location of the device relative to the interactive surface.
BRIEF DESCRIPTION OF THE FIGURES
The present invention is now described by way of reference to the accompanying figures, in which FIG. 1 illustrates a typical touch detection apparatus; FIG. 2 illustrates a schematic of a first arrangement; of a touch detection apparatus adapted to detect.acontacL-point provided by a pen; FIG. 3 illustrates a process for controlling the schematic apparatus of FIG 2; FIG, 4(a) to FIG. 4(c) illustrates the addition of flag bits to' data in accordance with the first arrangement; FIG. 5 illustrates a schematic of a second arrangement of touch detection apparatus adapted to detect a contact point provided by a pen; FIG. 6 illustrates a process for controlling r.h.e schematic apparatus of FIG 5; FIG. 7(a) to FIGS 7(d) illustrates the addition of flag bits to data in accordance with the second arrangement; FIGS 8(a) and 8 (b) illustrate an exemplary system implementation of an apparatus for the first to second arrangements; FIG. 9 illustrates an exemplary system implementation illustrating a third arrangement of a touch detection apparatus adapted to detect a contact point provided by a pen; FIG 10 illustrates an exemolary implementation of nan circuitry in accordance with this third arrangement; FIG 11 illustrates a schematic of the third arrangement of touch detection apparatus adapted to detect a contact point provided by a pen; FIG 12 illustrates a process for controlling the schematic apparatus of FIG 11; FIG. 13 illustrates a process for controlling the pen apparatus of; FIG 10; -FIG14 -illustrates -----a-----mnnc±ple----of-----opera-t-Lon-----of------t-ne ----pen---------------------------------circuitry of FIG 10; FIG. 15 illustrates an exemplary implementation of pen circuiti y in accordance with a fourth arrangement; and FIG. 16 illustrates a schematic of the fourth arrangemei.t nf touch detection anparatus adapted to detect a contact point proviaea by a penS
DESCRIPTION OF PREFERRED EMEODINENTS
The invent ion is described by way of example and with reference to exemplary arrangements, and particularly in relation to exemplary interactiv systems. The invention is not limited to any specific detail or arrangement described herein unless explicitly stated or defined by the accompanying clalm3 ne kifle in the att fll aopreciate ho decrbed arrangements may he modified, as appropriate, with alternatives.
In the following description reference is made to a touch input. In practice the term touch inputs is used to refer to any.nnut at an interactive surface of an interactive system provided by any passive input device that allows interaction with programs, buttons and menus. A passive input device may be an input device with no technology housed in it and that cannot communicate with the eractive system other than to provide a contact point. A passive input device may include, but not be limited to, a body part such as a finger, a stylus or a pointer. In this context a passive incut device is a device which cannot interact with the interactive system other than by providing a contact point on the interactive surface.
A passive device may also he referred to as an inactive device.
In qeneral a toucn input can be detected as a contact input, hut cannot be uniquely dentizied. ana cannot be identified as being on the interactive surface or proximate the interactive surface.
In the following description reference is also made to a pen input. In practice, the term pen tnout' is used to refer to any input at an interactive surface of an interactive system provided by any input device that allows interaction with programs, buttons and menus. Such an active input device may be an. input device having technology, such as printed circuitry and/or a battery, housed in it, and allowing the device to communicate with the interactive system to Drovide a more natural InteracnoLL with the in.t eractive system. A nen inDut device can orovide additional features such as, but not limited to, detecticxn of the active input device hovering above the interactive surface, oressure sensitive handwriting, and quick. tool and.fi.]Ti.c.1or.lC i.t:y access through the inclusion of electrical switch button.s on the active input device, such as on the side of a pen input device, An input device can be any type of device, but typically may be provided by a device which resembles and is referred to as a pen device or pointing device.. An input device may include, but not be limited to, light perle, infrared pens, inductive pens and capacitive pens.
To the extent that such additional operations require an active link with the interactive system beyond simple detection of a contact point, a pen device can he considered.
to provide an-active input and be an.. active input device.
In the art, pen devices are sometimes referred to as being passive or active devices in dependence on whether they have internal power sources for providing their interaction with the interactive system or not. For example, an active pen may be provided with a battery. This definition is not to be confused with reference to a tcuch input or a pen input being associated with a passive/inactive input device -or an active input device. An active input device may be passive' or active' in terms of a power source. Exemplary an angements may be advantageously implemented in conjunction with a pen input provided by an active pen in order to provide an appropriate transmission which is detected by an appropriate interface of the interactiv-stem. Arrangements as described may he in-demented with the pen being provided by either a passive or an active pen, unless the specifics of an arrangement requires an active pen.
when a pen device providing a pen input is required to provide a pen input it may be equipped with its own power source (active), or it may be adapted to utilise t.he energy in another signal of the interactive system (passive), such as S the energy in an electromagnetic (EM) field, such as an infra-red (Ia) or radio frequency (RF) field, provided on an interactive surface for detecting contact points.
Thus an active pen may have an active power source or a passive power source.
Where a pen provides an input in a t.ouch-only system, it may be considered a stylus.
In general a pen input can be detected as a contact input, and can be at least one of: uniquely identified (identifying the pen amongst a plurality of pens); determined as being on the interactive surface or proximate the interactive surface (such as indicating a hover or pen down state); or provide an additional input (such as a switch state).
Arrangements are described herein in the context of touch detection systems, and particularly interactive systems in which an input is detected as a touch input based on a touch provided by that input. The invention is not limited to any specifics of a touch system unless specifically stated herein, and may be implemented in any touch detection interactive system.
When a pen device providing a pen input is adapted to transmit, it may be adapted to transmit continually or only when certain conditions are met, for example when the pen contacts the interactive surface (which for example may be facilitated by a pressure switch in the pen nib).
The invention is not limited to any arrangement of a pen device for providing a pen input although different types of pen device may allow advantageous features of the invention to be implemented.
The description of arrangements refers to detection of a wireless signal in order to detect the presence of a pen device. The arrangements are applicable to any system in which an indication is to be provided as to whether a contact point is associated with a touch input or a pen input and thus whether a pen device providing pen inputs is present.
The system may be arranged to detect the presence of a pen device only when the pen is in contact with the touch surface, and not for example to detect the presence of a pen distant from the surface, to avoid spurious or mistaken detection. On this basis a pen device may only be detected as present when a pen-down' condition is detected.
A pen detector may only be enabled when a contact point is detected, or the wireless detection of a signal from a pen device may be arranged such that it can only be detected if the pen is at or near the surface.
The invention is not limited to enabling pen detection circuitry only when a contact point is detected. In an embodiment, pen detection circuitry may continually look for a pen, and may not be enabled only responsive to a contact point.
With respect to detecting the pen device only when the pen is near the surface, the pen may emit or detect an IR signal in a narrow zone, so that a signal from the pen is only received or detectable when the pen is in close proximity to the surface. This is an alternative or additional feature to enabling a pen detector only when a contact is detected. When the pen is arranged to receive an electromagnetic signal to give it power to transmit, it may be arranged so that it can only receive a signal to provide its necessary power when it is within certain proximity of the display surface.
Alternatively or additionally a pen detector cnay be arranged so that it can only receive a transmission from the pen when the pen is within certain proximity of the display surface.
The receiver/detector forming part of a pen detector of the interactive system may be designed to have a restricted field of view to ensure that detection of the pen device by a wireless pen detect block is only achieved when the pen device is within a short distance, for example centimetres or millimetres, of the surface, to avoid spurious pen detection.
These are all alternative arrangements which allow for the wireless detection not to be solely dependent on first detecting a contact point, or limit the wireless detection to detecting wireless signals only from pen devices which are close to the surface, and not for example a wireless pen which is distant from the surface and not otherwise being detected as present at the surface.
Communication between a pen and a pen detector is preferably via IR transmission, and controls the associated field of view in accordance with preferred arrangements, but communication is not limited to ER transmission, and may for example be an RF transmission such as a Bluetooth transmission. In general it may be preferable to provide a communication channel between the pen device and the interactive system which is a different type of communication than that which is provided for otherwise detecting a contact point.
The communication channel between the pen device and the interactive system may be referred to as a back-channel', the main channel being the channel provided to detect a contact point.
A first arrangement which provides for detection of a pen device for providing pen inputs in a touch contact detection system is now described. In this first arrangement there is disclosed a technique for determining if a single detected contact is associated with a touch contact or a pen contact.
FIG. 2 illustrates schematically the touch contact system of FIG. 1 adapted in accordance with the first arrangement to distinguish between pen inputs and touch inputs, and an associated flow process is illustrated in FIG. 3.
With reference to nO. 2, there is provided an interface 16 between the interactive surface 10 and the computer 14. The interface 16 comprises a buffer 20, a delay block 22, a register 24, a pen detector 28, and a flag set block 26.
A contact point on the interactive surface is detected, and data associated with this contact point, termed DATA, is ?forwarded on line 3 from the interactive surface 10 to the interface 16. The detection of this contact point is illustrated by step 30 in FIG. 3.
The contact point may be provided by a touch, for example a finger or a stylus or a pen.
The interface 16 receives the data stream from the interactive surface 10, which in practice may comprise receiving coordinate data from the touch surface when coordinate determination circuitry is provided with the surface. This coordinate data may be received on any electrical connection, for example, via a USS connection, but could also be received via a wireless communication network, such as Bluetooth. In the example it is assumed that the touch surface generally provides data associated with a contact point, which includes the coordinates of that contact point, but this is irrelevant to the present invention.
The data stream DATA is received by the buffer 20, and as denoted by step 29 is buffered. Also illustrated in FIG. 2 is a delay block positioned at the output of the buffer 20, and as denoted by step 31 the buffered data is also delayed. In practice, the buffer 20 may perform the delay function, and so an additional delay block 22 may not be required. The steps 29 and 31 of EXO. 3 may therefore be implemented as a single buffering/delaying step, as illustrated by reference numeral 32.
The delay associated with the buffering and/or delaying steps provided by blocks 20 and 22 results in a delayed version of the data stream DELAYED DATA being produced on line 5.
The pen detector 28 may be enabled by receipt of contact point data, and may be connected to receive the data stream DATA (not shown) simply to identify the presence of data associated with a detected contact point and thus provide a trigger. The pen detector 28 may alternatively be enabled by some control means, such as the computer 14, or may be permanently enabled to detect a wireless signal.
The pen detector 28 is adapted to detect whether a wireless signal is received, as denoted by step 33, following or in tandem with detection of a contact point. A pen providing a contact point is adapted to provide a wireless transmission for detection by the pen detector 28. The pen detector 28 is adapted to detect this wireless transmission.
As is mentioned above, and will be discussed further below, the pen and/or interface 16 are preferably adapted such that a wireless signal from the pen can only be detected/received when the pen is within a certain proximity of the interactive surface.
In dependence on whether a wireless signal is received in combination with detection of a contact point, the pen detector 28 dictates whether the system operates in pen mode or touch mode.
In this first arrangement, if a wireless signal is received the system operates in pen mode as denoted by step 37. If a wireless signal is not received the system operates in touch mode, as denoted by step 35. The pen S detector 28 sets a signal on its output to indicate a pen (P) or a touch (T), to control the flag set block 26 to set the flag bits of the register 24 in accordance with the mode of operation.
If the pen detector 28 does not detect a wireless signal, then the pen detector 28 sets its output accordingly to the flag set block 26 indicating that no pen is present. This may simply comprise setting its output to 0' or 1' to indicate the system mode (pen or touch) which is followed by the flag set block 26. The setting at the output of the flag set block indicates a touch mode.
If the pen detector 28 does detect a wireless signal, then the pen detector 28 sets its output accordingly to the flag set block 26 indicating that a pen is present. Again this may simply comprise setting its output to O or 1'. The setting, at the output of the flag set block indicates a pen mode.
On determination of the mode of operation, in step 42 the appropriate flag is set by the flag set block 26. In step 44, the flag set block then controls the register to append the appropriate bits to the current data which is held in the register 24.
As denoted by step 46, the appropriately appended data is then output by the register 24 to the computer 14 on line 7 as the data PEN/TOUCH DATA.
Some latency is associated with the passing of the data to the computer 14, because of the additional processing needed to determine whether the contact is provided by a touch or a pen. Data processing is not performed by the computer 14 until a determination of the input is made, and such processing has a latency determined by the delay of the buffer 20 and/or delay block 22.
The delay provided by the buffer 20 and/or delay block 22 S is preferably sufficient to allow the pen detector 28 to complete a determination of whether the contact input is a pen input or a touch input. The data stream may be delayed by n frames, where n=1 or 2 or 3, etc. Preferably the data stream may be delayed by one frame -i.e. frame delayed. During the delay, the pen interface 16 determines whether the object on the surface is a pen. This may be done in a number of ways and the above described technique represents a way of achieving this in accordance with a first arrangement.
The data DEtYED DATA provided to the register 24 is the data for which the mode of operation is determined for the flag setting.
With further reference to FIG. 4, there is illustrated the modification of the received data to append flag bits in accordance with this embodiment.
FIG. 4(a) illustrates in general the format of the PEN/TOUCH DATA provided by the register 24 to the computer 14.
The PEN/TOUCH DATA format comprises an X coordinate field 41, a Y coordinate field 43, and a pen/touch field 45. The pen/touch field is set by the flag set block 26 according to whether a pen is detected by the pen detector 28, and may have a value of 0' or 1' to denote one of two states.
FIG. 4(b) illustrates the values set in the event that a contact point is determined to be a touch. In such case, a wireless signal is not detected by the pen detector 28 responsive to detection of a contact point. The flag set block 26 thus controls the flag field 45 to set the value of this field as 0', as denoted by the value 5]. in FIG. 4(b).
The field 41 has a value 47 and the field 43 has a value 49, This assumes that 0' denotes touch.
FIG. 4(c) illustrates the values set in the event that a contact point is determined to be a pen. In such. case, a wireless signal is detected by the pen detector 28 responsive to detection of a contact point. The flag set block 26 thus controls the flag field 45 to set the value of this field as I' * as denoted by the value 53 in FIG. 4(b). The field 41 has a value 47 and the field 43 has a value 49. This assumes that 1' denotes pen.
The pen may be adapted to transmit, and the pen detector receive, at a sped tic frequency, multiple specific frequencies, or a range of frequencies.
In this arrangement the pen is required to transmit a wireless signal, hut no other requirement is imposed on the per.4 An active pen may continuously transmit a wireless signal. A passive pen may transmit a wire-less sianal whenever it is energised. The pen may transmit a wireless signal only when a pressure switch at its nib is activated, responsive to the nib being pressed against the display surface.
In this arrangement, a contact point or. the display surface is able to be identified as a contact point provided by a touch or a pen. However the technique does not extend to ident fication of multiple contact poir:ts, since the presence of a. pen is provided only. Thus the presence of a pen can only be mapped to the coordinates of a contact position.
The first arrangement provides a technique for determining if an initial contact point is a pen contact or a touch contact. Once this determination is made, all further contact points are assumed to be the same, so the appropriate flag hit is fixed for all further data sets associated with further contact points in further frames. Once contact ceases, and no data is provided, upon detection of a next contact point a determination is again carried out.
In an alternative, the determination could be made for every contact point.
A second arrangement which provides for detection of a pen in a touch contact detection system is now described. In this second arrangement there is disclosed a technique for determining if a single detected contact is associated with a touch or a pen contact in a pen-up or pen-down state.
FIG. 5 illustrates schematically the touch contact system of FIG. 2 adapted in accordance with this second arrangement.
The process of no. 6 is also referenced to illustrate this embodiment and is an adaptation of the process of nO 3.
Where reference numerals refer to like elements in previous figures, the elements are not further described.
With reference to FIG. 5, there is provided the interface 16 between the interactive surface 10 and the computer 14. The interface 16 comprises the buffer 20 and the delay block 22 performing the same purposes as previously described. In addition the interface 16 includes a modified register 23, a modified pen detector 27, and a modified flag set block 25.
The process in accordance with this second embodiment is similar to that described above with reference to FIG. 3, but as illustrated in Fig. 6 after step 33 in a step 60 it is determined if the detected wireless signal matches either one of two signal frequencies, denoted in this example as f1 and In general terms, in accordance with this embodiment the pen detector is adapted to identify a wireless signal of one of two specific frequencies, which a pen providing a contact point is adapted to transmit. The pointing device is adapted to transmit at the frequency f, when a pressure switch provided at the nib' of the pointing device is not activated, and to transmit at the frequency f2 when a pressure switch provided at the nib' of the pointing device is activated. Thus it may be detected, when a pen is present, whether an input condition S represents a pen-up or a pen-down condition.
In a simple arrangement, the pen detector may detect just the frequency f2.
In order to support the detection of a wireless signal at one of two specific frequencies, as denoted in FIG. 5 the pen detector 27 is adapted. The flag set block 25 and the register 23 are further adapted to allow the flag to be set, and the data to have bits appended, in accordance with the modified process of nO. 6.
As denoted in PIG. 6, the process is adapted such that if a wireless signal is detected in step 33 then in step 60 it is determined whether the frequency of the wireless signal is f1 or £3. If it is determined in step 60 that the detected wireless signal has a frequency t, then the process moves to step 62 and the mode is determined to be a pen-up mode. If it is determined in step 60 that the detected wireless signal has frequency £3 then the process moves to step 64 and it is determined that the system is in a pen-down mode.
Thus the system in accordance with this second arrangement can determine between two modes of operation: touch; and pen-up or pen-down.
In this second arrangement, it is assumed that for a pen to be detected as being associated with the contact point a wireless signal of a specific frequency f or f must be detected. In a preferred aspect, the signal will only have frequency £3 when a switch in the nib of the pointing device which is activated by pressure of the pointing device against the interactive surface is set. Thus, in this embodiment the system is adapted to detect a pen-down' condition, which simulates a mouse left-click operation. When a touch point is detected, it is assumed also that a touch point is associated with a mouse left-click. This may be advantageous where, for example, a contact point is provided by a device such a S stylus.
In the preferred aspect of this arrangement, the flag set block 25 is adapted to set two flags, a first flag associated with whether a contact is associated with a pen or a touch, and a second flag associated with a pen-up or a pen-down condition being determined. In combination, these two flags indicate whether the data associated with a contact point is to be associated with a pen or a touch, and if associated with a pen then identify what aspect of the pen mode is set.
If the pen detector 27 does not detect a wireless signal, then the pen detector 27 sets its output accordingly. The flag set block 25 then sets two flags accordingly. This may comprise setting one flag to 0' or 1' to indicate the touch mode, and further setting another flag to 0' or 1' to indicate the pen down condition or left-click for touch. The setting at the output indicates a touch mode.
If the pen detector 27 does detect a wireless signal, which is the frequency f, then the pen detector 27 sets its output accordingly. The flag set block 25 then sets two flags accordingly. This may comprise setting one flag to 0' or 1' to indicate the pen mode and further setting another flag to 0' or 1' to indicate the pen-up condition. The setting at the output indicates a pen mode.
If the pen detector 27 does detect a wireless signal that is at the frequency f, then the pen detector 27 sets its output accordingly. The flag set block 25 then sets two flags accordingly. This may comprise setting one flag to 0' or 1' to indicate the pen mode, and further setting another flag to 0' or 1' to indicate the pen-down condition or left-click.
The setting at the output indicates a touch mode.
With further reference to FIG. 7 there is illustrated the modification of the received data to append flag bits in accordance with this aspect of the arrangementS no. 7(a) illustrates in general the format of the PEN/TOUCH DATA provided by the register 24 to the computer 14.
The PEN/TOUCH DATA format comprises an X coordinate field 41, a Y coordinate field 43, a pen/touch field 45, and a pen down (or left click) field 48. The pen/touch field and the pen down field are set by the flag set block 25 according to whether a pen is detected by the pen detector 27, and each field may have a value of 0' or 1' to denote one of two states.
FIG. 7(b) illustrates the values set in the event that a contact point is determined to be a touch. In such case, a wireless signal is not detected by the pen detector 27 responsive to detection of a contact point. The flag set block thus controls the flag field 45 to set the value of this field as 0', as denoted by the value 70 in nO. 7(b). The flag set block 25 controls the flag field 48 to set the value of the pen-down field as 1', as denoted by the value 72 in nO. 7(b). The field 41 has a value 47 and the field 43 has a value 49.
FIG. 7(c) illustrates the values set in the event that a contact point is determined to be a pen with a pen-up condition. In such case, a wireless signal is detected by the pen detector 27 at frequency f1 responsive to detection of a contact point. The flag set block 25 thus controls the flag field 45 to set the value of this field as 0', as denoted by the value 74 in PIG. 7(c). The flag set block 25 controls the flag field 48 to set the value of the pen-down field as 0', as denoted by the value 76 in 110. 7(c). The field 41 has a
value 47 and the field 43 has a value 49,
FIG. 7 (d) illustrates the values set in the event that a contact point is determined to be a pen with a pen-down condition. In such case, a wireless signal is detected by the pen detector 27 responsive to detection of a contact point.
The flag set block 25 thus controls the flag field 45 to set the value of this field as 1' , as denoted by the value 78 in FIG, 7(d). The flag set block 25 controls the flag field 48 to set the value of the pen--down field as 1 * as denoted by the value 80 in FIG. 7(d) . The field 41 has a value 47 and the
field 43 has a value 49.
In this second. arrangement the pen is required to transmit at two wireless *i:raL1eflc)ies, with a switch provided respor.s ive to pressure of the nen against the interactive surface to switch between the two frequencies. No other requirement is imposed on the pen.
The second arrangement provides a technique for determining if an initial contact point is a pen contact or a touch contact, Once this determination is made, all further contact points are assumed to be the same. However, the determination may be made for every contact point SO; for example, it can be detected when a pen changes from a pen-down state to a pen-up state. Preferably, though, a contact point is assumed to be in the same state as the initial determination unti.i that contact point is lost.
Details of the first and secor.d arrangements may he interchanged and combined, and the arrangements are described above with reference to preferred implementations. Individual features of the two arrangements may be advantageously used independently.
An example apparatus is shown in FIGS. 8 (a) and S (b), in which apparatus of the first or second arrangements described above may be advantageously implemented. FIG. 8(a) illustrates a view onto the display surface, and FIG. (b) illustrates a corresponding aide view of the arrangement of FIG. $ (a). In the following, reference is made to the first arrangement
described above for ease of description.
With,reference to FIGS. 8(a) and 8(b), reference numeral 10 generally illustrates the interactive surface of nO. 2. It is assumed that the interactive surface has touch detection capability.
In an example, the interactive surface is a surface of an interactive whiteboard (nIB) provided with bezel technology v for detecting contact inputs, and ordinarily associating such contact inputs with a touch input. Referring to FIG. 8(à), the whiteboard is provided with a vertical 114 emitter bezel array 70a, a horizontal 114 emitter bezel array 70b, a vertical 114 detector bezel array 70c, and a horizontal 114 detector bezel array 70d. The implementation of bezel technology to allow detection of a contact point on an interactive surface is well-known in the art and is not shown in detail in FIG. 8(a).
As also illustrated in flO. 8(a), the system is provided with a tJSB port 54 for a touch detection system (not shown), although in a further embodiment this connection could be provided by other wired or wireless technology, such as Bluetooth. The implementation of a touch detection system to allow for detection of a contact point on a bezel system will be well-known to one skilled in the art.
The illustrated use of a bezel system and bezel technology is merely exemplary.
In accordance with the illustrated exemplary arrangement, the system is additionally provided with a pen augmentation interface 52, which has a USE input port 58 which is connected by a cable 56 to the USE port 54 of the touch system. The pen augmentation interface 52 additionally is provided with a USE port 60 for connection to a computer. The pen augmentation interface 52 provides the additional electronic circuitry needed to provide for detection of pen and touch in accordance with the foregoing described exemplary arrangements, and is connected to the existing board and touch detection circuitry.
Comparing FIG.. 3 to nO. 8(a), the wire 56 between USB ports 54 and 58 correspond to connection 3, and the wire from USB port 60 corresponds to connection 7. The interf ace 16 is implemented within the pen augmentation interface 52.
Although in FIG. B(s) a wired connection is illustrated between IJSB port 54 and USH port 58, this is merely exemplary and the ports may be wireless ports providing a wireless connection. Similarly port 60 may be a wireless port.
The pen augmentation interface 52 is preferably provided with an IR transceiver to provide for communication with a pen device, to implement the operation of the pen detector, such as pen detector 28.
With reference to no 8(a) and FIG 8(b), the pen augmentation interface is preferably mounted with respect to the interactive display surface to allow an IR transceiver 62 to illuminate with Ia the interactive display surface 10.
An IR illumination field 66 produced by the
Ia transceiver 62 is additional to and separate from the Ia transmission/reception associated with the bezel technology. This IR ilumination field 66 is provided to allow, in accordance with this described embodiment, detection of a pen device.
The location of the pen augmentation interface 52 may be chosen to allow the IR illumination field 66 to be optimised for the interactive surface. In the described example, the interface 52 including the ZR transmitters is located at the centre of the top edge of the interactive whiteboard, although a person skilled in the art will recognise that the interface including the Ut transmitters could be located in other positions.
The field of view of the Ut transceiver 62 across the interactive surface is preferably limited to a region prc.xi.mate to the surface, so that a region spaced from the surface is not illuminated by the Ut transceiver. This may be achieved by the design or orientation of the IR. transceiver, which is outside the scope of the present invention, or by the provision of a p**late or housing 64 (as shown in FIG, 8(b)) in front; of the Ut transceiver 62 which limits its optical field.
As illustrated in the example of FIGS 8(b). the Ut transceiver 62 provides a collimated lit illumination field 56, having a restricted field of view angle. Thc-*collimated lit illumination field 66, will tytically extend at least 1cm from the IWE surface and ideally less than lOam from the IWE surface, across the entire surface. The angle of the field of view and the distance the lit field extends from the di.snl.ay surface at any point will be implementation dependent. In the example shown, the illumination field is projected at an angle C) from the proj ection point The restriction of the lit illumination field in this way supports an exemplary implementation of the foregoing arrangements.
As denoted by reference numeral.s GSa and GSb, with a pen 68a outside the lit illumination field 65, a touch mode of operation Is determined, as the pen is not detected. With a pen GSb inside the lit illumination field, a pen mode of operation is determined as the pen is detected.
This assutis the pens are adapted to be enabled or activated by the energy of the lit illumination field 46 so a pen is unable to transmit unless it is located within the lit
illumination field 66
When a wireless connection is established between a pen and the pen detector 28 or 27 of the pen augmentation interface 52 -a pen.-to--interface connection the system switches to pen-mode. When the pen moves away from the surface, the IR connection is broken and the system reverts back to touch mode, in embodiments, the nresence of the pen may only be detected if, in addition to being in the illumination field 56, the pen is depressed on the display surface, closing a switch provi.ued at the nib -This arrangement is not limited to any specific configuration of the pen. The pen may be an active pen which constantly transmits a wireless signal. However, the cen preferably may transmit a wireless signas only when t is energi sed to do so by reception of liE energy which is received within the IR illumination field The per1 may more prefe-ably transmit a wireless signal only when it is energised to do so by reception of IR energy with n the IR illumination field, and further only then at some certain time interval, for example by pulse transmissions, or in reply to a request from a pen detect block, which transmits a request when data is received to indicate a contact point has been detected.
The pen may more preferably be adapted to transmit only in response to a request, and the pen may be adapted only to detect a request when the pen is located within, the IR illumination field. Thus the pen may start transmitting as soon as it is energised by the IR illumination field 66, or only start transmitting when it is energised by the IR illumination field 66 and receives an interrogation signal from the interface 16.
For power efficiency, the pen may detect a diffused or coherent IR illumination field 56 near to the surface provided by the IR transceiver 62 of the pen augmentation interface 52, and then signal its presence to the pen detector 28 or 27 using the energy provided by the IR illumination field 66. The pen may do so asynchronously, or the pen may wait for a synchronisation beacon emitted from the interface 16 of the pen augmentation interface 52 before transmitting (i.e. respond to an interrogation signal). In such an arrangement S the pen preferably only wirelessly signals its presence to the interface 16 when interface 16 has determined detection of a contact at the surface, rather than the pen continually signalling its presence.
The ER connection between the pen and the pen detector 28 or 27 may also act as a communication channel for flagging the state of a switch provided on the tip or side switch of the pen. The pen may simply transmit a code to the pen detect block which identifies the tip or switch state. Such additional information can be included in extended bits added, for example, to the data shown in PIG. 4 or PIG. 7. This additional information can be piggybacked' onto the signal transmitted by the pen and received by the wireless detector in the interface 16. This additional pen state information may be provided in any of the arrangements.
The IR connection between the pen and the pen detector 28 or 27 may also act as a pen identification for systems with more than one pen, without such information the system being able to detect the presence of a pen but not identify the pen (or identify the pen amongst multiple pens). The pen may simply transmit a code to the pen detect block which identifies the pen. This additional pen identity information may be provided in any of the arrangements.
In examples the pen identity is associated with a transmission frequency, and thus multiple pens can be identified in a system which allows discrimination detection between signals of different frequencies, such as the second arrangement described above.
It may be necessary to use a different wavelength of IR for the communication between the pen and the interface 52 (where IR is used for this communication) * to avoid interfering with the touch sensing system of the IR beze].
technology. The implementation of the back channel IR, iiiciuding the relevant frequency of the IR, is an implementation detail. As mentioned above, the back--channel may alternatively be implemented In RF, Adaptations will provide for advantageous or preferable techniques for establishing the wireless connection between the pen and the pen detect block.
In accordance with the arrangements as described ahove there is thus provided the ability to distinguish between a touch and a pen providing a contact point is provided. However this technique as described does not provide for identifying multiple contact points as being associated with one of multiple pens unless the identity of a pen is represented by its signal frecuency.
With reference to FIG, 9, a further arrangement is illustrated in which a plurality at colocated Ia transceivers (three in the example illustrated, namely 302a, 302b, 302c) are placed in the centre of either an upper or lower horizontal edge of an interactive whiteboard (1WB).
The three transceivers 302a, 302b; 30 2c each have a respective emitter/transmitter and a respective detector associated therewith.
The emitters of the transceivers are angled such that they direct radiation across the surface so that a photodiode detector located within a tracked. pen placed on the surface will receive maximum incident IR flux at different bearings from the three emitters. Thus with each emitter of the three transceivers emitting Ia signals a photodetector of a pen placed on the surface will receive an IR signal from up to three emitters.
Reference numeral 404 denotes an exemplary nosit ion on the surface at which a contact point may be provided by a pen.
In the example shown5 using a line parallel to the top horizontal edge of the IWB as a reference, the peak lii signal from the first emitter 302a will lie along a line at 0) from the top horizontal edqe of the IWB denoted by reference numeral 402a. The peak IR signal from the second emitter 30Th will lie along a line at an angle of Q2 from the reference 402a (straight down), denoted by reference numeral 402b. The peak IR signal from the third emitter 302c will lie along a line at 0° from the pea-.k iR signal of the second emitter (denoted by reference number 402b) denoted by reference numeral 402c. The line 402c is additionally at an angle Q° from the reference provided by tne top edge of the IWE.
In thi.s embodiment, angles ir and Q40 range between 0 and 60°, a.r.d are more preferably 600, 3Q, 3Q0 and 600 respectively. The beam width of the transmitters means that the transmitted signal.s from the three emitters will overlap ensuring there are no areas on the surface that (is) not receive a minimum level of IR signal required for the system to work.
In accordance with the described embodiment, the three emitters of the transceivers 302a, 302b5 302c may be modulated by three different excitation frequencies, f1, f2 and f3. The emitters of the transceivers are preferably controlled to transmit for a short duration when instructed to do so by a controller associated with a pen interrogator. The purpose of the pen interrogator is to determine whether a pen is close to the surface. The emitters provide a collimated zone of IR across the surface, such as the zone 68 of FIG 8, requiring pens to be within this zone to be able to detect an interrogation signal.
In accordance with this arrangement a pen is adapted to preferably include a photodiode detector, or more preferably a plurality of photodiode detectors (to ensure predominantly consistent reception of the incident IR field regardless of varying pen orientation) for detecting the lit transmissions from the emitter of one or more of the transceivers 302a, 302b, 302c. The pen is further adapted to include circuitry to process the received signal as discussed below.
An example implementation of circuitry within a pen in accordance with this arrangement is shown in FIG. 10. The pen includes a photodetector 4l0 an amplifier 412, multiple filters 414a to 414c, multiple demodulators 416a to 416c, multiple analogue-to-digital converters 4l8a to 418c, a coder 420, and a transmitter 422.
An adaptation of the interface 16 of FIG. 2 or FIG. 5 in accordance with this arrangement is illustrated in PIG. 11.
FIG. 12 and FIG. 13 illustrate the methods perfonned in the pen of FIG. 10 and the interface of FIG. 11 in accordance with this example. The example is now further explained with reference to FIG. 10 to FIG. 13.
The interface 16 includes emitters 440a, 440b, 440c; modulators 442a, 442b, 442c; an interrogator 430; a receiver 444; a control block 438; a position determination block 446; a comparator 448; a flag set block 449; a register 447; a comparator 445; a look-up table 443; the buffer 20; and the delay block 22.
The interrogator 430 is adapted to transmit an interrogation signal. The interrogator may be triggered, for example in response to a signal from the buffer 20 as denoted by dashed line 432 or in response to a signal from the computer 14 as denoted by dashed line 434. The interrogator may be triggered when a contact is detected.
The interrogator is adapted to transmit a signal to wake-up' a pen. In the event that a pen is present, the pen is woken up' by the interrogation signal.
In general, as denoted in step 450, a contact is detected, and an interrogation signal is transmitted in step 452.
As denoted by step 470 of nO. 13, responsive to detection of the interrogation signal a pen wakes up' and in a step 472 enables its circuitry.
The interrogator block 430 additionally provides a control signal on line 436 to an emitter controller 438.
Responsive to the control signal on line 436, which indicates that the interrogator block 430 has transmitted the interrogation signal, the control block 438 selectively enables the emitters 440a, 440b, 440c as denoted by step 454.
Each of the emitters 440a, 44th, 440c is associated with a respective modulation signal at a frequency f, f,, f3 provided by modulators 442a, 442b, 442c. Thus each emitter emits a signal with a respective modulation.
When a woken up' pen is within a detection zone, the photodiode detector 410 within the pen detects an incident IR signal from one or more of the plurality of emitters of transceivers 302a, 302b, 302c as denoted by step 474. The signal will be a composite of the multiple modulation frequencies associated with the different emitters.
After amplification in an amplifier 412 as denoted by step 476, the composite signal passes into separate band pass filters 4l2a, 4121,, 412c (equal to the number of emitters) for filtering as denoted by steps 478. The pen circuitry includes a channel for each emitter. They are then demodulated by respective demodulators 414a, 414b, 414c in step 480 to provide a DC voltage proportional to the incident ZR signal from each of the plurality of emitters.
The analogue to digital (A-D) converter in each channel, 418a, flab, 418c, typically within a microprocessor, then measures the plurality of DC voltages and digitises the signals, as denoted by step 482. This intonation is then output to the coding block 420 and used by the coding block 420 to code a backchannel tranSmission as denoted by step 484.
10. The output of the coding block is providing to a transmitter 422 for transmission in step 486.
The transmission from the pen may use an IR emitter in the pen as the transmitter 422, transmitting coded information to an ZR detector, preferably co-located with the interrogator controller. The pen transmitter 422 may typically be instructed by a pen microcontroller to transmit after the pen has successfully received an interrogation signal.
Alternatively, the backchannel could use an RF link, for example Bluetooth Low Energy' to relay the pen data packet, with the transmitter 422 being suitably adapted.
Regardless of the backchannel physical layer, the pen data packet will typically consist of a pen identifier data, amplitude data for the received ZR interrogator signal, and data to indicate the status of pen flag buttons (tip switch and barrel switch).
The receive block 444 of the interface 16 receives the wireless signal transmitted by the pen. This wireless signal is provided to a unit 446 which determines an approximate or coarse location of the pen based on the received signal.
Alternatively the received signal may include the approximate location.
The amplitude of the signal received is different in each detector (416a, 41Gb, 416c) for different pen bearings, and different pen distances from the detectors. The three vectors of the signals received in the respective detectors allow a coarse bearing to be calculated to approximately locate the position of the pen on the surface generating the wireless signal.
With reference to FIG. 14, this is further illustrated.
nO. 14 illustrates diagrammatically the amplitude of the signals received in a pen by each of the detectors 416a, 41Gb, 4l6c, from which it can be determined an approximate location of the pen. In general the signal received in each detector can be used to provide a coarse approximation of location.
A principle of operation in accordance with an example arrangement is now further described. it is assumed that a pen may be positioned on the interactive surface providing contact points at locations 307a, 307b, 307c, and 307d respectively.
Reference numeral 380 of FIG. 14 illustrates the amplitude of the signals received by the IR detectors with the pen in position 307a. The decoder 416a receives a signal having an amplitude as denoted by reference numeral 386, the decoder 416b receives a signal having an amplitude as denoted by reference numeral 388, and the decoder 416c Sceives a signal having an amplitude as denoted by reference numeral 390.
Reference numeral 382 of FIG. 14 illustrates the amplitude of the signal received by the detectors of a pen in position 307b. The decoder 416a receives a signal having an amplitude as denoted by reference numeral 392, the transceiver 41Gb receives a signal having an amplitude as denoted by reference numeral 394, and the decoder 416c receives a signal having an amplitude as denoted by reference numeral 396.
Reference numeral 384 of FIGS 14 illustrates the amplitude of the signals received by the detectors of apen in position 307c. The decoder 416a receives a signal having an amplitude as denoted by reference numeral 393, the decoder 41Gb receives a signal hav.ng an amplitude as denoted by reference numeral 395, and the decoder 4lGc receives a signal having an amplitude as denoted by reference numeral:397, Reference numeral 381 of FIG. 14 illustrates the amplitude of the signals received by the detectors of a pen in cosition 307th The decoder 4lGa receives a signal having an amplitude as denoted by reference numeral 387 the decoder 41Gb receives a signal having an amplitude as denoted by reference numeral. 389, and the decoder 4].Gc receives a signal having an amplitude as denoted by reference numeral 391.
Thus there is described above a technique for the pen to coarsely calculate its location.
In a step 456 the interface 16 determines if a response is received in the receiver 444 responsive to the transmitted signals from the emitters 4lOa, 41Db, 4lOc.
If no wireless signal is received, then the system is determined to be in touch mode as indicated by step 457.
If a wireless signal is received, then as denoted by step 458 a determination is made by the. .bioc: 446 as to the approximate location of the pen, or the approximate location determined by the pen (for example using the technique of FIG 14) is retrieved In step 460 this coarse location is compared with an accurate location of the contact in block 448.
If, as denoted by step 162, it is determined that the two locations do not mLatch, then the mode is set as touch mode in step 457.
If in step 462 it is determined that the two locations do match, then in step 464 the mode is set as pen mode. In view of the approximate or coarse nature of one of these values, the match may be successful if the positions are within a certain distance of each other.
After the mode is set in steps 457 or 464, the process may proceed to steps 42, 44, 46 as before.
The position determination block 446 provided in the interface 16 receives the coarse location of the pen, or may use the received amplitude data representing the strength of the signal incident at the pen to calculate a coarse bearing for the pen. This may be used to remove ambiguity when a number of devices (pen or touch) are presented simultaneously to the IWB surface and within the interrogator detection zone as described above.
Once a pen is being accurately tracked by the touch system, a more accurate bearing can be calculated and this can be compared with the coarse bearing provided by the IR interrogator system. A calibration correction table can be built up, as the pen is moved over the surf ace, and stored in non-volatile memory. With prolonged use the accuracy of the coarse location system steadily improves as the system leans' from the accurate touch coordinate bearing calculation.
The technique described above relates to determination of whether an initial contact point is a pen or a touch, and relating a pen input to a contact by location. As referred to in the preceding paragraph, once a contact is determined as a pen input, it can be tracked without having to compare its location. The values provided from the receiver 444 are compared directly in comparator 445 with values of existing contact points stored in a look*-up table (IAn), to identify the pen with which the contact is associated. A value can be rtar... %4.... *.
associated with a particular tracked contact based on its approximation to the values in the LCJT.
A further arrangerrant is now described? which is a modification of the foreqoing arrangement, in this arrangement, instead of the multiple frequency drive to modulate the plurality of interrogator emitters1 the emitters are excited with one frequency and then sequenced Tfl time. The pen may then sample at three different time interval. s denoted t 1, t2 * t3 to obtain three DC levels proportional to the incident energy for the three different sources.
In this arrangement a plurality of co-located IR transceivers are again utilised in accordance with the arrangement of FIG. 9.
As discussed above? an interrogation signal may be transmitted to wake up a pen. However the transmitted signals from the transceivers may also be used as a wake up' signal.
in this arrangement, the emitters d.c not transmit in tandem, but instead transmit in turn in accordance with their time offsets.
To ensure the pen sees the maximum energy to wake it up.
the inerfacc:e ma first fire' the emtner whrch is co$'st to the detected position provided by the coordinates which information may he provided by the interface signal on line 3 or line 5, followed by the other emitters after a predetermined time associated with their offsets.
The pen on waking, samples for time ti, waits a predetarmined time, samples for t2 etc. The sampling process is used to determine the amplitude of the incident signal arriving durina the period tl, t2 and t3.
This simplifies the pen/low power requirements as it only requires one band pass fi. lter channel.
The U. to t3 duration is dependent upon the frequency, and may be in the order of milliseconds.
n adaptation of the pen in accordance with this arrangement is illustrated in FIG. 15. The pen includes a S receiver 650, an amplifier 652, a bandpass filter 654, a demodulator 656, an analogue-to-digital converter 658, a coder or coding unit 660, and a transmitter 662. It will be apparent that the functional blocks of the pen as illustrated in FIG. 15 are consistent with the functional blocks of the pen as illustrated in FIG. 10 above, except in this embodiment there is no requirement to provide multiple channels. A controller denoted by reference numeral 664 within the pen controls the decoding circuitry to decode the received signals for each of the time offsets. The controller 664 may be adapted to process the received signals in accordance with time offsets for a known time offset, based on an initial timing mark provided by the first signal from the first emitter.
With reference to FIG. 16 there is illustrated an adaptation to the interface 16 in order to inçi.ement this arrangement. This adaptation is shown as an adaptation of the interf ace 16 of FIG. 11.
As shown in FIG. 16 the frequency modulation blocks 442a, 442b, 442c of FIG. 11 are replaced by a single frequency modulation block 602 which provides a signal to each of the three emitters 440a, 440b, 440c. Each of the emitters 440a, 440b, 440c apply a different timing to the signal produced by the signal modulator, but generates signals with the same modulation.
In the arrangement shown in FIG. 16 there is not shown an explicit block for generating an interrogation signal, and in this arrangement it is assumed that the interrogation is provided by controlling one of the emitters 440a, 440b, 440c.
In accordance with this exemplary arrangement, the control block 438 is adapted to receive the output of the buffer 20/delay 22, representing the data of the contact point detected. As discussed hereinabove, that. data will include coordinate information representing the precise location of S the contact detected. The control block 438 utilises this coordination information to enable the one of the emitter blocks 440a, 440b, 440c which is determined to be closest to the specific location, the enablement of that emitter block and the generation of its transmit signal acting as a wake up' or interrogation signal for the pen. As noted above, the choice as the first emitter being the emitter closest to the detected contact point maximises the likelihood of the transmitted signal waking up the pen.
As denoted hereinabove, it is uniuortant which of the emitters 440a, 44Db, 440c is first enabled, or the sequence of enablement of the emitters. This is because the control block 438 additionally provides a control signal to a reordering block 604, which has knowledge of which emitter a received wireless signal is received from, such that on receipt of all of the wireless signals the reordering block 604 can reorder the receive signals to be associated, if necessary, with the respective time offsets in sequence.
Other than as described, the circuitry of FIG. 16 operates in accordance with the circuitry of nO. 11. The control block 438 additionally receives the signal on line 434 from the computer 14.
It will also be understood that the circuitry of FIG. 15 and FIG. 16 operates generally in accordance with the method processes of FIGs. 12 end 13. these Figures are modified as appropriate, with the arrangement of FIG. 16 in particular not requiring the transmission of a dedicated interrogation signal, and requiring the transmission of the signals from the emitters 440a, 440b, 440c to be associated with timing controls provided by the control block 438.
There has been set out above various exemplary arrangements for implementation of techniques for detecti.n.g whether a contact point provided in a touch contact system is provided by a pen. Various aspects of each described arrangement may be implemented in other described arrangements. Therefore aspects of each described arrangement may be mixed.
It will. he understood from the foregoing description that in exemplary implementations there is a requirement to carry out an initial determination when a contact point is first detected; and thereafter to track that contact point (including the movement of that contact point) until i.t is no longer provided. The technique for determining the initial.
contact point; and the technique for monitoring a determined contact point. may be different. The arrangements describe techniques in which contact points provided by multiple different tens may be detected and tracked. without having to determine a frequency of operation. associated with a particular pen.
In preferred implementations, an interface (comprising a receiver block) is positioned in the centre top of an interact ive whiteboard A communications backchannel (IR or RF) may provide pen button flag data and pen unique identifiers, ?referably however, an IR location signal may be modulated to provide this h*ackchannel functionality, The above described arrangements illustrate example arrangement. s of the. invention, and etthodiments of the invention. Details of the arrangements as described in relation to any particular exelary arrangement may be cotthined with details of another exemplary arrangement.
In all arrangements, the system may follow an exemplary logic process, in which the system is placed in touch mode or pen mode in dependence on the determination of the type. of the first contact detected.
In the event that no data is received from the interactive surface, the interface 16 may be in a standby mode S of operation, and not operational.
When an object is detected, a data stream may be generated by the interactive surface to the interface:1.6, and the interface 16 leaves the standby mode. The interface 16 may activate an interrogator (where the.ir.t errogator is provided) to look for a pen.
if no pen is detected, the data is assumed to be associated with a touch, and the system is locked into touch niode until the tracking of the. object is lost, If a Den is introduced, to the surface while in touch mode, the contact provided by the pen. is treated as a touch input. This may prave useful for dual-handed size estures without the user having to swap from pen to finger in their pen holding hand If a finger track is lost, or where multiple finger contacts are detected the last finger track is lost, then the data stream from the interacti:ve surface halts, and the interface 16 returns to standby mode.
If a pen enters tne ceLecLion zone, for examp.ie the LR bezel detection zone, then a data stream is received by the interface 16 and the interrogator where prcvied) .s enabled.
where an interrogator is enabled, the pen responds to the interroqati.on signal, which response may include a pen identifier, and flag status indicating a button status of the pen. Once a response is received, the interrogator can be disabled. The system then enters pen mode. When a button changes state, the state information is passed through to the computer.
Additional finger contacts may occur while in pen mode9 and in an embodiment are determined as an invalid contact points for pen rode9 and ignored until/unless the system leaves pen made and enters touch mode.
In the example iven it is assumed that the system operates in either pen mode or touch mode, but in variations the system may operate in both pen and touch mode.
When in pen mode, the pen must be moved to beyond the field. 01:: the i-iterogator before the system can exit pen made and revert to touch mode.
The present invention has been described by way of reference to particular examples and preferable aspects of those examples, One skilled in the art will appreciate that the invention and those examples are not limited to any details given, unless as defined by the appended claims.
Various details may be optionally applied in different examples, and various details may be applied alone or in combination to different examples.

Claims (42)

  1. Claims 1, A method for detecting the presence of a pointing device at an interactive surface, which interactive surface is arranged to detect a contact point, the method comprising: S receiving data representing a contact point; determining if a wireless signal is received; and in dependence on receipt of a wireless signal identifying said data as touch data or pen data.
  2. 2. The method of claim 1 wherein the interactive surface detects a contact point provided by touch inputs.
  3. 3. The method of claim 1 or claim 2 wherein if a wireless signal is received the data is identified as pen data.
  4. 4. The method of any one of claims 1 to 3 wherein if a wireless signal is not received the data is identified as touch data.
  5. 5. The method of claim 3 or claim 4 wherein on identification, the data is transmitted for further processing.
  6. 6. The method of any one of claims 1 to 5 wherein transmission of said data for further processing of the data is delayed whilst determination is made as to whether a wireless signal is received.
  7. 7. The method of any one of claims 1 to 6 wherein identifying the data as touch data or pen data comprises setting one or more flag bits associated with said data.
  8. 8. The method of claim 7 wherein the one or more flag bits may be a single bit, the state of which indicates touch data or pen data.
  9. 9. The method of any one of claims 1 to 8 wherein a pen transmits a wireless signal when it is located within a certain proximity of the interactive surface.
  10. 10. The method of claim 9 wherein the pen is activated to transmit a wireless signal when it is located within certain proximity of the interactive surface.
  11. 11. The method of any one of claims 1 to 8 wherein a pen transmits a wireless signal responsive to an interrogation signal.
  12. 12. The method of any one of claims 1 to 11 wherein an interactive system associated with the interactive surface transmits an infra-red illumination field on the interactive surface, additional to any infra-red signal associated with detection of a contact point, for enabling detection of any pen providing the contact point.
  13. 13. The method of claim 12 wherein a pen detects an infra-red signal associated with said infra-red illumination field.
  14. 14. The method of claim 12 or claim 13 wherein a pen is energised by an infra-red signal associated with said infra-red illumination field.
  15. 15. The method of any one of claims 12 to 14 wherein a pen transmits a wireless signal upon detection or receipt of said infra-red signal.
  16. 16. The method of any preceding claim for identifying data associated with multiple contact points as being provided by touch inputs or device inputs, the method further comprising determining a location of any device, and comparing the location of such device to the location of a contact point.
  17. 17. The method of any one of claims 1. to 16 in which an interface is adapted to transmit wireless infra-red signals in a plurality of infra-red transmitters, the signals from the respective infra-red transmitters illuminating the interactivesurface with an infra-red illumination field.
  18. 18. The method of claim 17 in which the central axis of each infra-red transmitter is offset from the central axis of each other Infra-red transmitter.
  19. 19. The method of claim 17 or claim 18 in which a pen positioned on the interactive surface receives a signal from one or more of the infra-red transmitters, and processes the received signals.
  20. 20. The method of claim 19 in which the pen transmits a signal to the interface, which signal is indicative of a coarse location of the pen.
  21. 21. The method of claim 20 in which the signal transmitted from the pen is an indication of the amplitude of the signal received from each transmitter.
  22. 22. The method of any one of claims 1 to 21 in which the signal transmitted is modulated by each transmitter with a different frequency.
  23. 23. The method of claim 22 in which the time offset of each signal is the same.
  24. 24. The method of claim 22 or claim 23 in which the pen detects a composite signal being the signal detected at at least one transmitter.
  25. 25. The method of claim 24 in which the pen processes the composite signal to provide one or more signals indicating the coarse position of the pen.
  26. 26. The method of claim 25 in which the one or more signals are one or more amplitude signals representing the amplitude of the signals received at the pen from each transmitter.
  27. 27. The method of claim 26 in which the pen determines a coarse location of the pen based on said signals, and transmit said coarse location to the interface.
  28. 28. The method of claim 26 or claim 27 in which the pen transmits the one or more amplitude signals representing the amplitude of the signals received at the pen from each transmitter to the interface.
  29. 29. The method of claim 28 in which the interface determines a coarse location for the pen in dependence thereon, and compare said coarse location to an accurate location.
  30. 30. The method of claim 28 in which the interface compares the one or more amplitude signals to one or more amplitude signals of tracked positions.
  31. 31. The method of any one of claims 1 to 30 in which an interface modulates the signal transmitted by each transmitter with a different time offset.
  32. 32. The method of claim 31 in which the frequency modulation of each signal is the same.
  33. 33. The method of claim 31 or claim 32 in which the pen detects a signal being the time offset signal transmitted from each transmitter in turn.
  34. 34. The method of any one of claim 31 to claim 33 comprising processing each time offset signal to provide a signal which is used to indicate the coarse position of the pen.
  35. 35. The method of any one of claims 31 to 34 comprising generating, by the pen, in a signal sequence for each time offset transmitted signal, to jroduce one or more amplitude signals.
  36. 36. The method. of claim 35 wherein the one or more amplitude signals is used1 in accordance with their associated time offset, to determine a coarse location of the pen1 and transmit said coarse location to the interface.
  37. 37. The method of claim 36 in which the pen transmits the one amplitude signal for each time offset to the interface.
  38. 33, The method of claim 37 in which the interface determines a coarse location for the pen in dependence thereon, and compare said coarse location to an accurate location.
  39. 39. The method according to claim 38 in which the interface compares the one or more amplitude signals to one or more amplitud.e signals of tracked positions 40. A method for a device for an interactive display system, the device providing a contact point at an interactive surface of the system, the device receiving a wireless signal, and transmitting a wireless signal responsive to detection of.receipt of the wireless signal.41. The method of claim 40 wherein the receipt of the wireless signal energises the device.42. The method of claim 40 or claim 41 wherein the receipt of the wireless signal comprises detecting a wireless signal which is provided by the system in addition to a wireless signal for detecting a contact point.43. The method of any one of claims 40 to 42 wherein the device receives a plurality of wireless signals.44, The metiod of claim 43 wherein the device determines an approximate position relative to the display surface on detection of the plurality of wireless signals, and provides an indication of said approximate position in the transmitted wireless signal.45. The method of claim 43 wherein the device includes an indication of the received wireless signals in the transmitted wireless signals, so that the transmitted wireless signals can be used to determine a location of the device relative to the interactive surface.46. An interactive display system comprising circuitry for detecting a contact point provided by a pointing input or a touch input at an interactive surface thereof, the system comprising circuitry for receiving data associated with a contact point; circuitry for determining if a wireless signal is received; circuitry for, in dependence on receipt of a wireless signals identifying said data as touch data or pen data.47. The interactive display system of claim 46 wherein the interactive surface is arranged for detection of a contact point provided by touch inputs.48. The interactive display system of claim 45 or claim 46 further comprising circuitry to identify data as pen data if a wireless signal is received.49. The interactive display system of any one of claims 45 to 48 further comprising circuitry to identify data as touch data if a wireless signal is not received.50. The interactive display system of claim 48 or claim 49 wherein on identification, circuitry is adapted to transmit the data for further processing.51. The interactive display system of any one of claims 46 to 50 further comprising delay circuitry wherein transmission of said data for further processing of the data is delayed whilst determination is made as to whether a wireless signal is received.52. The interactive display system of any one of claims 46 to 51 further comprising flag setting circuitry for setting one or more flag bits associated with said data.53. The interactive display system of claim 52 wherein the one or more flag bits may be a single bit, the state of which indicates touch data or pen data.54. The interactive display system of any one of claims 46 to 53 wherein a pen is adapted to transmit a wireless signal when it is located within a certain proximity of the interactive surface.55. The interactive display system of claim 54 wherein the pen is adapted to be activated to transmit a wireless signal when pen circuitry determines it is located within a certain proximity of the interactive surface.56. The interactive display system of any one of claims 46 to wherein a pen includes circuitry for transmitting a wireless signal responsive to an interrogation signal.57. The interactive display system of any one of claims 46 to 56 wherein an interactive system associated with the interactive surface includes circuitry adapted to transmit an infra-red illumination field on the interactive surface, additional to any infra-red signal associated with detection of a contact point, for enabling detection of a pen providing the contact point.58. The interactive display system of claim 57 wherein a pen is adapted to include circuitry to detect an infra-red signalassociated with said infra-red illumination field.59. The interactive display system of claim 57 or claim 58 wherein a pen is adapted to include circuitry which is energised by an infra-red signal associated with said infra-red illumination field.60. The interactive display system of any one of claims 51 to 59 wherein a pen is adapted to include circuitry to transmit a wireless signal upon detection or receipt of said infra-red signal.61. The interactive display system of any one of claims 57 to 60 wherein a pen is adapted to include circuitry to transmit a wireless signal representing the detection of an infra-red signal generated for detecting a contact point.62. The interactive display system of any one of claims 46 to 61 including circuitry for identifying data associated with multiple contact points as being provided by touch inputs or device inputs, further comprising circuitry for determining a location of any device, and circuitry for comparing the location of such device to the location of a contact point.63. The interactive display system of any one of claims 46 to 62 in which an interface is adapted to include circuitry to transmit wireless infra-red signals in a plurality of infra-red transmitters, the signals from the respective infra-red transmitters illuminating the interactive surface with an infra-red signal.64. The interactive display system of claim 63 in which the central axis of each infra-red transmitter is offset from the central axis of each other infra-red transmitter.65. The interactive display system of claim 63 or claim 64 in which a pen positioned on the interactive surface includes 5' circuitry for receiving a signal from one or more infra-red transmitters, and processing the received signals.66. The interactive display system of claim 65 in which the pen is adapted to include circuitry to transmit a signal to S the interface, which signal is indicative of a coarse location of the pen.67. The interactive display system of claim 66 in which the signal transmitted from the pen is an indication of the amplitude of the signal received from each transmitter.68. The interactive display system of any one of claims 63 to 67 in which an interface is adapted to modulate the signal transmitted by each transmitter with a different frequency.69. The interactive display system of claim 68 in which the time offset of each signal is the same.70. The interactive display system of claim 68 or claim 69 in which the pen is adapted to include circuitry to detect a composite signal being the signal transmitted from each transmitter.71. The interactive display system of claim 70 in which the pen is adapted to include circuitry to process the composite signal to provide one or more signals indicating the coarse position of the pen.72. The interactive display system of claim 71 in which the one or more signals are one or more amplitude signals representing the amplitude of the signals received at the pen from each transmitter.73. The interactive display system of claim 72 in which the pen is adapted to include circuitry to determine a coarse location of the pen based on said signals, and transmit said coarse location to the interface.74. The interactive display system of claim 72 or claim 73 in which the pen is adapted to include circuitry to transmit the S one or more amplitude signals representing the amplitude of the signals received at the pen from each transmitter to the interface.75. The interactive display system of claim 74 in which the interface is adapted to include circuitry to determine a coarse location for the pen in dependence thereon, and compare said coarse location to an accurate location.76. The interactive display system of claim 75 in which the interface is adapted to include circuitry to compare the one or more amplitude signals to one or more amplitude signals of tracked positions.77. The interactive display system of any one of claims 46 to 76 in which an interface is adapted to include circuitry to modulate the signal transmitted by each transmitter with a different time offset.78. The interactive display system of claim 77 in which the frequency modulation of each signal is the same.79. The interactive display system of claim 77 or claim 78 in which the pert is adapted to include circuitry to detect a signal being the time offset signal transmitted from each transmitter in turn.80. The interactive display system of any one of claim 77 to claim 79 in which the pen is adapted to include circuitry to process each time offset signal to provide a signal which is used to indicate the coarse position of the pen.81. The interactive display system of any one of claims 77 to in which a signal is generated by the pen in sequence for each time offset transmitted signal, to produce one or more amplitude signals.82. The interactive display system of claim 81 wherein the one or more amplitude signals is used, in accordance with their associated time offset, to determine a coarse location of the pen, and transmit said coarse location to the interface.83. The interactive display system of claim 82 in which the pen is adapted to include circuitry to transmit the one amplitude signal for each time offset to the interface.84. The interactive display system of claim 83 in which the interface is adapted to include circuitry to determine a coarse location for the pen in dependence thereon, and compare said coarse location to an accurate location.85. The interactive display system of claim 84 in which the interface is adapted to include circuitry to compare the one or more amplitude signals to one or more amplitude signals of tracked positions.86. A device for an interactive display system, the device providing a contact point at an interactive surface of the system, the device comprising circuitry for receiving a wireless signal, and circuitry for transmitting a wireless signal responsive to detection of receipt of the wireless signal.87. The device of claim 86 wherein including circuitry such that the receipt of the wireless signal energises the device.88. The device of claim 86 or claim 87 wherein the receipt of the wireless signal comprises dircuits for detecting a wireless signal which is provided by the system in addition, to a wireless signal for deteccing a contact point.39. The device of any one of claims 86 to 88 wherein the device circuitry receives a plurality of wireless signals.90, The device of claim 39 wherein the device includes circuitry to determine its approximate position relative to the interactive surface on detection of the plurality of wireless signals, and circuitry to provide an indication of said approxImate position in the transmitted wireiess signal.91. The device of claim 89 wherein the device includes circuitry for including an indication of the received wireless signals in the transmitted wireless signal, so that the transmitted wireless signals can be used to determine a location of the device relative to the interactive surface.92. A method substantially as described herein, with reference to or as shown in the drawings.93. A device or system substantially as described herein, with reference to or as shown in the drawings.Amendments to the claims have been filed as follows CLAIMS: 1. A method for detecting the presence of a pointing device at an interactive surface, which interactive surface is arranged to detect a contact point, the method comprising: receiving data representing a contact point; determining if a wireless signal is received; and in dependence on receipt of a wireless signal identifying said data as touch data or pen data, wherein a pen is activated to transmit a wireless signal when it is located within certain proximity of the interactive surface.2. The method of claim 1 wherein the pen transmits a wireless signal responsive to an interrogation signal.3. The method of claim 1 or claim 2 wherein an interactive system associated with the interactive surface transmits an r infra-red illumination field on the interactive surface, additional to any infra-red signal associated with detection of a contact point, for enabling detection of any pen r providing the contact point.4. The method of claim 3 wherein the pen detects an infra-red signal associated with said infra-red illumination field.5. The method of claim 3 or claim 4 wherein the pen is energised by an infra-red signal associated with said infra-red illumination field.6. The method of any one of claims 3 to 5 wherein the pen transmits a wireless signal upon detection or receipt of said infra-red signal.7. The method of any preceding claim wherein the interactive surface detects a contact point provided by touch inputs.8. The method of any preceding claim wherein if a wireless signal is received the data is identified as pen data.9. The method of any preceding claim wherein if a wireless signal is not received the data is identified as touch data.10. The method of claim 8 or claim 9 wherein on identification, the data is transmitted for further processing.11. The method of any one of any preceding claim wherein transmission of said data for further processing of the data is delayed whilst determination is made as to whether a r wireless signal is received.12. The method of any one of any preceding claim wherein r identifying the data as touch data or pen data comprises setting one or more flag bits associated with said data.13. The method of claim 12 wherein the one or more flag bits may be a single bit, the state of which indicates touch data or pen data.14. The method of any preceding claim for identifying data associated with multiple contact points as being provided by touch inputs or device inputs, the method further comprising determining a location of any device, and comparing the location of such device to the location of a contact point.15. The method of any one of claims 1 to 14 in which an interface is adapted to transmit wireless infra-red signals in a plurality of infra-red transmitters, the signals from the respective infra-red transmitters illuminating the interactivesurface with an infra-red illumination field.16. The method of claim 15 in which the central axis of each infra-red transmitter is offset from the central axis of each other infra-red transmitter.17. The method of claim 15 or claim 16 in which a pen positioned on the interactive surface receives a signal from one or more of the infra-red transmitters, and processes the received signals.18. The method of claim 17 in which the pen transmits a signal to the interface, which signal is indicative of a r coarse location of the pen.19. The method of claim 18 in which the signal transmitted r from the pen is an indication of the amplitude of the signal received from each transmitter.20. The method of any one of claims 1 to 19 in which the signal transmitted is modulated by each transmitter with a different freguency.21. The method of claim 20 in which the time offset of each signal is the same.22. The method of claim 20 or claim 21 in which the pen detects a composite signal being the signal detected at at least one transmitter.23. The method of claim 22 in which the pen processes the composite signal to provide one or more signals indicating the coarse position of the pen.24. The method of claim 23 in which the one or more signals are one or more amplitude signals representing the amplitude of the signals received at the pen from each transmitter.25. The method of claim 24 in which the pen determines a coarse location of the pen based on said signals, and transmit said coarse location to the interface.26. The method of claim 24 or claim 25 in which the pen transmits the one or more amplitude signals representing the amplitude of the signals received at the pen from each LI') transmitter to the interface.r 27. The method of claim 26 in which the interface determines a coarse location for the pen in dependence thereon, and compare said coarse location to an accurate location. r28. The method of claim 26 in which the interface compares the one or more amplitude signals to one or more amplitude signals of tracked positions.29. The method of any one of claims 1 to 28 in which an interface modulates the signal transmitted by each transmitter with a different time offset.30. The method of claim 29 in which the frequency modulation of each signal is the same.31. The method of claim 29 or claim 30 in which the pen detects a signal being the time offset signal transmitted from each transmitter in turn.32. The method of any one of claims 29 to claim 31 comprising processing each time offset signal to provide a signal which is used to indicate the coarse position of the pen.33. The method of any one of claims 29 to 32 comprising generating, by the pen, in a signal sequence for each time offset transmitted signal, to produce one or more amplitude signals.34. The method of claim 33 wherein the one or more amplitude signals is used, in accordance with their associated time offset, to determine a coarse location of the pen, and r transmit said coarse location to the interface.35. The method of claim 34 in which the pen transmits the one r amplitude signal for each time offset to the interface.36. The method of claim 35 in which the interface determines a coarse location for the pen in dependence thereon, and compare said coarse location to an accurate location.37. The method according to claim 36 in which the interface compares the one or more amplitude signals to one or more amplitude signals of tracked positions.38. A method for a device for an interactive display system, the device providing a contact point at an interactive surface of the system, the device receiving a wireless signal, and transmitting a wireless signal responsive to detection of receipt of the wireless signal, wherein the device is activated to transmit the wireless signal when it is located within a certain proximity of the interactive surface.39. The method of claim 38 wherein the receipt of the wireless signal energises the device.
  40. 40. The method of claim 38 or claim 39 wherein the receipt of the wireless signal comprises detecting a wireless signal which is provided by the system in addition to a wireless signal for detecting a contact point.
  41. 41. The method of any one of claims 38 to 40 wherein the device receives a plurality of wireless signals.
  42. 42. The method of claim 41 wherein the device determines an approximate position relative to the display surface on r detection of the plurality of wireless signals, and provides an indication of said approximate position in the transmitted wireless signal. r43. The method of claim 41 wherein the device includes an indication of the received wireless signals in the ransmitted wireless signals, so that the transmitted wireless signals can be used to determine a location of the device relative to the interactive surface.44. An interactive display system comprising circuitry for detecting a contact point provided by a pointing input or a touch input at an interactive surface thereof, the system comprising circuitry for receiving data associated with a contact point; circuitry for determining if a wireess signal is received; circuitry for, in dependence on receipt of a wireless signal, identifying said data as touch data or pen data, wherein the pen is adapted to be activated to transmit a wireless signal when pen circuitry determines it is located within a certain proximity of the interactive surface.45. The interactive display system of claim 44 wherein the pen includes circuitry for transmitting a wireless signal responsive to an interrogation signal.46. The interactive display system of claims 44 or 45 wherein an interactive system associated with the interactive surface includes circuitry adapted to transmit an infra-red illumination field on the interactive surface, additional to any infra-red signal associated with detection of a contact point, for enabling detection of the pen providing the contact point. IC)47. The interactive display system of claim 46 wherein the r pen is adapted to include circuitry to detect an infra-red signal associated with said infra-red illumination field.48. The interactive display system of claim 46 or claim 47 wherein the pen is adapted to include circuitry which is energised by an infra-red signal associated with said infra-red illumination field.49. The interactive display system of any one of claims 46 to 48 wherein the pen is adapted to include circuitry to transmit a wireless signal upon detection or receipt of said infra-red signal.50. The interactive display system of any one of claims 46 to 49 wherein the pen is adapted to include circuitry to transmit a wireless signal representing the detection of an infra-red signal generated for detecting a contact point.51. The interactive display system of any one of claims 44 to wherein the interactive surface is arranged for detection of a contact point provided by couch inputs.52. The interactive display system of any one of claims 44 to 51 further comprising circuitry to identify data as pen data if a wireless signal is received.53. The interactive display system of any one of claims 44 to 52 further comprising circuitry to identify data as touch data if a wireless signal is not received.54. The interactive display system of claim 52 or claim 53 wherein on identification, circuitry is adapted to transmit LI') the data for further processing.r 55. The interactive display system of any one of claims 44 to 54 further comprising delay circuitry wherein transmission of said data for further processing of the data is delayed whilst r determination is made as to whether a wireless signal is received.56. The interactive display system of any one of claims 44 to 55 further comprising flag setting circuitry for setting one or more flag bits associated wich said data.57. The interactive display system of claim 56 wherein the one or more flag bits may be a single bit, the state of which indicates touch data or pen data.58. The interactive display system of any one of claims 44 to 57 including circuitry for identifying data associated with multiple contact points as being provided by touch inputs or device inputs, further comprising circuitry for determining a location of any device, and circuitry for comparing the location of such devioe to the location of a contact point.59. The interactive display system of any one of claims 44 to 58 in which an interface is adapted to include circuitry to transmit wireless infra-red signals in a plurality of infra-red transmitters, the signals from the respective infra-red transmitters illuminating the interactive surface with an infra-red signal.60. The interactive display system of claim 59 in which the central axis of each infra-red transmitter is offset from the central axis of each other infra-red transmitter.61. The interactive display system of claim 59 or claim 60 in which a pen positioned on the interactive surface includes r circuitry for receiving a signal from one or more infra-red transmitters, and processing the received signals.62. The interactive display system of claim 61 in which the pen is adapted to include circuitry to transmit a signal to the interface, which signal is indicative of a coarse location of the pen.63. The interactive display system of claim 62 in which the signal transmitted from the pen is an indication of the amplitude of the signal received from each transmitter.64. The interactive display system of any one of claims 59 to 63 in which an interface is adapted to modulate the signal transmitted by each transmitter with a different frequency.65. The interactive display system of claim 64 in which the time offset of each signal is the same.66. The interactive display system of claim 64 or claim 65 in whioh the pen is adapted to include circuitry to deteot a composite signal being the signal transmitted from each transmitter.67. The interactive display system of claim 66 in which the pen is adapted to include circuitry to process the composite signal to provide one or more signals indicating the coarse position of the pen.68. The interactive display system of claim 67 in which the one or more signals are one or more amplitude signals representing the amplitude of the signals received at the pen from each transmitter. r69. The interactive display system of claim 68 in which the pen is adapted to include circuitry to determine a coarse r location of the pen based on said signals, and transmit said coarse location to the interface.70. The interactive display system of claim 68 or claim 69 in which the pen is adapted to include circuitry to transmit the one or more amplitude signals representing the amplitude of the signals received at the pen from each transmitter to the interface.71. The interactive display system of claim 70 in which the interface is adapted to inolude oircuitry to determine a coarse location for the pen in dependence thereon, and compare said coarse location to an accurate location.72. The interactive display system of claim 71 in which the interface is adapted to include circuitry to compare the one or more amplitude signals to one or more amplitude signals of tracked positions.73. The interactive display system of any one of claims 44 to 72 in which an interface is adapted to include circuitry to modulate the signal transmitted by each transmitter with a different time offset.74. The interactive display system of claim 73 in which the frequency modulation of each signal is the same.75. The interactive display system of claim 73 or claim 74 in which the pen is adapted to include circuitry to detect a signal being the time offset signal transmitted from each transmitter in turn. r76. The interactive display system of any one of claim 73 to claim 75 in which the pen is adapted to include circuitry to r process each time offset signal to provide a signal which is used to indicate the coarse position of the pen.77. The interactive display system of any one of claims 73 to 76 in which a signal is generated by the pen in sequence for each time offset transmitted signal, to produce one or more amplitude signals.78. The interactive display system of claim 77 wherein the one or more amplitude signals is used, in accordance with their associated time offset, to determine a coarse location of the pen, and transmit said coarse location to the interface.79. The interactive display system of claim 78 in which the pen is adapted to include circuitry to transmit the one amplitude signal for each time offset to the interface.80. The interactive display system of claim 79 in which the interface is adapted to include circuitry to determine a coarse location for the pen in dependence thereon, and compare said coarse location to an accurate location.81. The interactive display system of claim 80 in which the interface is adapted to include circuitry to compare the one or more amplitude signals to one or more amplitude signals of tracked positions.82. A device for an interactive display system, the device providing a contact point at an interactive surface of the system, the device comprising circuitry for receiving a r wireless signal, and circuitry for transmitting a wireless signal responsive to detectioa of receipt of the wireless signal, wherein the device is activated to transmit the r wireless signal when circuitry determines it is located within a certain proximity of the interactive surface.83. The device of claim 80 wherein including circuitry such that the receipt of the wireless signal energises the device.84. The device of claim 82 or claim 83 wherein the receipt of the wireless signal comprises circuits for detecting a wireless signal which is provided by the system in addition to a wireless signal for detecting a contact point.85. The device of any one of claims 82 to 84 wherein the device circuitry receives a plurality of wireless signals.86. The device of claim 85 wherein the device includes circuitry to determine its approximate position relative to the interactive surface on detection of the plurality of wireless signals, and circuitry to provide an indication of said approximate position in the transmitted wireless signal.87. The device of claim 85 wherein the device includes circuitry for including an indication of the received wireless signals in the transmitted wireless signal, so that the transmitted wireless signals can be used to determine a location of the device relative to the interactive surface.88. A method substantially as described herein, with reference to or as shown in the drawings.89. A device or system substantially as described herein, with reference to or as shown in the drawings. r
GB1400900.5A 2014-01-20 2014-01-20 Active pointing device detection Withdrawn GB2522249A (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
GB1400900.5A GB2522249A (en) 2014-01-20 2014-01-20 Active pointing device detection
EP15700503.4A EP3097463A1 (en) 2014-01-20 2015-01-20 Active pointing device detection
PCT/EP2015/051026 WO2015107221A1 (en) 2014-01-20 2015-01-20 Active pointing device detection
US15/112,656 US20160334921A1 (en) 2014-01-20 2015-01-20 Active pointing device detection
CN201580014678.8A CN106104428A (en) 2014-01-20 2015-01-20 Active pointing device detects

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB1400900.5A GB2522249A (en) 2014-01-20 2014-01-20 Active pointing device detection

Publications (2)

Publication Number Publication Date
GB201400900D0 GB201400900D0 (en) 2014-03-05
GB2522249A true GB2522249A (en) 2015-07-22

Family

ID=50239164

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1400900.5A Withdrawn GB2522249A (en) 2014-01-20 2014-01-20 Active pointing device detection

Country Status (5)

Country Link
US (1) US20160334921A1 (en)
EP (1) EP3097463A1 (en)
CN (1) CN106104428A (en)
GB (1) GB2522249A (en)
WO (1) WO2015107221A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10025430B2 (en) * 2013-10-08 2018-07-17 Maxell, Ltd. Projection type image display device, manipulation detection device and projection type image display method
CN106775057A (en) * 2016-11-23 2017-05-31 广州视源电子科技股份有限公司 Interactive device, distance detection method and device
CN111638808A (en) * 2020-06-30 2020-09-08 深圳市绘王动漫科技有限公司 Digital electromagnetic pen, input system and control method thereof
CN116107469A (en) * 2021-11-11 2023-05-12 荣耀终端有限公司 Function mode switching method, electronic equipment and system

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100001962A1 (en) * 2008-07-07 2010-01-07 Nortel Networks Limited Multi-touch touchscreen incorporating pen tracking
US20100155153A1 (en) * 2008-12-22 2010-06-24 N-Trig Ltd. Digitizer, stylus and method of synchronization therewith
WO2010140805A2 (en) * 2009-05-30 2010-12-09 Hwang Jay-Yeob Handheld tablet pc system
US20110241988A1 (en) * 2010-04-01 2011-10-06 Smart Technologies Ulc Interactive input system and information input method therefor
US20120013555A1 (en) * 2010-07-15 2012-01-19 Panasonic Corporation Touch screen system
US20120105361A1 (en) * 2010-10-28 2012-05-03 Cypress Semiconductor Corporation Capacitive stylus with palm rejection
US20130106720A1 (en) * 2011-10-28 2013-05-02 Atmel Corporation Active Stylus with High Voltage
US20130234961A1 (en) * 2012-03-06 2013-09-12 N-Trig Ltd. Digitizer system
US20130271434A1 (en) * 2008-10-02 2013-10-17 Wacom Co., Ltd. Combination touch and transducer input system and method
EP2725459A2 (en) * 2012-10-25 2014-04-30 Samsung Electronics Co., Ltd Touch pen using delay device and touch input method thereof and touch input system and method thereof

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070004452A1 (en) * 2005-06-08 2007-01-04 Wen-Hsiang Yueh Wireless device
US20090277697A1 (en) * 2008-05-09 2009-11-12 Smart Technologies Ulc Interactive Input System And Pen Tool Therefor
TW201403422A (en) * 2009-01-06 2014-01-16 Elan Microelectronics Corp Touch input device and control method thereof, stylus used in the input device and active signal transmitting method thereof, and touch panel module used in the input device and control method thereof
CN201435070Y (en) * 2009-05-14 2010-03-31 谢宜轩 Display equipment and light pen
CN102693024A (en) * 2011-03-21 2012-09-26 汉王科技股份有限公司 Dual-touch apparatus and positioning method thereof
US20120268414A1 (en) * 2011-04-25 2012-10-25 Motorola Mobility, Inc. Method and apparatus for exchanging data with a user computer device
US20130088427A1 (en) * 2011-10-11 2013-04-11 Eric Liu Multiple input areas for pen-based computing
US9965107B2 (en) * 2011-10-28 2018-05-08 Atmel Corporation Authenticating with active stylus
US20130307787A1 (en) * 2012-05-16 2013-11-21 Research In Motion Limited Portable electronic device and method of controlling same
CN103425296B (en) * 2013-08-16 2016-12-28 汉王科技股份有限公司 Active capacitance pen, capacitance touching control panel and contactor control device

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100001962A1 (en) * 2008-07-07 2010-01-07 Nortel Networks Limited Multi-touch touchscreen incorporating pen tracking
US20130271434A1 (en) * 2008-10-02 2013-10-17 Wacom Co., Ltd. Combination touch and transducer input system and method
US20100155153A1 (en) * 2008-12-22 2010-06-24 N-Trig Ltd. Digitizer, stylus and method of synchronization therewith
WO2010140805A2 (en) * 2009-05-30 2010-12-09 Hwang Jay-Yeob Handheld tablet pc system
US20110241988A1 (en) * 2010-04-01 2011-10-06 Smart Technologies Ulc Interactive input system and information input method therefor
US20120013555A1 (en) * 2010-07-15 2012-01-19 Panasonic Corporation Touch screen system
US20120105361A1 (en) * 2010-10-28 2012-05-03 Cypress Semiconductor Corporation Capacitive stylus with palm rejection
US20130106720A1 (en) * 2011-10-28 2013-05-02 Atmel Corporation Active Stylus with High Voltage
US20130234961A1 (en) * 2012-03-06 2013-09-12 N-Trig Ltd. Digitizer system
EP2725459A2 (en) * 2012-10-25 2014-04-30 Samsung Electronics Co., Ltd Touch pen using delay device and touch input method thereof and touch input system and method thereof

Also Published As

Publication number Publication date
US20160334921A1 (en) 2016-11-17
GB201400900D0 (en) 2014-03-05
WO2015107221A1 (en) 2015-07-23
EP3097463A1 (en) 2016-11-30
CN106104428A (en) 2016-11-09

Similar Documents

Publication Publication Date Title
CN110073310B (en) Apparatus and method for adjusting power mode of display of device
Zhang et al. Extending mobile interaction through near-field visible light sensing
CN102439538B (en) Electronic device with sensing assembly and method for interpreting offset gestures
US10216330B2 (en) Touch systems and methods including rejection of unintentional touch signals
GB2522249A (en) Active pointing device detection
US9874949B2 (en) Stylus for a digitizer system
JP5674840B2 (en) Robust acoustic synchronization signaling for acoustic positioning systems
US20110109554A1 (en) Interactive display device and method, using a detection camera and optical pointer
US10310636B2 (en) Active stylus
CN208588985U (en) Pen including touch feedback unit
TW201617799A (en) Touch systems and methods
US20160209940A1 (en) Stylus synchronization with a digitizer system
US10101819B2 (en) Control system for a gesture sensing arrangement and method for controlling a gesture sensing arrangement
TWI710929B (en) Position detection device and position indicator thereof
WO2006006174A3 (en) A tracking window for a digitizer system
MY135197A (en) Personal identification device and method
US10353493B2 (en) Apparatus and method of pen detection at a digitizer
KR20140038745A (en) Touch system comprising optical touch panel and touch pen, and method of controlling interference optical signal in touch system
KR20190134378A (en) Electronic device, blood pressure measuring method of electronic device, blood pressure measuring system
CN102104374A (en) Keying device and system
CN106133655B (en) Detect existing method and contact detection system of the pointing device at interaction surface
GB2522250A (en) Touch device detection
JP4136417B2 (en) Position detection device
KR102311294B1 (en) Method of determining input for elevator button, button input decision device and button input decision system performing method
US20170177151A1 (en) Information display device, system, and recording medium

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)