AU7937101A - Transmitter pen location system - Google Patents

Description

AUSTRALIA

Patents Act COMPLETE SPECIFICATION

(ORIGINAL)

Class Int. Class Application Number: Lodged: Complete Specification Lodged: Accepted: Published: Priority Related Art: Name of Applicant: Electronics for Imaging, Inc.

Actual Inventor(s): Robert P Wood, Jacob Harel, Alfred Samson Hou, Serge Plotkin Address for Service: PHILLIPS ORMONDE FITZPATRICK Patent and Trade Mark Attorneys 367 Collins Street Melbourne 3000 AUSTRALIA Invention Title: TRANSMITTER PEN LOCATION SYSTEM Our Ref: 654537 POF Code: 365363/341666 The following statement is a full description of this invention, including the best method of performing it known to applicant(s): -1- 6o06q TRANSMITTER PEN LOCATION SYSTEM FIELD OF THE INVENTION The invention relates to the field of location algorithms for remote devices. More particularly, the invention relates to an algorithm system for determining the position of an electronic pointing device.

BACKGROUND OF THE INVENTION Digitizing pen and whiteboard systems are used for a variety of electronic applications. These systems typically include a whiteboard, a position indicating pen, and associated electronics for determining the interaction between the whiteboard and the position indicating pen. A digital data signal is typically derived to represent the relative position of the position indicating pen and the whiteboard.

When a signal, such as ultrasound, is used as a location signal for a remote device, it is often difficult to determine the location of the device accurately, since 20 it is difficult to determine where upon each of sequential long wavepulses to measure, as a determination of the time of arrival to external receivers.

M. Stefik and C Heater, Ultrasound Position Input Device, U.S. Patent No.

4,814,552 (21 March 1989) discloses an "input device, or stylus, for entering hand drawn forms into a computer using a writing instrument, a pressure switch for determining whether the instrument is in contact with the writing surface, an acoustic transmitter for triangulating the position of the stylus on the surface, and oeooo a wireless transmitter for transmitting data and timing information to the "i computer. In operation, the stylus transmits an infrared signal which the system 3o receives immediately, and an ultrasound pulse which two microphones receive after a delay which is a function of the speed of sound and the distance of the stylus from the microphone". While Stefik et al. discloses an algorithm to analyze .l NoI l lrl(29-99.doc the incoming ultrasound signals to locate the stylus, the algorithm computes radii to each of the two microphones using information from only a single sonic pulse sample, translates the two radii into a calculated X,Y location, and then filters the calculated X,Y values, removing them from the described path if they vary from a specified limit, or range.

B. Edwards, Ultrasound Position Locating Method and Apparatus Therefor, U.S.

Patent No. 5,142,506 (25 August 1992) discloses a "positional locating method and apparatus for measuring distances by accurately determining the transit time of ultrasonic wave bursts between two or more points". "Timer clocks are started when each of the bursts is triggered to be emitted from a transmission point, and are stopped when a highly defined point in the burst is received at a corresponding receiving point. The highly defined point is determined by first analyzing the burst to identify a particular cycle within the burst. The particular cycle is then analyzed to detect the specific point within the cycle".

Analog systems, such as described by Edwards, are inherently limited to "on the fly" comparison between a current signal burst and a small amount of amplitude information from a single prior signal. Since analog systems do not store the i' 20 entire prior signal bursts in memory, they are limited to the comparison of a small number of features on the last prior signal.

While Edwards typically uses multiple receivers to locate a transmitter using ordinary trigonometric calculations, the analog system is limited to the comparison of amplitude between a small number of measured peaks on successive cycles within "bursts" of the received ultrasonic waveform. Common variations of the waveform, typically due to ordinary use of a transmitter, either from the orientation of the transmitter to the receivers, the speed at which the transmitter is moved between different regions of a writing surface, the signal :i 30 strength of the transmitted signal, noise, or reflections can result in erroneous results. Reliance on the amplitude of a specific cycle within a pulse waveform can lead to errors of one or more cycles, resulting in position detection errors of \No[)DIlclc62 971-99.do" several centimeters. Errors in such an analog system commonly result either in an inaccurate determined location for the transmitter, or in a determined location point which is required to be "thrown out" from the described path of the movable transmitter. As well, the analog system used inherently limits the type of comparison between the amplitude of selected cycle peaks within signal "bursts" within a prior output signal and a current output signal, thus preventing the analog system to being easily adaptable to hardware embodiments or improved waveform comparison techniques.

I. Gilchrist, Acoustic Mouse System, U.S. Patent No. 5,144,594 (03 September 1992) discloses an acoustic mouse system, which "controls indications on an X-Y surface of the face of a display. The system comprises at least three acoustic receivers in an x-y plane, and a hand movable acoustic transmitter that is movable both parallel to the x-y plane and in a z direction perpendicular to the x-y plane. The transmitter generates periodic acoustic oscillations in the direction of the support and its receivers. Detection circuitry, responsive to the signals from the acoustic receivers, provides signals indicative of the absolute position of the acoustic transmitter in the x-y plane. A processor is responsive to the signals from the detection circuitry to provide absolute position signals to the display, 2o whereby the display responds by moving an indication to a corresponding position on the X-Y surface of the display face. The detector circuitry is further enabled to provide z position signals to the display, whereby the display may modify a display function in accordance with the z position signals". While Gilchrist discloses a generic, periodic acoustic wavelength position indicating 25 system, Gilchrist fails to disclose a useful algorithm by which the position of the movable acoustic transmitter is determined by the detection circuitry, either by the direction of arrival or by the time of arrival of a transmitter signal. Furthermore, the system apparently requires a minimum of three acoustic receiver locations to properly locate the movable acoustic transmitter. Gilchrist also fails to disclose 30o waveform analysis techniques which can be used to provide sufficient accuracy in the determination of the movable acoustic transmitter.

M,r NoI )clI 7 I-99.,(toc The discussion of the background to the invention herein is included to explain the context of the invention. This is not to be taken as an admission that any of the material referred to was published, known or part of the common general knowledge in Australia as at the priority date of any of the claims.

The disclosed prior art systems and methodologies thus provide basic transmitter pen and whiteboard positioning systems for determining the spatial relationship between a pen and a writing area, but fail to provide an accurate means for determining the position of the tip of the pen. The development of such a transmitter pen positioning system would constitute a major technological advance. Furthermore, the development of such a transmitter pen positioning system which also provides a means for communicating supplementary information between a transmitter pen and external receivers would constitute a further major technological advance.

SUMMARY OF THE INVENTION According to one aspect of the present invention there is provided a transmitter location system, including: 20 at least three external receivers; a time dependent output signal being transmitted repeatedly from a movable transmitter to each of said external receivers, wherein time to reach each of said external receivers defines a distance between said movable transmitter and each of said external receivers; and means for determining location of said movable transmitter, based upon said distance between said movable transmitter and each of said external receivers, and a comparison between said output signal and a stored prior output signal.

According to a further aspect of the present invention there is provided a location system, including: W Ii \\Nodllcd'62971 I-99.doc a surface having a writing area, at least three external receivers, and a signal processor; a movable device adapted to be located within said writing area of said surface, said movable device adapted to send a time dependent output signal repeatedly from said movable device to each of said external receivers; and a signal processor connected to each of said external receivers, said signal processor determining distance between said movable device and said external receivers based on time of arrival of said output signal to said external receivers and a comparison between said output signal and a prior output signal, and determining said location of said movable device, based upon said calculated distance between said movable device and each of said external receivers.

According to a still further aspect of the present invention there is provided a process for calculating a location of a transmitter pen relative to a writing area of a surface, including the steps of: sending a time-dependent output signal from said transmitter pen to at least three external receivers; comparing said output signal received at each of said external receivers to a stored prior second output signal received at each of said external receivers to determined a time of arrival of said output signal at each of said external receivers; determining a distance from said transmitter pen to each of said external receivers based on said determined time of arrival of said output signal at each of said external receivers; and determining the location of said transmitter pen based upon said determined distance from said transmitter pen to each of said external receivers.

According to a still further aspect of the present invention there is provided a 30 location system between a movable device and a receiver location, including: a first output signal having a first speed of propagation, said first output signal being transmitted repeatedly from said movable device to a plurality of first W Mar'\No I,062971-99.doc signal receivers at said receiver location, wherein time to reach each of said first signal receivers is dependent on a distance between said movable device and each of said plurality of first signal receivers; a second output signal having a second speed of propagation different from said first speed of propagation of said first output signal, said second output signal being transmitted repeatedly from said movable device to a second signal receiver at said receiver location; and means for determining location of said movable device, using said first output signal received at said plurality of first signal receivers to determine a direction of arrival of said first signal to said receiver location, and using said second output signal to calculate distance from said movable device to said receiver location.

According to a still further aspect of the present invention there is provided a process for calculating a location of a movable device relative to a surface, including the steps of: repeatedly sending a first output signal having a first speed of propagation from said movable device to at least two first signal receivers at a receiver location; 20 repeatedly sending a second output signal having a second speed of propagation different from said first speed of propagation of said first output signal from said movabledevice to a second signal receiver at said receiver location; determining a distance from said movable device to said receiver location, based on a time of arrival of said second output signal at said second signal receiver, and a time of arrival of said first output signal to at least one of said first signal receivers at said receiver location; ooolo determining a direction of arrival for said first output signal between said movable device and said receiver location, based on said time of arrival of said 30o second output signal at each of said second signal receivers at said receiver location; and \\',-lr\NoDic\c)c2971-99.dot calculating said location of said movable device, based upon said determined distance from said movable device to said receiver location, and upon the determined direction of arrival of the first output signal between said movable device and said receiver location.

A transmitter pen location system may be provided, in which a pen is adapted to send a repeated output signal to external receivers at two or more receiver locations, wherein the location of the pointing tip of the pen is determined in relation to the writing surface of a whiteboard. In one embodiment an output element, preferably an ultrasonic transducer, transmits an output signal from the transmitter pen to two or more external receivers at two or more receiver locations. The direction of arrival of the output signal to each of the receiver locations may be determined, and the position of the pointing tip of the transmitter pen may then be determined, as the intersection of direction vectors from the pen to the external receivers. In an alternate embodiment, the transducer may transmit an output signal from the transmitter pen to three or more external receivers, wherein the received signal is processed to determine the time of arrival to each of the receivers, and the location of the pointing tip of the pen may be determined as the calculated distance between the transducer and each of the receivers. In another alternate embodiment having a dual signal transmitter pen, a third receiver located at a receiver location may be used to determine the time of arrival of a secondary output signal, to determine the distance between the dual signal transmitter pen and the receiver location, while two or more receivers at the receiver location may be used to determine the direction of arrival of the primary output signal. Alternative embodiments allow the transmission of supplementary information from the transmitter pen to the receivers, using waveshaping of the output signal.

°°ooo BRIEF DESCRIPTION OF THE DRAWINGS 30 Preferred embodiments of the present invention will now be described with reference to the accompanying drawings wherein: \W'\Nl;ll \NoDIccl,\(2971 99 doc Figure 1 is a top view of a direction of arrival transmitter pen location system, in which a single signal transmitter pen is located within the writing area of a white board, and in which the transmitter pen periodically sends an output signal to external receivers; Figure 2 shows the geometric relationship between a single signal transmitter pen and two external receiver locations; Figure 3 is a partial top view of receiver locations located on a surface; Figure 4 is a perspective view of an alternate embodiment of a direction of arrival transmitter pen location system, in which a single signal transmitter pen is located within a writing volume; Figure 5 is a partial cutaway view of a single signal transmitter pen having an output signal transducer; Figure 6 is a detailed cutaway view of the pointing tip of a single signal transmitter pen having an output signal transducer;

I

.Figure 7 is a partial perspective view of the pointing tip of a single signal transmitter pen having a single output signal transducer; Figure 8 is schematic view of the transmission of an output signal from a single signal transmitter pen; Figure 9 shows a shaped pulse waveform of one embodiment of an output signal sent from a transmitter pen; 30 Figure 10 shows a calculated transcribed path of a single signal transmitter pen from sequential locations within the writing area of a white board; XV:\lr No Dect \6297I1-99doc Figure 11 shows a periodic output signal pulse train as it is sent from a single signal transmitter pen; Figure 12 shows an output signal as it arrives at a first external receiver at a first receiver location; Figure 13 shows an output signal as it arrives at a first external receiver at a second receiver location; Figure 14 shows the phase difference of an output signal arriving at two external receivers, which is used by the signal processor to determine the direction of arrival of the output signal; Figure 15 shows an output signal arriving at a first external receiver at a first receiver location; Figure 16 shows an output signal arriving at a second external receiver at a first receiver location; 4***44 4oo Figure 17 is a perspective view showing changes in transmitter pen orientation which can alter the received waveform of the second output signal as it arrives at an external receiver; *4 oeeo Figure 18 a top view showing the directional reception characteristics of one 4 embodiment of second output sensors at external receivers; Figure 19 is an alternate embodiment of the transmitter pen location system, S" having movable receivers, an automatic-calibration transmitter, and wireless communication between the receivers and the signal processor; 4 Figure 20 is a top view of a time of arrival transmitter pen location system, which shows the geometric relationship between a single signal transmitter pen and \W:\tNI.\N Dcl e\,29)71.99.doc three external receivers, with the calculated position of the single signal transmitter pen shown as the intersection of three arc lengths; Figure 21 shows an ultrasound pulse train signal as it is received at a first receiver location in a time of arrival transmitter pen location system; Figure 22 shows an ultrasound pulse train signal as it is received at a second receiver location in a time of arrival transmitter pen location system; 0io Figure 23 shows an ultrasound pulse train signal as it is received at a third receiver location in a time of arrival transmitter pen location system; Figure 24 shows a large writing area direction of arrival transmitter pen location system, in which a white board transmitter sends a return signal to a transmitter pen having a receiver circuit; allowing the period between subsequent output signals to be controlled; and Figure 25 shows a large writing area single signal transmitter pen having a receiver circuit; Figure 26 is a top view of a combined direction and time of arrival dual-signal transmitter pen location system, in which a dual signal transmitter pen is located within the writing area of a surface; .ooooi Figure 27 is a partial top view of a combined direction and time of arrival, dual signal receiver pod located on a surface; S"Figure 28 is a partial cutaway view of a dual signal transmitter pen having a first output signal transducer and a second output signal transducer; Figure 29 is a detailed cutaway view of the pointing tip of a dual signal transmitter pen; W De1k\W,'2971-.99 doc Figure 30 is a partial perspective view of the pointing tip of a dual signal transmitter pen; Figure 31 is schematic view of the transmission of first output signal and a second output signal from a dual signal transmitter pen; Figure 32 shows a repeated dual output signal as it is sent from a dual signal transmitter pen; Figure 33 shows a secondary output signal that includes encoded information which indicates a pen up position and supplementary information; and Figure 34 shows a secondary output signal that includes encoded information which indicates a pen down position and supplementary information.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS Figure 1 is a top view of a single signal transmitter pen 30a located within the writing area 14 of a surface 12, in which the single signal transmitter pen repeatedly sends a time dependent output signal 16 to at least two external receivers 20a, 20b at each of two receiver locations 18a and 18b. The surface is typically a whiteboard, a blackboard, a drafting table, an overhead projector, a projector screen, or any kind of presentation surface. A first incline angle .:oooi 15a is defined between the first receiver location 18a and the direction of transmission of the output signal 16. A second incline angle ?2 15b is defined between the second receiver location 18b and the direction of transmission of the output signal 16.

30 The single signal transmitter pen 30a has a transducer element 28 (FIGS. 5-8) having an output signal 16, which is used to determine the location of the pointing tip 36 (FIGS. 5-7) of the single signal transmitter pen 30a, in relation to the writing NM)el.l 06(2971 99 do area 14 of a surface 12 within a transmitter pen location system 10a,10b,10c.

The output transducer 28 transmits a time dependent output signal 16 from the single signal transmitter pen 30 to the external receivers 20a, 20b at receiver locations 18a and 18b.

The output signal 16, which is repeatedly transmitted from the single signal transmitter pen 30a, typically in a periodic manner, arrives at two or more receiver locations 18, at times which are dependent on the velocity of the output signal 16 and the distance from the transmitter pen 30a to each of the receivers 20a,20b.

In one embodiment, for example, the frequency of the output signal 16 lies within the ultrasound frequency spectrum.

When an output signal 16 arrives at each of the receivers 20a, 20b, the signal 16 is sampled by the signal processor 57 (FIG. such as by an A/D converter at either the receiver locations 18a,18b or the signal processor 57. The sampled signal 16 is then transferred to the signal processor 57 (FIG. The location of the pointing tip 36 (FIGS. 5-7) of the transmitter pen 30 is then determined by the signal processor 57, by measuring the relative phase difference of the output signal 16 between external receivers 20a, 20b at each receiver location 18a, 18b, •ooes using the difference in the phase of the arriving output signal 16 at each receiver o 20a and 20b to determine the direction of arrival 15a, 15b of the output signal 16 to each of the receiver locations 18a, 18b, and then by determining the location of the single signal transmitter pen 30a, based on the simultaneous calculated directions 15a, 15b to each of the receiver locations 18a, 18b.

o:ooo Figure 2 shows the geometric relationship 21 between a single signal transmitter pen 30a and two external receivers 18, with the calculated (X 1 ,Yl) position 22 of the single signal transmitter pen 30a represented in relation to an X-axis 24 and a o Y-axis 26. The distance da between the first receiver location 18a and the calculated (X 1

,Y

1 position 22 is defined along direction vector 23a. The distance o db between the second external receiver location 18b and the calculated (X 1

,Y

1 position 22 is defined along direction vector 23b. The (X 1 ,Yl) position 22 of the single signal transmitter pen 30a is shown, and is calculated, as the intersection Ii\Nol )elrl¢(?271 -9 do 22 of the first direction vector 23a and the second direction vector 23b within the writing area 14.

Figure 3 is a partial top view of external receivers 20a,20b at receiver locations 18a,18b, which are located on a surface 12. The first receiver location 18a includes a first external receiver 20a and a second external receiver 20b, and includes a signal connection 55a towards a signal processor 57 (FIG. 10). The second receiver location 18b also includes a first external receiver 20a and a second external receiver 20b, and includes a signal connection 55b to the signal 0io processor 57.

Direction of Arrival Transmitter Pen Location Process. The direction of arrival transmitter pen location process (FIGS. 1-4,10), which uses an output signal 16 to locate the single signal transmitter pen 30a relative to the writing area 14 of a white board 12, comprises the following steps: i) sending an output signal 16 from a single signal transmitter pen 30a to a plurality of external receivers 20a, 20b at a plurality of receiver locations 18; ooo i S 20 ii) determining the angle 15a, 15b from each of plurality of the receiver locations 18 to the single signal transmitter pen 30a, based on the difference in phase of the received output signal 16 at the external receivers 20a, 20b; and :°°eoe iii) determining the location of the single signal transmitter pen 30a based upon *O6 the determined angle 15a, 15b from each of the plurality of the receiver locations 18 to the single signal transmitter pen Figure 4 is a perspective view of an alternate embodiment of the direction of arrival transmitter pen location system 10b, in which a single signal transmitter 30 pen 30a is located within a writing volume 14b, and in which the single signal

S

transmitter pen 30a periodically sends an output signal 16 to external receivers and 20b at each of three receiver locations 18a, 18b, and 18c. The V \\N,'l;i\NoDclce {,2)71 .99 doc geometric relationship between the single signal transmitter pen 30a and the receiver locations 18a, 18b and 18c is repeatedly determined, wherein the successive calculated (X,YZ) positions 31a, 31b, 31c of the single signal transmitter pen 30a describe a path 82, in relation to an X-axis 24, a Y-axis 26, a Z-axis 29.

Single Signal Transmitter Pen. Figure 5 is a partial cutaway view of a single signal transmitter pen 30a having an output signal transducer 28, which is used with either the direction of arrival location system 10a,1Ob,10Oc (FIGS. 1,2,4,10) or 0io the time of arrival location system 10d (FIG. 20). While the transmitter pen 30a is described as a pen, it can be any sort of movable transmitter device. The transmitter circuitry 40, connected to the output signal transducer 28 through leads 46a and 46b, excites the output signal transducer 28 to produce an output signal 16. In one embodiment, the output signal 16 pulse train 89 (FIG. 11) has a periodic frequency of 100 pulses per second. It is preferred that the transmitter circuitry 40 include an out-of-phase driving mechanism, which effectively shapes and squelches the output signal 16 to produce a short duration pulsed output signal 16.

Figure 6 is a detailed cutaway view of the pointing tip 36 of a single signal transmitter pen 30a having an output signal transducer 28. Figure 7 is a partial perspective view of the pointing tip 36 of a single signal transmitter pen i o o having a single piezoelectric output signal transducer 28. An optional finger guard 38 protects the output signal transducer 28.

Output Signal Transmission. Figure 8 is schematic view 50 of the transmission of the output signal 16 from a single signal transmitter pen 30a, which is typically an ultrasound output signal 16. The output signal 16 is transmitted from one or more transducers 28 located near the pointing tip 36 of the single signal S30o transmitter pen 30a. In one embodiment, the transducer 28 is a cylindrical

OCCOSC

layered piezoelectric layer 56 surrounded by an outer conductive layer 54a and an inner conductive layer 54b, which is connected to the transmitter circuitry W y De 1c ht\(2971-99 doc by leads 46a and 46b and lead connections 52a and 52b. In another embodiment, the ultrasound transducer 28 used is Part No. AT/R 40-10P, manufactured by Nippon Ceramic Co. Ltd., of Tottori-Shi, Japan. The single signal transmitter pen 30a repeatedly transmits output signals 16, typically periodically, with a period 95 (FIG. 11).

Figure 9 shows a prior shaped pulse waveform 16a and a present, subsequent shaped pulse waveform 16b sent from either a single signal transmitter pen 30a,30b (FIG. 25), or a dual signal transmitter pen 30c (FIGS. 26,28-30). While 0io an ultrasound second output signal 16 can have any waveform shape, including a single ultrasound pulse 72, it is preferred that the waveform be shaped to have a short duration, with distinctive wave characteristics, which allows the waveform to be measured and compared accurately, to provide an accurate calculated position for a transmitter pen 30. In the preferred embodiment shown in Figure 9, the subsequent second output signals 16a, 16b each include two major pulses 72a and 72b, with specific timing between them.

While there are differences between the received amplitude of the subsequent o second output signals 16a and 16b, each of the signals 16 retain major features, 20 such as waveform characteristics 72a,72b, as well as wavelength dependent features, such as peaks 76a, 76b, 76c, and 76d, the position of relative peaks 76, and peak amplitudes. Comparison of these features between subsequent stored ooooo digitized output signals 16a and current output signals 16b allows the calculated transcribed path 82 of a transmitter pen 30 to be accurately determined. As well, the use of distinctive waveform characteristics 72a,72b allows the transmission of other information to be sent from the transmitter pen 30 to the external receivers as discussed below.

Comparison of the present output signal 16b to one or more stored output signals 3o 16a is preferably repeated for all external receivers 20 at each receiver location 18, giving multiple estimates of the time of propagation of the output signal 16b, and different arrays with the stored prior signals 16a.

\*\MIDd,1062971) -99.dOC Figure 10 is a top view 80 of one embodiment of the direction of arrival transmitter pen location system 10c, which shows a calculated transcribed path 82 of a single signal transmitter pen 30a from sequential locations within the writing area 14 of a surface 12. As the single signal transmitter pen 30a is moved by a user across the writing area 14 of the surface 12, the repeated transmission of output signals 16 is received at the external receivers 18. The receivers 18 are connected 55 to a signal processor 57, which calculates successive X-Y locations 84a, 84b,...84n, in relation to a defined X-axis 24 and a Y-axis 26. The 0io successive X-Y locations 84a, 84b,...84n define a path 82 for the single signal transmitter pen 30a. The successive X-Y locations 84a, 84b,...84n, and the defined path 82 can then be stored or transferred by the signal processor 57.

In a preferred embodiment, a functional area 85 is defined within the writing area 14 of the surface 12. Activation of the single signal transmitter pen 30a within the functional area 85 is selectively used to send function commands to either the signal processor 57, or to a computer 87 connected to the signal processor 57.

•Function commands can be used to print the displayed image path 82, save the .*oo image path 82, create a new page, or to control functions on the connected 20 computer 87, such as by activating pull-down menus on a graphic-user interface (GUI) 93 on the connected computer 87.

In another preferred embodiment, a programmable control application 91 within the computer 87 communicates with the signal processor 57, to control system options, such as waveform comparison algorithms, and the desired number of previous output signals 16a to be stored 99 and compared to current output signals 16b. Since the prior output signals 16a are captured and stored in a digital manner, the comparison between prior output signals 16a and current output signals 16b can be efficiently monitored or modified through the 3o programmable control application software 91.

V\ Wwy ',D-hlmy Nl} I\62971-99 doe Figure 11 shows an output signal 16 as it is sent from a single signal transmitter pen 30a,30b. The output signal pulse train 89a is comprised of a repeated transmission of an output signal 16. The repeated transmission of the output signal 16 is typically characterized by a period P 1 Direction of Arrival Transmitter Pen Location Algorithm. In the embodiment shown in Figures 11-13, the ultrasound output signal 16 arrives at each of the external receivers 20a,20b at receiver locations 18 at times which are dependent on the speed of the output signal 16, and the distance between the transmitter 0io pen 30 and receivers 20a,20b. Figure 12 shows the output signal 16 as it arrives at a first external receiver 20a of a first receiver location 18a. Figure 13 shows the same output signal 16 as it arrives at a first external receiver 20a of a second, further receiver location 18b. At each of the receiver locations 18a, 18b, the time of arrival of the output signal 16 is dependent on the distance between the movable single signal transmitter pen 30a,30b and each of the external receivers and 20b. The difference in path length, for the arriving output signal 16 between neighboring receivers 20a,20b, is seen as a shift in phase of the arriving output signal 16, and is analyzed by the signal processor 57 to determine the *.*oo direction of arrival 15a,15b of the output signal 16 to each receiver location 18.

The accuracy of the location of the single signal transmitter pen 30a is therefore dependent on the accuracy with which the signal processor 57 connected to the •external receivers 20 at receiver locations 18 can consistently determine the direction of arrival 15a,15b of the ultrasound signal waveform 16.

Direction of Arrival Location System Signal Processing. Figure 14 is a graph showing a received output signal 16 at external receivers 20a, 20b at a receiver oeoo° S°location 18. Since the external receivers 20a and 20b are slightly offset from each other, the output signal 16 typically defines a slightly different path length to 3o arrive at the external receivers 20a and 20b. The calculated phase difference between the received output signal 16 at external receivers 20a, 20b at receiver location 18a, provides the first incline angle 1 15a. Similarly, the calculated \Notcltc\6,2971-99.doc phase difference 90 between the received output signal 16 at external receivers 20b at receiver location 18b is analyzed by the signal processor 57, and provides the second incline angle ?2 15b. Given the first incline angle 15a and the second incline angle ?2 15b, the X,Y position of the transmitter pen is determined within the two-dimensional writing area 14. For external receiver locations 18a, 18b that are separated by a distance dl, the X,Y position of the transmitter pen 30 is given by: LINESPACE 150 X 1} sin- 2} cos- 1} OVER sin- io and LINESPACE 150 Y 1} sin- 2} sin- 1} OVER sin- It is preferable to space the external receivers 20a, 20b at each receiver location 18 away from each other, which results in a higher precision calculation of the incline angles However, if the external receivers 20a, 20b at each receiver location 18 are spaced apart by a distance greater than one wavelength of the transmitted frequency of the output signal 16, there can be ambiguity in the Sphase shift equal to n*T, where T is equal to the period of the transmitter output 20 signal 16 equal to and n is the number of wavelengths of separation between the external receivers 20a and 20b at each receiver location 18.

Determination of the number of full cycle shifts that exists between received output signals 16 at separated external receivers 20a and 20b is accomplished 25 by the signal processor 57 (FIG. 10). While there are differences between the received amplitude of the output signals 16 at neighboring external receivers at each receiver location, each of the signals 16 retain major features, such as waveform characteristics 72a,72b, as well as wavelength dependent features, such as peaks 76a, 76b, 76c, and 76d, the position of relative peaks 76, and peak amplitudes. Comparison of these features between digitized output signals 16 at neighboring receivers 20a,20b allows the direction of arrival 15a,15b of a second output signal 16 to be accurately determined.

W \M;i:v\NoDclcc\62971-99 doc While the above approach allows the phase difference to be measured with an accuracy of ±1 sample, resolution can be further improved to better than ±1 sample. Figure 15 and Figure 16 show a typical system configuration, where the arrival of the output signal 16 at the first external receiver 20a lags the arrival of the output signal 16 at the second external receiver 20b by multiple wavelengths.

Assuming that the output signals 16 x 1 and x 2 at receivers 20a and 20b, as shown in Figure 15 and Figure 16, are approximated as sine waves with io amplitude modulation. The approach described above gives delta as the phase difference approximation between x 1 and x 2 Letting x 2 x 2 the signal processor 57 can calculate the additional phase difference correction o as: LINESPACE 150{{ FROM 0} TO nperiods} 1} t x_{ 2} V (t)dt}OVER{{ }FROM 0}TO{ nperiods} (t) dt} arccot( (3) Figure 17 is a perspective view showing changes in transmitter pen orientation in relation to external receiver locations 18a, 18b, which can significantly alter the received waveform of the output signal 16 as it arrives at receiver locations 18,118. As discussed above, the amplitude of the incoming waveform 16 can change significantly from the distance to each of the receiver locations 18a, 18b.

Other factors also contribute to the attenuation of the output signal 16, including the angular orientation 98a, 98b between the transmitter pen 30 and the external receivers 20, the angle 96 of the inclined movable transmitter pen 30 against the surface of the writing area 14, the axial rotation 97 of the transmitter pen 30, and even the available source power to the output circuitry 40 within the transmitter pen 30. Figure 18 a top view showing the directional reception characteristics 99a, 99b of one embodiment of external receivers 20a, 20b at receiver locations 18a, 18b. The external receivers 20a, 20b within receiver locations 18a, 18b are typically placed at an angle of approximately 45 degrees in relation to a rectangular writing area 14, to improve signal detection of the second output signal 16.

WAN.r0v\NDoI)clcic6271-99.doc The direction of arrival transmitter pen location system 10a,10b,10c can accurately determine the location of the transmitter pen 30, even when the output signal 16 is significantly attenuated. The direction of arrival transmitter pen location system 10Oa,10Ob,10Oc includes simultaneous output signals 16a arriving at closely spaced external receivers 20a, 20b at each receiver location 18. While the output signal 16 is commonly attenuated, as discussed above, attenuation characteristics are similar between the output signal as it received at closely spaced external receivers 20a, 20b. Therefore, the comparison of the received output signal 16 to calculate of direction of arrival yields accurate results.

As well, in a preferred embodiment, the direction of arrival transmitter pen location system 10a,10b,10c advantageously stores one or more prior signals 16a for each external receiver 20a, 20b, allowing the comparison of a large number of features between the current second output signal 16b and one or more prior second output signals 16a for each external 20a,20b.

Since the current output signal 16b and one or more stored prior output signals I 16a are typically normalized to each other, and since detailed features between the current output signal 16b and one or more stored prior output signals 16a can be used for comparison, attenuation of the incoming signals 16 does not prevent the direction of arrival transmitter pen location system 10a,10b,10c from •accurately determining the X,Y position of the transmitter pen In contrast, prior art analog systems that rely on the comparison of a limited number of measured amplitudes of a limited number of points, such as the measured amplitudes of bursts or peaks, or an average of a limited number of peaks, will commonly fail to find a valid data point for a movable pointer, particularly when consecutive output pulses are attenuated differently. This results either in erroneous positions typically by missing a desired signal peak), or in requiring that position points are not used in the described path of a movable pointer, resulting in an inaccurate or erratic described path.

lil \'\Nol)I~lL1 -')l).dOC In a preferred embodiment of the digital direction of arrival array transmitter pen location system 10a,10b,10c, the storage of the received signal 16 to memory 158 allows signal processing comparison techniques between the current output signal 16b and the stored waveform 16a to be performed, such as by crosscorrelation methods. An accurate comparison between the features of the present 16b and prior output signals 16a can therefore be made. As the second output signals 16b arrive at the signal processor 57, they are preferably normalized to prior stored signals 16a. When the received second output signals 16b and one or more stored second output signals 16a are normalized to each other, a valid comparison can be made between the normalized output signals 16a, 16b. When the received output signals 16b and one or more stored second output signals 16a have widely varying signal strengths, it is still possible to cross-correlate features between the normalized signals, rather than to compare the amplitude of a limited number of data points.

In addition, preferred embodiments of the direction of arrival transmitter pen location system 10a,10b,10c allow changes to the comparison of features o between the current second output signal 16b and one or more stored prior second output signals 16a. The programmable control application 91 (FIG. 10) is typically controllable and updatable, allowing the signal processor 57 to be updated, and to be easily adapted to different transmitter pens 30, different •surfaces 12, and different external receivers Communication of Supplementary Information. The output signal characteristics of the circuitry 40 and characteristic transmitter output signal 16 can optionally communicate secondary information to the receiver locations 18.

Such supplementary information can include pen activation status, or pen types, such as different colored pens, or for pens of different widths, or even for calculated line types, such as for dashed lines. In systems where more than one user is writing on the white board 12, either sequentially of concurrently, the \l.s v\NoDrlclcX6297 I-99J.doc transmitter pens 30 can optionally communicate the designated user of each transmitter pen Pen Activation. Figure 9 shows a typical output signal 16b for a transmitter pen 30 in a "pen down" position. The output signal 16b is modifiable by the transmitter circuitry 40 to designate different signal states, such as to communicate whether the pen is inactivated in a first "pen up" position, or in an activated second "pen down" position. In Figure 9, the present output signal 16b includes two waveform pulses 72a,72b to designate a "pen down" position. In the io same embodiment, the present output signal 16b typically includes a single ultrasound pulse 72a to designate a "pen up" position.

When the "pen up" signal is received by the external receivers 20, the signal processor 57 determines that the transmitter pen 30 is currently in its "pen up" position. The "pen up" position typically means that the pointing tip 36 of the transmitter pen 30 is not in contact with either the writing area 14 of the surface 12, or with another writing surface placed within the writing area 14, such as a piece of paper.

When the "pen down" signal is received by external receivers 20, the signal processor 57 determines that the pen 30 is currently in its "pen down" position, and the directions of arrival 15a,15b of the pen 30 are also determined. The "pen •down" position 68b typically means that the pen tip 36 is in contact with either the writing area 14 of the surface 12, or with another writing surface placed within the 0 25 writing area 14, such as a piece of paper.

0iC As the transmitter pen 30 is moved along a path 82 in the pen-down position, a ooooe series of output signals 16 are received at the external receivers 20, from which successive directions of arrival are calculated, and subsequently X-Y coordinates 3o are determined, to produce a representation of the path 82 of the transmitter pen In some embodiments, the position of the transmitter pen 30 is also calculated when the transmitter pen is not in contact with the writing area 14.

W NI., \N,Ddl-clc,2971 I-99.d- Calculated Pen Attributes. The transmitter circuitry 40 in the transmitter pen preferably communicates pen attributes, and can include switching or continuous adjustment control to produce a transmitter signal 16 indicative of different pen attributes. For example, a transmitter pen 30 which contains a single writing tip 36 having one color of ink, such as black ink, may be selectively adjusted by the user to produce an output signal 16 that corresponds to drawn paths 82 of varying colors, widths, or line styles. While the user draws or writes upon a writing surface 14, such as a white board 12, displaying a black path 82 (FIG.

10), such as figures or letters, the transmitted and processed signal for the path 82 is dependent upon the pen characteristics chosen by the user.

While Figure 9 shows an output signal 16 that indicates a pen down position, using a two waveform pulses 72, the addition and spacing of waveform pulses 72 are preferably used to communicate encoded supplementary information, such as designated color, width, line type, or author.

In the output signal 16 shown in Figure 9, the time between multiple waveform pulses 72 spans a time that is specific to a particular pen color. For example, a 0 20 first time delay between the waveform pulses 72 can specify a pen color of black, while a second time delay between the waveform pulses 72 can specify a pen color of blue.

Direction of Arrival Transmitter Pen Location System Advantages. The direction of arrival transmitter pen location system 10a,10b,10c offers significant advantages over prior art location methods. The use of an improved process for calculating the phase difference between arriving output signals 16 allows the directions of arrival 15a,15b to be determined accurately, and allows the transmitter pen 30 to have a single transmitter 28.

Self Calibration. The distance d, 17 (FIG. 1) between receiver locations 18 can either be set once, such as for receiver locations 18 that are mounted a fixed l '\NolD0,1C1,\971-99 do distance from each other, or can be periodically set, such as for receiver locations 18 that can be remounted at different positions. The distance d, between fixed receiver locations 18 can be stored within the signal processor 57, such as for manufactured transmitter pen 30 and board systems 10 in which the distance between fixed receiver locations 18 is controlled by the design of the surface 12.

Figure 19 is an alternate embodiment of the transmitter pen location system in which the receiver locations 18a,18b are movable, wherein a calibration transmitter 92 is added at one receiver location 18b, providing automatic self- 0io calibration for the system 10d. An auto-calibration transmission signal 94 is sent from the receiver location 18b, and is received at another receiver location 18a.

The signal processor 57 analyzes the incoming auto-calibration transmission signal 94, and determines the distance d, between the receiver locations 18a,18b. A wireless connection is provided between the receivers 18a,18b and the signal processor 57, wherein information data signals 160a,160b are transmitted from the receiver locations 18a,18b to the signal processor 57.

Alternate Embodiments for Direction of Arrival Transmitter Location System. The direction of arrival transmitter pen location system 10a, 10b,10c 20 can also be adapted to larger writing areas 14. In basic embodiments, the period between subsequent output signal pulses 16 is determined by the largest distance across the writing area 14.

In an alternate, large white board embodiment 10f shown in Figure 24 and Figure 25 25, the single signal transmitter pen 30b includes a pen receiver 144, and the surface 12 includes a white board transmitter 102, which in this embodiment is shown next to one of the receiver locations 18b. As the transmitter pen reaches the periphery of the writing area 14, the signal processor 57 determines that the single signal transmitter pen 30b is far from one or more of the receiver locations 18. The increased distance requires a longer period between subsequent output signals 16. In this event, the signal processor 57 sends a return signal 104 to the transmitter pen receiver 144 through the white board W'\lu \'\W.,l.0NMcM ,62971-99.d transmitter 102. The signal circuitry 40 within the single signal transmitter pen then controllably lowers the frequency of transmission of output signals 16, in response to the return signal 104.

Lowering the transmitted frequency of the single signal pulse train 89a allows each of the output signals 16 to reach the furthest of each of the external receiver locations 18 before the transmission of a subsequent output signal 16, so that there is no overlap of information between receipt of the output signals 16. While the extended period between output signals 16 allows less frequent updates of io the location of the movable single signal transmitter pen 30b, the large area system 10e allows the single signal transmitter pen 30b to be located accurately over a large writing area 14.

Time of Arrival Transmitter Pen Location System. Figure 20 is a top view of a time of arrival transmitter pen location system 10e, which shows the geometric relationship between a single signal transmitter pen 30a,30b and three or more external receiver locations 18a,18b,18c, each having a single external receiver In the time of arrival transmitter location system 10e, the position of the oo** single signal transmitter pen 30a,30b is calculated as the intersection of three arc lengths 101a, 101b and 101c. By using three or more receiver locations 18a,18b,... 18n, one of the signal paths 16 acts as a relative starting point for the other signal paths 16.

Since the output signal 16 can be attenuated differently as it arrives at each of the external receiver locations 18a,18b,18c, as seen in Figure 9, the signal processor 57 preferably compares repeatable reference points 77 (FIG. 9) between present signals 16b arriving at each receiver 18a, 18b,18c and one or •more stored prior output signals 16a for each receiver 18a, 18b,18c. Any repeatable reference point 77 on the output ultrasound signal waveform 16 is sufficient to compare a present output ultrasound signal waveform 16b arriving at an receiver location 18 to a stored prior output ultrasound signal waveform 16a arriving at the same receiver location 18b, as long as the repeatable reference [)cl0le 6297 1-99.d, point 77 is consistently identified on the current output ultrasound signal waveform 16b and on the stored prior output ultrasound signal waveform 16a.

In Figure 9, the crossing time threshold 73 indicates a starting point for the repeated ultrasound output signals 16. In time of arrival transmitter pen location system 10e, it is preferred to use a linearly decaying ultrasound threshold 73, since the amplitude of the ultrasound signal 16 falls off like 1/r with distance. At times tl, t2, tN, where N equals the number of receiver locations 18 (where N as shown in Figure 20, the ultrasound signal 16 is received at three or more 0io external receiver locations 18.

The signal processor 57 finds a repeatable reference point 77 on the ultrasound output signal 16a, 16b, which in one embodiment lies between the threshold crossing 73 and the second peak 76b. In Figure 9, a threshold value 75 of volts is used to determine points along the subsequent output signals 16a, 16b.

As seen in Figure 9, the first point along the first output signal 16a to cross the threshold value is located along the first peak 76a. In contrast, the first point along the second output signal 16b to cross the threshold value 75 is located along the second peak 76b. Since subsequent output signals 16a, 16b typically 2o have different amplitudes, arbitrary measurement of a threshold 75 to determine a reference point 77 can yield differences between subsequent signals 16 on the order of a wavelength.

To provide a more accurate repeatable reference point 77 on the present ultrasound output signal 16b that lies between the threshold crossing 73 and the second peak 76b, the signal processor 57 preferably stores a prior output signal 16a, and compares repeatable features between the present second output •signal 16b and the stored prior second output signal 16a. Repeatable features that are distinguishable typically include the shape of major peaks 72a, 72b and minor peaks 76a, 76b, interpeak spacing, and the relative amplitude of the major peaks 72a, 72b and minor peaks 76a, 76b.

\N )elL62 9 71-99.do Since the prior output signal 16a is preferably stored, any or all features can be analyzed and compared, to determine an accurate repeatable reference point 77.

Even the combined relationship between sets of features can be compared. In a preferred embodiment, the current output signal 16b and one or more stored prior output signals 16a are energy-normalized, such that individual peaks 72, 76 are fit to each other between the current output signal 16b and the stored prior output signals 16a. The normalized output signals are then compared for features that do not depend on the amplitude of separate points on the signals 16a, 16b, but on the relationship between features.

In the example shown in Figure 9, the signal processor 57 adjusts the actual threshold crossing on peak 76b on the present output signal 16b by the period of one wavelength, to establish an adjusted threshold crossing 77 that is consistent with the features of the stored signal 16a. In this manner, the signal processor 57 preferably uses the previously received and stored pulse 16a, from the same external receiver location 18 to determine the repeatable reference point 77 on the current ultrasound signal 16b.

.:oooi I This preferred comparison is performed for the present output signal 16b and the 2o prior output signal 16a for each of the receiver locations 18a,18b,18c. As the arriving second output signal 16 is typically attenuated differently as it is transmitted and sent to different receiver locations 18, the output signal 16a is preferably stored 99 for each external receiver 20 at receiver locations 18, to provide an accurate comparison for subsequent output signals 16 arriving at each 25 external receiver The current ultrasound signal 16b for each receiver location 18, together with the •detected start of the signal reference points 73 and repeatable points 77, are then S"stored within memory 99 for analysis of subsequent output signals 16. For each 0 receiver location 18, one or more prior signals 16a, with reference points 73,77, can be used to determine repeatable features 77 of the current output signal 16b.

W' N;ll )CIce6297I -99 doc However, a limited number of previous ultrasound signals 16a from each receiver location 18 are typically stored, to conserve memory space within memory 99.

This is repeated for all N receiver locations 18, giving N 3 estimates of the time of propagation of the second output ultrasound signal 16b. The N 3 output signals 16b, along with associated reference points 73,77, are then stored within memory 99 as prior output signals 16a, for the analysis of subsequent output signals 16b.

The comparison of the currently received output signal 16b to previously received io and stored output signals 16a results in consistent time values, which yield consistent pen location values 84a, 84n that define a smooth path 82 (FIG.

Time of Arrival Transmitter Pen Location Algorithm. In the time of arrival transmitter pen location system 10e, each signal period is started and is defined by the transmission of an ultrasound waveform 16. Figure 21 shows an ultrasound pulse train signal 16 as it is received at a first receiver location 18a at time t, in a time of arrival phase array ultrasound system 10d. Similarly, Figure 22 shows the ultrasound pulse train signal 16 as it is received at a second 20 receiver location 18b at time t 2 and Figure 23 shows the ultrasound pulse train signal 16 as it is received at a third receiver location 18c at time t 3 The relative time for the ultrasound signal 16 to arrive at the three receiver locations 18a,18b,18c provides an X-Y location of the single signal transmitter pen 30a,30b. Times tj, t 2 and t 3 are calculated, in terms of a and b (FIG. 20), which 25 are then used to calculate the X-Y location of the single signal transmitter pen 30a,30b. Time t 2 is given by: 2} 2 D{ 2} a{ b{ OVER 2 (a b (4) Similar equations are derived for t, and t 3 From t, and t 2 X and Y values are given by: W:\NM;tu\No Dclcc\(62971-99,doc X 1}A{ 2} OVER 2 D} and Y SQRT 1}A{ 2}-XA{ (6) System Calibration. Small variations in distance D (FIG. 20) between receiver locations 18 can also be calibrated by the signal processor 57 for the time of arrival transmitter pen location system 10d. This can be useful for many conditions, such as for the variation of the speed of sound in different ambient environments temperature, barometric pressure, relative humidity). From three time estimates (t 1 t 2 t 3 the signal processor 57 calculates the distance between receivers 18 (dcalc) as: dcalc= SQRT 2 2) OVER 2}} (7) If the calculated dcalc is significantly different from the known distance D between i receiver locations 18, the signal processor 57 determines that there is a problem 20 with one or more of the time estimates ti. The signal processor 57 can also average the known distance D with the calculated distance D between receiver locations 18, to adaptively change the value of D.

Combined Direction and Time of Arrival Dual-Signal Transmitter Pen Location System. Figure 26 is a top view of a combined direction and time of arrival dual-signal transmitter pen location system 10g, in which a dual signal transmitter pen 30c is located within the writing area 14 of a surface 12. Figure 27 is a partial top view of a combined direction and time of arrival, dual signal receiver pod located on a surface. The dual-signal transmitter pen 30c has multiple transducer elements 28,128 (FIGS. 28-30), which are used to determine the location of the pointing tip of the dual signal transmitter pen 30c, in relation to W -\M.mno )chl\62971-99 do a writing area 14, or to a writing volume 14, of a combined direction and time of arrival dual-signal transmitter pen location system 1Of.

The primary output transducer 28 transmits a primary output signal 16 from the dual signal transmitter pen 30b to external receivers 20a,20b at the receiver location 118. In one embodiment, the primary output signal sensors 28 are ultrasound sensors, Part No. AT/R 40-10P, manufactured by Nippon Ceramic Co.

Ltd., of Tottori-Shi, Japan. In this embodiment, the primary output transducer 28 on the transmitter pen 30 is an ultrasonic transmitter 28.

A secondary output element 128, preferably an electromagnetic or infrared transmitter 128, transmits a secondary output signal 128 from the dual signal transmitter pen 30b to a secondary output signal receiver 120 (FIGS. 26,27) at a combined receiver location pod 118. In one embodiment, the secondary output signal receiver 120 is an infrared photodiode, Part No. SFH 205FA, manufactured by Siemens Microelectronics, Inc., of Cupertino, California.

Transmitter Pen. Figure 28 is a partial cutaway view of a dual-signal transmitter pen 30b having a primary output signal transducer 28 and a secondary output 20 signal transducer 128 While the dual-signal transmitter pen 30b is described as a pen, it can be any sort of movable transmitter device. The transmitter circuitry connected to the secondary output signal transducer 128 through leads 42a and 42b, excites the secondary output signal transducer 128, to produce a secondary output signal 116. The transmitter circuitry 40 is also connected to the primary output signal transducer 28 through leads 46a and 46b, and excites the primary output signal transducer 28, to produce a primary output signal 16. In one embodiment, the primary output signal 16 pulse train has a periodic frequency of 100 pulses per second.

Figure 29 is a detailed cutaway view of the pointing tip 36 of a dual-signal transmitter pen 30c having a first output signal transducer 28 and a secondary output signal transducer 128. Figure 30 is a partial perspective view of the \V 1cDO 62 971-99.do¢ pointing tip 36 of a dual-signal transmitter pen 30c having a plurality of secondary output signal transducers 128 and a single piezoelectric primary output signal transducer 28. An optional finger guard 38 protects the secondary output signal transducers 128 and the primary output signal transducer 28.

Combined Output Signal Transmission. Figure 31 is schematic view of the transmission a dual signal pulse train 89b from a dual signal transmitter pen comprising a repeated first output signal 16 having a period P 1 95, and a repeated second output signal 116 having a period P 2 105. Figure 32 shows a repeated dual output signal pulse train 89b as it is sent from a dual signal transmitter pen The first output signal 16, as described above for the single signal transmitter pen 30a,30b is typically an ultrasound output signal 16, which is transmitted from one or more ultrasound transducers 28 located near the pointing tip 36 of the dual signal transmitter pen 30c. In one embodiment, the ultrasound transducer 28 is a cylindrical layered piezoelectric layer 56 surrounded by an outer conductive layer 54a and an inner conductive layer 54b, which is connected to the transmitter circuitry 40 by leads 46a and 46b and lead connections 52a and 52b. In another 2o embodiment, the ultrasound transducer 28 used is Part No. AT/R 40-10P, manufactured by Nippon Ceramic Co. Ltd., of Tottori-Shi, Japan.

**go The second output signal 116 is typically an infrared output signal 116, which is transmitted from one or more infrared transducers 128 located near the pointing tip 36 of the dual signal transmitter pen 30c. In one embodiment, the infrared transducers 128 are Part No. SFH426, manufactured by Siemens Microelectronics, Inc., of Cupertino, California. While only one infrared transducer 128 is required, the use of more than one infrared transducer 128 is preferred, since it allows better line-of-sight transmission of the second output signal 116 to the dual signal receiver pod 118, such that the dual signal transmitter pen 30c can be rotated by the user.

"V NoDclIl',2971 99.'doc Dual Signal Transmitter Pen Location Process. The dual signal transmitter pen location process, which uses a repeated transmission of a first output signal 16 and a second output signal 116 to locate the dual signal transmitter pen relative to the writing area 14 of a surface 12, comprises the following steps: i) sending a first output signal 16 having a first time of propagation from the dual signal transmitter pen 30c repeatedly to at least two first signal receivers 20a,20b at a receiver location 18; 0io ii) sending a second output signal 116, having a time of propagation different from the time of propagation of the first output signal 16, from the dual signal transmitter pen 30b to a second signal receiver 120; iii) determining the distance from the transmitter pen 30 to the receiver location 18, based on the time of arrival of the second output signal 116 at the second output signal receiver, and the time of arrival of the first output signal 16 to at least one of the two first output signal receivers 20a,20b at the receiver location 18;

S.

S ee 20 iv) determining the direction of arrival for the first output signal 16 between the 0: dual signal transmitter pen 30c and the receiver location 18, based on the phase difference of the second output signal 16 at each of the second signal receivers 20a,20b at the receiver location 18; and Soo* *006 v) determining the location of the transmitter pen 30, based upon the determined distance from the transmitter pen 30 to the receiver location 18, and upon the determined direction of arrival of the first output signal 16 between of the dual signal transmitter pen 30b and the receiver location 18.

eee In most embodiments, the first output signal 16 is attenuated similarly as it arrives at each of the first output signal receivers 20a,20b at the dual signal receiver location 118, which allows an accurate determined direction to be calculated, as \NoDcc. e\2971-99.do described above for the single signal direction of arrival transmitter pen location system 10a,10b,10c. As in the single signal transmitter pen location system 10a,10b,10c, the dual signal transmitter pen location system 10g preferably stores 99 (FIG. 26) the received first output signals 16b received at each of the first signal receivers 20a, 20b, typically replacing the prior first output signals 16a, whereby the process is repeated for the next received first output signal 16b. In another preferred embodiment, precision is improved further, by storing more than one previous first output signal pulse 16, and by comparing the incoming first output signal 16b to a plurality of prior first output signals 16a.

Supplementary Information with the Dual Signal System. The output signal characteristics of the circuitry 40 and characteristic transmitter output signals 16, 116 can optionally communicate secondary information to the external receivers 20a,20b,120. Such supplementary information can include pen activation status, Is or pen types, such as different colored pens, or for pens of different widths, or even for calculated line types, such as for dashed lines. In systems where more than one user is writing on the writing area 14 of the surface 12, either sequentially of concurrently, the transmitter pens 30c can optionally communicate the designated user of each transmitter pen As discussed above for single signal transmitter pens 30a,30b, the first output S. signal 16 can be modified to transmit supplementary information. In addition, the second output signal 116 can be modified to transmit supplementary information.

Figure 33 shows a second output signal 116 that includes encoded information 126 which indicates a pen up position 129a and supplementary information 126c- 126e. Figure 34 shows a second output signal 116 that includes encoded information 126 which indicates a pen down position 129b and supplementary information 126c-126e. Figure 33 shows a secondary output signal 116 that indicates a pen up position 129a, using a single pulse 126a, and encoded .30 supplementary information 126c-126e. Figure 34 shows a secondary output signal 116 that indicates a pen down position 129b, using two pulses 126a and 126b, and encoded supplementary information 126c-126e. In Figure 33, the V:\N Us N No IDclc1\62971 -99.doc secondary output signal 116 includes a single infrared pulse 126a within time window 131a to designate a "pen up" position 129a. In the same embodiment, the first output signal 116 includes two closely spaced infrared pulses 126a and 126b to designate a "pen down" position 129b, as shown in Figure 34. The supplementary information 126c-126e provides bit information, which defines pen characteristics, such as designated color, width, line type, or user identification author).

In the embodiment shown in Figure 33 and Figure 34, a timeline 124 is broken up 0io into discreet windows 131a-131d, wherein the presence or absence of an infrared pulse 126c-126e indicates a binary or which can be combined with pulses within other windows 131a-131d along the timeline 124, to specify a pen color or type. In this manner, the presence of an infrared signal pulse 126 within a window 131 is identified as a bit within a number.

For example, in a three-bit number, three windows 131b-131d of 25-50 ms, 50-75 ms, and 75-100 ms are used to specify pen color. In this embodiment, the first window 131a of 0-25 ms is used to start the secondary output signal 116, in relation to the primary ultrasound signal 16 within a signal pulse train 89b.

In this embodiment, the three-bit number is chosen to represent pen color or type. Binary signals specify this supplementary information 1= black; 2= o red; 3= green; 4= blue). In the example shown in Figure 33, the binary number for the 25-50 ms window 131b is a the binary number for the 50-75 ms 25 window 131c is a and the binary number for the 75-100 ms window 131d is a This yields a binary number of "011", or a which specifies a pen color of green for a dual signal transmitter pen 30c in an "up" position 129a. The same "green" transmitter pen 30c is shown in the down position 129b in Figure 34.

Although the transmitter pen location system 10 and its methods of use are o described herein in connection with computer input systems, the techniques can be implemented for other control or display devices, or any combination thereof, as desired.

\V :\Nry'\No Dclcle \62971 -99.do Accordingly, although the invention has been described in detail with reference to a particular preferred embodiment, persons possessing ordinary skill in the art to which this invention pertains will appreciate that various modifications and enhancements may be made without departing from the spirit and scope of the claims that follow.

C*

S

S

o W \MIari\\NoDclcc\62971 -99.doc

Claims (58)

1. A transmitter location system, including: at least three external receivers; a time dependent output signal being transmitted repeatedly from a movable transmitter to each of said external receivers, wherein time to reach each of said external receivers defines a distance between said movable transmitter and each of said external receivers; and means for determining location of said movable transmitter, based upon said distance between said movable transmitter and each of said external receivers, and a comparison between said output signal and a stored prior output signal.

2. The transmitter location system of Claim 1, wherein said time dependent output signal is an ultrasound signal. .oeoo) 20 3. The transmitter location system of Claim 1 or 2, wherein said time 9* dependent output signal contains encoded information regarding said movable transmitter. e.e

4. The transmitter location system of Claim 1, wherein said encoded e information includes a determined color of said movable transmitter. The transmitter location system of Claim 1, wherein said encoded information includes a determined line width of said movable transmitter. 3o 6. The transmitter location system of Claim 1, wherein said encoded information includes a determined line style of said movable transmitter. ('\NoDcl-lF\62971-99 doc

7. The transmitter location system of Claim 1, wherein said encoded information includes a user identification of said movable transmitter.

8. A location system, including: a surface having a writing area, at least three external receivers, and a signal processor; a movable device adapted to be located within said writing area of said surface, said movable device adapted to send a time dependent output signal repeatedly from said movable device to each of said external receivers; and a signal processor connected to each of said external receivers, said signal processor determining distance between said movable device and said external receivers based on time of arrival of said output signal to said external receivers and a comparison between said output signal and a prior output signal, and determining said location of said movable device, based upon said calculated distance between said movable device and 20 each of said external receivers.

9. The location system of Claim 8, wherein said output signal is an ultrasonic output signal.

10. The location system of Claim 8 or 9, wherein said output signal has a first signal state and a second signal state.

11. The location system of Claim 10, wherein said movable device is located in a transmitter pen, wherein said first signal state corresponds to a pen up 30 position of said transmitter pen, and wherein said second signal state corresponds to a pen down position of said transmitter pen. \\W\M.1r\No Deletc\b2971-99,doc

12. The location system of Claim 8, wherein said output signal contains encoded information regarding said movable device.

13. The location system of Claim 12, wherein said encoded information includes a determined color of said movable device.

14. The location system of Claim 12, wherein said encoded information includes a determined line width of said movable device.

15. The location system of Claim 12, wherein said encoded information includes a determined line style of said movable device.

16. The location system of Claim 12, wherein said encoded information includes a user identification of said movable device.

17. A process for calculating a location of a transmitter pen relative to a writing area of a surface, including the steps of: sending a time-dependent output signal from said transmitter pen to at 20 least three external receivers; comparing said output signal received at each of said external receivers to .5*t a stored prior second output signal received at each of said external receivers to determine a time of arrival of said output signal at each of said 25 external receivers; determining a distance from said transmitter pen to each of said external receivers based on said determined time of arrival of said output signal at each of said external receivers; and Nl;)\N Dclcc\62971 I-99.do determining the location of said transmitter pen based upon said determined distance from said transmitter pen to each of said external receivers.

18. The process of Claim 17, wherein said output signal is an ultrasonic output signal.

19. The process of Claim 17 or 18, wherein said output signal has a first signal state and a second signal state. The process of Claim 19, wherein said first signal state corresponds to a pen up position of said transmitter pen, and wherein said second signal state corresponds to a pen down position of said transmitter pen.

21. The process of Claim 17, wherein said output signal contains encoded information regarding said transmitter pen.

22. The process of Claim 21, wherein said encoded information includes a determined color of said transmitter pen. S23. The process of Claim 21, wherein said encoded information includes a determined line width of said transmitter pen.

24. The process of Claim 21, wherein said encoded information includes a determined line style of said transmitter pen. The process of Claim 21, wherein said encoded information includes a user identification of said transmitter pen.

26. A location system between a movable device and a receiver location, including: DcIC\62971- I99.doC a first output signal having a first speed of propagation, said first output signal being transmitted repeatedly from said movable device to a plurality of first signal receivers at said receiver location, wherein time to reach each of said first signal receivers is dependent on a distance between said movable device and each of said plurality of first signal receivers; a second output signal having a second speed of propagation different from said first speed of propagation of said first output signal, said second output signal being transmitted repeatedly from said movable device to a second signal receiver at said receiver location; and means for determining location of said movable device, using said first output signal received at said plurality of first signal receivers to determine a direction of arrival of said first signal to said receiver location, and using said second output signal to calculate distance from said movable device to said receiver location.

27. The location system of Claim 26, wherein said received first output signal is compared to a stored prior said first output signal.

28. The location system of Claim 26, wherein said means for determining location of said movable device uses a stored prior transmitted said first output signal to calculate distance from said movable transmitter to each of said plurality of first signal receivers.

29. The location system of Claim 26, 27 or 28, wherein said means for determining location of said movable device is programmable.

30. The location system of Claim 26, wherein said first output signal includes a repeatable feature, and wherein said means for determining location of said movable device compares said repeatable feature of said first output signal and a stored prior transmitted said first output signal. \W\NI.L,\No[)clcc\62971-99 do

31. The location system of Claim 26, wherein said means for determining location of said movable device normalizes said first output signal and a stored prior transmitted said first output signal.

32. The location system of any one of Claims 26 to 31, wherein said second output signal is an electromagnetic output signal.

33. The location system of any one of Claims 26 to 31, wherein said second output signal is an infrared output signal.

34. The location system of any one of Claims 26 to 32, wherein said second output signal has a first signal state and a second signal state. The location system of Claim 34, wherein said movable device is a transmitter pen, wherein said first signal state corresponds to a pen up position of said transmitter pen, and wherein said second signal state corresponds to a pen down position of said transmitter pen.

36. The location system of Claim 26, wherein said second output signal 20 contains encoded information regarding said movable device.

37. The location system of Claim 36, wherein said encoded information .o includes a determined color of said movable device. 25 37. The location system of Claim 36, wherein said encoded information includes a determined clne widthor of said movable device. 0oo00 S38. The location system of Claim 36, wherein said encoded information includes a determined line widthle of said movable device.

39. The location system of Claim 36, wherein said encoded information includes a determined line style of said movable device. The location system of Claim 36, wherein said encoded information includes a user identification of said movable device. W:\NI.,.\NoDetc\297 1-99 doc 43

41. The location system of Claim 26, wherein said first output signal is an ultrasound transmission signal.

42. The location system of Claim 26, further comprising: a wireless connection between said receiver location and said means for determining location of said movable device.

43. The location system of Claim 36, further comprising: a defined functional area, whereby movable device is selectively activated to send functions to a computer.

44. The location system of Claim 36, wherein said first output signal contains encoded information regarding said movable device. The location system of Claim 44, wherein said encoded information includes a determined color of said movable device. ooooo 20 46. The location system of Claim 44, wherein said encoded information S• includes a determined line width of said movable device.

47. The location system of Claim 44, wherein said encoded information includes a determined line style of said movable device.

48. The location system of Claim 44, wherein said encoded information includes a user identification of said movable device.

49. A process for calculating a location a movable device relative to a surface, including the steps of: N\ k v \NdA)Ck02971 99 d.c repeatedly sending a first output signal having a first speed of propagation from said movable device to at least two first signal receivers at a receiver location; repeatedly sending a second output signal having a second speed of propagation different from said first speed of propagation of said first output signal from said movable device to a second signal receiver at said receiver location; determining a distance from said movable device to said receiver location, based on a time of arrival of said second output signal at said second signal receiver, and a time of arrival of said first output signal to at least one of said first signal receivers at said receiver location; determining a direction of arrival for said first output signal between said movable device and said receiver location, based on said time of arrival of said second output signal at each of said second signal receivers at said receiver location; and 20 calculating said location of said movable device, based upon said *o determined distance from said movable device to said receiver location, and upon the determined direction of arrival of the first output signal between said movable device and said receiver location.

50. The process of Claim 49, further comprising the step of: comparing said first output signal to a prior first output signal. S: 51. The process of Claim 50, wherein said step of comparing compares said first output signal received at each of said plurality of first signal receivers to a plurality of said stored prior first output signals received at each of said D6rv\ND06et\297 1-99.d-¢ plurality of first signal receivers to calculate distance from said movable device to each of said plurality of first signal receivers.

52. The process of Claim 50, wherein said step of comparing said first output signal and said stored prior first output signal is programmable.

53. The process of Claim 50, wherein said first output signal and said stored prior said first output signal include a repeatable feature, and wherein said step of comparing compares said repeatable feature of said first output signal and said stored prior said first output signal.

54. The process of any one of Claims 49 to 53, wherein said surface is a white board.

55. The process of any one of Claims 49 to 54, wherein said second output signal is an electromagnetic output signal.

56. The process of any one of Claims 49 to 54, wherein said second output S: signal is an infrared output signal.

57. The process of any one of Claims 49 to 56, wherein said second output signal has a first signal state and a second signal state.

58. The process of Claim 57, wherein said first signal state corresponds to a pen up position of said movable device, and wherein said second signal state corresponds to a pen down position of said movable device.

59. The process of Claim 49, wherein said second output signal contains i encoded information regarding said movable device. °eee° The process of Claim 59, wherein said encoded information includes a determined color of said movable device. har)\No Dcllo\2971 ;9 do"

61. The process of Claim 59, wherein said encoded information includes a determined line width of said movable device.

62. The process of Claim 59, wherein said encoded information includes a determined line style of said movable device.

63. The process of Claim 59, wherein said encoded information includes a user identification of said movable device.

64. The process of Claim 59, wherein said first output signal is an ultrasound transmission signal. The process of Claim 49, further comprising the step of: providing a wireless connection between said receiver location and a signal processor.

66. The process of Claim 49, further comprising the step of: 20 defining a functional area on said surface, whereby said movable device is S.o°O "**selectively activated to send information to a computer. S

67. The process of Claim 49, wherein said first output signal contains encoded information regarding said movable device.

68. The process of Claim 67, wherein said encoded information includes a determined color of said movable device. S

69. The process of Claim 67, wherein said encoded information includes a determined line width of said movable device. N Dcl e62 971-99. d, The process of Claim 67, wherein said encoded information includes a determined line style of said movable device.

71. The process of Claim 67, wherein said encoded information includes a user identification of said movable device.

72. A location system according to Claim 1, 8 or 26 substantially as hereinbefore described with reference to the accompanying drawings.

73. A process for calculating a location of a movable device relative to a surface according to Claim 17 or 49, substantially as hereinbefore described with reference to the accompanying drawings. DATED: 8 October 2001 PHILLIPS ORMONDE FITZPATRICK Patent Attorneys for: ELECTRONICS FOR IMAGING, INC. W\:\Mir\No )clcltc\62971-99.doc