CN1310122C - Tracking motion of a writing instrument - Google Patents

Tracking motion of a writing instrument Download PDF

Info

Publication number
CN1310122C
CN1310122C CNB00814981XA CN00814981A CN1310122C CN 1310122 C CN1310122 C CN 1310122C CN B00814981X A CNB00814981X A CN B00814981XA CN 00814981 A CN00814981 A CN 00814981A CN 1310122 C CN1310122 C CN 1310122C
Authority
CN
China
Prior art keywords
light
sensor
signal
pen
writing implement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB00814981XA
Other languages
Chinese (zh)
Other versions
CN1599894A (en
Inventor
阿尔卡迪·皮特尔
伊利娅·席勒
谢尔盖·利伯曼
加里·什列皮
伊桑·A·芬克
弗拉基米尔·V·苏巴奇
安德鲁·M·戈德曼
列昂尼德·列兹尼克
西蒙·谢利茨基
马里奥·A·施泰因
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Digital Ink Inc
Original Assignee
Digital Ink Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Digital Ink Inc filed Critical Digital Ink Inc
Publication of CN1599894A publication Critical patent/CN1599894A/en
Application granted granted Critical
Publication of CN1310122C publication Critical patent/CN1310122C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Abstract

Motion of writing instrument is tracked from sensors located in the vicinity. The signals generated from the sensors are processed and used in a wide variety of ways.

Description

Follow the tracks of the equipment of a writing implement position
The application requires application on October 27th, 1999, the U.S. Provisional Patent Application number 60/161752 that is entitled as Electronic Portable Penthat Captures Handwriting and Drawing with IR Sensing PSD BeaconSystem, application on April 10th, 2000, be entitled as the U.S. Provisional Application application in number on September 13rd, 60/195491 and 2000 of Using Handwritten Information, the U.S. Provisional Application number 60/230 that is entitled as Electronic Pen with a Keyboard Template, 912, and be application on August 18th, 1999, the Application No. 09/376 that is entitled as Electronic Portable Pen Apparatus and Method, the rights and interests of 837 part continuation application merge as a reference all.
Technical field
The present invention relates to follow the tracks of the motion of a writing implement.
Background technology
By following the tracks of the motion of a pen, for example when on paper, writing or drawing, can catch and reappear the thing of writing or drawing with electronic method with this pen.Can also follow the tracks of the motion of writing those nibs of not leaving a trace on the surface one.
In the method for some suggestion, the array that the surface that is moved of pen can have a pixel or other sense position, when this pen during in this position each sense position respond.
In other technology, finish this pen tracking by the electronic installation that is embedded on the nib fully.In some design, the pen that is moving is communicated by letter with the static sensor that is independent of this, and uses triangulation algorithm to follow the tracks of this motion.
Summary of the invention
Generally speaking, in one aspect in, feature of the present invention is a kind of method, this method comprises the light that sends from a writing implement that is moving, as this writing implement on a two-dimentional writing surface the position and the indication in path; A sequence signal of representing the light of institute's sensing with two or more these light of sensor sensing and generation; And use a kind of technology, be used to reduce of the influence of the variation edge of light intensity with respect to the variation of the third direction of generation signal.
Enforcement of the present invention can comprise one or more following features.This technology can be based on the conforming optical characteristics that is set to the signal response that strengthens sensor.These lens can be a spherical lens or a non-spherical lens.This sensor can be a photosensitive pixel element arrays or an analog sensor.This technology can be based on the signal algorithm that is produced is handled.This algorithm process can comprise according to and the parameter that interrelates of writing implement to the linearization of this sensor signal response.This technology can be implemented with digital hardware or with mimic channel.This algorithmic technique can also reduce the influence of the variation of light intensity except can effect reduced in size.This signal can divide into groups frame by frame, and this signal processing technology can comprise that the multiframe processing is so that abate the noise.Can with a frequency modulation (PFM) relevant with the speed that produces signal by this sensor should mobile writing implement transmission light, and can be in this modulating frequency with this sensor signal shunt.The bright or state that goes out corresponding to the light of this signal according to this writing implement certainly transmits can be applied to opposite gain each by the signal of shunt.Frame rate can change.Shunting sign in the future can be by the time integration for this.This light that is sent by this writing implement can comprise that is applied in a strong short pulse on this modulating frequency, a phase-locked loop is according to determining this modulating frequency from this sensor signal, and in this strong short pulse continues period, can sample to this sensor signal in the moment of triggering by this phase-locked loop.The feature of the light that is transmitted can be used to carry out between writing implement and sensor synchronously.The light that is transmitted can comprise low frequency modulations cycle and high frequency modulated train of impulses, and can be used to lock a modulating clock with this sensor signal that this high-frequency pulse string interrelates.
Generally speaking, in another aspect, feature of the present invention is a kind of method, this method comprises that the directional patterns that changes along a kind of time sends the light from a writing implement that is moving, be positioned at this light of sensor sensing with two or more different positions of this writing implement apart with two or more, and differ the position of determining this writing implement by detecting by one between the measured signal of these two or more sensors.
According to a scheme of the present invention, a kind of equipment that is used to follow the tracks of the writing implement position is provided, comprise: two or more sensors, described sensor comprises a plurality of pixels, and be set at light sensing that receives the writing implement on the comfortable two-dimentional writing surface and the sequence signal that produces the expression light sensing, be used to determine the position of the writing implement on two-dimentional writing surface, the feature of at least one sensor is, by the instability of a plurality of pixel data outputs of sensor; Optical device is set to the light intensity of enhancing from the light of this writing implement reception; And processor, a part center of gravity that is set at received signal and determines to export by the subarray of a plurality of pixels, this subarray is the center with the pixel that approaches most from the sub-pixel position of the light of writing implement, is used to increase the stability of being calculated from the sub-pixel position of the light of writing implement.
Enforcement of the present invention can comprise one or more following features.The directional patterns that this time changes can comprise a kind of with respect to the rotation pattern of this writing implement at the last X-Y plane that moves.This signal and the signal phase quadrature of launching light along the Y y direction along positive X-direction emission light.
Generally speaking, in another aspect, characteristics of the present invention are equipment, this equipment comprises sensor, be set to the light of reception from a writing implement that is just moving at an X-Y writing surface, this light has the Strength Changes of edge perpendicular to the Z-direction of this writing surface, and optical device, is set to the light intensity of enhancing from this light of this writing implement reception.
Enforcement of the present invention can comprise one or more following features.This optical device can be a spherical lens or a non-spherical lens.This optical device can comprise single spherical lens, and these lens are set at the light intensity of enhancing with the light that receives than wide-angle or long distance or receive at the unfavorable position of this writing implement with corresponding sensor.This optical device can comprise special-purpose lens, is set to the light intensity of enhancing from this light of the lip-deep position reception except that a precalculated position of this X-Y.This optical device can comprise two cylindrical lenses, and one near this sensor, be used for light level project sensor, and another is positioned, and is used to gather the light of Z-direction, another lens have a kind of body around the first lens bending.This algorithm process can strengthen this signal for tilt by this writing implement or with the caused vulnerability to jamming that receives the Strength Changes of light of the distance of this writing implement.This processing can be determined the integer power (integral power) of all signal distributions on this sensor, and calculates a sub-locations of pixels according to half of this integer power position.This processing can be used a polynoimal approximation and calculate a sub-pixel position with approximate maximum position this signal distributions.This calibration process can generate and be used for the parameter that is used in combination with this sensor characteristic.
This calibration parameter can be proofreaied and correct the manufacturing defect of this optical device and this sensor, and this algorithm process can be used a kind of honest triangulation technique so that determine a position of this writing implement.This calibration parameter can be proofreaied and correct the manufacturing defect of this optical device and sensor, and when having determined the coefficient in the polynomial expression during this calibration process, this algorithm process can use multinomial series to determine the position of this writing implement.
Generally speaking, in another aspect, feature of the present invention is a kind of method, this method comprises with a sensing element array received of the sensor light from a writing implement that is moving, read this sensing element according to the order of sequence, so that produce one by the indication of the burst of the light of this element arrays institute sensing, and this element that resets before being read of at least some other elements after each element is read and in this array.
Enforcement of the present invention can comprise one or more following features.This array can comprise a CMOS or CCD position transducer.Before being reset, all elements read all elements.
Generally speaking, in another aspect, feature of the present invention is a kind of method, and this method comprises a sequence three-dimensional position of determining the writing implement that this is moving according to signal.
Generally speaking, in another aspect, feature of the present invention is the combination of a writing implement, comprise an elongated envelope, be set to hand-held, the light source in this shell, and the lens in this shell, be set to reception and send this light to this writing implement apart optical sensors from the light of this light source and via a vacuum path, these lens are set to half reflection.
Generally speaking, in another aspect of this invention in, this light source comprises an array of source of arranging around the axle of this writing implement, and is set to along a direction emission light perpendicular to this.
Enforcement of the present invention can comprise one or more following features.These lens can be set to internal reflection and concentrate this light also to reflect this light emission by a reflective outer surface from these lens.These lens can comprise a columniform body, and this body has a upper face that receives this light, the base circle curved surface with this light reflection light supply sensor.This reflective outer surface can comprise a conical surface that becomes one the 45 definite angle of degree with the longitudinal axis of this writing implement.This light source in this nib can be included in the LEDs that arranges on the circle.
Generally speaking, in another aspect, feature of the present invention is a device, be set in response to a user and exert pressure to a writing surface from this writing implement, this light source is opened and closed, this light source is set, and installs desired amount of pressure and can be greatly interrupts to normally the writing motion that makes this writing implement on this writing surface so that trigger this.
Enforcement of the present invention can comprise one or more following features.This writing implement can comprise a kind of ball pen pen container with a writing tip, and this device can be placed on the end of this pen container away from writing tip.This device can be a switch or a pressure transducer.
Generally speaking, in another aspect, the feature of this invention is a supporter, has a socket, be used to receive at least a portion of this writing implement so that deposit this writing implement, this writing implement and this supporter comprise element separately, the signal that the transmission of enabled wireless and the motion of this writing implement interrelate and according to this signal trace this writes motion.
In enforcement of the present invention, this supporter can be a cap for brush, and may comprise that is set to a clip that this supporter is attached to a stacker or a notebook.This supporter can comprise at least two optical sensors and a processor, this processor processing from the signal of this optical sensor so that determine a sequence location of this writing implement.This supporter can comprise that the battery that a socket is used for holding this writing implement and making this writing implement can recharge.
Generally speaking, on the other hand, feature of the present invention is a kind of element, signal that the transmission of enabled wireless and the motion of this writing implement interrelate and according to this signal trace this writes motion, this element is embedded into a cell phone, a PDA, a WEB personal digital assistant or the board that folder is arranged.
Generally speaking, in another aspect, the feature of this invention is a supporter, has a kind of being used for this supporter is attached to a mechanism of writing base plate along a direction, make this element can with this wireless transmission together with use.This clip mechanism can comprise a switch that activates the function of the processor in this supporter when this clip mechanism of operation.
Generally speaking, in another aspect, feature of the present invention is a supporter, comprises a socket and a recharging circuit that is connected that is used for this writing implement, is used for battery being charged again during at this socket when this writing implement.
Generally speaking, in another aspect, the feature of this invention is a kind of cmos sensor, be applicable to and receive the light that the motion with a writing implement interrelates, and be applicable to the signal that is provided for indicating the angle that receives with respect to a known direction light, and lens, be positioned so that the light that receives is aimed at this CMOS array.
In enforcement of the present invention, these lens can be for gathering from the light in the zone that motion took place of this writing implement and being optimised.These lens can be a field lens or a Fresnel lens.This lens combination can be set to along one and gather light perpendicular to the direction of this writing implement plane of movement, and along the direction parallel with this plane of movement with this ray cast to this sensor.
Generally speaking, in another aspect, feature of the present invention is to proofread and correct, by with the continuous position on the writing surface being writing implement location, the light that receives from this writing implement that is in this continuous position generates signal at sensor, and being defined as the calibration parameter that this writing implement is identified for calibrating a kind of processing, this processing is used for determining its position when this writing implement moves.
In enforcement of the present invention, this calibration parameter can comprise the coefficient that uses in the multinomial series, and this multinomial series is used for the part that processing is determined in this position.
In enforcement of the present invention, this position is not on the regular rectangular shape grid.
Generally speaking, in another aspect, feature of the present invention is that (1) is discerned on a writing surface corresponding to the position that will be imported into the input element in the electronic installation, this writing surface be non-electronics and be independent of this electronic installation, (2) use a writing implement so that point touches in the position of being discerned those corresponding to the select location of the input element that will be transfused to, and this position of (3) sensing, touched by point and should corresponding data be input in this electronic installation at this writing implement of this position.
In enforcement of the present invention, this writing surface comprises a piece of paper, and this input element is included in the character or the order of the language of printing on this writing surface.
Generally speaking, in another aspect, feature of the present invention is to move a writing implement so that indicate a path on a non-electronic writing surface, and this path of far-end sensing, and produces and be used for this path is input to a signal in the electronic installation that is independent of this writing surface.
Generally speaking, in another aspect, feature of the present invention is with preset frequency modulation light, this light is to send light activated element with this writing implement apart to from a writing implement that is moving, and uses a phase-locked loop that interrelates with this sensor so that lock the phase place of this modulated light.
Generally speaking, in another aspect, feature of the present invention is, circuit is followed the tracks of the circuit of this writing implement by using transmission of wireless signals between a writing implement and the static cell, and this static cell comprises a primary processor and an independent pretreater, this pretreater is connected, be used for carrying out at least the data acquisition about the motion of this writing implement, this primary processor is connected, and is used for carrying out at least the data communication about this tracking.
In enforcement of the present invention, this pretreater can also be connected so that carry out user interface capabilities and sub-pixel data storage, and background is eliminated and sub-pixel calculates so that carry out and this primary processor can also be connected.
Generally speaking, in another aspect, feature of the present invention is a reflecting element, and this reflecting element is set to the light that will receive from this writing implement outside reflect sensor to the motion that is used to follow the tracks of this writing implement.
In enforcement of the present invention, this reflecting element can reflect light to this sensor when this writing implement is being used to write, and forbids that when this writing implement is not used to write this reflecting element reflects light to this sensor.
Generally speaking, in another aspect, feature of the present invention is the photoarray that has a photosensitive pixel element with, receive light from a writing implement that is moving, and determine that the light that receives from this writing implement has been the position of maximum intensity in array, this position is determined with subpixel accuracy.
In enforcement of the present invention, this sub-pixel position is determined this sub-pixel position by determining the integer pixel positions that approaches this sub-pixel position, and to search one be a part center of gravity of the subarray at center with this integer pixel positions.
Generally speaking, in another aspect, feature of the present invention is that indication and detects this position they are input in the electronic installation corresponding to the position to the input of an electronic installation on a non-electron surface.
Generally speaking, in another aspect, feature of the present invention is the clip that is used for fixing paper, and this writing implement will be moved to this sensor on this fixing paper.
In enforcement of the present invention, this mechanism can be one the board of clamping paper device or the part of a notebook, and this clip can comprise a mechanism, makes a user can clamp or disengage this paper.This clip can comprise that an activator button and spring and one are by this push-button lever.This lever can be configured to rotate in response to this button.This button can be configured to be pushed or draw.Other advantage and feature will be by following instructions and claims and are become clear.
Description of drawings
Fig. 1 illustrates pen tracking.
Fig. 2 illustrates a pen.
Fig. 3 illustrates the lens in the pen.
Fig. 4 illustrates the lens in the pen.
Fig. 5 and 6 illustrates a light reflection in the pen.
Fig. 7 illustrates a kind of tracking.
Fig. 8 illustrates a pen.
Fig. 9 illustrates a pen.
Figure 10 illustrates a supporter.
Figure 11 illustrates lens in the place ahead of a sensor.
Figure 12 illustrates a supporter.
Figure 13 illustrates a supporter.
Figure 14 and 15 illustrates half of a supporter.
Figure 16 illustrates second half of this supporter.
Figure 17 illustrates a ken.
Figure 18 illustrates a piece circuit diagram.
Figure 19 illustrates a constitutional diagram.
Figure 20 illustrates a sequential chart.
Figure 21 illustrates a sequence chart.
Figure 22 illustrates the geometric figure of tracking.
Figure 23 illustrates a circuit diagram.
Figure 24 illustrates a sequence chart.
Figure 25 and 26 illustrates a kind of rotating beam technology.
Figure 27 illustrates a channel mapping.
Figure 28 illustrates a channel loop.
Figure 29 illustrates a keyboard made of paper.
Figure 30 illustrates a spherical lens.
Figure 31 illustrates a non-spherical lens.
Figure 32 illustrates a kind of double lens scheme.
Figure 33 illustrates a kind of clip.
Figure 34 illustrates a kind of clip.
Figure 35 illustrates a kind of sliding bell clip.
Figure 36 illustrates a kind of two kinds of views of clip.
Figure 37 illustrates a kind of two kinds of views of clip.
We describe a kind of electronic wireless pen, and this is except also launching infrared ray (IR) the conventional func of staying next visible vestige on the writing surface, and this infrared ray is by outside infrared sensor collection, to measure the position with respect to the pen of this sensor.This sensor is CMOS or CCD linearity or two-dimensional array, position sensitive detectors (PSD) or other light-sensitive detector.This sensor can be sandwiched in the edge of writing surface, is provided at the reproduction of writing on those pages.By the reading of data reflection of this sensor is determined this position to this nib actual XY position on paper.
This electronic input apparatus looks like a conventional pen with a supporter.
The user with it as on paper, notebook or any other plane, writing with any common pen.It is used to catch handwritten text or drawing.Arrive in its storer by the survey record with sensor, this stores its total movement between its operating period.This pen is downloaded to computing machine, personal digital assistant, pocket computer or a portable phone with it then.Then, when this is hand-written when appearing on the page, automatically reproduced it according to this sensor information.
As shown in Figure 1, on a piece of paper or other writing surface 14, stay pen or other writing implement 10 of the visible marks 12 of writing or drawing with usual way, can also have a source 16, these source 16 emission infrared rays (IR) 18 are used for automatically following the tracks of this motion.For example keep static infrared sensor 20,22 to detect these light by near position one near the position at the edge 23 of this paper and with respect to this.
This sensor sends this position on writing surface of expression, and () burst for example, angle 24 is engraved in this position and receives light from this when each of continuous Measuring Time.The circuit that interrelates with this sensor uses a kind of algorithm, is used to handle directional information (and known distance between this sensor 26) and determines its continuous position with this pen of box lunch when mobile on writing surface.This algorithm can use a mathematical model, and the picture element signal of this sensor is converted into position on this writing surface.This algorithm can be a kind of (horizontal offset between the center of distance from lens to the sensor and their refractive index) accurate triangulation algorithm of using calibration parameter, perhaps can be a kind of polynoimal approximation.
The motion of this tracked pen can be used for discerning the person's handwriting that uses this establishment or catches by the picture of this establishment or be used for other multiple application.This tracked movable information can be sent to local PC or send to a central computer via a personal digital assistant, a pocket computer or a portable phone and be used for centralized storage and processing.
Sensor with bidimensional or one-dimensional is followed the tracks of light source
The problem that comes from the tracking XY of a pen can following formalization.
This carries a limited light source that approaches nib.This source emission light, this light depends on the source XYZ position of this test point that is initial point in the intensity of test point.
One multichannel wave detector is positioned at the another location.It gathers certain part by the light of the emission of the source on the pen.The intensity that sends different channels to changes according to the XYZ position of channel input with respect to the position in source.Intensity data is enough to the XYZ position of calculating source with respect to this detecting device.Intensity data is also comprised the influence of the noise of source instability, detector noise and other classification.
We are only interested in the XY figure that obtains to come from this.In fact, three all coordinates will change owing to thickness scrambling on the writing surface and pen in the variation of gradient during writing.
Along with noise, this will cause the variation of the complexity in the channel sense data.
The mode that the such signal of different processing is arranged: weighted mean (center of gravity), median calculation, threshold process or the like.They are mostly considered noise removing and the Z in source also are considered as noise to motion.
Our target is to set up a kind of like this character of detected signal, and this detected signal is invariant for the Z of pen to motion and some noise source.
For this purpose, we introduce a kind of aperture between a wave detector and this source.For example this aperture can comprise lens.We obtain the signal of a space amplitude limit thus.This means that existence is by signal and noise (being a part) the wave detector radio equipment of one group closure of excitation simultaneously under the situation of a linear array wave detector.This group is centered on by the channel that is only encouraged by noise.When lacking an aperture, all channels are all by signal and noise excitation.
We set up a specified point (for example maximal value) and define one with the mode that extends beyond this space clipped signal processing window around this point after creating a kind of like this signal.Contrast channel number then and calculate a cumulative distribution function of the data of this processing window interior.The projection of medium-sized point in channel number of these functions produces this invariant character.When channel number was integer, this invariant character can be mark.
Two kinds of wave detectors are arranged basically, two dimension or one dimension.Every kind of wave detector can be a double-channel wave detector as a PSD, perhaps the wave detector of " multichannel " is as a CMOS and CCD device.The PSD wave detector has two output signals, the relative position of its ratio definition incident luminous point.CMOS and CCD wave detector have many pixels.A specific space on this wave detector of each pixel definition also has a simulation output.These simulation outputs can be digitized for the subsequent treatment in firmware or software, perhaps can be handled by analog machine.The algorithm that uses in the software also can be implemented with hardware replacement by same method.
A kind of calibration process
Needn't obtain of the linear response of this wave detector, because advised with other known method for the pen motion.
If use simple triangulation that a wave detector sense data is interpreted as the XY figure position of a pen, will need a linear response
Between the installation drawing position of a pen and left and right sides wave detector (L and R) sense data, there is a kind of clear and definite dependency, as follows:
X=Fx(L,R);
Y=Fy(L,R)。;
These functions can be represented as multinomial series.
Coefficient in these polynomial expressions can be determined during calibration process.
During calibration process, this is placed in the different XY position known on this paper, and obtains and the sense data of storing two wave detectors is used for processing in the future.After having accumulated enough several points of destination, use the coefficient in the common linear algebra method calculating (1).
We know that system (1) comes down to nonlinear.Can be very important to the calibration point location with a kind of like this method in whole mode of writing the essential resolution of acquisition on the zone.We do not locate the calibration point at the node place in the conventional rectangular grid.As an alternative, we use mathematical model, are a calibration of the specific nonlinear character coupling grid of wave detector to us.
Another kind of calibration process
If according to the XY figure position that detector data is used a pen of simple trigonometric calculations, we are incorporated into an error in our geometric parameter of wave detector, so that the above-mentioned nonlinear character that discusses is taken into account wittingly.
Rely on our design, we know the refractive index of the lens in our wave detector and the distance between lens and the sensor exactly.Simultaneously verified, by changing these values in the trigonometric calculations, people can compensate the non-linear nature of wave detector effectively.
For the effective value of distance between the effective value that obtains refractive index and lens and the sensor, we move another calibration process.Need the calibration point of different XY figure positions for writing suitable resolution on the zone.The position that is used for the calibration point of these interrupted triangulations by the mathematical model acquisition.
Pen
As shown in Figure 2, in an example, the infrared source in this can be one LED13, when exerting pressure during writing, at nib 17 emission infrared rays 15.In this example, this LED source 13 is looped around a LEDs ring 19 of arranging around the longitudinal axis 21 of pen by one and constitutes (two LEDs only are shown).
Light from this LEDs projects nib is also advanced the acryhic material that uses as light pipe by projection handwriting/lens 18 downwards.This acrylic lenses scattering and the light that received of transmission are so that transmitted along the light path of all directions around this by the light of this emission.
As shown in Figure 3, this manages 18 polished, and is reflective, concentrate from LEDs 19 inside light 502, and do not allow light flee from the direction on next door.The bottom of this pipe is to polish at the bottom of this pipe 45 degree taper surfaces 504.A reflective cylindrical shell 506 helps to limit and cause the mixing of the light of being launched by LED.A cone 508 is supported this light pipe.Downward direct light is reflected by this taper surface 504 and is sent in the air with all angles around this in this pipe.
The side view and the top view of the internal reflection of the light in Fig. 5 and 6 these light pipes of diagram.Most of light from this LEDs reflect to sensor by the length of this housing and with an angle of 90 degrees.Other light finds the route that leaves this with the angle that is different from 90 degree.
As shown in Figure 2, this light that sends is limited in one near in the vertical space 11 of this writing surface 13, so that light as much as possible can reach the sensor (not shown), this sensor also is positioned in the little distance of this writing surface.
Can use other to have the structure of different light pipe and lens shape, comprise a kind of shown in Fig. 4, they can be in the better coupling between LED and this light pipe, and can more effective fractionation light and light is registered to the reflecting surface of the bottom that is positioned at this pipe.
This pen (Fig. 2) in this example comprises a ball pen pen container 23, and its terminal is a writing tip 25.When during the user is writing this writing tip being exerted pressure, a pressure switch 26 is sent a signal, and this signal can be used for opening this LEDs, also can be used for triggering the function of the circuit 28 that is contained on this.Circuit 28 and LED 19 are by 30 power supplies of a battery.These elements all are stored in the shell 15.
As shown in Figure 7, this position in an x-y coordinate system 40 parallel with this writing surface is determined by two a angle and known distances between β angle and the sensor 26 by two sensors, 20,22 sensings.
In another example, as shown in Figure 8, this pen is by three miniature AAA class nickel-cadmium chargeable battery 51 power supplies of depositing in this behind (for better weight distribution, move to approach nib and this circuit is placed in the back with this battery).
This battery is directly to 28 power supplies of this electronic circuit, and without any the transducer of DC-to-DC.Have only and when this pressure switch 26 is activated, just carry this electric power.This light activator switch only moves a short distance (for example, 0.25mm).So that the stroke of pen core is minimized, this should be unable to surpass the 0.008-0.010 inch to this switch by a spring device precompressed.
Pressure transducer may be a kind of mode that the activation of pressure on the pen core and LED is effectively mated, and has an activation pressure that surpasses desired 20 to 30 gram levels as many popular switches.
Be positioned at the modulating pulse of this electron plate 28 behind this battery about 100Hz and 50% dutycycle, and to be sleep pattern produce pen with 1 to 10kHz train of impulses opens and a cut-off signal for infrared LEDs produces.
This this light that sends all is visible along all directions, so that make this pen to use along any direction in hand.This emission light is more near this nib, because that pen and the angle of paper change the error that causes is just few more, and just accurate more to the tracking of this nib.This LED light should be positioned at the infra-red range away from visible spectrum, so that can this infrared emission of excessive interference from the ambient light of the sun and ligthing paraphernalia, and also is sightless for human eye.
This infrared source and the direction of this sensor in this supporter are provided with, and to guarantee that skew back is when rotating during normally writing or drawing when this pen, its infrared light beam can arrive this sensor.
Fig. 9 illustrates a more detailed isometric view of the pen of part assembling
Supporter
As shown in figs. 1 and 10, this sensor can be placed in the typical cap for brush 70, and this pen can be stored in wherein when not in use.
When this pen just in use, this is removed the cap for brush and this cap for brush is placed near this writing surface and near a fixing position this.At some example, this sensor is Linear CMOS array (for example can use 1024 pel arrays from the photoelectricity vision system, LLC (PVS) (NY 13045 for mailbox 509, Ke Telan) (element number LIS1024)).Can also use PVS or other to have other linear cmos sensor of the company of same or different number of pixels.The simulation output of each sensor is the sequence of 1024 simulating signals, and each signal is from each sensor pixel.
As shown in figure 10, this supporter can comprise a clip 62, is used for this supporter is attached to the edge of a stacker or a notebook.
When writing beginning (for example, this pen begins to launch light), use the 3rd sensor of photodiode 56 forms of the centre that is positioned at this supporter that this processor is waken up from a sleep pattern (describing below).
The 3rd sensor signal can also be used for the circuit in the circuit of this sensing system and the pen is carried out synchronously.Three all sensors are all covered by the infrared fileter window towards writing surface.
As shown in figure 11, in an example, the front surface 100 of each master reference has vertical height 104 and front surface 108 4 mm distance 106 apart from these lens 110 of one 125 microns.This FOV112 is 10 degree.When this nib is that this nib 114 points to infrared ray light among this FOV on this paper 116 time.
As shown in figure 17, these two sensors 88.90 are placed at interval with 100 millimeters.It is the ken (FOV) 94,96 at center with a FOV axle 195,197 that each sensor has one.The axle of this FOV is not parallel but with angle 199 introversions, so that increase the lap of this FOV.The FOV of each sensor has on 150 ° width on a level (xy) plane and the vertical plane+/-5 ° height.
This FOV does not cover some position 101 at the edge 303 that approaches this paper on this writing surface 15, and this FOV is set up, so that this dead zone 98 can not extend beyond this supporter 25mm.
In another example of supporter, as shown in figure 12, this sensor 117 and these lens 119 are installed on the support mounting 121 that has infrared fileter 123 in front.This mounting is installed on the printed circuit board (PCB) 125 and is accommodated in the shell 127.The central compartment 100mm of two master references.
By the light of two sensor acquisition, so that in a range of definition (8.5 * 11 inches), discern the linear position of a modulated light source from this.This linear position can be the arbitrary combination calculation with triangulation, lookup table, polynoimal approximation or these methods.
This sensor is the plane, linear many element sensors.When the different position of this light source in this, the different pixels of each sensor is all illuminated.When this light source is mobile on this, the corresponding sports of this light of the pixel of this this sensor of process may not be linear, but the shortage of this linearity can be solved, because this linear position can calculate with the combining of calibration data from this a pair of sensor by mathematics and optical knowledge.
We are not linear responses of seeking from this sensor, but manage the light optimization within the zone of writing that will drop on this sensor.By using previous calibration process stored parameters to obtain the correct reproduction of writing.In some is implemented (in polynomial expression example as follows, the number of parameter may be bigger, and provide with an individual files), this system only uses four parameters, sends a main frame to or server is handled and these data of linearization by every pen.This particular calibration parameter that is used for a pen is stored in this storer between production testing and alignment epoch.On the personal computer that this parameter can also be stored on the server or the user uses, and not be used in during the download from this transmission.
Each sensor is with lens or one group of lens.The target of this optical system is the efficient optimization that light is transmitted, and covers the field of this whole ken, provides the signal response of a unanimity at whole, and makes this optical system as far as possible little and cheap.This target part realizes by following steps:
As shown in figure 30, a spherical lens 753 is used for light focusing on sensor 755.This focal plane has a semi-circular shape.Distance 759 from these lens to this sensor is optimized, and other optics of these lens and mechanical property comprise focal length, diameter, thickness and material.
As shown in figure 31, aspheric lens 760 can be designed as has a focus that is positioned on the sensor when on the scene peripheral mobile of this light source the time, the most weak at this place by the whole energy that offer this sensor of this light source.Thus, this non-spherical lens is designed to have a focal plane, and it is consistent with the plane of sensor for the outer point of placing at this page only.Naming a person for a particular job in this page can not focus on, but the amount that drops on this sensor is incited somebody to action significantly bigger (approaching sensor or better angle), and this signal is stronger.
(comprise a top top view and a following side) shown in figure 32, can replace lens with two vertical cylindrical lenses 770,771.The distance limit of this sensor these lens in the horizontal direction the axle on focal length.Therefore this lens diameter must be little and these lens must be positioned at the position of approaching this sensor.On this Z-axis, these lens may be more away from sensor, so this diameter can be bigger.This bigger diameter allows from the more light of light source collection.Near first cylinder (these lens) along continuous straight runs axle focuses on this light.These lens can be spheres, because the axle spot diameter is not very important and can change too many in our given in the horizontal direction.Second cylinder has the energy of vertical axis.On this sensor, focus on as much as possible only very important in vertical direction.For this point is come true, this light must all be propagated equal distance from this cylinder to this sensor for any angle.In order to finish this point, second cylinder should be bent to aspherical shape.Any one can be a Fresnel lens so that save the space in two cylindrical lenses.
In a more detailed example of the supporter shown in Figure 13,14,15 and 16, this sensing system is accommodated in one to have in the bottom 80 and the shell 79 at top 82.This bottom 80 comprises clip 62 (not shown)s.When pressing next clip button 86, paper can be inserted between the bottom of this clip 62 and this supporter.When discharging this button, this paper of this clamp.This pen clip holds a folded thick paper or the standard notepad 83 of 7mm.This clip is placed on this supporter on this paper, so that vertical towards this side 87, tilts to be no more than+/-1 °, thereby guarantees that this sensor receives the infrared ray from this when using this pen to write from the teeth outwards.
This supporter can also only be positioned at the top of paper or notebook and needn't use clip.
In the supporter shown in Figure 13-16, these two sensors are installed in infrared fileter window 89,91 back and in the middle of this photodiode 93 is contained in." inkwell " 95 can receive this nib 97 and be used for depositing temporarily, and a pipe 99 provides a place that deposits this in.This can fully be inserted in this pipe and the battery in this pen can be recharged during storage.
The various mechanisms that are used to operate this clip may comprise the example shown in the Application No. 09/376,837 of application on August 18th, 1999.
In a kind of scheme, use clip mechanism shown in Figure 33.This illustrates the step in this mechanism of operation, and is as follows.
Step 1: mechanism is not activated.
Step 2: when button 780 was pressed on the spring 782, the latter discharged mounting 733, and allowed this hinge spring 784 open this clip 785.
Step 3: paper 786 is inserted in the middle of the housing 787 of this clip and this supporter.
Step 4: lever 785 (this clip) props up this paper, and the spring 788 that obviously is weaker than this hinge spring is made a concession and begun to sink.This clip is around the point of rotation 789 rotations.
Step 5: this clip is pressed in this paper the bottom of this supporter.Spring 788 sink, and two levers all descend according to the paper amount of inserting.
A clip button can be used for by a lever tangential movement being converted to vertical movement, thereby reduces this clip.Just, this button can be pushed a lever, and this lever rotation is converted to vertical movement with tangential movement, thereby reduces this clip.
This mechanism is showed among Figure 34.This clip has two longitudinal sliding motion bars 790,791 that are connected to a horizontal bar 792.A spring 793 is arranged between the housing of this horizontal bar and this supporter.There are two longitudinally guiding equipment 794,795 to be used to make this vertical bar high and low to slide.
In the side view of the bottom of this figure, when this button is not pressed, this spring be from start to finish upwards and this clip be pressed towards this penholder housing (left side of this figure).When this button is pressed (the right of this figure), this spring is pressed and this clip (seeing this front view now) descends between this sliding apparatus.Be inserted into and after this button was released, this spring upwards promoted this clip and this paper blocks in this mechanism between this clip and this penholder housing at paper.
This button can move a lever so that reduce this clip along a plurality of axles.
This button can activate a lever and rotate linearly and move so that reduce this clip.
In another program, as shown in Figure 36, this operator presses on a sliding panel (button) 901.The center of two top spring bases 903,905 of this sliding button contact moves down these fulcrums with the equidirectional of this button/plate.The bottom terminal of this lever be fixed on the rotation pin 907,909 around, thereby this bottom terminal moves down the distance that approximately doubles this button.The top terminals of this lever is equipped with pin 911,913, and these two pins are placed in 915,917 and two of gathering sills and vertically go up in the curved kick from this bottom clips.Last result is the motion vertically downward of this clip, and this approximately is the twice of the distance that moves of this button/plate.
Also can be that as shown in figure 35, this sliding panel 930 can be put into by horizontal direction and by means of the elastic belt of a rigidity, obtain promptly opposite with the vertical movement of this button level of desired result and promote motion.
As shown in figure 37, other method can be a tractive motion acquisition by this button 951, if the power that acts on these two levers 953,955 in this mechanism moves to bottom terminal from the centre of this lever, and the fulcrum of this lever move into place in certainly this top terminals to this bottom terminal distance 1/3 a bit.This will provide necessary mechanical advantage, so that keep distance that this clip moves this 2: 1 ratios with respect to the stroke of this button.
In two kinds of mechanisms, the point that applies power on lever can be used for increasing the mechanical shift of this clip with respect to this location of center of rotation.
Supporter circuit
A circuit block diagram of this supporter shown in Figure 18.By a battery 511 or by an AC adaptor 513 or by a USB being connected to a main frame 211 is 205 power supplies of an application-specific integrated circuit ASIC.These two cmos sensors 201,203 have output, make 165,167 to be connected to special IC by operational amplifier 169,171 via a multipath transmission 180 and 12 A-D converters.
The simulation output of this cmos sensor eliminates with side-play amount and the automatic gain control forms is carried out signal Processing.The signal to noise ratio (S/N ratio) of this processing requires to be this cmos sensor and all analog signal processing circuit use 5v power supplys.Some analog-digital converter with reference to operation, and can use a resitstance voltage divider scaled with factor 2 from the signal of this cmos sensor with 2.5v.
This application-specific integrated circuit ASIC can be the model Clarity 2B from Sound Vision, is positioned at framingham MA) and based on an ARM7 core.This application-specific integrated circuit ASIC firmware implementation data collection, data storage, file system, I/O service (LED and switch), RS232 and usb communication, the power adjustments that is used for free time and sleep pattern, optical correction and test pattern.
This multiplexer can alternately carried out so that the mistiming between two sensors is minimized this A-D converter 182 between two CMOS arrays 201 and 203.The clock frequency of this A-D converter is 1.2MHz.Each cmos sensor is the clock of 600khz.Direct memory access (DMA) (DMA) device of this application-specific integrated circuit ASIC is used in data acquisition.
Drive a kind of input, input signal that this phase-locked loop 513 receives from this photodiode of waking up of this special IC by a phase-locked loop 513.This photodiode is driven by the modulated light from this.
This application-specific integrated circuit ASIC carries out clock control by one 48 megahertz crystal and a clock distributor 517.Provide I/O feature via a USB port 211 and a RS232/IrDA port 209.In SDRAM 207, handle firmware and data and be stored in the flash memory 519.Can provide an optional LCD 172 for user display screen.
USB provides the data mode of two kinds of self-supporting devices to personal computer: in batch with real-time.Real-time Transmission is that replacement drives interrupts and that be used as keyboard and mouse is used.
A kind of dual function transceiver is used for implementing RS232 and communicates by letter for two kinds with IrDA.This RS232 communication is used as by being dial-up connection to by cellular server.
This supporter can be supported outside connection not the of the same race, comprises USB, serial, arranged side by side, IrDA, bluetooth (Bluetooth), the communication port of fire wall or any kind of.When power down, if this supporter is connected to any external device (ED), it has a kind of ability of automatic power.It also has the ability of cutting off the power supply itself when an external device (ED) disconnects connection.For this supporter two kinds of connections are arranged:
A kind of connection is a kind of connection of external memory storage type.Constitute a kind of like this connection with a computing machine that is called main frame or other device, this main frame can display graphics and is had a user interface that meets the demands.When being connected to a host apparatus, this supporter is equivalent to an external memory devices.A user of this host apparatus can pass through this supporter browser document system, duplicates, checks and edit the file of before having been collected by this supporter.Reside in software in this main frame and can on this main frame screen, change, show, print and edit the file of on this supporter, storing, perhaps copy to this main frame from this supporter.When being connected to this main frame, this pen can also use as a real-time input unit.
The another kind of type that connects is to use a kind of portable network or modulator-demodular unit enabled device, such as a cell phone.When detecting a kind of like this connection, this supporter automatically begins all data of before having collected are transmitted in the mode of Email or fax.
This optional LCD display is to the state of this pen of user notification, for example about by communication not being connection and the download that the reliable portable phone of the Internet fully carries out.This display screen can be installed in this supporter above.If use a LCD, may not need this LED.
The normal collection of three independent looks (green, yellow, redness) LED 170 (referring to Figure 18) written order data downloads to people's computing machine one by one by portable phone, and the supervision of battery and memory state.
Pen, clip and inkwell switch 141,143 and 145 are used for controlling this application-specific integrated circuit ASIC, and a reset switch 147 this application-specific integrated circuit ASIC that is used for resetting.
Figure 19 illustrates a constitutional diagram of the mode of operation of being invented.Shaded block indication research state.Bright piece indication intermediateness.In other situation, this map logo uses the mode of multi-colored led this mode of operation of indication.
When powering up, when in the storer page being arranged, this identical time of green light flicker.When this storer was sky, this green light did not work when powering up, and if this user began to write 30 seconds afterwards or just stopped flicker soon.
During writing, when correctly carrying out data acquisition, this LED is a light green color.This green light extinguishes owing to for example intercepting the fault detect that light, pen leaves triggerings such as writing surface or battery use up.
When not writing generation, by the low state of a flashes yellow light pilot cell capacity.Yet when writing, if low this yellow of this battery capacity and light green color light glimmer off and on.
When write when not taking place by yellow light to double the instruction memory that glimmers almost full up, and almost full up when writing when taking place by yellow and the light green color light instruction memory that glimmers off and on.
After the download of success, by a bright green light indication download state (no matter this pen still is the outside in this supporter or inkwell can begin independently).The green of flicker is represented to download underway.When not having effective downloading service or download signal very weak, a blinking red lamp.For example when a server goes offline, this red light doubles flicker for a Internet problem.A kind of mistake setting of red light indication communication of three times of flickers comprises the user identifier or the server address of mistake.After this Data Matching that need write down is unsuccessful, a code is returned to pen from server in from the data of pen and database.
The battery recharge state is indicated by a continuous green light after successful charging again, and is indicated by the green light of a multiple flicker when this supporter being inserted AC adapter and charging.Whether the combination from the signal of battery monitor circuit and the rapid charge signal of a next white charger (being height when not charging) can identify this state, charge or trickle charge in processing.
This energy is used between charge period.If this pen is removed and used between charge period from this inkwell, this yellow light is replaced by aforesaid all normal pilot lamp.
By a continuous yellow light written order to the flash memory state that flashes.
By in two switches of inkwell that activate pen or mention later on any one, all faults all are reset.Unique exception is when successfully downloading when beginning to write with the user.This constant bright green light will be transformed into a greenish light then.
In sleep pattern, all indicating fault, low memory capacity and low battery capacity all continue with normal mode.All download faults also continue to keep.
If this application-specific integrated circuit ASIC need be indicated low memory capacity or low battery capacity situation during powering up, this powers up indication and obtains right of priority.Showed this indicating fault then later at overtime 30 seconds.If this application-specific integrated circuit ASIC need be indicated low memory capacity or low battery capacity situation during downloading, it is preferential that this downloads indication.After the download state that resets, show this indicating fault.
In these four supporters of connecting, this clip switch 141 indicates this clip just in open and close in one way, so that notify this user of this circuit to begin once to skip.When pen is in this supporter or beyond this supporter in these switch 143 indications.When this pen is in this inkwell or beyond this inkwell in inkwell switch 145 indications.This reset switch 147 is hidden and can uses a folder can use via a hole in this bottom.
When this pen is in this supporter or in this inkwell for this switch and the indication of this inkwell switch, and removes the power supply of data acquisition and storage electronics in this supporter or this inkwell the time when this.This switch is also opened new file (perhaps page or leaf) when activating, and this inkwell switch is not done.
When this clip is activated the indication of this clip switch, and and once skips and the beginning (each page or leaf is a file) of a new file.
If this software freezes, this reset switch this application-specific integrated circuit ASIC that resets.This switch is following opening usually:
Pen is opened when this pen is beyond this supporter.
Inkwell is opened when this pen is beyond this inkwell.
Clip is opened when this clip button is released.
Reset and when switch is depressed, open.
This supporter also comprises miniature connector and antenna that is used to use bluetooth (Bluetooth) or other wireless technology of a USB and RS232 interface.This USB and RS232 connector also are connected to this and wake feed circuit up, so that a supporter can oneself be powered when cable is injected this miniature connector.
Handle and be stored in the flash memory by this application-specific integrated circuit ASIC by the angle signal that this sensor generates, for use in transmitting such as portable phone, PDA and PC (not shown) to other device, they are used to handwritten form identification or catch picture there.For example, can use USB, RS232, IrDA or bluetooth (Bluetooth) agreement to carry out this transmission.
File system
The structure of this flash memory is the compatible file system of FAT (file allocation table), wherein hand-written information page of each representation of file.Each file has the unique name of one 12 character, comprises the extension name and a separation " point " of 3 characters.
Data file is created
When a user by taking out from supporter by pen, perhaps when this pen has been in write mode when pressing the clip button that skips and make this pen enter write mode, created a new file, and writing afterwards is stored in the new file.If this user carries out write later on creating new file practically, the file of the new wound of institute is deleted, and when entering write mode next time, reuses same filename.
In data acquisition period, packed data is not stored in the interim buffer among the SDRAM, and compresses this data by a data storage operation before in the file in being stored in flash memory.Each page is stored in the independent file.Prevpage was compressed before beginning to gather new page or leaf.
Document format data
We use a kind of scale-of-two compressed format based on the variable bit rate Huffman encoding with cube approximate value.A kind of like this form comprises coded data coordinate and timestamp.
Before being compressed, this document has following form:
This document is constructed with four byte section byte segments.Each section is corresponding to a pixel or a timestamp.It is zero highest significant position (MSB) that each pixel has one, and is made up of two 15 bit digital, and this this be the subcoordinate of corresponding cmos sensor.Highest significant position discrimination time by one is stabbed, and this timestamp can store the long date fomat and the time (being called complete timestamp) of next pixel, perhaps can store the increment counter of pixel since last time complete timestamp.
Each file is all from this complete timestamp.Insert one at the end of each writing stroke and add 1 timestamp.Because scan all pixels equably on time, a kind of like this combination of timestamp enables to recover effectively the whole historical record of person's handwriting in handling in the future.
The download of data
When this supporter uses a USB cable and a personal computer to lead to, this personal computer automatically is identified as this supporter the compatible USB device of a PC, and by this personal computer file systems extension name, as seen the content of this supporter file system becomes for this personal computer.This user can browse and uses a person's handwriting to check that program is to watch this document by it.
When a RS232 cable at this supporter with when for example leading between the portable phone, this supporter oneself power supply automatically, and begin to be transferred to this phone from the data file of the storer of this supporter.Can also carry out infrared data and be transferred to this phone.
These data send to this server with compressed format and are stored in the there up to being requested to mail to an addressee.It is decompressed and be converted to a kind of in the following form: .GIF then .pdf, and .gif is exclusively used in the .ps of Email or fax service.
The sensor signal pre-service
At some example, can use a pretreater (not shown) to carry out background and eliminate and the storage in flash memory, this application-specific integrated circuit ASIC processor is carried out all communication and I/O function simultaneously.This pretreater can be implemented with a kind of programmable device form, such as PLD, and FPGA or digital private integrated circuit ASIC or a DSP.In this example,, carries out a frequency multiplication and operate so that produce a high-frequency pixels clock and a clock that is used for this pretreater according to this LED modulating frequency of recovering by this phase-locked loop (PLL).
Second processor can be another mancarried device, such as the processor of a portable phone or PDA.
Data acquisition
The target coordinate is to gather in 10 milliseconds of continuous sample spaces that are separated by, so as to be 0.5 millimeter resolution with the speed trap of 5 common centimeters per seconds enough write motion.This application-specific integrated circuit ASIC is as a main operation, for sensor produces clock and all essential signals.
Sensor in this supporter uses the pixel clock from this application-specific integrated circuit ASIC.By each sensor produce a frame signal and by retaking of a year or grade in this application-specific integrated circuit ASIC.Therefore, in some is implemented, there is not synchronization from this this LED pulse and the signals collecting of on this supporter, carrying out.In other example, this data acquisition and this modulating frequency are synchronous.Synchronization has improved angular resolution effectively.
In each sampling period, obtain this position coordinates, catch data from two sensors.A kind of scheme of this background elimination algorithm (asynchronous with pen) need be caught three consecutive frames at each sensor.A frame in addition is by being used for this application-specific integrated circuit ASIC architecture use that sensor resets.
For the coordinate skew with two sensors minimizes, this multiplex (MUX) data acquisition hockets between two sensors for each pixel.
Operate this A-D converter and between two sensors, hocket with the maximum sampling rate of a 1.2MHz, allow pixel sampling frequency up to 600kHz.Each CMOS array has 1024+4 pixel, and this produces the frame rate of about 600Hz.Can use the slow speed of 300Hz to obtain more pixel exposure and correspondingly better signal to noise ratio (S/N ratio).
Each sensor is operated with a kind of pattern, and each pixel is reset after being read in the A/D converter in this pattern.
This infrared LEDs dutycycle is 50% of three frame periods.For this dutycycle, this LED frequency can not surpass 200Hz.
Need not synchronous purpose in order to eliminate ground unrest and low frequency to crosstalk, need the Frame of three 1024 pixels, as described below.
Except that this main simulation output, each CMOS also sends the END_FRAME signal.By each CMOS, all be to start from this END_FRAME signal for the collection period of each frame in these three continuous Frames, this last pixel with frame is consistent.Each A-D conversion takes place in the negative edge in this PIXEL_CLOCK pulse.The sum of point is (1024+4) * 3 basically, and wherein 1024 is the length of this CMOS array, the 4th, and the number of the time clock between this END_FRAME signal and next frame begin, and 3 are numbers of implementing the required continuous frame of background compensation.
According to the waveform that is obtained, this special IC extracts three arrays, and each is equivalent to 1024 pixels.This array must correctly be located in case i unit in each in them corresponding to this CMOS i pixel.
Let us is called A1, A2 and A3 with these arrays.According to carrying out background compensation with the fact of the LED in this pen of duty ratio modulation of 1/3 the frequency that equals frame rate and 50%.In order to realize background compensation, on this array, carry out following calculating: A12=abs (A1-A2) in the unit mode; A23=abs (A2-A3); A13=abs (A1-A3).Array A12, A13 are formed a new array mutually with A23 with unit form then, are called A.
This array A is Unit 1024 length and carries the light beam information with background elimination.
In order to remove the big peak value that in the pixel waveforms of END_FRAME impulse duration, occurs reliably, can extract the subarray shorter than Unit 1024, three 1020 long subnumber groups in unit for example, this subnumber group originates in pixel 3,1032 and 2061 (based on 0).
The sense data of these two sensors (is perhaps had the simultaneously accurate of multiplex (MUX)) by simultaneously when only utilizing A-D converter digitizing.
Search peak position with the sub-pixel resolution along the CMOS array
The angle of determining each sensor reception light depends on the location of pixels of determining peak light intensity along the array of this sensor.Being used for searching with the sub-pixel resolution two parameter: T of this algorithm use of peak position, is the intensity threshold of unit with the volt, and W, is the window width of unit with the pixel.The representative value of these parameters is T=0.1V and W=15.
As an initial step, search peak value in this array and its subscript, they are called Amax and M.If any one in these two Amax values (corresponding to these two sensors) then abandons this point less than T.In this case, this LED is considered to not contact this paper with this pen and closes.If M<W/2 or M>(1024-W/2), this point is because be dropped near the edge of the ken very much.
From A, extract a subarray from the W unit length that unit M-W/2 begins.Following part center of gravity of searching it: the array (being called S) of creating the unit operation summation of the subarray that extracts.Obtain the value of its last element.With it divided by 2.Utilize linear insertion/look-up table to search the part subscript of this value position among the S.With M-W/2 and this value addition.This will become this part subscript of the light beam center of gravity in original 1024 cell arrays.Add 512 (, being 510 perhaps) after making its sign inversion with regard to the long A in Unit 510 with regard to the long A in Unit 1024.This as a result P be the part position (is unit with the pixel) of light beam with respect to the axle of this sensor.
The use of sub-pixel algorithm allows the factor with 8 to 10 to increase this pixel resolution.
Calculating is with respect to the light-source angle of sensor axis
As last result calculated, we have the angular coordinate (is unit with the pixel) of the light beam of each sensor.We are called Pleft and Pright (seeing this sensor from the visual angle of this tip of the brushstyle of a writing or painting point) with them.We calculate Ps with radian again according to the geometric configuration of this sensor.In an example, this pel spacing L=7.77 micron, these lens are D=4800 micron (common) to the distance of this CMOS, the refraction coefficient of this lens material is N (for glass is 1.5, is 1.4 for plastics, is 1.8 for SF6).Use is used to proofread and correct the calibration data of writing reflection adjusts each parameter, distance D, refractive index N and horizontal offset and disconnection Off.
(mode of N*sin (arctan ((P*L)/D))) is calculated this angle (is unit with the radian) with F=arcsin then.
As shown in Figure 22, the following parameter of needs is calculated this light source position in the Cartesian coordinates:
Sensor argument (introversion) C (radian), typically 30/57
Benchmark B, distance (mm) between the sensor; Typically 150
Left side sensor: Kleft=tan (C-Fleft)
Right sensor: Kright=tan (C+Fright)
X(mm)=B*Kright/(Kleft+Kright);
Y(mm)=Kleft*X
Be used for the standard of a point as available point acceptance
With coordinate to (X, Y) form memory point.When storing into point in the storer, coordinate is stored continuously, unless following situation:
Be lower than this threshold value (as mentioned above) then a mark (a pair of monodrome) is write this storer if find this signal, for example (NaN, NaN), this will represent this pen be picked up (NaN represents the neither one numeral, as defined in the IEEE algorithm standard) in the back.Then, do not add new points up to detecting this signal once more to this document.This method allows this to interrupt to the trajectory that this playback programs is reported there to be reduced exactly.
If this signal is effectively, but this position does not have marked change by comparison with last position, then do not add new points, but be different from the situation of no signal to this storer, do not write mark to this storer.With (X1-X0) 2+ (Y1-Y0) 2Calculate and to move foursquare size.Being used for this, to move foursquare effective representative value be 0.04 square millimeter.
Timestamp is not included in the file, because do not need this information for the track that recovers this.
Coordinate is stored in the temporary transient impact damper and only was compressed in the past storing flash memory into.Each page is stored in the individual files.Therefore, the mark that does not need an EOP.
Complete timestamp will be inserted in the past at first valid pixel.Whenever this pen lifts away from this paper, all on a page (file) are stabbed At All Other Times and will be added 1 and and be inserted into.No matter this pen leaves this paper and how long only inserts a timestamp.
Sleep pattern
When taking out this written confession from this supporter or this inkwell when writing, this application-specific integrated circuit ASIC is opened with sleep pattern and is waited for up to a light signal that detects from this.
Write when having interrupted scheduled time slot when this supporter is waken up and detects, this supporter is got back to the sleep pattern of saving electric power.This application-specific integrated circuit ASIC is reduced to 750kHz by the normal 48MHz clock frequency with it and enters sleep pattern.The SDRAM refresh rate also correspondingly changes so that keep data integrity.
When this pen was within this supporter or this inkwell, the electric power of this supporter was almost fully disconnected.RS232 receiver and USB supervisory circuit consume the very little electric current of keeping.When this circuit is connected to a portable phone by cable or is connected to a personal computer by USB cable, in case detect the activation level of RS232 or USB, this circuit is waken up and for remaining electronic installation starts electric power when this pen is within supporter, this supporter is disconnected fully.
In sleep pattern, unique function of this supporter electronic installation is to wait for that one from photodiode and relevant phase-locked loop circuit is indicated this WAKEUP that is activated to import.In sleep pattern, when this this photodiode of pen check, it consumes little power between this period.
During writing, the IR pulse that this transmission has been modulated.This pulse is detected at this supporter place, makes this phase-locked loop wake this processor up, promptly begins normal drainage pattern in case this application-specific integrated circuit ASIC is converted to the 48MHz system clock.
Phase-locked loop (PLL)
When detecting from the modulated IR light of this this, the modulating clock of this LED (being represented by the 1kHz train of impulses in the output light) extracts the modulating frequency of adjusting to this infrared ray light with PLL circuit 132.
All image data store among the SDRAM 134 by DMA at first.The refresh rate of this SDRAM remains unchanged during from drainage pattern to sleep pattern.This memory requirement is 1M bytes for the 50 compressed pages or unpressed 10 page datas.This 5: 1 compression algorithms must have the restriction that does not have with calculating simple coding fast in the decoding.
The data of being gathered during writing are to be stored among the SDRAM at first.When this pen was got back to this inkwell or this, when the switch 136 that perhaps skips was activated, this application-specific integrated circuit ASIC write flash memory 138 with all data from SDRAM.One whole page handwritten text data are write flash memory only need the of short duration time.On this supporter, indicate this transmission for the user by lighting a yellow led 140.
The flash memory storage of 8M bit represents to be to the maximum the compressed file of the handwritten text of 50 pages.This compression algorithm allows at least 6 to 1 compressions and does not have visible text distortion.
The power supply that is used for this supporter
This supporter provides the electric power of 3.0V by the AA NiMH battery of two series connection.When this pen was in inkwell or supporter, this three nickel-cadmium batterys were by trickle charge.This battery has high capacity and was not almost charged fully.This trickle charge is enough to keep this battery charge.When two of this pen and this supporters are all in charger, provide a kind of dedicated mode, so as with this complete charging current to comprising all battery charge of this battery.
Battery life is that the data compression that do not have in ten hand-written pages or a week is used for being stored in the average magnitude of storer.A general user can write 2 characters p.s., just 120 characters/minute, 7200 CPH characters per hour just.The general hand-written page approximately is 700 characters.In order to produce ten pages, this battery must be worked 5 hours.
When being connected to a USB port, this supporter can obtain electric power from this usb host.Electric charge on the battery is maintained at sufficiently high level so that started this circuit before being transformed into USB electric power.Just set up liaison by this USB link from the electric power of this USB connector and be provided later on, and to report this connection to the personal computer of the other end of this USB link be high power supply at this application-specific integrated circuit ASIC.In response, this personal computer provides the power supply up to 0.5A.Battery charge is set at 0.4A, and monitored so that this charger is converted to trickle charge.
When this pen by when supporter or inkwell take out, this supporter circuit is activated.Some supporter circuit such as RS232 driver and wake power circuit up and directly obtain electric power from this battery.
Other circuit obtains electric power from one by an on-board switching voltage stabilizer according to the 3.3v power supply that 2 to 3 volts battery voltage produces.When being connected to a USB link, this 3.3v produces according to the USB power supply.
Produce 5v according to this 3.3v power supply for this mimic channel.
Pen and supporter synchronous
This and this receiver can produce better signal resolution and resolution that correspondingly better writes and angular resolution synchronously.
As shown in figure 20, for synchronously, this produces the periodic pulse train 401 of higher-frequency pulse, and such as the pulse (we illustrate some sequential chart as suggestion) of 1-10kHz, this can easily detect by phase-locked loop.This phase-locked loop PLL not only detects this actual modulated clock but also detects its phase place, this can produce a signal be used for the log-on data collection and make it and this LED synchronous.
As shown in figure 21, this control signal LED_ON and LED_OFF trigger pip are gathered.In this case, only need two frames to carry out background and eliminate, one is used for this IR signal when this LED is bright, and another is used for this IR signal when this LED extinguishes.
For a cmos sensor, provide a shutter mode all pixels that resets simultaneously.
Each sampling only has two frames to improve sampling rate and resolution, and can allow this processor to enter idle pulley so that save electric power between sampling.
The use of the CMOS array of 2 dimensions
The supplier of digital sensor produces the sensor of small-sized saving electric power and has the sensor of image processing circuit to manufacturer, and these can be integrated in the application of pen on the paper or three-dimensional pen.
The three-dimensional localization of luminous point can be used two 2 D photoelectric arrays.An independent point in the projection definition 3d space of the luminous point on two planes.When the track of a three-dimensional position was effective, the motion of an IR pointer pen can be controlled at a three-dimensional body on the personal computer screen.When this pen during in spatial movement, it is dilatory or rotate this object with any direction.
Subordinate pattern (SLAVE MODE)
In other is implemented, use this ARM7 in a kind of subordinate pattern based on application-specific integrated circuit ASIC, this DMA can the deal with data collection still provide this vertical synchronizing signal by this light testing circuit (PLL).
The analog channel of two replacements
Can use two independent channels to be used for analog signal processing and A-D conversion.What a kind of like this enforcement can be used more economy does not need the parts of Time Created, frequency span and switching rate fast.
Frame changes alternative
Cmos sensor has a limited dynamic range.Although can use an adjustable electron gain simultaneously by two CMOS after this CMOS output, this scheme may also not be desirable, because two reasons.
At first, just regional when mobile when this in certain of this paper, be used for the signal of this two CMOS may be aspect big or small difference, may fix a signal and simultaneously another signal is reduced to a unacceptable level so change both gains.In order to obtain the appropriate signals on this page, it is useful having independent gain for each CMOS.Secondly, use an electron gain not do anything for preventing that actual CMOS is saturated, this zone that must cover for this sensor is inevitable.
The gain of this CMOS can change by the irradiance rate that changes each CMOS independently.As shown in figure 21, this transfer rate remains on 100Hz, and the frame rate 601 of this CMOS is at 300Hz, 600Hzand 1200Hz intermediate conversion.At 300Hz, it is directly forward that this background is eliminated.For 600Hz, this algorithm uses every a frame ( frame 1,3 and 5).For 1200Hz, this algorithm uses every four frames ( frame 1,5 and 9).This pixel rate is 300kHz, 600kHz and 1.2MHz.Changing this frame rate can be finished by application-specific integrated circuit ASIC and need not other any hardware.
Each CMOS can be directly connected to its analog to digital converter ADC, and perhaps the both can be led to an analog-digital converter ADC, and this analog to digital converter ADC can handle 1.5 million samples/sec, and has a 4V reference voltage.This analog-digital converter ADC may be access in an interleaver then, so that this signal is sent into this application-specific integrated circuit ASIC.
PSD based on method
Without the CMOS array, can also use the infrared ray light of two PSD detections from this.Each PSD determines sight line between this and PSD and the angle between this page.The position that these two angles determined by these two PSD and the distance between the PSD are enough to calculate this nib.
Even use infrared fileter, ambient light also will be introduced error in the PSD position measurement.In order to reduce this error, this infrared ray is modulated so that produce the pulse that is in a modulating frequency and has 50% dutycycle, as mentioned above.
Can use two kinds of analogue techniques to differentiate this PSD signal that is converted into the angle that is used for triangulation.
Be called synchronous demodulation and be used in the method for testing electronic devices a kind of, the synchronous light pulse of this incident, and is bright or goes out and opposite gain (distinguishing+1 and-1) is not applied to those signals according to this LED by along separate routes at light modulation frequency.This can the subtracting background noise.Use on the one hand then one in response to this signal transformation period constant to this signal integration, and this noise of balance on the other hand.In an example, this modulating frequency can be 3kHz, and this pulse-response amplitude can be ILEDpeak=Xma.
A kind of method that is used to judge a kind of sampling of use and maintenance technology.The shape of this light signal has the dutycycle of one 50% on the 3kHz modulating frequency, as previously mentioned, also has a strong short pulse that showing that puts on this modulating frequency.This modulating frequency is judged by a phase-locked loop PLL and is used to trigger this sampling and holding circuit, and this intense light pulse is by actual samples.This pulse-response amplitude is ILEDpeak=Xma and should duration of pulse T=Y usec.
PSD sensing on their photosurface is split-hair with the position of measuring light.They are cheap and only need very little power consumption.The enforcement of this PSD is simple than CMOS also.
As shown in figure 23, electric current to voltage transformation is to carry out in the middle of four channels each, respectively is two for each PSD.These four simulating signals are carried out low frequency filtering 605, synchronous detection 607, integration 609 and digital conversion 611 by microcontroller 613 (12 analog-digital converter A/D).Carry out the A-D conversion in the 100Hz sampling rate.This processor activates this causes vestige on paper when.This processor execution signals collecting and scheduled store are in flash memory.Figure 24 illustrates system's sequence chart.When not making vestige, this microcontroller enters idle pulley, and is entering sleep pattern after the period arbitrarily.
By with the interruption of next one input or poll (TBD), this microcontroller is waken up from idle pulley or sleep pattern: of this four analog channels, when this signal that is in its modulating frequency surpasses a certain threshold value of this comparer; From an interruption of a USB port, when detecting activity from a main frame and exist; One in its button is pressed.
When this RAM becomes full or/and when arriving the terminal conditions of a flash memory page, this processor from RAM to the flash memory write data.This page or leaf is full if gather continuation, and this microcontroller begins to write to flash memory.Yet ought not write fashionablely, major part should be carried out during idling cycle in this flash disk operation.
Each PSD has the double-channel of two analog signal processing.Each channel has an electric current to voltage changer, and its output is ac-coupled to first gain amplifier.This signal with the modulated frequency of this pulse generation IR LED (on pen) along separate routes, current is 1kHz.
When LED emission light, this chopper has+1 gain.When not having light, this gain is-1, so this signal is by rectification synchronously.Final stage is an integrator, and it is exported near direct current.Or rather, it is a zig-zag owing to charging of the integrating capacitor in the feedback of this amplifier and discharge.
This analog-digital converter A/D perhaps synchronously samples to this output with this modulating frequency in given interval based on the DAQ of PC or an analog-digital converter A/D of this microcontroller for one, so that eliminate the error that produces owing to zig-zag.
In order to use all 12 of this analog-digital converter A/D resolution, use a dynamic change of the reference voltage of this converter.This microcontroller always reads this analog-digital converter channel with the highest scope, and it to be divided into half then be best up to this scope for this signal.
This chopper amplifier uses the profiling of going up detected this modulating frequency with a mimic channel at each channel (four channels altogether).This signal obtains later in second gain stage,, for detecting, signal transformation handles, and the modulating pulse that recovers changes gain through OR-gate so that drive this chopper amplifier analog switch between+1 and-1 then.
Use the phase shift of photodiode, the rotation nib
As shown in figure 25, if use a rotary light source 617, can measure differing between the signal on three photodiodes 619,620,621 on the supporter, so that search this position at this nib.
Rotating light on this nib can use some (for example eight) realizes with the LED 623 of the Time Triggered of spaced apart by T/N, whole period in this LED cycle during T wherein, and N (for example 8) is the number of LED.
This signal source certain position on an X-Y plane.Two signal detectors 619,620 are positioned at two other fixed positions on the same plane.If this signal source has a kind of radiation mode consequently along this signal of positive X-direction emission light and the signal phase quadrature of launching along Y direction (in this signal frequency space rotation), and this propagation delay to compare with this signal period be negligible, this angle A 1 that is formed by two intersections 637,639 of hauling out to this signal source from this wave detector then will be with identical in the phase difference between signals of wave detector measurement.
If add one the 3rd fixed position wave detector 621, then will form one second angle A 2 in the signal source intersection because of three lines.Similarly, this angle A 2 that is between the line of point of crossing will be identical with the phase differential of the signal measured between this wave detector.By using some basic triangles, known fixed position that can be by this wave detector and the phase differential of measuring the signal of this wave detector are searched the position of this signal source in this X-Y plane.If arrange this three wave detector with the distance that equates between three wave detectors along straight line, this calculating becomes unessential.
With reference to Figure 26, angle calculation B and the A angle measured according to sensor, " a " and " b " is as follows:
Have: a/A=d/R (1)
And b/B=d/R (2)
With B+A+b+a=180 ° (3), according to basic geological theorems,
We obtain: B/A=b/a, (4),
B=A * b/a (5) correspondingly
A=B×a/b (6);
Now we obtain with (3) substitution (5) and (6):
A * b/a+A+b+a=180 ° (7) and
B×a/b+B+b+a=180°(8);
We solve A and B with them:
A=a×(180°-b-a)/(a+b) (9)
B=b×(180°-b-a)/(a+b) (10)
Rotating light on this nib can use some (for example eight) by LED 623 realizations of T/N with the Time Triggered of spaced apart, and wherein T is the whole period in this LED cycle, and N is the number of LEDs.For example, eight emission light diodes (LED) can be arranged on the circle outside the sensing, and being separated by and having 45 signal oscillators of spending phase differential by one between the adjacent LED s with 45 degree spaces drives.
Shown in Figure 27 and 28, these three wave detectors 641 can be negative (PIN) diode photodetectors of original, drive one by a transimpedance amplifier 643 and the signal processing chain 642 that high-gain limiter 645 is formed, so that eliminate any Modulation and Amplitude Modulation in the detection signal.
Can finish phase-shift detection with an add subtract counter type of two edge-triggered phase detector 649, two binary counters and one the some metric clocks of operation on this signal frequency.If consequently they add 1 counting to each clock period to lead to this counter, the phase place of a sensor is in advance in another one in this clock period, and for each clock period countdown, the phase place of a sensor is delayed in another one in this clock period, and be provided with one the 3rd counter add continuously 1 the counting, a microprocessor all counters that can read periodically and reset then are by reading this counter that moves continuously to the bi-directional scaling that reads from these two counters that are connected to this phase detector (by driving).This number is the phase differential (is unit with the slope) between these three sensors, and identical with angle the point of crossing of line from this sensor to this source.Calculating this source then is an inappreciable task with respect to the position of this sensor.
Light activator switch alternative
Can use different light Activiation methods, comprise conductive rubber, pressure sensitive or strainmeter.
Coordination between allow pressure sensitive a variable pressure threshold value and this switching point and this ink flow.This will make at this ink and prevent data degradation when yet this pen of a vestige does not have activation.For example, most of refill for ball-point pens disengaged ink at 20 to 30gf+/-30% o'clock, and an existing switch activates at 50 to 100gf and+/40gf simultaneously, made to realize that ink flows and the reliable coordination of data acquisition.Special-purpose pen core can be designed to prevent that the ink that is lower than 50gf from flowing, so that can use existing chip switch.
Optical device alternative
Can use another method to be used for from this nib emission light.Optical fiber can be used for gathering from the light of a LED and in 360 ° of modes around this nib launches this light.Independent led chip can be set at around this nib and via semi reflective lens/window emission light, so that launches 50% light and other 50% mix by internal reflection so that with other light, finally produces uniform 360 ° of illumination.Thereby the light that can use special-purpose ring to mix from single LED redistributes these light as consistance.
A passive alternative
If this IR light source is close to this sensor setting, this can be fully passive.To provide a reflecting surface near the local of nib or at nib.This sensor it will be appreciated that from the ultrared reflected light of this nib and calculates angle as mentioned above.
This nib must have only when applying pressure to paper and ink formation vestige just reflective.Otherwise also have the wrong vestige of digital form when not having corresponding vestige on paper.
The activation of this reflection organization can be machinery or electric.In a kind of machinery was implemented, the pressure on this nib will be opened a sheath and expose this nib reflecting surface on every side.In a kind of electric enforcement, the pressure on this nib will activate liquid crystal or other makes the photoelectric technology of this material reflection ray.From other reflected by objects light, can be as finger nail and ring by solving with the polarization infrared ray.
A passive supporter
On the contrary, this supporter can have two catoptrons, and this pen had both been launched light and also received reflected light.Sensing element on this can be a kind of 2 dimension PSD or CMOS arrays.If use the planar sensor, this pen can not be omnidirectional, but it can form a kind of circular two-dimensional sensor of customization, and this will have 360 ° of coverages.
Keyboard and mouse are replaced architecture
As mentioned above, this PC input equipment that can be used for the standard of replacing is such as mouse and keyboard.
In the sub as keyboard or mouse, paper, plastics or other plane can have the keyboard pattern of a printing with acting on for example keyboard and the mouse pad of personal computer, pocket computer and portable phone.
Now, when the input data arrived in personal computer, pocket computer or the cell phone, the user was subject to keyboard, keypad or the finger on screen mostly and touches input.Be efficiently and easily when keyboard is actual size, but when being used for mancarried device such as palmtop computer and portable phone just dying.Cellular keypad is effectively for dialing phone number, but needs too much keystroke when attempting to produce ASCII letter and symbol, makes the data input of any kind all become a very tediously long and time-consuming procedure.Finger on the screen of hand-held device touches input and minimizes for the amount that the handwritten form of this device demand is discerned, need this user to use single writing style, perhaps need this user on the dummy keyboard that shows on this screen, to rap such as " graffiti " (graffito).Both refer to touch method and often produce incorrect input, have limited the functional of this device.
Electronic pen can be by providing the pattern of the reliable method of a kind of height, be used for the input text character and record hand-written image and lines.The user keys in needed all just a piece of papers or other any surface the printed patterns of neither one keyboard (have or) with pen.
This electronic pen is used for replacing mouse or keyboard together with the space ability of transcribing of keyboard template.
This paper keyboard can be multiple size according to user's needs.Size can be from 8 1/ 2* 11 paper vary to the size of a cell phone cover.The keyboard size that this user at first selects him to expect is then by calibrating with the designated character on this this keyboard of contact.In order to key in a piece of news, this user contacts this nib on suitable key.In the square area of this this paper of contact corresponding to a certain letter, this position of nib is calculated and definite specified letter.This method allows this user to generate text with an electronic pen on a computing machine, and need not to rely on any handwritten form identification software.
This method is touched input method than current embedding keypad, software keyboard or the finger on screen on the personal device that constantly dwindles improvement.This keyboard made of paper make the user hand-held with portable phone on quicker and key in message more reliably than replacement method.This paper can also use so that record is drawn and hand-written bill and image with other pattern.When finishing, this keyboard made of paper can be dropped or folding usefulness in order to future.
Except that character, this keyboard can also comprise shortcut and function key, enables more effective mutual with midget plant.Shortcut can reduce to minimum with enabling the desired keystroke number of order.Shortcut can customize according to being transfused to type of device.
This keyboard can also comprise a part as mouse pad made of paper.The ability of transcribing in the space by using this electronic pen, this user can move in the square space of an appointment on this paper, so that moves a point subsequently on the screen of a device.Therefore, the alternative that this mouse made of paper touches as button and the finger on screen is as a kind of equipment of navigating on a screen hand-held or portable phone of being used for.
This paper keyboard also has the dirigibility of the foreign character of input.Can create keyboard for some kinds of language, such as Japanese, Korean, Spanish, French and Russian.If wish a kind of different letter of input, the user can only be printed a kind of new keyboard.
As shown in figure 29, in order to key in a piece of news, this user contacts this nib 701 on the suitable key 703 that is printed on the keyboard 705 made of paper.Follow the tracks of by tracker 707 this position that is touched, and sends to a mancarried device such as a portable phone 711 or a palmtop computer 709 after being converted into text.
After use, this paper keyboard can be folded or abandon.
In other was implemented, the paper that does not have to print was done keyboard; But when this pen was used for writing on any surface, warp was owing to write the motion of this pen of body recognition and tracking to draw text, order and picture.
In a kind of enforcement of this method, this mouse and keyboard can continue to be used, and this pen is as a kind of alternative.This pen can be with " fixed-point apparatus " (mouse) pattern or the operation of " character input " (keyboard) pattern.This pattern can be selected by specialized hardware switch on a supporter or the pen or button, and is perhaps selected by sending an order from personal computer to supporter.
In mouse mode, the pen operation is indistinguishable with the operation of one second (USB) mouse.It is a kind of on screen the relative positioning fixed-point apparatus of moving cursor.In keyboard mode, the pen input can receive by a kind of custom-designed application program, and this application program uses an effective Character recognizer that figure input (stroke) is converted to character.Other application program is not known this existence and is continued to use conventional (tradition) keyboard operation.
In other method, this is unique input media to this system.In this case, a kind of software-driven stack is modified so that the keypad function of system-wide is provided.The mouse mode operation does not influence and is consistent with first describing method.In with the keyboard mode operation, the pen input sends system's input queue in the mode similar to traditional keyboard input then by embedding the effective handwritten form identification software identification of keyboard filtration drive inside.
This second method needs the modification of a kind of platform availability model and (probably) certain system's ingredient, such as basic input/output (BIOS).
Two kinds of methods increase human factor and availability issue.Specifically, exist the identification of two kinds of handwritten forms substantially by way of discrete (each independent character) and continuous (each word, phrase or page or leaf).In the previous case, this user must rely on computer screen output continuously in order to feed back.This may be inflexible, must often interrupt this person's handwriting processing because watch computer screen attentively for feedback.In the situation of back, the user only must watch screen attentively once in a while, when a writing unit (word or phrase) is finished and corrected it as required.
Switching to an input mode from mouse can carry out by retractable pen core action.When this refill is within this (pen can not be write), it is used as a mouse.Write be activated in, this pen is as a keyboard.
Other embodiment is within the scope of following claim.
This supporter does not need to comprise an aforesaid inkwell, yet can be the device that can hold this sensor of any kind of.This supporter can be a simple cap for brush, shown in before, perhaps can be other any kind device, no matter whether it closely cooperates or this cap is lived, also no matter whether it comprises a clip.For example, this supporter can be incorporated a board or the notebook that folder is arranged into.
Light in this can be optical fiber, and light is delivered to nib, and its all directions around this is transmitted this light with a kind of pattern as disk.

Claims (8)

1, a kind of equipment that is used to follow the tracks of the writing implement position comprises:
Two or more sensors, described sensor comprises a plurality of pixels, and be set at the light sensing that receives the writing implement on the comfortable two-dimentional writing surface and
Produce the sequence signal of expression light sensing, be used to determine the position of the writing implement on two-dimentional writing surface, the feature of at least one sensor is, by the instability of a plurality of pixel data outputs of sensor;
Optical device is set to the light intensity of enhancing from the light of this writing implement reception; With
Processor, a part center of gravity that is set at received signal and determines to export by the subarray of a plurality of pixels, this subarray is the center with the pixel that approaches most from the sub-pixel position of the light of writing implement, is used to increase the stability of being calculated from the sub-pixel position of the light of writing implement.
2, equipment as claimed in claim 1 is characterized in that, described processor also be set at strengthen this signal for tilt by this writing implement or with the caused vulnerability to jamming that receives the Strength Changes of light of the distance of this writing implement.
3, equipment as claimed in claim 2 is characterized in that, the vulnerability to jamming of enhancing signal comprises the integer power of determining all signal distributions on this sensor.
4, equipment as claimed in claim 2 is characterized in that, the vulnerability to jamming of enhancing signal comprises the sub-locations of pixels of half calculating according to this integer power position.
5, equipment as claimed in claim 2 is characterized in that, the vulnerability to jamming of enhancing signal comprises uses a polynoimal approximation to calculate a sub-pixel position with approximate maximum position to this signal distributions.
6, equipment as claimed in claim 1 is characterized in that, described sensor comprises:
The optical sensors of opening by a separating distance;
Produce sequence signal comprise determine with respect to a received direction of this light of reference direction and
The signal of expression direction is provided.
7, equipment as claimed in claim 1 is characterized in that, at least one in described two sensors comprises a CMOS or ccd array.
8, equipment as claimed in claim 1 is characterized in that, this processor is set at, and on writing surface, the sub-pixel position of calculating is converted to the coordinate of writing implement.
CNB00814981XA 1999-10-27 2000-10-27 Tracking motion of a writing instrument Expired - Fee Related CN1310122C (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US16175299P 1999-10-27 1999-10-27
US60/161,752 1999-10-27
US23091200P 2000-09-13 2000-09-13
US60/230,912 2000-09-13

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CNA2007100852622A Division CN101071351A (en) 1999-10-27 2000-10-27 Tracking motion of a writing instrument

Publications (2)

Publication Number Publication Date
CN1599894A CN1599894A (en) 2005-03-23
CN1310122C true CN1310122C (en) 2007-04-11

Family

ID=34681128

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB00814981XA Expired - Fee Related CN1310122C (en) 1999-10-27 2000-10-27 Tracking motion of a writing instrument

Country Status (1)

Country Link
CN (1) CN1310122C (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102692182A (en) * 2011-03-23 2012-09-26 刘中华 Optical detection system used for screen touch control input device
TWI479390B (en) * 2011-08-19 2015-04-01 Tpk Touch Solutions Inc An optical touch system and a positioning method thereof
CN102778979A (en) * 2012-06-28 2012-11-14 广州视睿电子科技有限公司 Optical touch method and device thereof
EP2698260A1 (en) * 2012-08-17 2014-02-19 BlackBerry Limited Combination pen refill cartridge and active stylus
US9129180B2 (en) 2012-08-17 2015-09-08 Blackberry Limited Combination pen refill cartridge and active stylus
CN103846974A (en) * 2012-11-28 2014-06-11 南通跃通数控设备有限公司 Technology capable of automatically correcting pattern positions and applied to quadrilateral gauge square saw
CN103995491B (en) * 2013-02-20 2016-06-15 西门子公司 The graphical output system of programmable logic controller (PLC) and programmable logic controller (PLC)
TWI496059B (en) * 2013-11-27 2015-08-11 Wistron Corp Touch locating method and optical touch system
CN104615313A (en) * 2015-03-06 2015-05-13 京东方科技集团股份有限公司 Touch display screen and touch displayer
JP7447001B2 (en) * 2017-12-30 2024-03-11 ペリメトリクス,インク. Determination of structural features of objects
CN109117028A (en) * 2018-08-27 2019-01-01 四川仪岛科技有限公司 A kind of electronic writing method for detecting position and device
CN109814740B (en) * 2019-02-22 2022-04-15 曲阜学能通教育科技有限公司 Interactive intelligent painting and calligraphy equipment and interactive method
CN110197675B (en) 2019-06-04 2022-10-21 京东方科技集团股份有限公司 Mobile storage device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5945981A (en) * 1993-11-17 1999-08-31 Microsoft Corporation Wireless input device, for use with a computer, employing a movable light-emitting element and a stationary light-receiving element
US5963194A (en) * 1993-11-25 1999-10-05 Alps Electric Co. Ltd. Apparatus for inclination detection and input apparatus using this apparatus

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5945981A (en) * 1993-11-17 1999-08-31 Microsoft Corporation Wireless input device, for use with a computer, employing a movable light-emitting element and a stationary light-receiving element
US5963194A (en) * 1993-11-25 1999-10-05 Alps Electric Co. Ltd. Apparatus for inclination detection and input apparatus using this apparatus

Also Published As

Publication number Publication date
CN1599894A (en) 2005-03-23

Similar Documents

Publication Publication Date Title
CN1310122C (en) Tracking motion of a writing instrument
US7268774B2 (en) Tracking motion of a writing instrument
CN1310493C (en) Image reader
CN1286052C (en) Finger print input device
CN1193606C (en) Photographic picture retrieval device, electric photographing device and photographic picture retrieval method
CN1252576C (en) Pen type optical mouse device and method of controlling the same
CN1084008C (en) Coordinate inputting apparatus and signal transmitting system thereof
CN1152345C (en) Optical scanning-type touch panel
CN1074843C (en) Cursor positioning unit
RU2386161C2 (en) Circuit of optical system for universal computing device
CN100422915C (en) Universal computing device
CN1667567A (en) Coordinate input apparatus and its control method
CN1156745C (en) Calendar
CN1659505A (en) Method and system for obtaining positioning data
CN1220131C (en) Coordinate input device and its controlling method, and program
CN1324030A (en) Carried type information processing terminal device
CN1493053A (en) Data input device
CN1910431A (en) Image processing system and camera
CN1577227A (en) Inputting key and inputting device
CN1955898A (en) Remote control system, and display device and electronic device using the remote control system
CN1425150A (en) Handwritting data input device and method, and authenticating device and method
CN1922932A (en) Illumination control system
CN1177747A (en) Automatic-tracing lighting equipment, lighting controller and tracing apparatus
CN1695156A (en) Information reproduction/i/o method using dot pattern, information reproduction device, mobile information i/o device, and electronic toy
CN1672021A (en) Image processing system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20070411

Termination date: 20111027