SYSTEM AND METHOD FOR CONDUCTING AND AUTHENTICATING TRANSACTIONS
1. Reference to Related Applications
The present appli cation claims priority from each of the following five patent applications: U.S. provisional patent application no. 60/100,240 filed
September 14, 1998 which is hereby incorporated by reference in its entirety; U.S. provisional patent application no. 60/108,473 filed November 15, 1998 which is hereby incorporated by reference in its entirety; U.S. provisional patent application no. 60/123,069 filed March 3, 1999, which is hereby incorporated by reference in its entirety; U.S. provisional patent application no. 60/140, 168 filed June 20, 1999 which is hereby incorporated by reference in its entirety; and U.S. patent application no. 09/190,652 filed November 12, 1998 which is hereby incorporated by reference in its entirety.
PCT application no. PCT/TJ398/01957 filed November 13, 1998, is hereby incorporated by reference in its entirety.
Field of the Invention
The present invention relates generally to a system and method for the generation and use of electronic data and more particularly to the generation and use of electronic data representing the motions of a writing implement.
Background
A keyboard in one form or another has, for a long period of time, played a dominant role in the interface between humans and electronic devices, including computers. Despite this fact, a large number of computer users lack proficiency in the use of a keyboard for entering information into a computer. Additionally, a number of languages, especially those that use characters, are not easily mapped onto a keyboard. Several technological solutions have been suggested in an attempt to solve these and other problems. Two commonly suggested solutions are digitizing tablets and voice entry systems.
Digitizing tables typically involve a stylus and a special writing surface or tablet. The movements of the stylus are converted into electronic signals for entry into a computer or other electronic system by the tablet. Such systems are
typically expensive because not only must the writing implement be purchased, but also the user must purchase the specialized tablet.
Additionally, the user is often restricted to writing only on the area of the tablet and in some cases the user may not even be able to place a pad of paper on top of the tablet. The required tablet may also impact the practical portability and hence the utility of the system.
Typical voice entry systems, despite recent improvements, can be slow and may have trouble understanding a user's voice. Additionally, there are many situations in which voice entry is not appropriate or desirable such as when taking notes at a meeting, signing an electronic authorization, or in a situation in which background noise levels are too high.
What is needed is a system and method for generating electronic signals from human hand motions that does not require a special writing surface and that can be used in situations in which the user would ordinarily desire to use handwriting or other hand motions to generate the input. Preferably such a system would be inexpensive and easily portable.
Summary of the Invention
One embodiment of the invention is a system and method for generating data representing the position of a writing implement. This embodiment includes a writing implement comprising an infrared detector coupled to an ultrasound transducer, and a position sensing device including an infrared emitter coupled to a timing device and a first ultrasound detector separated by a predetermined distance from a second ultrasound detector, the first and second ultrasound detectors being coupled to the timing device. This embodiment operates as follows. The infrared emitter emits an infrared pulse that is detected by the infrared detector of the writing implement. The detection of the infrared pulse by the infrared detector causes an ultrasound pulse to be emitted by the ultrasound emitter of the writing implement. The ultrasound pulse is detected by the first ultrasound detector and the second ultrasound detector a predetermined distance away. The timing device determines a first elapsed time between the emission of the infrared pulse and the detection of the ultrasound pulse by the first detector and a second elapsed time between the emission of
the infrared pulse and the detection of the ultrasound pulse by the second ultrasound detector. The position of the writing implement can then be determined using the speed of ultrasound in air, the first and second elapsed times, and triangulation. Another embodiment of the present invention is a system and a method for a transponder. In this embodiment the transponder system includes an infrared radiation detector coupled to an ultrasound generating device, and the infrared radiation detector and the ultrasound generating device are both attached to a stylus which may include a writing implement. In another embodiment, a switch for controlling operation of the infrared radiation detector is coupled to the tip of the stylus such that when pressure is applied to the tip of the stylus, infrared radiation detected by the infrared radiation detector will result in the generation of an ultrasound wave or pulse by the ultrasound generating device. In another embodiment of the invention an electromagnetic radiation detector is coupled to a device for generating compression waves. In one aspect of this embodiment, the device for generating compression waves includes an ultrasound pulse generator such as an ultrasonic transducer, and the compression waves include an ultrasound pulse, the device for generating compression waves may also include a device for impedance matching the device for generating compression wave to air, the device for impedance matching may include a horn. In another aspect of this embodiment, a switch for controlling operation of the transponder can be coupled to the electromagnetic radiation detector and to a housing. In yet another aspect of the invention, the housing is a stylus, and the stylus may be a writing implement such as a pen. In another aspect of this embodiment, the electromagnetic radiation detector and the device for generating compression waves can be both at least partially contained in or connected to a housing. The housing can include but is not limited to a stylus, a writing implement, a scanner, a bar code reader, a laser pointer, a mouse, a joystick, a paintbrush, a surgical instrument
(e.g., a scalpel, or catheter). In still another aspect of the invention, the device for generating compression waves is positioned near an end of the stylus, preferably near the end of the stylus that is of interest such as the end used for
writing, pointing, or indicating. In yet another aspect of this embodiment, the housing includes a smart card.
In a further aspect of the invention, the electromagnetic radiation detector is coupled to a mode detector and the mode detector includes a memory. The mode detector includes a draw mode and a data mode wherein in the data mode, when the electromagnetic radiation detector receives a data mode electromagnetic pulse or signal, one or more compression waves are generated by the device for generating compression waves corresponding to data in the memory to be transmitted. In the draw mode a received electromagnetic pulse results in the generation of a compression wave by the device for generating compression waves, wherein the generated compression wave does not contain data in the memory to be transmitted. Data which can be stored in the memory includes but is not limited to: stylus information such as type of stylus, color of tip (e.g. color of pen ink), thickness of tip; user identification information such as name, address, identification number or information, social security number, signature information or a representation of a signature; data; computer related information such as key stroke information, instructions concerning the downloading of information from a network such as the Internet; Internet web site information or addresses; advertising information for transmission and display; insurance information such as car, home owners or other insurance coverage; credit information; bank account or other monetary, banking, or financial information; debit card related information; or heath and health care related information such as insurance coverage, medical history, or prescription information. In other embodiments the mode detector is switched between modes by a mode switch coupled to the housing.
In yet a further aspect of the invention, the mode detector includes a receive data mode wherein in the receive data mode, when the electromagnetic radiation detector receives a receive data mode electromagnetic pulse or signal, information received by the electromagnetic radiation detector is stored in the memory in the mode detector. In other embodiments the mode detector is switched between modes by a mode switch coupled to the housing.
Still another embodiment of the invention includes a system and method for position sensing comprising an electromagnetic radiation source, a first
ultrasound detector and a second ultrasound detector, the first ultrasound detector being separated from the second ultrasound detector by a predetermined distance. A device that determines a first elapsed time between the emission of a pulse from the electromagnetic radiation source and the reception of an ultrasound pulse by the first ultrasound detector, and a second elapsed time between the emission of the pulse and the reception of the ultrasound pulse by the second detector is coupled to the electromagnetic radiation source. One aspect of this embodiment includes a processor, computer or other electronic device coupled to the device that determines the first and second elapsed times.
Yet another embodiment of the invention includes a system and method for electronic position sensing of a stylus comprising a stylus and a position sensing device. The stylus includes an electromagnetic radiation detector coupled to a device for generating compression waves, the detector and the device for generating compression waves both being coupled to the stylus. The device for generating compression waves may include but is not limited to an ultrasound pulse generator. The position sensing device includes an electromagnetic radiation source coupled to a first device for detecting compression waves and a second device for detecting compression waves, the first device for detecting compression waves being separated from the second device for detecting compression waves by a predetermined distance. One or more of the devices for detecting compression waves may include but is not limited to an ultrasound detector. Coupled to the first device for detecting compression waves and the second device for detecting compression waves is a device that determines a first elapsed time between the emission of a pulse from the electromagnetic radiation source and the reception of a compression wave by the first device for detecting compression waves and a second elapsed time between the emission of the pulse from the electromagnetic radiation source and the reception of the compression wave by the second device for detecting compression waves.
In one aspect of the invention, the second elapsed time can be measured by determining the differential time elapsed between the reception of the compression wave by the first device for detecting compression waves and the
reception of the compression wave by the second device for detecting compression waves and adding this differential elapsed time to the first elapsed time.
The first elapsed time and the second elapsed time, together with the speed of the compression waves in air, can be used to triangulate the position of the device for generating compression waves.
An embodiment of the invention operates as follows. An electromagnetic pulse is transmitted from the electromagnetic radiation source, and the electromagnetic pulse is detected by the electromagnetic radiation detector. When an electromagnetic pulse is detected by the electromagnetic radiation detector, the device for generating compression waves (e.g. ultrasound pulse generator) coupled to the electromagnetic radiation detector emits a compression wave (e.g. an ultrasound pulse). This compression wave is detected by a first compression wave detector and a second compression wave detector placed a predetermined distance from the first compression wave detector. A device determines a first elapsed time between the emission of the electromagnetic pulse and the detection of the compression wave by the first compression wave detector, and a second elapsed time between the emission of the electromagnetic pulse and the detection of the compression wave by the second compression wave detector. In one aspect of this invention, the distance from the device for generating compression waves to the first and second compression wave generators is determined using the known speed of the compression waves in air and the first and second elapsed times. In one aspect of the invention, this process is repeated with the emission of more electromagnetic radiation pulses and the reception of more compression waves.
Another embodiment of the invention further includes a device for receiving voice input coupled to either the stylus or the position sensing device. The device for receiving voice input may be coupled to a device for voice recognition, or the device for voice input may transmit the received voice information to another location such as a computer for processing or recognition. In other embodiments, a device for outputting voice information is coupled to either the stylus or the position sensing device and the device for outputting voice information may be configured to reproduce sounds or voice
information from information stored in a memory in the stylus or in the position sensing device. The device for outputting voice information may also be configured to output information received from another location via, for example, radio waves, or modulated on the pulse from the electromagnetic radiation source.
According to another aspect of the invention, the electronic writing system includes a resource that determines a position of the ultrasound emitter from information including the first elapsed time, the second elapsed time, the speed of the ultrasound pulse, and the predetermined distance between the first ultrasound detector and the second ultrasound detector. According to still another aspect of the invention, the process for determining the position of the ultrasound emitter is repeated and a set of points representing the position of the ultrasound emitter over time can be generated. Additionally, this repeated process can be used to gather or generate data related to velocity, acceleration, and other aspects of the movements of the ultrasound pulse generator and the housing to which it is attached.
In a further aspect of the invention, the data gathered by the position sensor is input into a computer. This data may be displayed on display; processed for handwriting or object identification or recognition; used to generate input for a computer file such as a word processing file, an email file, or an Internet web site; used to fill in or generate comments or annotations for an existing file; or used to navigate a user interface or Internet browser (e.g. substituting for a mouse). Computer files containing the data can then be transferred to other computers or processors by email or through a network such as the Internet. In one aspect of the invention, the computer file is transmitted along with a computer application or computer file which allows a user on another computer to read or view the data in a desired format. For example, data representing drawing or handwriting may be sent via email to another location along with a computer application which allows the receiving computer to view the drawing or handwriting so that the receiving computer need not already include software or hardware to view the drawing or handwriting.
Additionally, in embodiments in which the ultrasound pulse generator is coupled to a housing that includes a scanner, the scanner information and the
position information can be used to reproduce an image of the scanned information.
In still another aspect of the invention, the position data gathered by the position sensing device is input into a computer for processing, displaying or transmission to another location. The position sensing device can be coupled to a computer or other processor by systems including but not limited to standard wires or cables, wireless links using radio waves, microwaves, ultrasound, LRDA (an infra-red standard), Blue-tooth (a radio frequency standard), or modulated on audio frequency electrical signals suitable for communicating and processing using sound processing equipment (see, for example, U.S.
Provisional Patent Application serial No. 60/090267 filed 6/22/98 which is hereby fully incorporated by reference).
According to still another aspect of the invention, a resource uses information including the set of points representing the position of the ultrasound emitter over time to generate symbols including but not limited to letters, words, characters, images, pictures, and shapes.
In yet another embodiment of the invention, one or more of the data points or locations generated by the position sensing device corresponds to one or more of the following pieces of information: stylus information such as type of stylus, color of tip (e.g. color of pen ink), thickness of tip; user identification information such as name, address, identification number or information, social security number, signature information or a representation of a signature; data; computer related information such as key stroke information, instructions concerning the downloading of information from a network such as the Internet; Internet web site information or addresses; advertising information for transmission and display; credit information; bank account or other monetary information; or debit card related information; information related to the generation of a draw mode or data mode signal for reception by the mode detector. In operation this embodiment functions as follows. A user places the housing in a particular location or performs one or more motions with the housing. The data corresponding to location, velocity and/or acceleration of the housing is then gathered by the position sensing device. This data is input into a processor or computer which contains a mapping or a look up table that relates
the data to particular functions or information. For example, holding the housing at a particular location for a predetermined length of time may correspond to a request for the computer to access a particular web site.
In a further aspect of this embodiment, different mappings or look up tables relating the data to particular functions or information can be loaded (e.g. from a memory in the computer, or through a network such as the Internet), to allow varied functionality. The mappings or look up tables can be displayed on a screen to allow a user to know the available functions and how to access them (e.g. the location that corresponds to the functionality). In operation this embodiment may function as follows. When the position sensing system is first turned on a default set of mappings is loaded onto a screen of a computer coupled to the position sensing system. Along the top boarder of the screen, icons and pull down menus for a variety of functions are displayed such as icons related to changing the color of the position data displayed on the screen, an icon for a word processing application, an icon for an Internet browser application, an icon for an email program, and a pull down menu to select other mappings for display on the screen. To access these icons or menus a user positions the housing coupled to the device for generating compression waves at the location corresponding to the icon or function the user desires to access. A pointer or other visual display cue may be displayed on the screen to assist the user in positioning the housing at the proper location. In another aspect of this embodiment, the housing may contain one or more selection button (e.g. like those on a computer mouse) which the user presses to indicate that the icon or function mapped to the location of the housing is to be selected. A selection signal is then sent to the device for generating compression waves and this selection signal is transmitted to the position sensing device. Upon reception the position sensing device relays this signal to the computer and the icon or menu at the mapped location of the housing is selected commencing operation of the function related to the icon or menu (e.g. running a computer program, accessing a web site, etc.).
Another embodiment of the invention includes a system and method for conducting and authenticating transactions. Still another embodiment includes a system and method for the use of biometrics and other user information to
authenticate and facilitate transactions and the collection of transaction information over a network.
Yet another embodiment of the invention includes a system and method for the generation and use of digital information to facilitate business transactions. In one aspect of this embodiment data including data points gathered as described above are transmitted through a network to a server. The server processes the data to verify the user and determine if a transaction should be authorized.
Brief Description of the Drawings Figure 1 depicts an embodiment of the invention in which the transponder system includes an electromagnetic radiation detector;
Figure 2 depicts another embodiment of the invention in which the transponder system includes an infrared detector;
Figures 3 A - 3G depicts an embodiment of the invention in more detail in which the transponder system includes a TFDU4100 [plus B-G] infrared detector;
Figure 4 depicts the voltage output from driver circuit 320; Figures 5 and 6 show the form of the currents flowing from/into collectors of transistors Ql (upper) and Q2 (lower) of driver circuit in Figure 3; Figure 7 depicts another embodiment of the invention in which the transponder system is contained at least partially within or attached to the housing;
Figure 8 depicts one embodiment of a position sensor which includes a first compression wave detector and a second compression wave detector; Figure 9 depicts another embodiment of the invention which includes a position sensor which includes a first ultrasound detector and a second ultrasound detector;
Figures 10A-C depict typical waveform at locations A-C in Figure 9 after amplification; Figure 11 depicts a data protocol for the data protocol sent from the microcontroller to the processor in one embodiment of the invention;
Figure 12 depicts a detailed schematic of an embodiment of the invention;
Figures 13A and 13B depict, respectively, the directivity of an exemplary ultrasound transducer used in a transponder in one embodiment of the invention, and an ultrasound detector used in an embodiment of a position sensor of the present invention;
Figures 13C and 13D are, respectively, typical specifications for the transducer and detector of Figures 13 A and 13B;
Figure 14 depicts a directivity pattern of an embodiment of a device for generating compression waves used in a transponder;
Figure 15 depicts a compression wave signal generated by an embodiment of a device for generating compression waves in a transponder;
Figure 16 depicts another embodiment of the invention in which more than one device for generating compression waves is coupled to each transponder and the devices for generating compression waves are pointed in different directions so that the orientation of the transponder is less critical;
Figure 17 depicts yet another embodiment of the invention in which more than two devices for detecting compression waves are used;
Figures 18A-18K are a flow chart representing one embodiment of software;
Figure 19 depicts still another embodiment of the invention in which the transponder system includes an electromagnetic radiation detector which is coupled to a mode detector and switch;
Figure 20 depicts an embodiment of the invention which includes an infrared detector coupled to the first input of an AND-gate;
Figure 21 depicts a detailed embodiment of the mode decoder;
Figure 22 depicts the timing of the various signals for an embodiment of the invention;
Figure 23 depicts an embodiment of the invention including a network for transmitting electronic data to facilitate business transactions;
Figure 24 is a depiction of an embodiment of the invention including biometric unit devices coupled via a network to a computer including a verification program;
Figure 25 depicts a depiction of an embodiment of the invention including a customer computer, a merchant computer and a computer including a transaction/authentication program all coupled via the Internet;
Figure is a flow chart depicting the operation of an embodiment of the invention;
Figure 27 depicts information included in the transaction information sent by a merchant computer in an embodiment of the invention;
Figures 28A-28C depict 3 embodiments of a registration system; and
Figure 29 is a flow chart depicting an embodiment of the registration process.
Detailed Description
The following description is presented to enable a person skilled in the art to make and use the invention, and is provided in the context of a particular application and its requirements. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. Thus, the present invention is not intended to be limited to the embodiments disclosed, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
Figure 1 depicts an embodiment of the invention. In this embodiment transponder system 100 includes electromagnetic radiation detector 102. Electromagnetic radiation detector 102 can include but is not limited to an infrared radiation detector such as part number TDU4100 from Temic or its functional equivalent.
In the embodiment depicted in Figure 1, electromagnetic radiation detector 102 is coupled to switch 104. Switch 104 is optional and can be eliminated without departing from the invention. If switch 104 is present it can be configured to be actuated by events including but not limited to a pressure applied to the switch or an actuator (not shown) connected to the switch, a predetermined sequence as detected by electromagnetic radiation detector 102, or the passage of predetermine period(s) of time. Switch 104 can be configured
such that it controls operation of electromagnetic radiation detector 102 or device for generating compression waves 106 by, for example controlling the supply of power to them. This configuration may be used to limit the power consumed by transponder system 100 to only those instances when it is desired to have transponder system 100 in an enabled state. Additionally, switch 104 may control the transmission of a signal from electromagnetic radiation detector 102 to device for generating compression waves 106.
Device for generating compression waves 106 is coupled to electromagnetic radiation detector 102. Suitable devices for generating compression waves 106 include but are not limited to an ultrasonic transducer such as one made using a piezoceramic element to generate an ultrasonic signal.
In operation, assuming optional switch 104 is absent, when an electromagnetic signal is detected by electromagnetic radiation detector 102, one or more ultrasonic pulses are emitted from device for generating compression waves 106. In one embodiment, device for generating compression waves 106 generates ultrasonic waves with a frequency range from about 1 kHz to about 500 kHz or any range subsumed therein, preferably with a frequency range between about 10 kHz and about 100 kHz, even more preferably with a frequency range between about 30 kHz and about 50 kHz, and in one preferable embodiment at a frequency of about 40 kHz.
In embodiments in which switch 104 is present, device for generating compression waves 106 does not generate a compression wave each time a suitable electromagnetic radiation pulse hits electromagnetic radiation detector 102. A compression wave is generated only when switch 104 is in a state which puts transponder system 100 in an enabled state and allows transponder system
100 to emit a compression wave.
In one embodiment, switch 104 is coupled to a pressure sensitive actuator. The pressure sensitive actuator is coupled to the tip of a stylus so that transponder system 100 is in an enabled state when, for example, the tip of the stylus is pressed against a surface. Other actuators which can be used include but are not limited to a heat sensitive actuator or a pressure sensitive actuator on the tip of a stylus which can be configured to sense the presence of a human touch.
Figure 2 depicts another embodiment of the invention. In this embodiment transponder system 200 includes infrared detector 202. The output of infrared detector 202 is input into the first input of AND-gate 204. The second input of AND-gate 204 is coupled to switch 206 and through pull up resistor 208 to Vcc.
In the embodiment of Figure 2, switch 206 is a normally closed switch (the position depicted in Figure 2) and transponder system 200 is in a non- enabled state. In this position the input to AND-gate 204 from switch 206 is connected to ground (i.e. logical "0") and pulses output from infrared radiation detector 202 are not transmitted through AND-gate 204. When switch 206 is in the enabled state the contact of the switch connects ground to contact "B" of Figure 2 and the second input to AND-gate 204 is at about Vcc (i.e. logical "1").
When switch 206 is in the enabled state, connected to contact "B," optional voltage converter 210 is activated. Voltage converter 210 converts the voltage output of power supply 212, which may be a battery, to a voltage level
Vcc suitable to run electronic components of transponder system 200. In one embodiment, voltage converter 210 operates as follows. When switch 206 is in the non-enabled state (as depicted in Figure 2) power supply 212 discharges through pull up resistor 214 until capacitor 216 is charged up. Power supply 212 is also connected to input 220 of voltage converter 210. When capacitor
216 is charged up, connection 218 of converter 210 is at approximately the same voltage as power supply 212, causing voltage converter 218 to shut down. In this shut-down mode, little or no current is drawn from power supply 212 allowing its useful lifetime to be extended. When switch 206 is in the enabled state, the voltage on connection 218 is brought to ground and voltage converter 210 is activated and converts the voltage of power supply 212 to a voltage of Vcc (e.g., 5 volts) at output 222. Optional by-pass capacitor 224 can be added to improve performance of the voltage converter. When switch 206 is again switched to the non-enabled state, capacitor 216 again charges up through pull up resistor 214. The time constant of this charging circuit can be chosen to set the period of time between the switching of switch 206 from the enabled to the non-enabled state, and the halting of the operation of voltage converter 210.
Voltage converter 210 can be eUminated in embodiments in which a voltage supply of sufficient voltage to directly operate the electrical components of the transponder system is used. In these embodiments, switch 206 is configured to prevent voltage from reaching one or more of the components of the transponder system when it is in the non-enabled state, and to allow voltage to reach the components of the transponder system when it is in the enabled state.
In the embodiment of Figure 2, when switch 206 is in the non-enabled state, output pulses from infrared detector 202 are not transmitted through AND-gate 204. When switch 206 is in the enabled state, output pulses from infrared detector 202 are transmitted through AND-gate 204 to one-shot generator 226. One shot generator 226 converts an input pulse of variable duration into a pulse of a predetermined duration suitable to operate driver 228 and ultrasonic transducer 230. The output pulse of one-shot generator 226 is input into driver 228, and driver 228 drives ultrasonic transducer 230.
Optionally, ultrasonic transducer 230 may be coupled to a horn or other impedance matching element to more efficiently couple the transducer to air. See, for example, the discussion in "A High Efficiency Transducer for Transmission to Air," by J. Kritz, IRE Trans. Ultrason. Eng., vol. UE-8, March 1, 1961, pp. 14-19, which is hereby fully incorporated by reference.
Figure 3 A depicts an embodiment of the invention in more detail. In this embodiment, transponder system 300 includes infrared detector 302 which is a TFDU4100. Data sheets for the TFDU4100 are in Figures 3B-3F. The output of infrared detector 302 is input into NAND gate 304 connected to function as an inverter. The output of NAND gate 304 is then input into the first input of NAND gate 306. The second input to NAND gate 306 is from terminal "A" of switch 308 connected through a 150 K-Ohm resistor to the Vcc output of voltage converter 310.
In the non-enabled position (depicted in Figure 3) switch 308 is connected to terminal "A" and the second input to NAND-gate 306 is held at ground (logical "0") preventing any pulses from infrared detector 302 from passing through NAND-gate 306. When switch 308 is in the enabled position as depicted by the dotted line connected to terminal "B," voltage converter 310
is activated and the voltage output by battery 312 is converted into voltage Vcc at output 314 driving the second input of NAND-gate 306 to a voltage near Vcc (logical "1 "). This allows pulses from infrared detector 302 to pass through NAND-gate 306 to one-shot generator 316. One shot generator 316 is a LMC555 biased to convert an input pulse into an output pulse of approximately 12.5 microseconds. This output pulse is fed through NAND-gate 318 wired as an inverter to provide a fast driving signal which is then sent into driver circuit 320 and ultrasound transducer 322. The specifications for a suitable transducer are in Figure 3G. Driver circuit 320 is configured so that the amplitude of the leading part of the generated ultrasound wave is as high as possible. Since the ultrasound transducer may have a high Q, the driver may cause ringing in the transducer. The ringing is reduced by having the lower transistor of driver circuit 320 short the transducer to ground just after the initial excitation of the transducer. Figure 4 depicts the voltage output from driver circuit 320, and Figures
5 and 6 show the form of the currents flowing from/into collectors of transistors Ql (upper) and Q2 (lower) of driver circuit 320 in Figure 3.
Figure 7 depicts another embodiment of the invention. In this embodiment, the transponder system is contained at least partially within or attached to housing 702. Suitable housings include but are not limited to a stylus such as a pen. In this embodiment, device for generating compression waves 704 is placed as close as possible to the portion of the housing whose location it is desired to have identified. In this embodiment, device for generating compression waves 704 is placed near the tip of housing 702. In one embodiment, device for generating compression waves 704 is placed within 3 centimeters of the tip or closer, or any distance subsumed therein, in another embodiment the device for generating compression waves is placed within 1 centimeter from the tip or closer.
Electromagnetic radiation detector 706 is coupled to device for generating compression waves 704 and is placed on the housing near the tip of housing 702. In other embodiments electromagnetic radiation detector 706 is placed at other locations on housing 702. Switch 708 is coupled to device for generating compression waves 704 and electromagnetic radiation detector 706
as discussed with reference to the embodiment of Figure 1. Switch 708 is configured to put the transponder system in the enabled stated when pressure is applied to the tip of housing 702 such as when it is pressed against a surface and to put the transponder system in the non-enabled state when pressure is not applied to the tip of the housing.
Figure 19 depicts still another embodiment of the invention. This embodiment may be useful in circumstances in which it is desirable to have data stored in the transponder system which can be selectively transmitted upon request. In this embodiment transponder system 1900 includes electromagnetic radiation detector 1902 which is coupled to mode detector 1904 and switch
1906 (similar to switch 104 of Figure 1). Switch 1906 is optional and can be eliminated without departing from the invention. If switch 1906 is present it can be configured to be actuated by events including but not limited to a pressure applied to the switch or an actuator (not shown) connected to the switch, a predetermined sequence as detected by electromagnetic radiation detector 1902, or the passage of predetermined period(s) of time. Switch 1906 can be configured such that it controls operation of electromagnetic radiation detector 1902, mode detector 1904 or device for generating compression waves 1908 by, for example, controlling the supply of power to one or more of these components. This configuration may be used to limit the power consumed by transponder system 1900 to only those instances when it is desired to have transponder system 1900 in an enabled state. Additionally, switch 1906 may control the transmission of a signal from electromagnetic radiation detector 1902 to device for generating compression waves 1908. Device for generating compression waves 1908 is coupled to mode detector 1904. Suitable devices for generating compression waves 1908 include but are not limited to an ultrasonic transducer such as one made using a piezoceramic element to generate an ultrasonic signal.
Mode detector 1904 includes a data mode and a draw mode, and a memory. In the data mode, selected data from the memory is transmitted from the mode detector to the device for generating compression waves, and the data is converted into and/or encoded on compression waves by the device for generating compression waves. In the draw mode each signal received by the
electromagnetic radiation detector 1902 results in a signal being transmitted by the device for generating compression waves 1908, and in essence transponder system 1900 behaves like transponder system 100 of Figure 1.
Mode detector 1904 is put into the data mode by the reception of a data mode signal by electromagnetic radiation detector 1902. In an alternate embodiment a mode switch is included in transponder system 1900 wherein the mode switch can be activated by a user to put the transponder system in data mode or draw mode. The mode switch can be used in addition to or in place of a resource in the mode detector which can detect a data mode signal. Figure 20 depicts another embodiment of the invention. In this embodiment transponder system 2000 can be housed in a stylus (not shown) which can be but is not limited to a pen, a pointer, a scanner, a bar code reader, or a computer mouse. This embodiment includes infrared detector 2002 coupled to the first input of AND-gate 2004. The second input of AND-gate 2004 is coupled to ground though switch 2006 and positive voltage (e.g. logical
"1") through resistor 2008 such that when switch 2006 is closed the second input of AND-gate 2004 is at ground. Switch 2006 may be placed on an accessible portion of the housing or for example, if the housing is a stylus, on the tip of stylus so that when the tip is pressed against a surface the switch is opened, or the it may be placed on a side of the stylus to aid accessibility to the user.
When switch 2006 is open a logical " 1 " is present at the second input to AND-gate 2004, and signals generated by infrared detector 2002 are transmitted through AND-gate 2004. The output of AND-gate 2004 is fed into mode detector 2010. Mode detector 2010 includes mode decoder 2012 which is coupled by a draw mode connection to a first input of OR-gate 2014, and coupled by a data mode connection to data storage and output system 2016. Data storage and output system 2016 is coupled to the second input of OR-gate 2014. Data storage and output system 2016 includes AND-gate 2018 coupled to data store 2020. The first input of AND-gate 2018 is the data channel output from mode decoder 2012, and the second input to AND-gate 2018 is from a clock (not shown). In the data mode a logical " 1 " is put on the data mode channel and the clock signal is allowed to pass though AND-gate 2018 and into
data store 2020. The clock signal then clocks out pre-stored data from data store 2020 on data channel 2022 to OR-gate 2014. In data mode, the draw mode channel is kept at a logical "0" level while data is being clocked out of data store 2020. In draw mode, the data mode channel is kept at a logical "0" preventing data from being clocked out of data store 2020, and the output from
AND-gate 2004 is passed to OR-gate 2014 through mode decoder 2012 along the draw mode channel and then into one shot generator 2024. In one particular embodiment, a PIC16C508 micro-controller from Microchip in an SO-8 package was used as data store 2020 and the clock (not shown in Figure 20). The output of OR-gate 2014 is coupled to one shot generator 2024. One shot generator 2024 converts an input pulse of variable duration into a pulse of a predetermined duration suitable to operate ultrasonic transducer 2028. The output of one shot generator 2024 is input into driver 2026 and driver 2026 drives ultrasonic transducer 2028. Figure 21 depicts the embodiment of the invention in more detail than
Figure 20. In particular, more detail is shown for mode decoder 2012. In this embodiment, the output from AND-gate 2004 is input into the first input of AND-gate 2102, the clock input of D-flip-flop 2104, and peak hold circuit 2106. Diode 2108, capacitor 2110 and resistor 2112 are chosen to hold a signal level for a predetermined period of time which is shorter than the period between signals ordinarily received by transponder system 2100 in the draw mode. The Q output of D-flip-flop 2104 is input into data storage and output system 2016 and the not-Q output is input into the second input of AND-gate 2102. This embodiment functions as follows. A data transmission session may be initiated by a user placing the pen in a specified location causing a data mode signal to be transmitted for reception by infrared detector 2002. the data mode signal may be transmitted from a position sensing device as described below. Alternatively, the data mode can be initiated by the user pressing a data mode switch (not shown) on the stylus. In the case in which a data mode signal is transmitted, transponder system 2000 recognizes the data mode signal and switches the transponder system to the data mode. The transponder system sends the data through its ultrasonic transmitter. The data is sent as a
continuous serial bit stream in asynchronous format. A time interval ("bit cell") is reserved for each bit. If the corresponding data bit is " 1 " the ultrasound burst is sent at the time period corresponding to the origin of the bit cell and if the corresponding data bit is "0" then the ultrasound burst is not sent in the time period for the data cell.
The data is stored in a data store (not shown) in data storage and output system 2016 which can be but is not limited to a serial EEPROM, serial flash memory or the RAM of a micro-controller.
The data mode pulse in this embodiment is a series of two electromagnetic pulses separated by less than the hold time of peak hold circuit
2106. In one example, peak hold circuit 2106 has a time constant of about 25 microseconds while the data mode pulse is composed of two pulses separated by about 7 microseconds. If switch 2006 is pressed when the data mode signal is received, this signal, in the form of the two closely spaced pulses, appears on the output of the AND-gate 2004 and passes to mode decoder 2012 which include AND-gate 2102, D flip-flop 2104 (74AC74) and peak hold circuit 2106.
The first pulse passes AND-gate 2102 and excites one-shot generator 2024 through the OR-gate 2014. At the same time, this pulse is applied to peak hold circuit 2106, which stores the "1" voltage level for an amount of time, and to "clock" synchronous input of D-flip-flop 2104, which is controllable by "low- to-high" transition. The output of peak hold circuit 2106 is applied to "D" control input of D-flip-flop 2104. When the first "high-to-low" transition occurs on the "clock" input, D-flip-flop 2104 stays clear. The "1" level, stored by the peak hold circuit 2106, slowly decays to "0" with the time constant as set by the components (e.g. approximately 25 μs in one embodiment). Thus, when the second pulse comes later (e.g. 7 μs later in one embodiment), the level on "D" input is "1" and the "high-to-low" transition on "clock" input sets the D- flip-flop. The level of the "Q" output toggles "low-to-high" and initiates operation of data storage and output system 2016 (which can be a micro- controller in one embodiment). Data storage and output system 2016 then clocks out data stored in the memory in data storage and output system 2016 using an internal clock (not shown).
The level on "not-Q" output of the D-flip-flop disables the pulses from AND-gate 2004 to pass through gates 2102 and 2014 to one-shot generator 2024. The short pulse which appears on the output of OR-gate 2014 does not affect the one-shot generator 2024 because it is configured so that it is not retriggerable during 12.5 μs from the origin of the first pulse of data mode signal sequence.
Data storage and output system 2016 starts to output the data stored in its on-board memory. Each clock transition shifts one bit of the memory contents (least significant bit first to master significant bit) to one-shot generator 2024 through OR-gate 2014. For each bit of data which is a " 1 " data storage and output system 2016 sends an output pulse of width of 4 μs through to trigger the one-shot generator 2024 which generates an output pulse of 12.5μs to excite transducer.
In one example each bit cell is 2.5 ms long, (i.e. the data is sent at the rate of 400 bps) and the data was a 16 decimal digit number presented in BCD format, encoded by the 64-bit binary value. The transmission was protected by a check sum, calculated by summing of all significant bits of the ID value on modulo 2 powered by 8. The ID, containing 72 bits of the data and check sum, was sent during 0.18s at data rate of 400 bps. Figure 22 is a chart depicting the timing of the various signals for this example.
Figure 8 depicts one embodiment of a position sensor. In this embodiment, position sensor 800 includes first compression wave detector 802 and second compression wave detector 804. Compression wave detectors 802 and 804 can be any detector devices including but not limited to ultrasound detectors. Compression wave detectors 802 and 804 can optional include a horn or other impedance matching structure to enable the compression wave detectors to more efficiently detect the compression waves. First compression wave detector 802 is coupled to first timer 806 and second compression wave detector 804 is coupled to second timer 808. Timers 806 and 808 are coupled to processor 810.
Timers 806 and 808 can be any device that can measure elapsed time including but not limited to counters connected to a clock and in other embodiments timers 806 and 808 need not be separate timers but can be
implemented as one timer capable of measuring two elapsed times. Processor 810 can be any processor implemented in any logic including but not limited to a microprocessor, a personal computer, or dedicated logic. In an embodiment not shown, timers 806 and 808 are incorporated into processor 810. Electromagnetic radiation source 812 is coupled to timers 806 and 808 and to processor 810.
In operation, a trigger pulse generated by processor 810 triggers electromagnetic radiation source 812 to generate an electromagnetic radiation pulse. The trigger pulse also starts timers 806 and 808. A device such as any of the transponder systems previously depicted (e.g., that in Figure 1) receives this electromagnetic radiation pulse and emits a compression wave. When the compression wave is detected by first compression wave detector 802 first timer 806 is stopped, and when the compression wave is detected by second compression wave detector 804 second timer 808 is stopped. Processor 810 determines the time elapsed on timers 806 and 808 between the emission of the electromagnetic pulse by electromagnetic radiation source 812 and the detector of the compression wave by compression wave detectors 802 and 804. Using these elapsed times and the distance between compression wave detectors 802 and 804, the relative position of the device for generating compression waves generating the detected compression wave can be determined by triangulation using the velocity of the compression wave.
Figure 9 depicts another embodiment of the invention. In this embodiment position sensor 900 includes first ultrasound detector 902 and second ultrasound detector 904. Suitable detectors include but are not limited to MA40S4R available from Murata. Detectors 902 and 904 are connected with the same polarity so that an increase in pressure on the detector results in a positive voltage output. Ultrasound detectors 902 and 904 are connected respectively to band pass filter 906 and band pass filter 908 each with a pass band of about 300 Hz to about 60 kHz. In other embodiments, the pass band of filters 906 and 908 is between 100 Hz and 500 kHz or any range subsumed therein.
The outputs of band pass filters 906 and 908 are input respectively into amplifiers 910 and 912 with a gain of about 700. Suitable amplifiers include
but are not limited to RC4558 available from Texas Instruments. The gain factor on the amplifiers can be set to any value as required by position sensor 900, from a gain of 2 to a gain of 1,000,000 or any value within this range. In one embodiment, the gain on amplifiers 910 and 912 is dynamically adjusted to attempt to keep a characteristic (such as peak, RMS value, or means value) of the output signal from each of the amplifiers at the same value during repeated uses of the position sensing device. This aids in reproducibility and accuracy of detection.
The outputs of amplifiers 910 and 912 are then input into half- wave rectifiers 914 and 916 respectively, and then into the inverting input of comparators 918 and 920 respectively. The non-inverting inputs of comparators 918 and 920 are connected to a ground or near ground voltage such as about 100 millivolts.
The output of comparators 918 and 920 are sent to microcontroller 922 and input into timer system 930 of microcontroller 922. Microcontroller 922 can be any type of microcontroller implemented in any logic, including but not limited to a microprocessor, or dedicated logic. Microcontroller 922 is coupled to infrared LED driver 924 which is coupled to infrared LED 926. Microcontroller 922 is coupled by connection 932 to processor 928 which can be any type of processor including but not limited to a microprocessor, a neural network or dedicated logic, and may be part of a personal computer, a main frame computer, a personal assistant such as a palm top computer, a cellular phone, a land line phone, or any other system which includes a processor. Connection 932 can be any type of connection including but not limited to a network connection such as the Internet, a fiber optic connection, a standard wire or cable, inductively coupled signals impressed on other lines such as power distribution lines (e.g. AC wiring in a house), wireless means such as infrared, radio waves or microwave links can be used. In other embodiments of the invention, the functionality of microcontroller 922 is performed by processor 928 and microcontroller 922 can be eliminated as a separate functional unit.
In the embodiment of Figure 9, timer system 930 includes a first counter and a second counter connected respectively to the outputs of comparators 918
and 920. The counters are also connected to a clock. The frequency of the clock will determine the timing accuracy of the system, and hence the spatial accuracy of the position sensing device. In one embodiment, the clock rate was 1.536 MHz which gives a time resolution of 651 nanoseconds and a distance resolution of about 0.22 mm (given the speed of ultrasound waves in air)
One embodiment of the position sensing system shown in Figure 9 operates as follows. Microcontroller 922 generates a trigger pulse which causes LED 926 to emit an infrared pulse and begins the counting of both counters in timer system 930. These counters count at the clock rate set by the clock in timer system 930. In other embodiments, there is a predetermined time delay between the emission of the infrared pulse and when the counters begin counting.
The infrared pulse output by LED 926 is received by a transponder such as that depicted in Figure 1 causing a compression wave such as an ultrasound wave to be emitted from the transponder. The compression wave is detected by ultrasound detectors 902 and 904 upon its arrival at their respective locations. Figures 10A-C depicts schematically the appearance of typical waveforms at the locations indicated a "A," "B," and "C" respectively in Figure 9.
Figure 10A depicts a typical signal after amplification. In this example, the signal has a duration of about 0.8 milliseconds and a period of about 25 microseconds. The signal and noise oscillate about a centerline voltage level which can be set by the electronics to be any arbitrary level (e.g., 0 volts or 2.5 volts). The polarity of compression wave detectors 902 and 904 are configured so that the electrical output signal from the detectors will have the same polarity when detecting the same part of the compression wave.
Figure 10B depicts a typical waveform after passing through the rectifier. In this embodiment, the comparator is set to detect signals over 100 millivolts. At this threshold setting, the noise is not detected, but the second positive peak of the signal does surpass this threshold and is detected. The threshold set for the comparator can be adjusted subject to the noise present in the system and the desired cycle number of the received signal to be detected. Figure 10C depicts the typical output of the comparator. The output switches from high-to-low whenever the input signal crosses the comparator threshold.
The output of the comparators is sent into the capture input of the counters and the first pulse out of each comparator stops the counter. Each counter thus measures the time elapsed between the trigger pulse causing the LED emission and the reception by the respective detectors of a compression wave which generates an electrical signal greater than the detection threshold of the comparator. In one embodiment, microcontroller 922 does not enable the capture inputs to the counters until a predetermined time has passed. The predetermined time corresponds to a predetermined distance between the device generating the compression wave and the compression wave detectors 902 and 904. This time period can also be used to prevent the detection of spurious reflections of compression waves from objects or surfaces.
This predetermined time can by used to reduce the number of bits required to be sent from the counters if the approximate position of the device for generating compression waves is known (e.g. from previous operations of the position sensing device.) This predetermined time can be dynamically changed as the position of the device for generating compression waves changes. In other embodiments, the clock rate can be increased to provide a more accurate determination of the position of the device for generating compression waves. Figure 11 depicts the data protocol sent from the microcontroller to the processor in one embodiment of the invention. The output of the counters representing the time of flight of the compression wave has 12 bit resolution. The content of the counters is sent from the microcontroller to the processor in a four byte package. Byte "0" contains synchro-bit (bit 7) set to indicate which counter the data is from. The rest of byte "0" and the least significant bits of byte "1" contain the contents of one of the counters while bytes "2" and "3" contain the contents of the other counter. In one aspect of the invention, processor processes the time of flight information using the know speed of compression waves in air to determine the position of the device for generating compression waves using triangulation.
The system can be configured to repeat the LED signaling, time of flight measurement process at any desired rate. In some embodiments, the process is repeated at a rate between 1 Hz and 10 kHz, or any range subsumed therein. In
one particular embodiment, the process is repeated at between about 100 Hz and 200 Hz. In some embodiments, the rate at which the process is repeated may depend on the locations of objets which may cause spurious reflections of compression waves that may be detected by the position sensing device. These effects may warrant a decrease in the rate of repetition of the process. However, the process should be repeated often enough to sample the motions of the device for generating compression waves to the extent desired by the particular use to which the system is being put. Figure 12 depicts a more detailed schematic of an embodiment of the invention. Figures 13A and 13B depict, respectively, the directivity of an exemplary ultrasound transducer (part # MA40S4S) used in a transponder in one embodiment of the invention, and an ultrasound detector (part # MA40S4R) used in an embodiment of a position sensor of the present invention. The plots are done in a relative scale and the location of maximum signal strength is the arbitrary 0-dB reference. Typical specifications for the transducer and detector are in Figures 13C and 13D respectively.
It is noted that in general the higher the frequency of the ultrasound, the more quickly it is attenuate in air. Additionally, since higher frequency ultrasound waves have a shorter wavelength they may be more useful in allowing more accurate determination of the location of the device for generating compression waves (i.e. the ultrasound emitter) by the position sensing device. Thus, there is a trade off between attenuation of the ultrasound signal and accuracy of location determination. In one embodiment of the invention, ultrasound in the frequency range between 5 kHz and 500 kHz is used, in a another embodiment, frequencies in the range between 10 kHz and
100 kHz are used, in yet another embodiment frequencies between 25 kHz and 75 kHz are used, and in still another embodiment frequencies between 35 kHz and 50 kHz are used.
It is noted that the speed of propagation of compression waves (e.g. ultrasound waves) varies with temperature, humidity and other environmental factors. Such variations typically only cause a change of less than about +/- 2% in the speed of propagation of the waves. Such an offset along with other constant offsets may be important if one desires to use the invention to
determine the absolute position of the device for generating compression waves. However, such offsets have less of an effect for applications in which only the relative motions of the device for generating compression waves are desired. All of the applications of the invention listed above require (or can be made to require) only detection of relative motions. For example, handwriting detection, drawing, or the use of the stylus to navigate a computer interface, application or web site can be implemented to require only relative motions in just as for example the absolute position of a computer mouse is not required to perform some of these same functions. As depicted in the embodiment of the invention in Figure 14, the directivity patterns of the device for generating compression waves used in the transponder, and compression wave detectors used in the position sensor will affect the area over which this embodiment of the invention will be able to operate. As depicted in Figure 14, the position sensor will only operate if the device for generating compression waves of the transponder is within the area of overlap of the zones of acceptance of the two compression wave detectors.
As depicted in Figure 15, the compression wave signal generated by the device for generating compression waves in the transponder must generate a signal that can be detected by both compression wave detectors in order for this embodiment to work. Thus, the device for generating compression waves must have a large enough directivity angle so that both detectors can be illuminated by the compression waves at once, and the device for generating compression waves must be pointing in the right orientation to direct the compression wave signal toward the two detectors. From Figure 15 it is clear that when using a device for generating compression waves on the transponder with a directively less than +/-90 degrees, that there will be a "dead spot" between the two compression wave detectors, the size of which is related to one or more of the separation of the two compression wave detectors, the angle of acceptance of the two compression wave detectors (and their orientation), and the directivity of the device for generating compression waves. The dead spot can be reduced or eliminated by angling the two compression wave detectors towards each other so that their cones of acceptance overlap at any desired point or region. In one
embodiment, the separation between the compression wave detectors is 55 mm and the dead zone is about 80 to 140 mm.
Other factors that may determine the useful area of overlap between the two compression wave detectors include user related factors. In the embodiment of the invention in which the transponders is housed in a stylus or pen, one such factor may be the amount by which the user rotates the pen, and hence the device for generating compression waves as the user writes.
In another embodiment of the invention, more than one device for generating compression waves is coupled to each transponder and the devices for generating compression waves are pointed in different directions so that the orientation of the transponder is less critical. This is depicted in Figure 16.
In yet another embodiment of the invention more than two devices for detecting compression waves are used. The more than two devices can be positioned so that the compression waves emitted by the transponder are less likely to fall outside the detection cone of any two of the detectors. One example of this embodiment is depicted in Figure 17.
Another embodiment of the invention includes a transponder system and a position sensing device wherein the transponder system include a mode detector and a memory for storing information to be transmitted and/or received by the transponder system. As discussed above, the data contained in the memory can include but is not limited to information listed above such as financial or other personal information. In this embodiment, when the position sensing device determines that the transponder has been positioned in a predetermined location, hardware or software in the position sensing device or a computer attached to it initiates a data transmission session by sending a data mode pulse to the transponder. A mode detector on the transponder switches the transponder into data mode and begins sending data tot he position sensing device. The position sensing device or an attached processor or computer check the data to ensure that it was received correctly (e.g., using check sum methods). If the data was received correctly, the a draw mode signal is sent to put the transponder back into draw mode. In other embodiments, the transponder automatically reverts back to draw mode after a predetermined length of time, or it is toggled between the two modes by one type of signal
from the position sensing device. If the data is not received correctly, the position sensing device transmits a signal to the transponder to get it to repeat the incorrectly received data.
The received data can then be used as discussed above to, for example, debit a bank account, verify a signature or a transaction, load a file or data into a computer from a location specified in the received data. In embodiments in which the transponder includes a mode detector with a receive data mode, data can be transmitted to and stored in a memory in the transponder.
In one embodiment of the invention, the position sensor senses the location of the device for generating compression waves in the transponder and these positions are input into a processor. The processor may be any type of processor which is standing alone or incorporated into any electronic or other device such as a personal computer, a portable computer, a hand held computer, a cellular phone, a personal digital assistant, a palm computer, or any other device. Software, or hardware implementing the same logic, can then use these data, representing the position, velocity and/or acceleration of the device for generating compression waves which is part of the transponder as input for handwriting recognition, to generate strokes or sets of curves or lines from the data. In embodiments in which the transponder is attached to a stylus such as a writing implement, the curves represented by the stokes are intended to recreate the motion of the stylus over time. Figures 18 A-K are a flow chart representing one embodiment of such software. This embodiment of the software works as follows:
Stroke Collection A stroke is defined as a sequence of elapsed time samples from timers such as the counters in timer system 930 which were collected between two events: "Stroke Start" and "Stroke End".
"Stroke Start" means that the device for generating compression waves is in the writing zone and PenStatus change from PenUp to PenDown (e.g. the switch has changed the transponder from the non-enabled state to the enabled state).
"Stroke End" means that after "Stroke Start" the device for generating compression waves is out from writing zone or PenStatus has been changed to PenUp (e.g., transponder changed to non-enabled state). In case the stroke is less than 13 samples, it is defined as noise and is not processed at all. This embodiment of the software processes each and every stroke independently.
Logic Filter
From time to time as the device for detecting compression waves detects (captures) the sent signal transmitted by the device that generates compression waves on different cycles of the compression wave in burst, there is a "jump" in the signal. As these jumps typically correspond to motion that is too fast to be real they cannot indicate a movement that the device for generating compression waves can take while being moved by a human, a logic filter is applied to eliminate these "jumps". In existing prototype the value of "jumps" is not less than 28 units of counters (according to frequency of the compression waves used in the device).
There are two kinds of "jumps":
Singular jump - Ci+28<Cin; and Cip+28< n
The logic filter detects such jumps and correct it by averaging:
X i+1 = (Xi+Xi+2)/2
Shift in signal -- Ci+28<Ci|1; and Ci|2-Ci|i<28
The Logic filter detects such jumps and correct it according to the following formula:
Dot Detection In order to define a "dot" in the presence of noise, a special procedure for dot detection is used. A dot is identified according to the following conditions: Assuming a stroke of N samples. If for each timer (e.g., counter) the absolute difference between Average of 1..N/2 samples and Average of 1..N samples is less than 2 units, and the absolute difference between Average of N/2+1..N samples and Average of 1..N samples is less than 2 units, and
Absolute difference between Maximum and Minimum values of counter is less than 5 units. In this case the dot stroke is shortened to a three pairs of samples stroke which are the three above averages.
Adjustment of stroke length The Mean Least Square Algorithm (MLSA) which is implemented for smoothing XY coordinates requires at least 32 samples stroke length. In case stroke length is less than 32 samples an extrapolation is used to make it a 32 samples stroke length.
XY coordinates calculation The following drawing illustrates the relations between the device for generating compression waves (as located in the transponder) and the two devices that detect compression waves.
When X and Y coordinates are calculated by triangulation:
y = SQRT{C1 2-[L+(C1 2-Cr 2)/4L]2}
x = (d2-Cr 2)/4L
Smoothing Procedure
In order to ensure good curve approximation in the edges of the stroke, additional samples are added to each side of the stroke in the following way: Assuming stroke length is N samples, we add to each side K samples where K=(Max(N* 1.2,32)-N)/2. The added K samples of each side are selected to provide central symmetry around the edge point. The smoothing procedure of each stroke of size N (number of samples in stroke including added samples) we smooth the signals of X and Y separately taking the following steps: For every point I (I<=N-32) of segment, approximate point with Mean Least Square
Algorithm (MLS A) using a polynomial of 2nd order. This procedure is repeated with a sliding window with step 1. As a result every point is approximated up to 32 times. The value of the point is calculated by averaging all the approximations for this point.
MLSA
Let Ta be the matrix for 32 points:
to2 to 1
Ta :
And Ta' the transposed matrix of Ta.
Let F=[fo f ... f3ι] be the vector of function values in time T=[to ti ... t31]
FT2= _ . ti2
FT1= > * ti
FT0= ^ i,
And finally vector FM = [FT2 FT1 FTO]; The matrix equation for vector C =[C2 Cl CO] the coefficients of approximate polynomial of power two is: FM = Ta' * Ta * C
From last equation:
C= INV (Ta' * Ta) * FM
In our case INN (Ta' * Ta) is constant.
The new vector of approximated values of points is: Fnew = Ta * C;
Alternatively an MLS A using first degree polynomial using 16 samples window, is used.
In other embodiments of the invention, recognition software such as character or shape recognition software can be used to identify symbols or characters as represented by samples or the strokes.
Yet another embodiment of the invention is a system and method for generating data using a stylus device without the need for a special purpose writing surface. A user manipulates the stylus and the position information of the stylus is stored as data. The data is loaded onto a data storage device for processing and/or transmission over a network to another location for processing. Suitable stylus input and storage devices include but are not limited to those described herein, in U.S. provisional application no. 60/065,866 filed
November 14, 1997, which is hereby incorporated by reference in its entirety, a stylus and digitizing surface or tablet or any other device that produces an electronic output in response to a user's hand motions (all such being collectively called "electronic pens" or "e-pens"). In one aspect of the invention, the data generated includes authentication data which includes but is not limited to a user signature, an identifier associated with the stylus, a password, or a combination of one or more of the aforementioned data types. The authentication data is used to verify the identity of the user initiating a transaction. In one embodiment the e-pen is a cordless regular size pen that writes on plain paper without a digitizing surface. The motion of the e-pen is detected and stored in any base station device that includes a transceiver that communicates with the e-pen. The base station device may be coupled to any other electronic device including but not limited to a computer, a personal computer, a portable computer, a laptop computer, a notebook computer, a handheld or palm PC, a cellular phone, a landline phone, a television, a beeper, or any other electronic device that includes a processor and a memory. The data
generated by the motion of the e-pen can then be edited, employed for annotating documents, searched, translated into text, saved in a database, sent as e-mail or fax, or used for authentication of the writer in electronic commerce. In another embodiment, a user manipulates an e-pen, for example in filling out a form, or signing his or her name, and generates data. Additionally, voice or video data may also be generated and transmitted by the user through a microphone or video camera included in an e-pen. In one aspect of the invention at least a portion of the data generated is transmitted over a communications system such as an internet, an Ethernet, the Internet, a telephone network, a wireless network such as a cellular telephone system, or any other network or communications system to a server. The server processes the data to authenticate the user and/or transmit information back to the user or another location. One advantage of an aspect of this embodiment is the ability of a user to generate the data for transmission using conventional handwriting strokes, without the need for a keyboard. This allows for a system which can reduce or eliminate the need for a conventional keyboard.
In another embodiment, hand written messages generated through the use of an e-pen are transmitted over a network such as the Internet to a verification server. The verification server verifies the identity of the user using information including handwriting recognition of the message, signature verification, or verification based on a code generated or transmitted by the e- pen. The verification server then transmits the message to a recipient as directed by the user along with an authentication certificate identifying the user who generated the message. In one aspect of this embodiment, the verification server charges a small transaction fee to an account for the service of verifying and/or transmitting the message. The account charged for the transaction can be either a user's account (i.e., the party generating the message), the recipient's account, a third party's account such as a company or on-line business, or a combination of any or all of these parties. In one embodiment of the invention, the user pays a fee for the use of the service that allows the generation of electronic data using an e-pen or other stylus. The generated data can be used by the user for any purpose including but not limited to the same uses as for data typed or otherwise entered into a
computer or other electronic system. The ability to convert conventional handwriting motions into electronic data also allows the use of computers, electronic processing, and electronic communication including but not limited to archiving, searching, editing, messaging. In one aspect of this invention, users are charged a per use fee for each feature accessed such as message storage, retrieval, or sending a message. In another aspect of the invention, users are charged a subscription fee for each service which allows the service to be used for a flat fee for a fixed period of time or a fixed number of uses. A combination of the flat fee and fee for service payment systems can be used. In another embodiment of the invention a user uses an e-pen to generate data corresponding to handwriting including a signature and other verification codes. The signature and/or verification codes are then stored in a base station device for transmission to a verification server through a network such as an internet, the Internet or a telephone network. In another embodiment, the e-pen contains a receiver for receiving information transmitted to it through a network such as an internet, the Internet or a telephone network. The received information may include but is not limited to data from another e-pen, verification data from a verification server, error messages, financial information, text, audio or visual information, or a digital receipt corresponding to a transaction completed by the user.
In another embodiment, the e-pen is coupled to a computer and the computer includes character recognition software for converting the user's handwriting strokes into characters. In one aspect of this embodiment, the characters are then faxed or emailed to another location. In this aspect, the handwriting data is processed and converted in standard fax format and transmitted to a receiving station in fax format. The transmission can be over conventional telephone lines, or the data may be transmitted to a verification server and authenticated as described above, the appropriate account can then be charged for the service and the data finally transmitted in fax format. In another embodiment, a base station is included in a cellular telephone.
A user engaging in a conversation with another party on his cellular phone, also manipulates his e-pen, drawing figures, maps or generating text. The user's handwriting motions are stored as data by the base station. The data can then be
processed in the cell phone (e.g., handwriting recognition, data compression, or verification) and/or transmitted to the other party over the cellular telephone network or any other network including but not limited to the Internet. The data can also be transmitted to a verification server over the Internet or any other user or computer attached to the Internet or any other network.
Another embodiment of the invention is depicted in Figure 23. Any electronic device that can be coupled to a base station for receiving position or other information from an e-pen can be used as an input device. As depicted in Figure 23, possible input devices include but are not limited to cellular phone 2302, personal computer 2304, land line phone 2306, notebook computer 2308, or interface 2310 capable of being used for an online transaction (e.g. supporting software for communicating over a network such as Internet 2312. Any of devices 2302-2310 can be coupled to internet 2312 through any communications media including but not limited to a network, a telephone network, a cellular telephone network, or any other communications network.
As depicted in Figure 23, message 2314 contains information including one or more of the following fields, the destination(s), a subject describing the contents of the message (to be used for indexing), author information, time information, origin location information, financial information and logical information that can be used to sequentially order messages or other information, or describe the relationship between information contained in this message and other data or information contained in other messages or stored on other computers, and a body which contains text, images, sound or video information, drawings, signatures, or other information input by a user using an e-pen.
Message 2314 is transmitted via Internet 2312 to computer 2316. Computer 2316 may include a server which may act as a verification server. When message 2314 is received by computer 2316 information contained in message 2314 is converted to text and computer 2316 determines from this information what action is to be taken with message 2314. For example, message 2314 may be a message to be forwarded to an email address, a fax machine, a pager, a cellular phone, a voice mail messaging system, or another computer in order to complete an electronic commerce transaction.
In one example depicted in Figure 23, information from message 2314 is sent from computer 2316 to transaction server 2318 in order to verify a signature contained in message 2318. Once the verification process is completed in transaction server 2318, the approval or rejection is transmitted to the appropriate financial service (e.g. credit card company, bank, on-line debit, etc.) and the transaction verification is transmitted back to the user and/or the company or service the user is transacting with.
In one embodiment, the information transmitted from devices 2302- 2310 includes a user's signature, name of transaction, sum and date, and is stored in some encrypted format. This information is communicated to a registration server via TCP/IP connected to the Internet. The Registration Server receives the encrypted data and signature, sends it to the verification system in a verification server, and receives either a verified name or a declined result. The verification system is used to identify and authenticate an encoded signature and handwritten data from an e-pen. It connects to and utilizes a database of user and e-pen-encoded signatures and handwritten characters. The e-pen may include ID stored or burned into memory in the e-pen that is used to identify the user name, while the signature works as a biometric password. In other embodiments not shown, non-Internet based systems, such as cell phones, may connect to the registration server via TCP/IP from the base station.
In one embodiment the registration system and the verification system both will reside on the same server. The verification system accesses the database directly, and the verification results in sending the verified credit card number to the acquiring bank - VISA MasterCard/AMEX, etc. In one aspect, new users are added to this database by logging in and signing 3 times, writing a-z and 1-10. The database may be configured to be adaptable to gradual changes. The registration system can be connected to various backend systems such as credit card systems for reasons such as payment authorization, sending secured messages and documents, performing bank transactions, etc. In one embodiment, a fee (either per transaction or percentage based) is charged to a user. In another embodiment, the seller of the good or service the user purchases is charged a fee for each user or a flat fee for connection to the service. This system enables Internet merchants to allow their customers to
sign-in and complete purchases using their natural handwriting rather than having to remember a user LD and password and credit card information. This system could offer a single point of authentication and registration for users. Additionally, embodiments of this system allow companies that currently do not have a registration and authentication and payment system to implement one that may be less costly to implement, maintain, quicker than developing in house, offered with service level agreements (SLAs), offered with various levels of security authentication functionality, ranging from risk adverse to risk friendly, enables higher follow-through rates, offers web users and web sites more value added features than an in-house system, has real-time online reporting with access to historical and current information, allows data-mining expertise via third party relationships, user registration pages that personalize functionality, facilitates inter-site information sharing agreements, facilitates the internationalization of the internet by supporting the integration of registration information from all regions of the world, and is scalable. Companies that currently do have a registration and authentication and payment system may be interested in embodiments of the invention because it may help to reduce registration and authentication and payment costs, may help to reduce complexity of maintaining registration and authentication system, can increase the scalability of existing systems, can enhance current systems with value added features that result in increased user convenience, security, privacy, system effectiveness, and improved data accuracy.
Users may be interested in the system and method because it is more convenient to have a single point of contact for users to: register for all of the web-based services to which they are interested in subscribing, have a single authentication system for logging onto the Internet, have a widely available online resource for managing the multitude of user names and passwords and password hints and credit card information which serve as keys for unlocking online security systems, have a centralized resource for modifying user names or passwords, which helps to increase system security, provide users with a centralized resource for tracking all of the web sites that they have given their credit card information to as well as tools for managing this information, and address user sensitivity to privacy issues.
Other users that may be interested in embodiments of the invention include members of the health care industry. Embodiments of the invention can be used to authenticate doctor signatures, support applications that control access to and transmission of patient records as well as remote/mobile healthcare solutions.
Additionally, the system can be used to provide electronic signature and verification (ESV), verify and authenticate signatures on documents, and verify that documents have not been altered. In one embodiment, this is achieved as follows. When signing a document in e-mail or another transaction, the user will be prompted to supply either (1) a signature password which is unique and separate from the network password, or alternatively, (2) a finger image using a biometric input device attached to the e-pen, base station, or other device. The transaction is verified and a document digest is encrypted and attached to the document as an electronic signature block. The recipient of the signed message can determine that the signature in the document is valid, and that message contents have not been altered.
Other embodiments of the present invention allow users to conduct transactions over a network such as the Internet without the need to transmit sensitive information to a merchant to complete the transaction. Additionally, embodiments of the invention allow users to use biometric information and/or identification numbers, code words or passwords to protect their sensitive information and it's use and release over the Internet. Additionally, users can set a level of security or verification that will be required to complete a transaction, and transactions can be conducted through a trusted third party intermediary that has access to the user's information and information about the merchant selling the goods or services the user desires to purchase.
Figure 24 is a high level depiction of an embodiment the invention. System 2400 comprises a plurality of user computer systems 2402A, 2402B, and 2402C. One or more of user computer systems 2402A-C are coupled to biometric input devices 2404. As depicted in Figure 24, user computer system
2402A is coupled to biometric input device 2404A and user computer system 2402B is coupled to biometric input device 2404B while user computer system 2402C is not coupled to a biometric input device. It is noted that each user
computer could be connected with more than one biometric input device, or user computers may share biometric input devices.
User computer systems 2402A-C are coupled to network 2406. Network 2406 includes but is not limited to the Internet, an internet, an intranet, a telephone network, an Ethernet network, a wireless network such as a cellular telephone network, any other type of network, or a combination of one or more of the preceding network types. Computer system 2408 is also coupled to network 2406. Computer system 2408 generically represents any type of computer system such as a microprocessor based system, a main frame system, a personal computer, a workstation, or any other type of general purpose or special purpose computing system. Computer system 2408 includes application program 2410, functionally coupled to database 2412 and verification program 2414 coupled to application program 2410.
It is noted that one or more of user computer systems 2402 can be used by a merchant and one or more can be operated by a customer or other user. In operation system 2400 allows users to transmit information to other users securely, and a user receiving the information can have a confidence level that the user transmitting the information was authorized to do so. As an example, userl using user computer system 2402 A wishes to make user2 using computer system 2402B aware of information stored in user 1 's account on computer system 2408 in database 2412. In one embodiment, user2 asks userl for the information which userl either does not want to transmit over the network, or is embedded in information userl does not want user2 to know. For example, the information could be identification information or credit information embedded in userl 's spending or financial records. Userl then directs user2 to send the request for information to computer system 2408. Userl then sends an authentication to computer system 2408 in the form of biometric and non- biometric input transmitted across network 2406. This input is received by computer system 2408 and application program 2410 sends this biometric input data along with an archival copy retrieved from user database 2412 to the verification program 2414. Verification program 2414 compares the biometric and non-biometric information submitted by userl to the archival copies and based on the degree to which they match, assigns them a confidence level.
Based on this confidence level, userl 's information is either released to user2 or not, or the proposed transaction between userl and user 2 commences or does not commence (e.g. a credit check prior to a sale of a good or service).
Figure 25 depicts another embodiment of the invention, system 2500. In this embodiment customer computer 2502 is coupled to biometric input device
2504 and Internet 2506. Also coupled to Internet 2506 is merchant computer 2508, and computer system 2510 and optionally, credit clearinghouse or bank 2512. Computer system 2510 is optionally coupled to credit clearinghouse or bank 2512 by a separate connection which may be a dedicated connection or a dial-up connection.
Computer system 2510 includes transaction/authentication information ("TNI") program 2514, database 2516 and verification program 2518. The data stored in database 2516 includes, but is not limited to one or more of the following: user names, credit information, identification numbers, biometric features, notes, and transaction details for each register user. The registration of users will be discussed below. Each of the customer computer 2502, merchant computer 2508, computer system 2510 and optionally credit clearinghouse or bank 2512 communicate to Internet 2506 and over Internet 2506 using communications protocols well known in the art as may be used depending on the types of connections each computer has to the Internet.
The operation of an embodiment of system 2500 is depicted in Figure 26. At step 2602 a user using a customer computer "browses" on the Internet looking at world wide web ("web") pages from a number of merchant computers offering various products and services for sale. Eventually, the user views a web page from a merchant computer and decides to purchase a good or service as shown in step 2604. In step 2606 the customer decides if he would like to purchase other goods or services from the merchant and the customer can choose to repeat steps 2602 and/or 2604.
Eventually, the customer finishes shopping and decides to purchase the goods or services selected. It is noted that various purchase decision and checkout processes can be used by the merchant computer, including but not limited to "one click" purchasing in which when the customer selects an item, the controls embedded in the web page displayed on the customer computer
both select the item and signal the merchant computer that customer wishes to complete the purchasing transaction. Additionally, the customer can select items on a list and then select a control indicating he wishes to complete the purchase, or the merchant computer may allow customers to select items displayed on their web pages to put these items on a list or in a "shopping cart" as the customer looks at other merchant web pages. Whichever purchase decision process is used, when the user selects the control (e.g. button on the merchant web page) indicating the desire to purchase the selected items, an embedded control on the merchant web page directs the browser on the customer computer to a web site generated by a TVI program running on a computer system such as computer system 210 of Figure 2, and causes the merchant computer to send certain transaction information to the TVI program running on the computer system. This is depicted as step 2608. In other embodiments, information on the customer computer (e.g. a "cookie") retains the customer's purchasing preferences based on merchant, total price, time of day, customer computer user (e.g. as determined by a login ID), other information, or any combination of one or more of these pieces of information. Then, when the customer is on any merchant web site, when a decision to purchase is made, even if the merchant web page does not have an embedded control in it to direct it to the computer system running the TVI program and to send the transaction information, the information on the customer computer is used to tell the merchant computer to do so. In other embodiments, information stored on the customer computer causes the customer computer to do so itself. In one embodiment, the transaction information sent by the merchant computer to a computer system running the TVI program is depicted in Figure
27, and includes but is not limited to a merchant identification number, a transaction identification number (which allows the merchant to track the transaction), the goods and/or services the customer wishes to purchase, the prices of these goods and/or services, the amount and name(s) of any fees the merchant is going to charge the customer, a web address or URL (uniform resource locator) to send the customer's browser to if the transaction is successful, and a web address or URL to send the customer's browser to if the transaction is not successful.
In other embodiments, the database on the computer system running the TVI program retains information related to each merchant, by merchant identification number, as to the web addresses or URLs to send the customer's browser to if the transaction is successful or not successful so that this information need only be updated in the database by the merchant and not sent with every transaction information message.
In one embodiment the merchant identification number is encrypted and digitally signed by a program on the computer system running the TNI program so that the computer system running the TVI program can ensure that the merchant identification number has not been tampered with by the merchant or in transit. As will be discussed below, merchants must have registered and have their information stored in the database to receive a merchant identification number and to enter merchant preferences in the database.
In one embodiment the transaction information is sent as a form post in http (hypertext transfer protocol). The transaction information may also be encrypted to help insure its integrity.
When the TVI program receives the transaction information, it generates a web page containing a summary of the proposed transaction. This is depicted in step 2610. The summary may include one or more of the following pieces of information: the merchant name, the goods and services to be purchased, their respective prices, the names of fees to be charged and their respective amounts, and the total amount the purchase will cost. In other embodiments, the customer enters a user LD which is transmitted to the TVI program running on the computer system and the transaction summary then includes a user selectable and configurable display of the data stored under the user's ID in the database in the computer system. The display may include but is not limited to one or more of the following: listing other purchases the user has made at the same merchant, purchases made within a certain time period, similar purchases (e.g. if books are being purchased, all books purchased are listed), budgets, money spent within a selectable time period, money spent at merchant in selectable time period, user notes related to good or service type or time of day or date (e.g. reminders that a relative's birthday or anniversary is soon or a scheduled appointment is near), a reminder to make a note if the purchase is
business or personal, links to data stored in the database concerning preferences of friends or acquaintances to remind the user what each like or dislikes, a database of presents user has purchased for certain people in the past, reminders of what user was asked to buy certain people (e.g. shopping list), or a list of items newlyweds have registered for, including which stores they are registered at. Other information may be displayed including but not limited to one or more of the following: reviews of goods or services being purchased or links to such reviews (e.g. book, goods, restaurant reviews, reports on consumer satisfaction) suggestions of related or similar goods or services user may want to purchase, or other merchants user may want to visit. Additionally, targeted advertising may be displayed to user based on merchant visited, items to be purchased or other information, or payment by merchants.
At step 2612 after the user has reviewed the transaction information, and looked at any other information presented, the user may store the current purchase information (e.g. in a "shopping cart" at the computer system database) and repeat the shopping process, the user may decide not to complete the purchase and leave the web site generated by the TVI program, or the user may wish to complete the transaction.
If the user does not wish to complete the transaction or purchase the goods or services, then the user selects an option on the web site generated by the TVI program that ends the transaction. If the user wishes to shop more before completing the transaction, then the TVI program saves the transaction information in the database and the user goes to a merchant web site, either the same merchant or a different one as desired and repeats steps 2602 to 2612. When the user decides to complete the transaction at step 2612 the user can select among the payment options input by the user when the user registered. The user may have selected one payment option as the default based on a user configurable set of parameters, including but not limited to one or more of the following: the merchant, the total cost, whether it is business or personal, or any other options. In one embodiment, if the user selects an option other than the default option then the user goes to step 2614 and if the user has not already entered his ID then his ID is entered. In one embodiment, computer executable code resident on the customer's computer is launched (e.g. a "plug-
in") and opens a window on the user's browser that asks the user to enter the ID number. If this executable code is not resident on the customer's computer yet, then the customer's computer will be prompted to ask the user to download the code from, for example, the computer system running the TVI program. When the ID is entered and sent to the computer system running the TVI program, the user's available payment options (e.g. those entered into the database by the user) are displayed and the user selects one or more among them and how much of the total purchase price is to go to each. In one embodiment, the payment options are displayed using nicknames or aliases known to the user. The user selects one or more options and then continues to step 2616. If the user selects the default payment option in step 2612 then the user goes directly to step 2616. In step 2616 if the user's ID has not already been entered, then the user enters his LD. In one embodiment, computer executable code such as that described above ("plug-in") is prompted to be launched and asks the user to input the biometric feature and ID if necessary. In step 2616 the user enters the biometric information into the biometric input device. The biometric element(s) entered into the biometric input device may include but is not limited to one or more of the following from one or more individuals: fingerprint, thumb print, retinal print, signature, voice, palm print, DNA, blood sample. In one embodiment, two individuals are required to approve a transaction and each must either enter a fingerprint or a signature, but at least one must enter a fingerprint.
In one embodiment the user ID is stored in an e-pen as described above, or in a small card incorporated into the e-pen. The user then enters the ID from the e-pen by placing it in a particular location with respect to a portion of the biometric input device, or by pressing a button on the e-pen and transmitting the ID to a receiver in the biometric input device. In another embodiment, the user ID is obtained from a card with a magnetic strip such as a credit card or a bank card. The card is swept past a magnetic strip reader on the biometric input device (or alternatively, the customer computer). The ID is then generated from information on the magnetic strip (e.g. the ID is the credit card number or a function of the credit card number). In yet another embodiment the ID is keyed into the biometric input device through a keypad on the device or on the
customer computer. In still another embodiment the ID is input by the motions of a user's hand holding an e-pen.
In one embodiment, the user ID is encrypted by the biometric input device and sent to the customer computer and then to the computer system running the TVI program. In another embodiment, the ID is encrypted by the biometric input device and electronically signed by the biometric input device and then sent to the customer computer and then to the computer system running the TVI program. In another embodiment, the user enters the user ID and the biometric input and both are encrypted by the biometric input device and sent to the customer computer and then to the computer system running the
TVI program.
In yet another embodiment, the user ID in whichever form it is sent to the customer computer is stored on the customer computer for a certain length of time or is set to expire after a certain length of time (e.g. it is encrypted with a time marker or expiration marker). Then, while the user LD is still unexpired, the biometric input device or the computer system running the TVI program can retrieve it from the customer computer as need during transactions or otherwise.
In embodiments of the invention in which the biometric input device includes an e-pen, the user may input notes to be sent to the computer system running the TVI program and stored in the database. These notes may include explanations of the purchases, or notes to be used later for tax or other financial planning. These notes can be encrypted if desired and they can be sent along with the other biometric information to the customer computer and then to the computer system running the TVI program. In another embodiment in which the biometric input device includes an e-pen, part of the information received by the biometric input device may be encrypted and part may be left unencrypted. A static representation of the shapes drawn by the e-pen may be left unencrypted so that the customer computer can display a representation of the motions of the e-pen (e.g. signature and notes if desired) while other information critical to matching the signature to a user's information stored in the database (e.g. velocity information from the e-pen, timing information, acceleration information, etc.) may only be sent from the biometric input device in encrypted form to ensure its integrity while it is
transmitted to the computer system running the TVI program.
In step 2618 the encrypted ID and biometric input are sent to the computer system running the TVI program. In step 2620 the TVI program retrieves the reference samples of the user's biometric information from the database (e.g. those stored during registration as discussed below) and sends it along with the received encrypted biometric information to the verification program. In step 2622, the verification program compares the reference sample biometric information from the database to the biometric information received from the biometric input device. The verification program then returns a confidence score to the TVI program based on information including but not limited to one or more of the following: the degree of the match between the reference sample(s) and the biometric information received from the biometric input device, the type of biometric information (e.g. fingerprint, signature, DNA, etc.), user's purchasing patterns, or other information stored in the database. In other embodiments, the verification program also sends to the TVI program: data related to the biometric information (e.g. x, y coordinates for signatures) sent from the biometric input device so that the TVI program can generate an image of the biometric feature(s) which may be sent to the customer computer; the number of biometric features that were sent (e.g. the number of signatures or fingerprints sent from the biometric input device); and any other information sent by the biometric input device or the customer computer (e.g. time, user notes, etc.).
In step 2624 the transaction is either approved or not approved based on a comparison of the confidence level to limits set by the user and/or limits set by the merchant. The user can set confidence level limits at registration or at other times as detailed below for transactions based on criteria including but not limited to one or more of the following: dollar amount of the transaction, business or personal, payment option used (e.g., credit card or debit card type used), recent expenditures, balances in bank accounts or remaining balances on credit card or any other user defined information. The merchant can set the confidence level based on information including but not limited to one or more of the following: the dollar amount of the transaction, the payment option used, the customer name, or any other merchant defined information.
In other embodiments, the transaction is not approved until the TVI program checks the user's credit information with a credit clearinghouse.
In one embodiment, when the confidence level returned by the verification program passes the user and/or merchant set levels, then the TVI program sends the dollar amount of the purchase and the credit card information for the credit card the user selected to the credit card company for approval. If the credit card company indicates the user has enough credit, then the TVI program charges the credit card and authorizes the transaction. In another embodiment, the TVI program reserves the amount of credit required to complete the purchase for the merchant and authorizes the transaction while informing the merchant of the information required for the merchant to access the user's reserved credit for the transaction.
If the transaction is not approved, then in step 2626 the user is informed and optionally directed to a web site supplied by one of the merchants that was a party to the failed transaction. If the transaction is authorized, then in step
2628 the TVI program stores the information related to the transaction in the database, a transaction authorization is sent to the merchant, and optionally the user is directed to a web site supplied by one of the merchants that was a party to the successful transaction. In some embodiments, when the transaction is completed the TVI program asks the merchant computer(s) to send an electronically signed receipt and other electronic information or data related to the goods or services purchased which are stored in the database for the user. If desired, some or all of the transaction information and other information in the database can be sent to the customer computer for display, including but not limited to one or more of the following: a copy of the customer biometric information input into the biometric input device to authorize the transaction, an electronic receipt, budget information, or credit information.
In yet another embodiment of the invention, if the transaction is successful, the TVI program sends the customer's shipping information to the merchant computer so that the merchant can ship the purchased goods to the user.
Figures 28 A, 28B, and 28C depict embodiments of the invention. Figure 28A is registration system 2800 which includes user computer 2802 coupled to biometric input device 2804 and to Internet 2806. Computer system 2808 is also coupled to Internet 2806 and includes registration program 2810 and database 2812. In other embodiments of the invention computer system
2808 includes an embodiment of a TVI program, a verification program, and/or a database as depicted in Figure 25 which may be combined with database 2812.
Figure 29 depicts an embodiment of the registration process for system 2800.
In step 2902 the user visits the web site generated by the registration program running on the computer system. In step 2904 the user starts the registration process by, for example, selecting a link to the web site that has an embedded code that starts the registration process in the registration program. In step 2906 each user (there may be more than one user for each account) is prompted to enter personal information into a form. The personal information includes but is not limited to one or more of the following: the user(s) name(s), address(es), email address(es), credit card information (and nick names for the cards if desired so that, for example, only the nicknames are displayed when purchases are made), birthdays and anniversaries of friends and relatives, authorized users for one or more of the entered payment options, how often the user wants spending reports sent to him, which types of transactions can be authorized by which biometric features or set of biometric features, and by which users, or any other information the user(s) desires. In step 2908 the user is prompted to enter an ID and biometric data. If the executable code (e.g. "plug-in") for entering such information is not resident on the user computer, then in step 2910 the user computer will be sent a prompt by the registration program to download the necessary code.
In step 2912 the executable code is launched and the user enters an LD. In some embodiments the LD is stored internally in an e-pen as described above and sent to the biometric input device by the press of a button on the e-pen, or by the placement of the e-pen in a particular location with respect to portions of the biometric input device, or the LD can be read off of a magnetic strip, or
entered into the biometric input device by a key pad or entered into the user computer.
In step 2912 the user(s) also enters one or more biometric features into the biometric input device. If the account being registered requires more than one user for authorization, the multiple users would at this point enter their LD and biometric features (and personal information if desired). Each registrant may be asked to enter each biometric feature more than once to ensure clarity and reproducibility. For example, if the biometric feature is a signature, then each user registering with a signature may have to enter a number of signatures. In step 2914 the registration program determines if the biometric information entered by the user is useable. The registration program makes this decision based on information including but not limited to one or more of the following: were the repeated instance of the biometric feature similar enough, or too simplistic. For example, if the biometric feature is a signature, the registration program will compare the sample signatures to each other to determine if they are similar enough to be useful for authentication or identification purposes, or if the signature is too simple to be use for such purposes (e.g. a signature that is an "X" may be too simple for such purposes). The registration program may make these decisions based on parameters set by the user, merchants or predetermined parameters programmed into the registration program. It is noted that the registration program of this embodiment may include or be included in a TV program and/or a verification program.
If the biometric features are found to be deficient in step 2914, then the user(s) is asked to re-enter them. If they are found sufficient, then the registration process is completed in step 2916 and the information entered by the user(s) and the user(s) biometric features are stored in the database.
Figures 28B and 28C depict other embodiments of the invention. In Figure 28B system 2820 includes user computer 2822 coupled to biometric input device 2824 and coupled by non-Internet connection 2826 to computer system 2828 running a registration program. Non-Internet connection 2826 may be but is not limited to a dial-up connection, a dedicated connection, a private network or any other non-public internet. A user registers using system
2820 in substantially the same way as with system 2800 but the information is not sent through the Internet. In another embodiment which is not shown, some of the registration information is sent through the Internet and some is sent though a non-Internet connection. In yet another embodiment not shown, users register by filling out one or more forms which are mailed, faxed or otherwise transmitted to the site containing the computer system running the registration program and the database and then input into the computer system running the registration program and the database.
Figure 28C depicts yet another embodiment of the invention. System 2830 includes computer system 2832 running a registration program and secure registration site 2834. Computer system 2832 is coupled to secure registration site 2834 which may be located physically near computer system 2832 or may be coupled to computer system 2832 by a connection which may including but is not limited to a dial-up connection, a network, the Internet, a dedicated line, or any other connection. Secure registration site 2834 includes a computer system coupled to a biometric input device. In this embodiment, users can register at registration site 2834 in substantially the same way as in system 2800; however, secure registration site 2834 allows the physical identity of the user to be matched with and verified as related to the identity the user registers with. For example, users registering at a secure registration site may be asked for identification such as a driver's license or a passport, and some or all of the personal information may be matched with that entered during the registration process. This secure registration can be noted in the database and may allow the user so registered different access privileges to certain information or merchant sites.
In another embodiment of the invention a registered user can access and review or modify information in his account by, for example, providing the LD and biometric feature required to access the account. In one embodiment of the invention, the user uses a computer attached to a biometric feature input device to access a web site generated by a computer system running a TVI program.
The user then selects the control appropriate for indicating he wishes to modify or review the information related to his LD stored in the database. The user is then prompted to enter his LD and the appropriate biometric feature which is
done as described above. This information is sent to a verification program and if it matches that stored in the database, the user is granted access to review or modify the stored information.
Still another embodiment of the invention is a system and method for merchants to register. In one embodiment, a merchant computer is coupled to the Internet and a computer system including a merchant registration program is also coupled to the Internet. The merchant registration program may include or be included in a registration program or a TVL program. The merchant registers by providing to the merchant registration program information including one or more of the following, name, address, type of goods or services sold, location, confidence level and type of biometric authentication required for different purchases, type of registration for user required to allow user to purchase certain goods or services (e.g. user must have registered in person at secure registration site to obtain prescription drugs or alcohol) and other information as desired by the merchant. The merchant is then sent a digital certificate which is digitally signed by the merchant registration program to ensure that it is not tampered with. The merchant information and digital certificate identification are stored in the database coupled to the computer system. The merchant then sends a copy of this certificate during any communications it has with the TVL or registration programs (e.g. customer purchase requests as detailed above) and these programs will use the digital certificate to identify the merchant as the source of the communication.
The foregoing description of embodiments of the present invention are presented for the purposes of illustration and description only. They are not intended to be exhaustive or to limit the invention to the forms disclosed.
Many modifications and variations will be apparent to practitioners skilled in the art. It is intended that the scope of the invention be defined by the following claims and their equivalents.