GB2500378A

GB2500378A - An integrated writing and computer input device

Info

Publication number: GB2500378A
Application number: GB1204539.9A
Authority: GB
Inventors: Clayton Wyatt
Original assignee: Individual
Current assignee: Individual
Priority date: 2012-03-15
Filing date: 2012-03-15
Publication date: 2013-09-25
Also published as: GB201204539D0

Abstract

An integrated writing and computer input device (10) for alternately making notes on a surface (such as paper) and controlling a computer (20). The device (10) comprising a pen (12) for marking the surface, a pressure sensor (13) for determining if the pen (12) is in contact with the surface, motion sensing means (14) for sensing motion of the pen (12) relative to the surface, and a wireless transmitter (16) for transmitting a signal indicative of the motion of the device (10) to the computer (20). The motion sensing means may include a light/LED 141 and detector 142 for capturing light reflected from the surface. In a first mode of operation the signal indicative of the motion of the device (10) is transmitted to the computer (20) only if the pressure sensor (13) indicates that the pen (12) is not in contact with the surface.

Description

INTEGRATED WRITING AND COMPUTER INPUT DEVICE

The present invention relates to an integrated writing and computer input device, and specifically but not exclusively to an integrated pen and computer input device.

The term computer" as used herein should be interpreted as any electronics device operable via a Graphical User Interface (GUI), the GUI being visible on a visual display unit (VDU) or screen, and comprising a cursor.

It is well known to use a mouse to operate a cursor on a computer screen. In order to control the cursor, a user moves the mouse relative to a fixed surface such as a mouse pad. The movement of the mouse is detected by electronics in the mouse or in a processor of the computer, and this movement is translated into movement of the cursor on the computer screen.

It is common for a user to alternate between controlling a computer and making notes and/or drawings on a piece of paper. For example, a user may wish to perform some calculations on a piece of paper and then input the results of the calculations into the computer. However, it is cumbersome for a user to pick up a pen when he or she wishes to make notes on a piece of paper, and then put down the pen and operate the mouse when he or she wishes to use the computer.

I have now developed an integrated writing and computer input device to alleviate the above-mentioned problem.

In accordance with the present invention, as seen from the first aspect, there is provided an integrated writing and computer input device comprising a writing portion for marking a surface, contact sensing means for determining if the writing portion is in contact with the surface, motion sensing means for sensing motion of the writing portion relative to the surface, and communication means for communicating a signal indicative of said motion to a computer! wherein, in a first mode of operation, the device is arranged for communicating said signal only if the contact sensing means determines that the writing portion is not in contact with the surface.

Advantageously, the integrated writing and computer input device enables a user to quickly and easily alternate between controlling a computer and making notes on a surface such as a piece of paper. If, for example, the user wishes to use the device as a computer input device, then he or she moves the device in a plane proximal to, but not coplanar with, the surface (for example between 1 mm and 20 mm above the surface). The rate and direction of motion of the device are measured by the motion sensing means and communicated to the computer via communication means, whereupon the motion of the device is translated into motion of a cursor on a computer screen. If, however, the user wishes to use the device as a writing device, then he or she allows the writing portion of the device to contact the surface. In this mode of operation, the device functions as a conventional writing implement such as a pen or pencil.

The writing portion may comprise a ballpoint refill. Alternatively, the writing portion may comprise a graphite shaft.

Preferably the communication means comprises a wireless transmitter. The wireless transmitter may comprise an infrared transmitter, in which case the computer must be provided with an infrared receiver. Alternatively or in addition thereto, the wireless transmitter may comprise a Bluetooth® transmitter, in which case the computer must be provided with a Bluetooth® receiver.

It will be appreciated that the action of writing and/or drawing on the surface will create a pressure on the writing portion, the pressure being directed upwardly from the surface. Accordingly, the contact sensing means preferably comprises pressure sensing means arranged for sensing pressure on the writing portion. The pressure sensing means may comprise a piezo-electric transducer and/or a microswitch and/or any other pressure sensor known in the art.

Preferably the motion sensing means comprises a light source, a detector and a digital signal processor, the light source being arranged for illuminating the surface at a grazing angle, the detector being arranged for capturing a plurality of images of the illuminated surface spaced apart in time, and the digital signal processor being arranged for performing digital image correlation on the plurality of images captured by the d-etector and outputting the signal indicative of the motion of the device for transmission to the computer via communication means.

The light source may comprise a light emifting diode (LED), or a laser, or any other suitable source of illumination known in the art. The detector is preferably a complementary metal-oxide semiconductor (CMOS) sensor.

Preferably the device comprises a battery arranged for energising the contact sensing means, motion sensing means and communication means. The battery may be replaceable or may be rechargeable.

Preferably the device comprises an elongate body portion, which is preferably circular in cross-section. The writing portion is preferably detachably coupled to the body portion for enabling a user to replace a used writing portion with a new writing portion. Preferably, the writing portion is disposed at a first end of the elongate body portion when engaged therewith.

The device preferably comprises a first button disposed on the elongate body portion, the first button being adapted for performing an analogous function to the left-hand button of a conventional mouse i.e. the left-click" function. The device may also comprise a second button disposed on the elongate body portion, the second button being adapted for performing an analogous function to the right-hand button of a conventional mouse i.e. the right-click" function. The second button is preferably displaced axially relative to the first button, the first button being disposed proximal to the first end of the body portion and the second button being disposed distal from the first end of the body portion.

The device may also comprise a roller-wheel disposed on the elongate body portion, the roller-wheel being adapted for performing an analogous function to a scroll-wheel of a conventional mouse. The roller-wheel is preferably disposed intermediate the first and second buttons.

The device may also comprise a second mode of operation, wherein the device is arranged for communicating the signal indicative of the motion thereof only if the contact sensing means determines that the writing portion is in contact with the surface. In this mode of operation the shape drawn on the surface by the writing portion is replicated on the screen of the computer. It will be appreciated that this second mode of operation is useful for inputting a signature into a computer document and for simultaneously creating a virtual copy of a drawing when a hardcopy is created.

Alternatively or additionally, the device may comprise a third mode of operation, wherein the device is arranged for communicating the signal indicative of the motion thereof only if the contact sensing means determines that the writing portion is in contact with the surface, and handwriting recognition means is arranged for a converting a handwritten character into a letter code representative of said character.

The letter code may be used in word-processing applications, thereby enabling the user to simultaneously create a handwritten note and a computer-readable text copy of said note.

The device may comprise switching means for selecting the mode of operation. The switching means preferably comprises a switching button.

In accordance with the present invention, as seen from a second aspect, there is provided an integrated writing and computer input system comprising an integrated writing and computer input device as hereinbefore described and a computer, the computer comprising communication means and a screen, wherein in the first mode of operation, the device is arranged for communicating the signal indicative of the motion thereof to the communication means of the computer, and the computer is arranged for controlling a cursor on the screen thereof in dependence upon said signal.

The communication means of the computer preferably comprises a wireless receiver.

The wireless receiver may be an infra-red receiver, a Bluetooth® receiver or any other receiver appropriate for communication with the communication means of the device. The wireless receiver may, for example, connect to the computer via a USB port thereof.

Embodiments of the present invention will now be described by way of example only and with reference to the accompanying drawings, in which: Figure 1 is a schematic illustration (not drawn to scale) of an integrated writing and computer input device in accordance with the present invention as seen from the first aspect, the device being shown in use controlling a cursor on a screen of a computer in accordance with the present invention as seen from the second aspect; Figure 2 is a perspective view of the integrated writing and computer input device shown in Figure 1; and, Figure 3 is a schematic cut-away view of the integrated writing and computer input device shown in Figures 1 and 2.

With reference to the drawings, there is illustrated an integrated writing and computer input device 10 for use with a computer 20. Also shown is a recharge station 30 for the device 10.

The integrated writing and computer input device 10 comprises an elongate body portion 11 of generally circular cross-section. The body portion 11 tapers outwardly from a first end 111 to an intermediate region 112 and tapers inwardly from the intermediate region 112 to a second end 113. The cross-sectional diameter of the body portion 11 proximal to the intermediate region 112 is between 5 mm and 20 mm for enabling a user to comfortably grip the body portion 11 in a pen-like fashion.

Two buttons 114, 115 and a roller-wheel 116 are disposed on an exterior surface of the body portion 11. The buttons 114, 115 and roller-wheel 116 are displaced axially relative to one another, the roller-wheel 116 being disposed intermediate the two buttons 114, 115. The first button 114 is disposed proximal to the first end 111 of the body portion 11 and is adapted for performing an analogous function to the left-hand button of a conventional mouse i.e. the "left-click" operation. The second button 115 is disposed distal from the first end 111 of the body portion 11 and is adapted for performing an analogous function to the right-hand button of a conventional mouse i.e. the "right-click" operation. The roller-wheel 116 comprises a disc that partially protrudes from an elongate aperture in the outer surface of the body portion 11. The disc is manually rotatable about an axis that extends substantially parallel to the axial direction of the body portion 11, the axis of the disc being disposed within the body portion 11 such that less than half of the disc protrudes from the body portion 11. The roller-wheel 16 is adapted for performing an analogous function to a scroll-wheel of a conventional mouse.

A switching button 117 such as a push-button is provided at the second end 113 of the body portion 11, the switching button 117 being adapted for for selecting the mode of operation of the device 10.

A writing portion 12 is provided for enabling a user to create physical notes and/or drawings on a surface S such as a piece of paper. In the illustrated embodiment, the writing portion 12 comprises a ball-point refill having an elongate cylindrical ink reservoir 121 and a roller-ball writing tip 122. The writing portion 12 is detachably coupled to the body portion 11 by means of an externally threaded screw portion (not shown) disposed on the exterior of the writing portion 12 and internally threaded screw portion (not shown) disposed on an interior of the body portion 11. When attached to the body portion 11, the writing portion 12 is disposed at the first end 111 thereof, the ink reservoir 121 being housed within the interior of the body portion 11 and the writing tip 122 protruding from the first end 111 of the body portion 11. It will be appreciated that alternative writing portions 12 are possible, such as an ink pen with replaceable ink cartridge or a pencil with a graphite shaft.

Contact sensing means 13 are coupled to the writing portion 12 for determining if the writing portion 12 is in contact with the surface S. The contact sensing means 13 comprises a pressure sensor disposed at the end of the writing portion 12 distal from the writing tip 122. The pressure sensor comprises a piezo-electric disc (not shown) mechanically coupled to the writing portion 12 such that pressure exerted on the writing portion 12 is translated into compression of the piezo-electric disc (not shown). A voltmeter (not shown) is arranged for measuring a voltage output from the piezo-electric disc (not shown) when the piezo-electric disc (not shown) is deformed under pressure. However, it will be appreciated that other pressure sensing means are also possible, such as a microswitch.

The device further comprises motion sensing means 14 arranged for sensing motion of the writing portion 12 relative to the surface S. The motion sensing means 14 comprises a light source 141 arranged for illuminating the surface S at a grazing angle when the device 10 is held over the surface S in a pen-like fashion by a user.

The light source 141 may be a light-emitting diode (LED) but is preferably a laser light source. A detector 142 such as a complimentary metal-oxide semiconductor (CMOS) sensor is provided for capturing light from the light source 141 that has been reflected by the surface S. The detector 142 is arranged for capturing between approximately 1000 and 2000 images of the surface S every second and communicating these images to a digital signal processor (DSP) 143. The DSP 143 is adapted for performing digital image correlation on the images i.e. for calculating the degree one image is offset from the previous image and for outputting a signal indicative of the rate and direction of motion of the device 10. It will be appreciated that illumination at a grazing angle accentuates any irregularities in the surface S and therefore improves the accuracy of the digital image correlation process.

A processor 15 is arranged for communication with the contact sensing means 13 and motion sensing means 14. In particular, the processor 15 receives a signal from the contact sensing means 13 indicative of whether the writing portion 12 of the device 10 is in contact with the surface S. The processor 15 also receives a signal from the DSP 143 of the motion sensing means 14 indicative of the motion of the device 10. The processor 15 is adapted for outputting the signal indicative of the motion of the device 10, or a processed (e.g. conditioned) form thereof, in dependence upon the signal indicative of whether the writing portion 12 is in contact with the surface S. The mode of operation dictates the particular dependence, as discussed below.

Communication means 16 are provided for receiving the signal output by the processor 15 and wirelessly communicating this signal to the computer 20. The communication means 16 comprises a wireless transmitter such as an infra-red transmifter or a Bluetooth® transmitter. The wireless transmitter communicates with a complementary communication means 21 of the computer 20, such as a wireless receiver adapted for receiving the appropriate signal. The complementary communication means 21 is provided with a USB connector (not shown) for engaging with a USB port (not shown) of the computer 20.

The device 10 is adapted for performing automatic character recognition. For example, the processor 15 may comprise integrated character recognition means (not shown), or character recognition may be effected by the computer 20 upon receipt of the signal communicated thereto by communication means 16.

The device 10 further comprises a power source 17 such as a battery 171 arranged for energizing the contact sensing means 13, motion sensing means 14, processor and communication means 16. In the illustrated embodiment, the battery 171 is rechargeable via recharge contacts 172, 173. The recharge contacts 172, 173 are formed of an electrically conductive material and are disposed on the outer surface of the body portion 11 intermediate the first end 111 and the intermediate region 112 thereof. Each recharge contact 172, 173 forms a collar that extends circumfrentially around a part of the body portion 11, the respective recharge contacts 172, 173 being axially displaced relative to one another.

A recharge station 30 is provided for recharging the battery 171 from a mains power supply. In the embodiment illustrated in Figure 1, the recharge station 30 comprises a base-plate 31 and tapered tubular portion 32 that extends upwardly from the base-plate 31 and tapers outwardly therefrom. The tubular portion 32 is shaped and sized for engagement with a lower section of the body portion of the device, the lower section extending from the first end 111 to at least the upper recharge contact 173.

Two conductive collars 33, 34 are disposed on an interior wall of the tubular section 32 for electrically coupling with the recharge contacts 172, 173 of the device 10 when the device 10 is engaged with the recharge station 30. It will be appreciated that as an alternative to a rechargeable battery 171, the battery may be replaceable.

The device 10 comprises a first mode of operation, which may be defined as CURSOR MODE. In the preferred embodiments, the device 10 also comprises second and third modes of operation -so-called SIGNATURE MODE and NOTE MODE respectively.

In use, the mode of operation is selected via switching means 117. Depression of the switching button 117 initiates the start of pre-set timeframe (e.g. 5 seconds), in which the mode of operation may be selected by moving the device 10 (either in contact with, or proximal to, the surface 5) to trace a set character. It is envisaged that the set characters associated with CURSOR MODE, SIGNATURE MODE and NOTE MODE are C, S and N respectively. Movement of the device 10 is tracked by motion sensing means 14. In particular, images of the surface S below the device 10 are captured by the detector 142 at a rate of between 1000 and 2000 images per second. These images are communicated to the DSP 143, whereupon the offset between each image and the preceding image is calculated via digital image correlation. The DSP 143 outputs a signal indicative of the rate and direction of motion, which is communicated to the processor 15. The character recognition means (not shown) recognises if the user has traced one of the set characters, and if this is carried out within the pre-set timeframe then the appropriate mode of operation is selected. If the user does not trace one of the above characters within the pre-set timeframe then mode of operation is not changed.

CURSOR MODE may be selected if the user wishes to alternately make notes on the surface S (such as a piece of paper) and control the computer 20. When CURSOR MODE is selected, the contact sensing means 13 is operable to determine whether the writing tip 122 of the writing portion 12 is in contact with the surface S. If the writing tip 122 is in contact with the surface S then the resulting pressure on the writing portion 12 compresses the piezo-electric disc (not shown) of the contact sensing means 13, which generates a potential difference measureable by the voltmeter (not shown). Simultaneously, the motion sensing means 14 is operable to measure motion of the device 10 relative to the surface S via digital image correlation of images captured by the detector 142. Both the contact sensing means 13 and motion sensing means 14 transmit output signals to the processor 15. the former being indicative of contact between the writing portion 12 and the surface 5, and the latter being indicative of the rate and direction of motion of the device 10. If the signal from the contact sensing means 13 indicates that the writing portion 12 is in contact with the surface S then no signal is output from the processor 15. If, however, the signal from the contact sensing means 13 indicates that the writing portion 12 is not in contact with the surface S then the processor 15 outputs the signal indicative of the rate and direction of motion of the device 10 (or a processed form thereof) to the communication means 16, whereupon the signal is transmitted to the computer 20.

Once received by the wireless receiver 21 of the computer 20, the signal is translated into motion of the cursor 23 on the screen 22.

Whilst in CURSOR MODE, depression of first and second buttons 114, 115 transmits an instruction to the computer 20 (via communication means 16) to complete the "left-click' or "right-click" command respectively. Rotation of the roller-wheel 116 instructs the computer 20 to scroll either upwardly or downwardly in dependence upon the direction of rotation of the roller-wheel 116.

If SIGNATURE MODE is selected, the "cursor" on the screen 22 is transformed into a virtual pen. The contact sensing means 13 and motion sensing means 14 are operable in the same manner as in CURSOR MODE but the processor 15 outputs a signal indicative of the motion of the device 10 only if the signal from the contact sensing means 13 indicates that the writing portion 12 is in contact with the surface S. Accordingly, in this mode of operation, the shape drawn on the surface S is replicated on the screen 22 of the computer 20. It will be appreciated that this mode of operation is useful for inputting a signature into a computer document and for simultaneously creating a virtual copy of a drawing when a hardcopy is created.

If NOTE MODE is selected, the contact sensing means 13 and motion sensing means 14 are operable in the same manner as in CURSOR MODE and SIGNATURE MODE, and the processor 15 outputs a signal indicative of the motion of the device only if the signal from the contact sensing means 13 indicates that the writing portion 12 is in contact with the surface S. Handwriting recognition means (either within the processor 15 or the computer 20) converts the hard-written characters into a letter codes representative of said characters. The letter codes may be used in word-processing applications, thereby enabling the user to simultaneously create a computer-readable text copy of a hand-written note when the note is created.

When the user wishes to recharge the battery 171, he or she engages the device 10 with the recharge station 30, whereupon the battery is energised from a mains power supply via electrical contact between the conductive collars 33, 34 of the recharge station 30 and the recharge contacts 172, 173 of the device 10.

Claims

CLAIMS1. An integrated writing and computer input device comprising a writing portion for marking a surface, contact sensing means for determining if the writing portion is in contact with the surface, motion sensing means for sensing motion of the writing portion relative to the surface, and communication means for communicating a signal indicative of said motion to a computer, wherein, in a first mode of operation, the device is arranged for communicating said signal only if the contact sensing means determines that the writing portion is not in contact with the surface.
2. A device as claimed in claim 1, wherein the writing portion comprises a ballpoint refill.
3. A device as claimed in claim 1, wherein the writing portion comprises a graphite shaft.
4. A device as claimed in any preceding claim, wherein the communication means comprises a wireless transmitter.
5. A device as claimed in any preceding claim, wherein the contact sensing means comprises pressure sensing means arranged for sensing pressure on the writing portion.
6. A device as claimed in claim 5, wherein the pressure sensing means comprises a piezo-electric transducer.
7. A device as claimed in any preceding claim, wherein the motion sensing means comprises a light source, a detector and a digital signal processor, the light source being arranged for illuminating the surface at a grazing angle, the detector being arranged for capturing a plurality of images of the illuminated surface spaced apart in time, and the digital signal processor being arranged for performing digital image correlation on the plurality of images captured by the detector and outputting the signal indicative of the motion of the device for transmission to the computer via the communication means.
8. A device as claimed in claim 7, wherein the light source comprises a light emitting diode (LED).
9. A device as claimed in claim 7, wherein the light source comprises a laser.
10.A device as claimed in any of claims 7 to 9, wherein the detector is a complementary metal-oxide semiconductor (CMOS) sensor.
11. A device as claimed in any preceding claim, wherein the device further comprises a battery arranged for energising the contact sensing means, motion sensing means and communication means.
12. A device as claimed in any preceding claim, wherein the device comprises an elongate body portion.
13.A device as claimed in claim 12, wherein the writing portion is detachably coupled to the body portion for enabling a user to replace a used writing portion with a new writing portion.
14.A device as claimed in claim 12 or claim 13, wherein the device comprises a first button disposed on the elongate body portion, the first button being adapted for performing an analogous function to the left-hand button of a conventional mouse i.e. the left-click" function.
15. A device as claimed in any of claims 12 to 14, wherein the device comprises a second button disposed on the elongate body portion, the second button being adapted for performing an analogous function to the right-hand button of a conventional mouse i.e. the "right-click" function.
16.A device as claimed in claim 15 as appended to claim 14, wherein the second button is displaced axially relative to the first button.
17. A device as claimed in any of claims 12 to 16, wherein the device comprises a roller-wheel disposed on the elongate body portion, the roller-wheel being adapted for performing an analogous function to a scroll-wheel of a conventional mouse.
18.A device as claimed in claim 17 as appending to claim 16, wherein the roller-wheel is disposed intermediate the first and second buttons.
19.A device as claimed in any preceding claim, wherein in a second mode of operation the device is arranged for communicating the signal indicative of the motion of the device only if the contact sensing means determines that the writing portion is in contact with the surface such the shape drawn on the surface by the writing portion is replicated on the screen of the computer.
20.A device as claimed in any preceding claim, wherein the device further comprises handwriting recognition means, wherein in a third mode of operation the device is arranged for communicating the signal indicative of the motion of the device only if the contact sensing means determines that the writing portion is in contact with the surface, and wherein the handwriting recognition means is arranged for a converting a handwritten character into a letter code representative of said character.
21.A device as claimed in claim 19 or claim 20, wherein the device comprises switching means for selecting the mode of operation.
22. An integrated writing and computer input device substantially as herein described with reference to Figures 2 and 3 of the accompanying drawings.
23. An integrated writing and computer input system comprising the integrated writing and computer input device of any of claims 1 to 22 and a computer, the computer comprising communication means and a screen, wherein in the first mode of operation, the device is arranged for communicating the signal indicative of the motion thereof to the communication means of the computer, and the computer is arranged for controlling a cursor on the screen in dependence upon said signal.
24. A system as claimed in claim 23, wherein the communication means of the computer comprises a wireless receiver.
25. An integrated writing and computer input system substantially as herein described with reference to Figure 1 of the accompanying drawings.