WO2001014955A1 - Apparatus for recording movement - Google Patents

Apparatus for recording movement

Info

Publication number
WO2001014955A1
WO2001014955A1 PCT/GB2000/003286 GB0003286W WO2001014955A1 WO 2001014955 A1 WO2001014955 A1 WO 2001014955A1 GB 0003286 W GB0003286 W GB 0003286W WO 2001014955 A1 WO2001014955 A1 WO 2001014955A1
Authority
WO
Grant status
Application
Patent type
Prior art keywords
apparatus
camera
surface
implement
means
Prior art date
Application number
PCT/GB2000/003286
Other languages
French (fr)
Inventor
John Heppell
Original Assignee
John Heppell
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03542Light pens for emitting or receiving light

Abstract

An attachment (11) for a writing implement (1), comprising an attachment body (12) adapted to be connected to the writing implement, a signal generator (16) connected to the body to emit a signal, a power supply (14) for said generator, and switch means (17) to turn said generator means on when said writing implement is being used. Apparatus according to the invention includes a camera for tracking movement of the signal generator, means for generating digital signals representative of the movement, and a computer system for recording the signals and therefore the movement of the implement.

Description

APPARATUS FOR RECORDING MOVEMENT

The present invention relates to apparatus for recording the movements of an object such as a marker pen on a surface such as a whiteboard.

The presentation of information using marker pens to write information on whiteboards is well known. Such whiteboards are commonly used in educational establishments (replacing the blackboard) and in the corporate environment, e.g. for use in business presentations. A problem with the use of whiteboards is that information written on them is permanently removed when they are wiped clean to receive new information.

It is known to provide a whiteboard which converts information written thereon into a format which can be fed to a computer (e.g. a PC). This allows information written on the board to be saved on computer e.g. as a file. Such whiteboards have a special surface having X and Y axis grid lines (or use X and Y axis laser beams) to record the movement of a marker pen over the surface of the whiteboard which can be fed to the computer. Such boards are purpose made and are expensive.

The invention seeks to provide, inter alia, apparatus which converts information written on a whiteboard into a format which can be fed to a computer (e.g. a PC). The apparatus uses a novel marker pen attachment.

The present invention provides apparatus for recording the movements of an object on a surface, said apparatus comprising a signal generator for connection to said object, a camera for detecting movements of said signal generator as said object moves over said surface, means for creating a digital signal representative thereof, and a computer for storing said digital signals from said camera, whereby to store image/s of the movements of the object.

Said object may be a writing implement, and the generator may be provided by an attachment for the implement.

Perspective adjustment means are preferably provided whereby the camera can be sited at an angle other than normal to the centre of the surface and the image/s stored by the computer are adjusted as if the camera was sited normal to the centre of the surface.

The attachment may comprise an attachment body adapted to be connected to a writing implement, signal generator means connected to the body to emit a signal, a power supply for said generator means, and switch means to turn said generator means on when said writing implement is being used.

In one embodiment the attachment body is a hollow tube adapted to receive a writing implement such as a marker pen. Preferably the tube has an aperture at one end thereof through which the writing tip of the implement can project. Preferably the tube is formed from two separable parts to enable the writing implement therein to be replaced.

Preferably the generator means is adjacent the tip of the writing implement when the attachment is fitted to the implement. Preferably the signal is based on electromagnetic radiation. In one embodiment the generator means generates an infra red signal. The generator means may be an LED.

In one embodiment the switch means may be a press button switch preferably operable by a finger of the user. In another embodiment the switch may be a pressure sensitive collar around the writing implement which senses lateral movement of the writing implement when it is used for writing. Preferably the collar is mounted adjacent the writing tip of the implement. The collar may be a piezoelectric sensor such as a piezoelectric ceramic resonator.

The invention also relates to a digital camera with perspective adjustment means, whereby the camera can be sited at an angle other than normal to the centre of the surface and the image/s stored by the computer are adjusted as if the camera was sited normal to the centre of the surface. The perspective adjustment means may create a corrective algorithm based on four reference points in a square on said surface. The invention thus also extends to a method of correcting the perspective of images taken by a digital camera by applying a corrective algorithm based on four reference points in a square in a single plane.

Embodiments of the present invention will now be described, by way of example, with reference to the accompanying drawings in which:

Figure 1 shows a perspective view of a writing implement and attachment, and

Figure 2 shows a schematic view of an embodiment of apparatus according to the present invention used with a whiteboard and marker pen. Referring to Figure 1 there is shown a writing implement in the form of a marker pen 1. Marker pen 1 has a main cylindrical body 2 charged with ink and which tapers at one end to an integral nozzle 3 which supports a writing tip such as felt nib 4. Marker pen 1 may be of the type well known in the art, such as used on whiteboards, and need not be described further.

Marker pen 1 is connected to and housed in an attachment 1 1 having an attachment body in the form of a hollow cylinder 12. Connected to one end of the cylinder 12 is a detachable cylindrical battery compartment 13 housing a power supply in the form of a battery 14. Pen 1 can be replaced by removing temporarily battery compartment 13.

Cylinder 12 tapers to a reduced diameter section 12A having an aperture 15 through which the nib 4 projects. Adjacent the aperture 15 and nib 14 is a signal generator means in the form of an infra red LED 16. LED 16 is connected to the battery 14 by suitable leads (not shown) and through switch means in the form of a pressure sensitive collar 17 which forms a tight fit around the writing implement nozzle 3. The collar 17 is a piezoelectric sensor such as a piezoelectric ceramic resonator as is known in the art. A spring 18 biases the nozzle 3 into the collar 17.

Switch collar 17 is turned "on" when it senses lateral movement of the pen 1 when it is used for writing. Thus when the pen is writing the LED is "on", and the LED is "off when the pen is not writing. Instead of collar 17, the switch means may be a press button switch preferably operable by a finger of the user whilst writing, such as the forefinger, and may be mounted on the reduced diameter section 12A. Also the infra red LED could be replaced with a generator of an alternative type of electromagnetic or other radiation.

A cover cap 18 fits over the reduced diameter section 12A when the pen is not in use to prevent the nib 4 from "drying out".

The attachment described above is designed to be used in conjunction with apparatus as described now with reference to Figure 2. In Figure 2 a computer system is shown for recording the movements of an object, in the form of a marker pen 1 (of Figure 1) with the attachment 1 1 , whilst information is being written onto a surface in the form of a whiteboard

20. The LED 16 of attachment 11 acts as a signal generator for the system.

A camera 21 is provided to record movements of the LED 16 as the pen moves over whiteboard 20 when the user is writing. Camera 21 creates a digital signal representative of the movement which is fed to a PC 22 (or other computer) to store and display digital signals from the camera 21, whereby to store and display image/s written by the pen 1 on the whiteboard 20. In the drawing the sum "1+2=3" has been written on the whiteboard 20 which then appears on the screen of computer 22. Camera 21 may be a standard video camera giving a continuous output (rather than a "stills" camera), and may have a filter designed so that the camera only sees the signal from LED. Alternatively the camera could be custom designed. In use a person can write information on a whiteboard. As the person writes so the information is recorded by the camera and stored on computer. The information may be saved as a file for use at a later date, e.g. for onward transmission or duplication. If desired that file can be fed through a projector back onto a whiteboard or other surface at a later date.

The file can also be edited if desired.

It is envisaged that a kit comprising a camera 21, appropriate software, and a pen attachment 11 would be sold as a package for connection to a PC. This would allow a person to record information written on any standard whiteboard. The software could have many extra features. For example the system could be programmed so when the attachment 1 1 is positioned in certain positions on the whiteboard, it could change certain programming functions. For example it could change colour information displayed. The attachment 11 could thus act rather like a computer mouse.

In order that a person writing on the whiteboard does not become positioned between the LED 16 and the camera so preventing the camera from following the LED, the camera may be positioned as shown at an angle other than normal to the centre of the board 20. Under normal circumstances this would effect the perspective view of the information displayed on the computer screen because the camera is not positioned normal to the centre of the board 20. (i.e. because the number "I" is closer to the camera than number "3", the number "1" would appear larger).

i ciύ t il vt ujUauutiiL incαua, 111 int. lOiϊIi VJJL UIlli .J liuubuϊg αppru ilαlc lO ll £C*l**£ V» VUv> j« r by the computer are adjusted as if the camera was sited normal to the centre of the board 20. The perspective adjustment means may create a corrective algorithm based on four reference points A, B, C, D, in a square on whiteboard 20. The reference points can be entered into the unit 23 using the attachment 11.

The use of selecting four reference points in a square and creating a corrective algorithm to correct the perspective of an image taken by a digital camera has applications outside recording images on whiteboards. The invention thus also extends to a method of correcting the perspective of images taken by a digital camera by applying a corrective algorithm based on four reference points in a square in a single plane.

The invention also relates to a digital camera with perspective adjustment means, whereby the camera can be sited at an angle other than normal to the centre of the surface and the image/s stored by the computer are adjusted as if the camera was sited normal to the centre of the surface. The perspective adjustment means may create a corrective algorithm based on four reference points in a square on said surface.

Further modifications will be apparent to those skilled in the art without departing from the scope of the present invention.

Claims

1. Apparatus for recording the movements of an object on a surface, said apparatus comprising a signal generator for connection to said object, a camera for detecting movements of said signal generator as said object moves over said surface, means for creating a digital signal representative thereof, and a computer for storing said digital signals from said camera, whereby to store image/s of the movements of the object.
2. Apparatus as claimed in claim 1. in which said object is a writing implement, and the generator is provided by an attachment for the implement.
3. Apparatus as claimed in claim 1 or claim 2, in which perspective adjustment means are provided whereby the camera can be sited at an angle other than normal to the centre of the surface and the image/s stored by the computer are adjusted as if the camera was sited normal to the centre of the surface.
4. Apparatus as claimed in claim 3, in which the perspective adjustment means creates a corrective algorithm based on four reference points in a square on said surface.
5.. Apparatus as claimed in claim 2 or either of claims 3 and 4 when dependent on claim
2, in which the attachment comprises a body adapted to be connected to the writing implement, signal generator means connected to the body to emit a signal, a power supply for said generator means, and switch means to turn said generator means on when said writing implement is being used.
6. Apparatus as claimed in claim 5, in which the attachment body is a hollow tube adapted to receive the writing implement.
7. Apparatus as claimed in claimed in claim 6, in which the tube has an aperture at one end thereof through which the writing tip of the implement can project.
8. Apparatus as claimed in claimed in claim 6 or claim 7, in which the tube is foπned from two separable parts to enable the writing implement therein to be replaced.
9. An attachment as claimed in claimed in any of claims 5 to 8, in which the generator means is adjacent the tip of the writing implement when the attachment is fitted to the implement.
10. Apparatus as claimed in claimed in any of claims 5 to 9. in which the signal is based on electromagnetic radiation.
11. Apparatus as claimed in claimed in any of claims 5 to 10, in which the generator means generates an infra red signal, the generator means being an LED.
12. Apparatus as claimed in claimed in any of claims 5 to 11, in which the switch means is a press button switch.
13. Apparatus as claimed in claimed in any of claims 5 to 11, in which the switch means is a pressure sensitive collar around the writing implement which senses lateral movement of the writing implement when it is used for writing.
14. Apparatus as claimed in claimed in claim 13, in which the collar is mounted adjacent the writing tip of the implement.
15. Apparatus as claimed in claimed in claim 13 or claim 14, in which the collar is a piezoelectric sensor such as a piezoelectric ceramic resonator.
16. A camera with perspective adjustment means, whereby the camera can be sited at an angle other than normal to the centre of the surface and the image/s stored by the computer are adjusted as if the camera was sited normal to the centre of the surface.
17. A camera as claimed in claim 16, in which the perspective adjustment means creates a corrective algorithm based on four reference points in a square on said surface.
PCT/GB2000/003286 1999-08-26 2000-08-25 Apparatus for recording movement WO2001014955A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
GB9920095.8 1999-08-26
GB9920095A GB9920095D0 (en) 1999-08-26 1999-08-26 Writing implement attachment and computer system

Publications (1)

Publication Number Publication Date
WO2001014955A1 true true WO2001014955A1 (en) 2001-03-01

Family

ID=10859759

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2000/003286 WO2001014955A1 (en) 1999-08-26 2000-08-25 Apparatus for recording movement

Country Status (2)

Country Link
GB (1) GB9920095D0 (en)
WO (1) WO2001014955A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2432341A (en) * 2005-10-29 2007-05-23 Hewlett Packard Development Co Digital pen and document marking system
US8803978B2 (en) 2006-05-23 2014-08-12 Microsoft Corporation Computer vision-based object tracking system

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101317148B (en) 2005-12-30 2010-09-29 国际商业机器公司 Hand-written input method and apparatus based on video
WO2010048655A3 (en) * 2008-10-30 2010-07-22 Robert Koeppe Writing device and method for operating a writing device
GB2508840B (en) * 2012-12-12 2015-10-21 Modular Software Ltd T A Reflective Thinking Method and apparatus for tracking the movement of a plurality of pointer devices within a scene
CN104391591A (en) * 2014-05-16 2015-03-04 深圳市天美意科技有限公司 Laser page-turning pen

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5581637A (en) * 1994-12-09 1996-12-03 Xerox Corporation System for registering component image tiles in a camera-based scanner device transcribing scene images

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4814552A (en) * 1987-12-02 1989-03-21 Xerox Corporation Ultrasound position input device
US5166668A (en) * 1991-04-10 1992-11-24 Data Stream Corporation Wireless pen-type input device for use with a computer
CA2060564C (en) * 1992-02-06 1996-05-21 Toru Suzuki Wireless input system for computer
DE69307544D1 (en) * 1992-11-17 1997-02-27 Lectra Systemes Sa A method and apparatus for detecting and treating graphical information
US5866856A (en) * 1997-02-28 1999-02-02 Electronics For Imaging, Inc. Marking device for electronic presentation board
US6118205A (en) * 1998-08-13 2000-09-12 Electronics For Imaging, Inc. Transducer signal waveshaping system
US6731270B2 (en) * 1998-10-21 2004-05-04 Luidia Inc. Piezoelectric transducer for data entry device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5581637A (en) * 1994-12-09 1996-12-03 Xerox Corporation System for registering component image tiles in a camera-based scanner device transcribing scene images

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2432341A (en) * 2005-10-29 2007-05-23 Hewlett Packard Development Co Digital pen and document marking system
GB2432341B (en) * 2005-10-29 2009-10-14 Hewlett Packard Development Co Marking material
US8803978B2 (en) 2006-05-23 2014-08-12 Microsoft Corporation Computer vision-based object tracking system
US9964624B2 (en) 2006-05-23 2018-05-08 Microsoft Technology Licensing, Llc Computer vision-based object tracking system

Also Published As

Publication number Publication date Type
GB2353501A (en) 2001-02-28 application
GB9920095D0 (en) 1999-10-27 grant

Similar Documents

Publication Publication Date Title
US6806867B1 (en) Palm pad system
US6377249B1 (en) Electronic light pen system
US6573887B1 (en) Combined writing instrument and digital documentor
US5635682A (en) Wireless stylus and disposable stylus cartridge therefor for use with a pen computing device
US6991332B1 (en) Digital hand stamp with memory to store multiple images
US6567078B2 (en) Handwriting communication system and handwriting input device used therein
US7098894B2 (en) Pen type optical mouse device and method of controlling the same
US6724374B1 (en) Sensing device for coded electronic ink surface
US20050024346A1 (en) Digital pen function control
US5670992A (en) Portable graphic computer apparatus
US5511983A (en) Graphic image generating apparatus with automatic demonstration image generating program
US5737740A (en) Apparatus and method for processing electronic documents
US20090115744A1 (en) Electronic freeboard writing system
US5511148A (en) Interactive copying system
US5897648A (en) Apparatus and method for editing electronic documents
US7091960B1 (en) Code sensor attachment for pen
US20110298709A1 (en) System and method for digital recording of handpainted, handdrawn and handwritten information
US4670751A (en) Eraser for electronic blackboard
US20060279784A1 (en) Handheld printer
US6317266B1 (en) Coordinate input apparatus
US6441807B1 (en) Display system
US6847356B1 (en) Coordinate input device and its control method, and computer readable memory
US20050185002A1 (en) Information processing apparatus
US6191777B1 (en) Portable graphic computer apparatus
US20080166175A1 (en) Holding and Using an Electronic Pen and Paper

Legal Events

Date Code Title Description
AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase in:

Ref country code: JP