EP1380006B1 - Einrichtung zum aufzeichnen und erkennen handschriftlicher zeichen - Google Patents

Einrichtung zum aufzeichnen und erkennen handschriftlicher zeichen Download PDF

Info

Publication number
EP1380006B1
EP1380006B1 EP01912929A EP01912929A EP1380006B1 EP 1380006 B1 EP1380006 B1 EP 1380006B1 EP 01912929 A EP01912929 A EP 01912929A EP 01912929 A EP01912929 A EP 01912929A EP 1380006 B1 EP1380006 B1 EP 1380006B1
Authority
EP
European Patent Office
Prior art keywords
implement
writing surface
light
handwriting
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP01912929A
Other languages
English (en)
French (fr)
Other versions
EP1380006A1 (de
EP1380006A4 (de
Inventor
Edward Fisher
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thinkpen LLC
Original Assignee
Thinkpen LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thinkpen LLC filed Critical Thinkpen LLC
Priority to AT01912929T priority Critical patent/ATE325379T1/de
Publication of EP1380006A1 publication Critical patent/EP1380006A1/de
Publication of EP1380006A4 publication Critical patent/EP1380006A4/de
Application granted granted Critical
Publication of EP1380006B1 publication Critical patent/EP1380006B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof

Definitions

  • the invention relates to handwritten character input and recognition devices. More particularly the device provides a means to electronically record handwritten graphics and record and recognize hand written characters.
  • Another method uses accelerometers or gyroscopes to sense acceleration and deceleration of the pen (US188392, US5247137, US5517579).
  • US 5,852,434 which represents the basis for the preamble of claim 1, discloses a digitizer and absolute position determination device for indicating the instantaneous position and movement of a stylus on a surface. It proposes the use of a data surface (e.g., paper) formatted with a position-related code for indicating X-Y coordinates capable of reflecting a frequency of light.
  • the stylus comprising a writing element has a light source of a frequency for illuminating the position-related code.
  • the frequency of light is absorbed by the data surface but reflected by the position-related code onto a charge-coupled device (CDD) located within the stylus.
  • CDD charge-coupled device
  • the invention is an electronic recording and computing device that resides within or on a pen shaped object for the purpose of recording and processing handwritten text or graphics.
  • the device includes a marking implement that may be a pencil, ink pen, non-marking tip, chalk, crayon, marker, paint, laser marking tool, or any other instrument used for writing or marking.
  • the device records motion and marking with one or more of each of the following components: image sensor, light source, light detector, force sensor, contactor, microprocessor, volatile and non-volatile memory, analog to digital converter. Movement of the apparatus is sensed and recorded by means of the image sensor and optical navigation software which tracks microscopic and/or macroscopic features of the writing surface.
  • the orientation of the pen to the writing surface is electronically sensed and recorded by casting a plane wave of light on the surface and detecting the amount received back with several light sensors placed in a specific orientation with each other. This information is used to correct optical navigation data that is distorted by the orientation of the pen to the writing surface.
  • Data may be processed by on board application software and/or stored for later retrieval. Data may be transmitted through a docking station or via a wireless technology. The transmitted information may later be used with software for tasks such as optical character recognition, signature authentication, or image reconstruction.
  • FIG 1 A first embodiment of the device is shown in FIG 1 and is constructed in accordance with claims of the present invention.
  • a pen shaped enclosure provides a housing for all components of the system such that the apparatus may operate autonomously.
  • the embodiment also comprises a marking implement for writing characters or making graphical markings on paper or other surface.
  • the marking implement in this first embodiment is ink.
  • the marking implement resides within a cartridge 4 such that the cartridge 4 may move within the pen so that it may engage a force sensor 3 for detecting when the tip of the device is in contact with the marking surface (FIG. 1).
  • This embodiment is also comprised of one or more infrared light emitting diodes 5 arranged in a manner to produce a plane wave of light which is to be incident on the marking surface (FIG 3).
  • the embodiment is also comprised of three infrared phototransistors for detecting infrared light from said light emitting diodes 5 that has reflected off the marking surface.
  • the phototransistors are arranged in a specific orientation to each other in this embodiment of the device (FIG 2).
  • the amount of infrared light detected is used to calculate the distance and/or angle of inclination of the apparatus to the marking surface. Using data obtained from two light sensors the angle of inclination of the apparatus relative to the writing surface may be calculated in two orthogonal directions.
  • the embodiment is also comprised of an imaging system that includes a charged coupled device image sensor 1, two lenses 6, and a fibre optic image pipe 2 (FIG 1).
  • the two lenses 6 are chosen such that the image obtained by the imaging system 6 provides a telecentric view of the page, this ensures there is little or no distortion in the image.
  • This imaging system 6 is used to rapidly obtain images of macroscopic and/or microscopic features of the marking surface. These images are used in conjunction with optical navigation software capable of comparing these images and mathematically calculating the motion of the apparatus relative to the marking surface.
  • the embodiment also consists of a microprocessor, memory, and application software that includes said optical navigation as well as software necessary for processing data obtained from said phototransistors. This information may be stored in memory for later retrieval or transmitted in real time to a personal computer or other computing device.
  • the embodiment of the device also includes a display and several buttons so the user may interact with the device and invoke application software or data transmission.
  • This embodiment of the device includes electronic hardware and/or software to support the transmission of data via a wired or wireless means.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Position Input By Displaying (AREA)
  • Image Input (AREA)
  • Character Input (AREA)

Claims (9)

  1. Handschriftgerät, wobei das Gerät über eine Schreiboberfläche manipuliert werden kann, um die Erstellung einer Schriftsache zu simulieren oder zu erzeugen, und wobei eine solche Manipulation maschinenlesbare Daten erzeugt, die die Schriftsache verkörpern, wobei das Gerät umfasst:
    a) eine Lichtquelle (5), die auf die Schreiboberfläche einfallendes Licht emittiert;
    b) einen Bildsensor (1), welcher das Bild der Schreiboberfläche erfasst;
    c) einen Prozessor zum Empfangen erfasster Bilder von dem Bildsensor (1) während der Bewegung des Geräts über der Schreiboberfläche und um davon Daten zu erzeugen, welche die Bewegung des Geräts über der Schreiboberfläche verkörpern;
    dadurch gekennzeichnet, dass das Gerät ferner umfasst:
    d) ein Array von von dem Bildsensor seperaten Lichtsensoren, die einfallendes Licht erfassen, das von der Schreiboberfläche reflektiert wird, und dass der Prozessor auch zum Empfangen erfasster einfallender Lichtsignale von den Lichtsensoren dient und um daraus Daten zu erzeugen, die die Orientierung des Geräts in Bezug auf die Schreiboberfläche verkörpern.
  2. Handschriftgerät nach Anspruch 1, ferner umfassend ein telezentrisches Linsensystem (6), durch welches der Bildsensor (1) das Bild der Schreiboberfläche erfasst.
  3. Handschriftgerät nach einem der voranstehenden Ansprüche, ferner umfassend einer Lichtleiter (2), der das Bild der Schreiboberfläche zu dem Bildsensor (1) leitet.
  4. Handschriftgerät nach einem der voranstehenden Ansprüche, ferner umfassend eine Gerätespitze, mit der ein Kraftsensor (3) verbunden ist, wobei der Kraftsensor einen Kontakt der Spitze mit einer Schreiboberfläche detektiert um eine Datenerzeugung auszulösen.
  5. Handschriftgerät nach einem der voranstehenden Ansprüche, wobei die Gerätespitze ein Tinte spendendes Markierungsgerät umfasst.
  6. Handschriftgerät nach einem der voranstehenden Ansprüche, wobei die Lichtquelle (5) eine ebene Welle einfallenden Lichts emittiert.
  7. Handschriftgerät nach einem der voranstehenden Ansprüche, wobei das von der Lichtquelle (5) emittierte Licht Licht im infraroten Spektrum ist.
  8. Handschriftgerät nach einem der voranstehenden Ansprüche, wobei die Lichtsensoren Licht mit Wellenlängen im infraroten Spektrum detektieren.
  9. Satz umfassend ein Handschriftgerät nach einem der voranstehenden Ansprüche und mindestens eines der Folgenden:
    integrierte Anwendungssoftware;
    eine Dockingstation;
    kabellose Technologie zur Datenübertragung;
    optische Zeichenerkennungssoftware;
    Unterschriftenauthentifizierungssoftware;
    Bildrekonstruktionssoftware.
EP01912929A 2001-02-22 2001-02-22 Einrichtung zum aufzeichnen und erkennen handschriftlicher zeichen Expired - Lifetime EP1380006B1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AT01912929T ATE325379T1 (de) 2001-02-22 2001-02-22 Einrichtung zum aufzeichnen und erkennen handschriftlicher zeichen

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2001/005689 WO2002069247A1 (en) 2001-02-22 2001-02-22 Handwritten character recording and recognition device

Publications (3)

Publication Number Publication Date
EP1380006A1 EP1380006A1 (de) 2004-01-14
EP1380006A4 EP1380006A4 (de) 2005-01-19
EP1380006B1 true EP1380006B1 (de) 2006-05-03

Family

ID=21742359

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01912929A Expired - Lifetime EP1380006B1 (de) 2001-02-22 2001-02-22 Einrichtung zum aufzeichnen und erkennen handschriftlicher zeichen

Country Status (4)

Country Link
EP (1) EP1380006B1 (de)
JP (1) JP2004519772A (de)
DE (1) DE60119393T2 (de)
WO (1) WO2002069247A1 (de)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7203383B2 (en) 2001-02-22 2007-04-10 Thinkpen Llc Handwritten character recording and recognition device
US7298367B2 (en) 2003-11-25 2007-11-20 3M Innovative Properties Company Light emitting stylus and user input device using same
US7826641B2 (en) 2004-01-30 2010-11-02 Electronic Scripting Products, Inc. Apparatus and method for determining an absolute pose of a manipulated object in a real three-dimensional environment with invariant features
US9229540B2 (en) 2004-01-30 2016-01-05 Electronic Scripting Products, Inc. Deriving input from six degrees of freedom interfaces
US7961909B2 (en) 2006-03-08 2011-06-14 Electronic Scripting Products, Inc. Computer interface employing a manipulated object with absolute pose detection component and a display
US8542219B2 (en) 2004-01-30 2013-09-24 Electronic Scripting Products, Inc. Processing pose data derived from the pose of an elongate object
US7575334B2 (en) * 2007-02-27 2009-08-18 Becnel Mark C Chalk holding device with light
US8360669B2 (en) * 2008-06-23 2013-01-29 Silverbrook Research Pty Ltd Retractable electronic pen with sensing arrangement
US11577159B2 (en) 2016-05-26 2023-02-14 Electronic Scripting Products Inc. Realistic virtual/augmented/mixed reality viewing and interactions

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5103486A (en) * 1990-04-19 1992-04-07 Grippi Victor J Fingerprint/signature synthesis
US5852434A (en) * 1992-04-03 1998-12-22 Sekendur; Oral F. Absolute optical position determination
US5484966A (en) * 1993-12-07 1996-01-16 At&T Corp. Sensing stylus position using single 1-D image sensor
GB9516441D0 (en) * 1995-08-10 1995-10-11 Philips Electronics Uk Ltd Light pen input systems
US6081261A (en) * 1995-11-01 2000-06-27 Ricoh Corporation Manual entry interactive paper and electronic document handling and processing system

Also Published As

Publication number Publication date
DE60119393D1 (de) 2006-06-08
JP2004519772A (ja) 2004-07-02
EP1380006A1 (de) 2004-01-14
DE60119393T2 (de) 2007-04-19
WO2002069247A1 (en) 2002-09-06
EP1380006A4 (de) 2005-01-19

Similar Documents

Publication Publication Date Title
US7203383B2 (en) Handwritten character recording and recognition device
JP4809778B2 (ja) 長寸の物体の姿勢から得られた姿勢データの処理方法及び装置
KR100590375B1 (ko) 핸드 헬드 입력 장치 및 호스트 프로세서
JP5425368B2 (ja) 不変特徴部を有する平面上で長寸の物体の先端の絶対位置を決定するための方法及び装置
US5477012A (en) Optical position determination
US7257255B2 (en) Capturing hand motion
US20050156915A1 (en) Handwritten character recording and recognition device
US5852434A (en) Absolute optical position determination
US7342575B1 (en) Electronic writing systems and methods
CN110785729B (zh) 用于产生模拟笔画且用于模拟笔画的数字存储的电子装置和用于使模拟记录数字化的输入系统及方法
AU2002335029A1 (en) A combined writing instrument and digital documentor apparatus and method of use
US20020118181A1 (en) Absolute optical position determination
WO2000025293A1 (en) Pen-input device
US20050024690A1 (en) Pen with tag reader and navigation system
EP1380006B1 (de) Einrichtung zum aufzeichnen und erkennen handschriftlicher zeichen
JP2007507039A (ja) 筆記スタイラスを使用する方法
WO2002058029A2 (en) Optical position determination on any surface
KR100360477B1 (ko) 무선전자펜
US20020158848A1 (en) Optical position determination on plain paper
WO2009114821A9 (en) Apparatus and method of finger-motion based navigation using optical sensing
RU2166796C2 (ru) Ручка для ввода рукописной и графической информации в компьютер "shelpen iii"
JPH0588809A (ja) 筆記具型ポインテイング装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20030919

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

A4 Supplementary search report drawn up and despatched

Effective date: 20041202

RIC1 Information provided on ipc code assigned before grant

Ipc: 7G 08C 21/00 B

Ipc: 7G 09G 5/00 B

Ipc: 7G 09G 3/28 B

Ipc: 7G 06K 9/00 B

Ipc: 7G 06K 9/20 B

Ipc: 7G 06K 7/00 B

Ipc: 7G 06K 9/22 B

Ipc: 7G 06F 3/033 A

17Q First examination report despatched

Effective date: 20050204

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060503

Ref country code: LI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060503

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.

Effective date: 20060503

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060503

Ref country code: CH

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060503

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060503

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060503

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REF Corresponds to:

Ref document number: 60119393

Country of ref document: DE

Date of ref document: 20060608

Kind code of ref document: P

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060803

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060803

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060814

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061003

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

ET Fr: translation filed
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070228

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20070228

Year of fee payment: 7

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20070323

Year of fee payment: 7

26N No opposition filed

Effective date: 20070206

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060804

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20070228

Year of fee payment: 7

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20080222

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20081031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080902

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080229

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20080222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070222

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060503

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060503