WO2005024619A2 - Produits avec motif d'identification de position - Google Patents

Produits avec motif d'identification de position Download PDF

Info

Publication number
WO2005024619A2
WO2005024619A2 PCT/EP2004/051932 EP2004051932W WO2005024619A2 WO 2005024619 A2 WO2005024619 A2 WO 2005024619A2 EP 2004051932 W EP2004051932 W EP 2004051932W WO 2005024619 A2 WO2005024619 A2 WO 2005024619A2
Authority
WO
WIPO (PCT)
Prior art keywords
product
pattern
lines
intersection
marks
Prior art date
Application number
PCT/EP2004/051932
Other languages
English (en)
Other versions
WO2005024619A3 (fr
Inventor
Patrick Brouhon
Original Assignee
Hewlett-Packard Development Company, L.P.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett-Packard Development Company, L.P. filed Critical Hewlett-Packard Development Company, L.P.
Publication of WO2005024619A2 publication Critical patent/WO2005024619A2/fr
Publication of WO2005024619A3 publication Critical patent/WO2005024619A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
    • G06F3/0321—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet

Definitions

  • the present invention relates to products which have a position identification pattern, made up of markings on the product, which can be detected by a suitable detection system and used to distinguish different positions on the product.
  • the product may be a document, such as a form, label or note pad, or any other form of product suitable for such marking, such as a packaging product.
  • a pen having an imaging system, such as an infra red camera, within it, which is arranged to image a small area of the product close to the pen nib.
  • the pen includes a processor having image processing capabilities and a memory and is triggered by a force sensor in the nib to record images from the camera as the pen is moved across the document. From these images the pen can determine the position of any marks made on the document by the pen.
  • the pen markings can be stored directly as graphic images, which can then be stored and displayed in combination with other markings on the document. In some applications the simple recognition that a mark has been made by the pen on a predefined area of the document can be recorded, and this information used in any suitable way.
  • the pattern In order to allow documents to be produced easily with the position identifying pattern on them, it is desirable for the pattern to be suitable for printing on the type of printer that is readily available to a large number of users, such as an ink jet or laser jet printer. These typically have a resolution of 300, 600 or 1200 dots per inch, and the accuracy with which each dot can be located is variable. It is therefore desirable to provide a position identifying pattern which will be easy for the pen or other imaging system to read and which does not rely on very accurate printing.
  • the present invention provides a product having a position identifying pattern thereon, the pattern defining a number of mark positions and a grid of intersecting lines having intersections each formed by the intersection of at least two lines, wherein each intersection has a plurality of marks associated with it each of which is on at least one of the intersecting lines.
  • each intersection will be formed where two lines cross each other at right angles.
  • each intersection will be formed where three lines cross each other, each being at an angle of 60° to the other two.
  • each intersection is formed by three lines . extending outwards from the intersection, each one being at an angle of 120° to the other two.
  • Each mark position may have a marking state, which is one of at least two possible marking states, whereby the marking state of the mark positions is used to identify position on the document.
  • the marking state can be either the presence or absence of a mark in the mark position, or it may be defined as a feature of the mark at that position, for example its size or shape.
  • each mark position can have more than two possible marking states.
  • One of the mark positions at each intersection may be at the point of intersection of the two intersecting lines. This helps the pen or other reading device to identify the grid and therefore to read the pattern.
  • Some of the marks may be arranged to represent positional data and some of the marks may be orientation marks arranged to indicate the orientation of the product. The use of particular marks to indicate orientation can also help the pen to read the pattern easily.
  • the present invention further provides a product having a position identifying pattern thereon, the pattern defining a number of mark positions and a grid of intersecting lines having intersections each formed by the intersection of two lines, wherein some of the marks are arranged to represent positional data and some of the marks are orientation marks arranged to indicate the orientation of the product.
  • the present invention further provides a position determining system arranged to sense position identifying marks on a product, the system comprising sensing means arranged to sense the position of marks on an area of the product, and processing means arranged to analyse the positions of the marks within said area and define from them a grid comprising lines and intersections where the lines intersect, to define a plurality of mark positions associated with each intersection each of the mark positions being on at least one of the intersecting lines, and each intersection having a plurality of marks in respective mark positions associated with it, and to determine from the sensing means a marking state of each of the mark positions thereby to determine the position of the area on the product.
  • HP Ret " : 200208368 Attorney Ref: ASW1581
  • a corresponding method of sensing position identifying marks on a product is also provided.
  • the present invention still further provides a position determining system arranged to sense position identifying marks on a product, the system comprising sensing means arranged to sense the position of marks on an area of the product, and processing means arranged to analyse the positions of the marks within said area and define from them a grid comprising lines and intersections where the lines intersect, to define a plurality of mark positions associated with each intersection, and to identify some of the mark positions as orientation mark positions, and to determine from marks in those positions the orientation of the product relative to the sensing means.
  • a corresponding method of sensing a position identifying pattern on a product is also provided.
  • the present invention further provides corresponding systems and methods for applying a position identifying pattern to a product, and a data carrier carrying data arranged to control relevant systems to operate as a system according to the invention and to perform the methods of the invention.
  • the data carrier can comprise, for example, a floppy disk, a CDROM, a DVD ROM/RAM (including -l-RW, -RW), a hard drive, a non-volatile memory, any form of magneto optical disk, a wire, a transmitted signal (which may comprise an internet download, an ftp transfer, or the like), or any other form of computer readable medium.
  • a floppy disk a CDROM, a DVD ROM/RAM (including -l-RW, -RW), a hard drive, a non-volatile memory, any form of magneto optical disk, a wire, a transmitted signal (which may comprise an internet download, an ftp transfer, or the like), or any other form of computer readable medium.
  • a floppy disk a CDROM, a DVD ROM/RAM (including -l-RW, -RW), a hard drive, a non-volatile memory, any form of magneto optical disk, a wire,
  • Figure 1 shows a document according to an embodiment of the invention and a digital pen according to an embodiment of the invention
  • Figure 2 shows a part of a position identifying pattern on the document of Figure 1;
  • Figure 3 shows a larger part of a position identifying pattern on the document of Figure 1 ;
  • Figures 4 and 5 show images of the pattern of Figure 3 as reconstructed by the pen of Figure 1 ;
  • Figures 6 shows an image of the pattern of Figure 3 as viewed by the pen of Figure 1;
  • Figure 7 shows the construction of grid lines from the image of Figure 6
  • Figure 8 shows a position identifying pattern according to a second embodiment of the invention
  • Figures 9 and 10 shows a system for producing the document of Figure 1 ;
  • Figure 11 shows a position identifying pattern according to a third embodiment of the invention.
  • HP Ref 200208368 g
  • the markings 5, which are not shown to scale in Figure 1, form a position identifying pattern 6 on the document 2.
  • Also printed on the paper 4 are further markings 7 which are clearly visible to a human user of the form, and which make up the content of the document 2.
  • the pen 8 comprises a writing nib 10, and a camera 12 made up of an infra red (IR) LED 14 and an IR sensor 16.
  • the camera 12 is arranged to image a circular area adjacent to the tip 1 1 of the pen nib 10.
  • a processor 18 processes images from the camera 12 taken at a predetermined rapid sample rate.
  • a pressure sensor 20 detects when the nib 10 is in contact with the document 2 and triggers operation of the camera 12.
  • the processor 1 8 can determine from the pattern 6 the position of the nib 10 of the pen whenever it is in contact with the document 2. From this it can determine the position and shape of any marks made on the patterned areas of the document 2. This information is stored in a memory 22 in the pen as it is being used.
  • a document completion process for example by making a mark with the pen 8 in a send box 9.
  • the pen is arranged to recognise the pattern in the send box 9 and send the pen stoke data to a pen stroke interpretation system in a suitable manner, for example via a radio transceiver 24 which provides a Bluetooth radio link with an internet connected PC.
  • Suitable pens are available from Logitech under the trade mark Logitech Io.
  • the position identifying pattern 6 is made up of a number of dots 30 arranged HP Ref: 200208368 7 Attorney Ref: ASW1581 on an imaginary grid 32.
  • the grid 32 can be considered as being made up of horizontal and vertical lines 34, 36 defining a number of intersections 40 where they cross.
  • the intersections 40 are of the order of 1.0mm apart, and the dots are of the order of 100? m across.
  • Each intersection 40 has nine dot positions 42 associated with it in the form of a cross with all of the dot positions 42 being on the horizontal and vertical lines 34, 36.
  • Each dot position 42 is only associated with one of the intersections 40.
  • Each dot position 42 can either have a dot 30 present in it, or no dot in it. Each dot position is therefore equivalent to a binary digit having two possible marking statuses, those being the presence or absence of a dot.
  • the group of nine dot positions 42 shown in Figure 2 six of the positions 42a, 42b, 42c, 42g, 42h and 42i have dots 30 present in them, and the other three 42d, 42c, 42f have no dot.
  • the combination of dots 30 present at the intersections changes in a predetermined manner across the document so that, for any group of a sufficient number of intersections 40, the position • on the document is uniquely identified.
  • the camera 12 can view an area 50 of the document. This area is large enough to ensure that there will always be one group of four intersections 40a, 40b, 40c, 40d, in a two by two block, for which all of the HP Ref: 200208368 g
  • dot positions 42 are within the area.
  • the processor 18 is therefore arranged to analyse each recorded image from the camera 12 to identify such a block of four intersections, identify each of the nine dot positions 42 at each of the intersections, determine whether or not there is a dot 30 in each of the dot positions 42, and determine from the presence and absence of dots 30 the position and orientation of the viewed area 50 on the document. From this information the position of the pen nib 10 on the document 2 can also be determined.
  • the processor 18 allocates a binary positional code to each of the four intersections 40a, 40b, 40c, 40d which is made up of Is and 0s depending on the presence or absence of a dot 30 in each of the dot positions 42 taken in a predetermined order. To determine the order the processor 18 first determines which of the grid lines 34, 36 is closest to a vertical direction defined in relation to the pen 8, which corresponds to the vertical direction as shown in Figure 5, and for that grid line defines a top and a bottom direction and a left and right direction.
  • the dot positions 42 for the intersection 40a are then allocated an order, which in this case, referring back to Figure 2, is 42b, 42c, 42d, 42e, 42a, 42f, 42g, 42h, 42i.
  • This process is then repeated for the other three intersections 40b, 40c, 40d in the group which have position codes (1 ,0,1 ,1 ,1 ,0,1 ,1 ,1), (0,0,1 ,1,1 ,1 ,1,0,1), and (1 ,1 ,1 ,0,1 ,0,1,1 ,0) respectively.
  • each of the four orientations gives a unique grid reference, and the processor 18 can therefore determine both the position and the orientation of the pattern 6 relative to the pen 8.
  • the pattern 106 is again made up of a number of dots 130 defining horizontal and vertical lines 134, 136 of a grid, with intersections 140 where the lines intersect.
  • the dot positions 142a which are at the intersections are reserved for indicating the orientation of the pattern, and the remaining eight dot positions 142b, 142c, 142d, 142e, 142f, 142g, 142h, 142i are used for position coding.
  • the intersections 140 are grouped into groups of nine intersections in a three by three block. Of the nine orientation dot positions 142a in each block, a first group 150, 152, 154 are marked with dots and a HP Ref: 200208368 JO
  • the first group comprises one dot position 150 at one corner of the group, and the two dot positions 152, 154 adjacent to that corner on the horizontal and vertical grid lines 134, 136 respectively.
  • the first group of dot positions 150, 152, 154 therefore defines a right angled triangle which has no rotational symmetry and therefore uniquely defines the orientation of the pattern 106 relative to the pen 8 which reads it.
  • the grid spacing in this pattern 106 is 0.5mm and any area viewed by the pen, will include at least one complete group of 9 orientation dot positions 150, 152, 154, 156, 158, 160, 162, 164, 166. This enables the processor 18 in the pen to determine the orientation of the pattern 106 relative to the pen 8.
  • a very simple system for producing printed documents having the position identifying pattern on them comprises a personal computer (PC) 200 and a printer 202.
  • the PC 200 has a screen 204, a keyboard 206 and a mouse 208 connected to it to provide a user interface 209 as shown generally in Figure 10.
  • the PC 200 comprises a processor 210 and a pattern allocation module 212 which is a software module stored in memory.
  • the pattern allocation module 212 includes a definition of a total area of pattern space and a record of which parts of that total area have been allocated to specific documents, for example by means of coordinate references.
  • the PC 200 further comprises a printer driver 214, which is a further software module, and a memory 216 having electronic documents 218 stored in it.
  • the user interface 209 allows a user to interact with the PC 200.
  • the processor 210 retrieves an electronic document 218 from the memory 216 and sends it to the printer HP Ref: 200208368 J ⁇
  • the electronic document 218 contains a definition of the content 7, and the areas of the document 2 which are to have the pattern 6 printed on it.
  • the printer driver 214 requests the required amount of pattern from the pattern allocation module 212 which allocates by means of coordinate references an area of the pattern space to the document, generates the pattern 6 for that area using a pattern generation algorithm, and communicates the details of the pattern including the positions of all the required dots, back to the printer driver 214.
  • the printer driver 214 then combines the content 7 and the pattern 6 into a single file which contains an image including the pattern and the content, converts the content 7 and the pattern 6 to a format suitable for the printer 202, and sends it to the printer which prints the content 7 and the pattern 6 simultaneously as a single image.
  • the various components of the system can be spread out over a local network or the internet.
  • the pattern allocation module 21 2 can be provided on a separate internet connected server so that it can be accessed by a number of users.
  • relatively low resolution printer can be used, such as a 300 dpi (dots per inch) ink jet or laser jet printer.
  • a higher resolution printer of at least 600 dpi is needed.
  • the position identifying pattern is again made up of a number of dots 330 which define a grid of horizontal and vertical lines 334, 336.
  • dots 330 which define a grid of horizontal and vertical lines 334, 336.
  • each intersection 340 there is a group of five dots positions, one on the intersection 340, and one on either side of it along both the horizontal and vertical lines 334, 336.
  • Each of the dot positions is marked with either a HP Ref: 2 002O8368 J2
  • Each dot 330 therefore represents a binary digit which can be a ' 1 ' or a '0' depending on the size of the dot 330.
  • each dot position may have one of three possible marking states: a small dot, a large dot, or no dot. This increases the number of possible combinations of dot patterns at each intersection and therefore increases the total available pattern space.
  • the number of dot positions associated with each grid intersection can vary.
  • the use of specific orientation dots can be incorporated into the pattern of Figures 2 and 3 or the pattern of Figure 11.
  • the dot positions chosen for the orientation pattern could be any suitable group of dots which has no rotational symmetry.
  • the orientation pattern could have some rotational symmetry, but less that the grid itself.
  • the grid has four-fold rotational symmetry in that it appears the same in any of four rotational positions.
  • the orientation pattern could have two-fold rotational symmetry, appearing the same in only two orientations.
  • the rotational pattern could consist of two dots aligned with the vertical, or the horizontal, lines.
  • the pattern may also include dots or other marks which are not located on the grid lines.
  • the orientation could be indicated by a single dot offset diagonally from the intersection, i.e. in a direction at 45 ° to the horizontal and vertical lines 1 34, 136.
  • placed dots could also be used as part of the main position identifying part of the pattern, as could HP Ref: 200208368 ⁇ 3
  • the reading device when the reading device has identified the grid it can essentially identify mark positions anywhere, either on the grid or off the grid between the grid lines. It can then use the marking stale of each of the mark positions in a viewed area of pattern to determine the position within the defined pattern space of the viewed area as described above. However, it will be understood that the higher the proportion of dots that are on the grid lines, the easier it is for the reading device to identify the grid lines and to read the pattern correctly.

Abstract

L'invention concerne un produit à motif d'identification de position, qui définit un certain nombre de positions de marque (42) et une grille de lignes d'intersection (34, 36) dans laquelle les intersections (40) sont formées chacune de l'intersection de deux lignes. Chaque intersection (40) comporte plusieurs marques (30) associées, chacune d'entre elles se trouvant au moins sur l'une des lignes d'intersection (34, 36).
PCT/EP2004/051932 2003-09-10 2004-08-27 Produits avec motif d'identification de position WO2005024619A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GBGB0321174.5A GB0321174D0 (en) 2003-09-10 2003-09-10 Products with position identification pattern
GB0321174.5 2003-09-10

Publications (2)

Publication Number Publication Date
WO2005024619A2 true WO2005024619A2 (fr) 2005-03-17
WO2005024619A3 WO2005024619A3 (fr) 2005-05-06

Family

ID=29226819

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2004/051932 WO2005024619A2 (fr) 2003-09-10 2004-08-27 Produits avec motif d'identification de position

Country Status (2)

Country Link
GB (1) GB0321174D0 (fr)
WO (1) WO2005024619A2 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6098882A (en) * 1996-03-01 2000-08-08 Cobblestone Software, Inc. Variable formatting of digital data into a pattern
WO2001071654A1 (fr) * 2000-03-21 2001-09-27 Anoto Ab Appareil et procede permettant de determiner une orientation spatiale
WO2001075783A1 (fr) * 2000-04-05 2001-10-11 Anoto Ab Identification d'un motif de trame virtuel
US20030012455A1 (en) * 2001-06-26 2003-01-16 Andreas Olsson Method and device for data decoding
WO2003038741A1 (fr) * 2001-10-29 2003-05-08 Anoto Ab Procede et dispositif pour le decodage d'un modele de codage de position
WO2003049023A1 (fr) * 2001-12-06 2003-06-12 Anoto Ab Reconstitution d'une trame virtuelle

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6098882A (en) * 1996-03-01 2000-08-08 Cobblestone Software, Inc. Variable formatting of digital data into a pattern
WO2001071654A1 (fr) * 2000-03-21 2001-09-27 Anoto Ab Appareil et procede permettant de determiner une orientation spatiale
WO2001075783A1 (fr) * 2000-04-05 2001-10-11 Anoto Ab Identification d'un motif de trame virtuel
US20030012455A1 (en) * 2001-06-26 2003-01-16 Andreas Olsson Method and device for data decoding
WO2003038741A1 (fr) * 2001-10-29 2003-05-08 Anoto Ab Procede et dispositif pour le decodage d'un modele de codage de position
WO2003049023A1 (fr) * 2001-12-06 2003-06-12 Anoto Ab Reconstitution d'une trame virtuelle

Also Published As

Publication number Publication date
GB0321174D0 (en) 2003-10-08
WO2005024619A3 (fr) 2005-05-06

Similar Documents

Publication Publication Date Title
US6962450B2 (en) Methods and apparatus for generating images
US7249716B2 (en) Position-coding pattern
US20040109034A1 (en) Hybrid printing/pointing device
US7422154B2 (en) Apparatus and methods relating to image coding
EP2056233A2 (fr) Système de gestion d'information
US20060283962A1 (en) Data encoding pattern
US20090182527A1 (en) General information management system
US7600693B2 (en) Information code including redundant information providing copy protection
US7542607B2 (en) Digital pen and paper
US7553537B2 (en) Position identification pattern
GB2431032A (en) Data encoding pattern comprising markings composed of coloured sub-markings
US20070273918A1 (en) Printing Digital Documents
US7559484B2 (en) Products with data encoding pattern
US8130391B2 (en) Printing of documents with position identification pattern
US8100338B2 (en) Data encoding pattern
JP2005056357A (ja) 電子ペン用帳票
WO2005024619A2 (fr) Produits avec motif d'identification de position
EP1269396B1 (fr) Appareil et procedes pour images
US7792365B2 (en) Methods and apparatus for generating images
GB2428502A (en) Data encoding pattern
WO2005024714A1 (fr) Incorporation de donnees dans un motif d'identification de positions
WO2005076194A2 (fr) Produits presentant un motif d'identification de position
GB2421617A (en) Products with data encoding pattern
WO2005024701A2 (fr) Creation de documents avec motif d'identification de position
WO2005024618A1 (fr) Production et traitement de motif d'identification de position

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase