EP1417636B1 - Device, method and computer program for position determination - Google Patents

Device, method and computer program for position determination Download PDF

Info

Publication number
EP1417636B1
EP1417636B1 EP02744043A EP02744043A EP1417636B1 EP 1417636 B1 EP1417636 B1 EP 1417636B1 EP 02744043 A EP02744043 A EP 02744043A EP 02744043 A EP02744043 A EP 02744043A EP 1417636 B1 EP1417636 B1 EP 1417636B1
Authority
EP
European Patent Office
Prior art keywords
image
value
coding pattern
processing means
basis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP02744043A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP1417636A1 (en
Inventor
Stefan Lynggaard
Mats Petter Pettersson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Anoto AB
Original Assignee
Anoto AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anoto AB filed Critical Anoto AB
Publication of EP1417636A1 publication Critical patent/EP1417636A1/en
Application granted granted Critical
Publication of EP1417636B1 publication Critical patent/EP1417636B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
    • G06F3/0321—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet

Definitions

  • the present invention relates to a device for position determination, comprising a processing means for determining a position on a surface, on the basis of an image of a position-coding pattern on the surface.
  • the invention also relates to a method and a computer program for position determination.
  • Pen and paper it is often useful to have pen and paper handy in order to note down things that it is important to remember.
  • pen and paper for the storage of information, such as computers.
  • the advantage of using computers is that the information can be stored digitally and forwarded immediately to other electronic units.
  • computers are quite expensive and unwieldy, and that a user must have technical know-how in order to be able to work with them.
  • Pen and paper on the other hand, can be used by anyone, at any time and irrespective of location, as they are easily portable.
  • a communication method that is a combination of the above two storage alternatives is known from WO 01/16691 .
  • the WO publication describes a system for electronic recording and processing of information.
  • the system consists of a base that is provided with a position code for coding positions on the base and a device for recording the information that is written on the base by detecting the position code.
  • the position code is recorded continually while the information is being written down by hand.
  • the sequence of positions that is recorded defines the movement of the device across the base.
  • the information is recorded at the same time as it is written down and it can be stored in the device or transmitted to an external unit such as a computer or a mobile telephone.
  • WO 00/25293 describes a device and a method for determining the movement of a pen point.
  • the movement of the pen is determined by comparison of images of the base that are recorded in succession.
  • the movement of the pen is determined by absolute positioning.
  • different areas are provided with different patterns.
  • the pen can identify the type of area by analysing the pattern in the area. The resulting analysis can, for example, be used to determine whether or not the pen is to write on the base.
  • US 5,852,434 describes an electronic pen for determining the movement of a pen point.
  • a paper surface is provided with a position-related code and the electronic pen is arranged to capture images of the code during writing.
  • the handwriting may be sent to a computer for analysis and output to a computer display or a computer printer.
  • WO 01/30589 on which the preambles of the independent claims are based, describes an electronic pen with a controllable writing means.
  • a user writes and draws on a surface, the appearance of the writing can be changed, as the pen has functions that, for example, make it possible to produce different colours and types of line.
  • the pen can record images comprising coded data in order to change the properties of the writing and in order to determine its position.
  • WO 01/61636 which was not public at the priority date of the present application, describes another electronic pen that reads a position-coding pattern.
  • the pen has a writing means that can selectively be activated and deactivated.
  • Another electronic pen, which also has a writing means that can be selectively activated and deactivated is disclosed in WO 00/73983 .
  • a device of the above type does not succeed in recording a position on the base. This means that a part of the information that a user writes down is not recorded either. The user will not be able to be certain that the information that is stored in the device or transmitted to an external unit is complete. If information is missing, a supplementary recording must be carried out at a later time, an operation that can be very time-consuming.
  • An object of the present invention is to remedy the above-mentioned problems of prior-art technique completely or partially.
  • information that is written on the surface using the first writing means can be recorded electronically.
  • the information corresponds to a sequence of acceptable positions that describe the path of the first writing means across the surface.
  • a user can know whether an acceptable position can be determined or not. If the writing means writes at a point on the surface, this is an indication that an acceptable position corresponding to the point can/cannot be determined. In a corresponding way, a line on the surface means that acceptable positions corresponding to a coherent sequence of points can/cannot be determined. The user is thus made fully aware of which information has been recorded by the device, as the recorded information is precisely what was written/not written on the surface.
  • the position-coding pattern can contain elements that each have at least two possible decoding values.
  • the processing means can be arranged to identify a plurality of the elements in the image, and to calculate for each identified element an associated value probability for each possible decoding value that the element has this decoding value.
  • Each element can consist of at least one mark.
  • one decoding value for an element cannot be determined with complete certainty, as there is a possibility that the element has another of the possible decoding values.
  • the reason for this can be that the position-coding pattern on a surface is not completely perfect.
  • the limited resolution of the printer can mean that the marks are not printed out with absolute precision.
  • the marks can, for example, be printed out slightly deformed or displaced from their "nominal" location.
  • Another reason can be that the recording of images of the position-coding pattern can be carried out in different positions in relation to the surface, that is from varying perspectives. The resultant image distortion can lead to difficulties in determining the decoding values of the elements unambiguously.
  • the processing means can be arranged to cause the first writing means to write on the surface only if the processing means decides that an acceptable position on the surface can be determined. This means that the points on the surface at which there is writing correspond to acceptable positions that can be determined by the device. In other words, the information that is written on the surface is what can be recorded by the device. If the writing means stops writing at a point on the surface, this is an indication that an acceptable position on the surface corresponding to this point cannot be determined, and consequently that not all the information can be recorded. If this is caused by unfavourable circumstances during the recording, such as the recording having been carried out at too oblique an angle, there is then an opportunity to carry out a supplementary recording.
  • the advantage of this alternative is that the use of the device is made easier if the user can see what he or she is writing or drawing on the surface.
  • the processing means is then arranged to cause the first writing means to write on the surface only if the processing means decides that an acceptable position on the surface cannot be determined.
  • the device can determine an acceptable position on the surface if the image contains sufficient information.
  • the processing means can be arranged to determine a measure of the amount of information that the image contains concerning a position on the surface. A small measure indicates that the image contains little information, which can mean that a position on the surface cannot be determined at all. With a larger measure, the chance increases that a position, and hence an acceptable position, can be determined on the surface.
  • the processing means can be arranged to compare the measure discussed above with a predetermined limit measure. If the measure exceeds the limit measure, it is possible to determine a position on the surface on the basis of the image. This position is, however, not necessarily acceptable. If, on the other hand, the measure does not exceed the limit measure, the image cannot be used to determine a position on the surface.
  • the processing means can be arranged to determine a position probability corresponding to the level of certainty with which the position can be determined. This position probability can then be used to decide whether or not it is possible to determine an acceptable position on the surface.
  • the position probability corresponding to an image can be determined on the basis of the value probabilities for a predetermined number of selected elements out of all the identified elements. These selected elements can be those that have a dominating value probability for one of the decoding values, that is those that can contribute the most information concerning the position on the surface.
  • the position probability can, for example, be determined by a multiplication of the dominating value probabilities for the selected elements, but it can, of course, also be determined in other ways.
  • the processing means can be arranged to compare the position probability with a predetermined limit value and to decide that it is possible to determine an acceptable position on the surface on the basis of the image if the position probability exceeds the limit value. If, on the other hand, the position probability does not exceed the limit value, the position that it is possible to determine on the basis of the position-coding pattern in the image is not considered to be acceptable, as it has not been determined with sufficient certainty. The processing means thus decides that it is not possible to determine an acceptable position on the surface.
  • the processing means can be arranged to decide that it is possible to determine an acceptable position on the basis of a recorded image if a position can be determined on the basis of the image and this position lies within a predetermined distance from a previously determined acceptable position.
  • This step can, of course, be combined with the above steps in various ways.
  • the processing means can here, for example, be arranged to determine first said measure of how much information the image contains. This measure then indicates whether the position can be determined on the basis of the image.
  • the processing means can be arranged to decide that it is possible to determine an acceptable position if the position probability for the position that can be determined on the basis of the recorded image exceeds said limit value, and the position lies within said predetermined distance.
  • the session can initially comprise determination of position probabilities, if possible, for each recorded image. This could involve position determination with probability calculations for the first positions in a sequence that corresponds to one stroke with the first writing means across the surface. For other positions, probability calculations should not need to be used in order to determine whether the writing means is to be activated. On the other hand, the distance from each of the other positions to a previously determined acceptable position could be checked. This last example thus makes possible a more rapid control of the writing on the surface as time is saved in that probability calculations are not made throughout.
  • a device can consist of an application-specific integrated circuit (ASIC). It can, however, also consist of any other circuit that also contains discrete components.
  • ASIC application-specific integrated circuit
  • a device can also be hand-held and can be a shape that makes it easy to handle.
  • the device can also comprise the first writing means.
  • the device can then be the shape of a pen, for maximum comfort for the user.
  • a hand-held device can be provided with a transceiver for wireless transmission of data from the device to an external unit.
  • the information that has been recorded using the device can thereby be sent, for example, to an adjacent computer or via a mobile telephone to another computer or mobile telephone.
  • the transmission can be carried out by short-range radio link or using infrared light.
  • the information is transmitted using cables.
  • the hand-held device has a built-in modem for communication with a computer network or telephone network.
  • a hand-held device can also comprise a second writing means for writing on the surface.
  • the second writing means can be arranged to write on the surface irrespective of whether it is possible to determine an acceptable position on the surface.
  • This embodiment makes it possible for a user to follow all the movements of the device on the surface as the device now functions as a conventional pen. Precisely as in the preceding embodiments, a user is, however, made aware that an acceptable position on the surface cannot be determined by the first writing means stopping/starting writing on the surface.
  • the second writing means can be arranged to write on the surface when the first writing means is not writing on the surface. This embodiment also makes it possible for a user to follow all the movements of the device on the surface.
  • the first writing means can, for example, write with red ink
  • the second writing means can write with black ink, which means that the colour of the writing on the surface indicates whether it is possible to determine an acceptable position on the surface.
  • the writing means described above can write on a surface.
  • they can be nozzles that are arranged to dispense ink onto the surface at certain points. This embodiment makes possible rapid control of the supply of ink to the surface, that is the supply can easily be cut off and opened up.
  • dispensing is meant in this connection that ink is ejected from the nozzle.
  • Fig. 1 shows a device 1, in the form of a reading pen, for position determination. It comprises a casing 2, which is approximately the same shape as a pen. In the short side of the casing there is an opening 3. The short side is intended to abut against or to be held a short distance from a surface 4 on which the position determination is to be carried out.
  • the device 1 comprises at least one light-emitting diode 5 for illuminating the surface 4, and a light-sensitive area sensor 6, for example a CCD or CMOS image sensor, for recording a two-dimensional digital image of the surface. If required, the device 1 can also contain a lens system 7.
  • the power supply for the device 1 is obtained from a battery 8, which is mounted in a separate compartment in the casing 2.
  • the device 1 comprises, in addition, an image-processing means 9 for determining a position on the basis of the image recorded by the sensor 6, and in particular a processor unit 10 which is programmed to read images from the sensor 6 and to carry out position determination on the basis of these images.
  • the device 1 also comprises a writing means in the form of a nozzle 11 which dispenses ink, and using which it is possible to write or draw on the surface 4.
  • the nozzle 11 can be an ordinary ink-jet nozzle. When the dispensing of ink is stopped with such a nozzle, the supply of ink to the nozzle is quite simply cut off.
  • the device 1 can also comprise buttons 12, by means of which the device can be activated and controlled. It can also comprise a transceiver 13 for wireless transmission, for example using infrared light or radio waves, of information to and from the device. The device 1 can also comprise a display 14 for displaying information based on the position determination.
  • a pressure sensor 15 is arranged to indicate when the device 1 is in contact with the surface 4.
  • the light-emitting diode 5 and the area sensor 6 are activated when the pressure sensor is in contact with the surface. Thus the area sensor cannot record images unless the pressure sensor indicates that the device is in contact with the surface.
  • Fig. 2 shows a sheet of paper 65 that has a surface 66 that is provided with an optically-readable position-coding pattern 67.
  • the position-coding pattern stores positions that can be determined using the device.
  • the pattern consists of marks 68, and is shown greatly enlarged for the sake of clarity.
  • the device illuminates the marks 68 with infrared light so that they become visible to the area sensor 6.
  • the ink that is dispensed from the nozzle 11 is of such a kind that it is not visible to the area sensor 6 when it is illuminated with infrared light. This means that the functioning of the device is not affected by the marks being overwritten with the ink. This can be achieved, for example, by the ink not containing any carbon.
  • the reading pen in Fig. 1 is used to record handwritten text at the same time as this is being written on a surface.
  • the area sensor 6 is arranged to record an image of the surface, as mentioned above.
  • the image In order for position determination to be possible on the basis of the recorded image, the image must contain a coding pattern.
  • a coding pattern which for example consists of dark marks on a lighter background such as the one in Fig. 2 , there are clear contrasts between dark areas (marks) and light areas (background).
  • markings dark areas
  • background background
  • an image of a surface of an ordinary clean single-coloured sheet of paper there are, however, no clear contrasts.
  • the image-processing means is therefore arranged initially to calculate a first information measure (step ⁇ ) that expresses how much information the image contains concerning a position on the surface.
  • the first information measure is calculated on the basis of contrast distributions between light and dark areas in the image.
  • the first information measure can be calculated on the basis of some statistical measure of the luminance distribution in the image, such as standard w deviation or the like.
  • the information measure can be calculated on the basis of the technique that is described in Swedish Patent Application No. 0102254-0 , published as US 2003/053 699 , WO 03/001450 and EP 1 421 555 . More specifically, a background luminance value and an object luminance value can be estimated for a number of partial areas distributed over the image. The difference between the background and object luminance values provides a measure of the contrast in the respective partial areas.
  • the first information measure can then be set to correspond to the number of partial areas with a contrast in excess of a contrast limit value.
  • the image-processing means is then arranged to compare the first information measure with a first limit measure (step ⁇ '). If the first information measure exceeds the first limit measure, the image is considered to contain a coding pattern, and the image processing continues. If, on the other hand, the first information measure does not exceed the first limit measure, the image is considered not to contain any coding pattern, and the image processing is terminated.
  • the image-processing means is also arranged to calculate a second information measure (step ⁇ ).
  • the second information measure also expresses how much information the image contains concerning a position on the surface.
  • the second information measure can be determined by investigating in the image a feature that is characteristic of a position-coding pattern.
  • the position-coding pattern in Fig. 2 has the characteristic feature that it nominally contains a given number of marks per unit of surface. Therefore the image-processing means 9 is arranged to determine the number of separate objects are identifiable in the image for one of the above-mentioned partial areas.
  • these objects are the continuous dark areas (possible marks) in the image.
  • the second information measure can be calculated as a function of the difference between the identified number of objects per unit of surface and the given number of marks per unit of surface, with the second information measure decreasing as the difference increases. Alternatively, the second information measure can be set as the number of identified objects per unit of surface.
  • the image-processing means is thereafter arranged to compare the second information measure with a second limit measure (step ⁇ '). If the second information measure exceeds the second limit measure, the image is considered to contain a position-coding pattern, and the image processing continues. If, on the other hand, the second information measure does not exceed the second limit measure, the image is considered not to contain any position-coding pattern, and the image processing is terminated.
  • a position-coding pattern usually contains elements, each of which has at least two possible decoding values. Each element contains at least one mark.
  • the position-coding pattern 67 in Fig. 2 is an example of such a position-coding pattern, using which the reading pen 1 can determine a position.
  • the image-processing means 9 is arranged to identify a plurality of elements in the image. For each identified element, the processing means is thereafter arranged to calculate an associated value probability for each possible decoding value that the element has this decoding value. If an element is determined unambiguously, the value probability that corresponds to the element's unambiguously determined decoding value will be maximal, while the other value probabilities for the element are zero. The more uncertain the decoding value for an element, the less its value probabilities differ from each other.
  • the image-processing means is, in addition, arranged to calculate a third information measure (step ⁇ ).
  • the third information measure also expresses how much information the image contains concerning a position on the surface.
  • the third information measure can be determined on the basis of the value probabilities for the identified elements. In this example, it is determined by a multiplication of the largest value probabilities for each of the identified elements. If the identified elements are determined unambiguously, the third information measure will be large. Correspondingly, the third information measure will be smaller, the more uncertain the decoding values of the identified elements are.
  • the image-processing means is thereafter arranged to compare the third information measure with a third limit measure (step ⁇ ').
  • the third information measure exceeds the third limit measure, the image is considered to contain a position-coding pattern, using which the reading pen 1 can determine a position on the surface, and the image processing continues. If, on the other hand, the third information measure does not exceed the third limit measure, the image is considered not to contain a position-coding pattern, using which the reading pen 1 can determine a position, and the image processing is terminated.
  • the image-processing means 9 is therefore arranged to decide whether the position that can be determined on the basis of the image is acceptable.
  • said decision is based partly on probability calculations, and partly on comparisons with previously determined acceptable positions on the surface.
  • the image-processing means 9 first determines a position probability (step ⁇ ) corresponding to the level of certainty with which said position can be determined.
  • the position probability corresponding to said position can be calculated on the basis of the value probabilities for a predetermined number of selected elements out of all the identified elements. In this example, these selected elements are those that have a dominating value probability for one of the decoding values.
  • the position probability can, for example, be determined by a multiplication of the dominating value probabilities for the selected elements.
  • the position probability can consist of, or be calculated from, some probability value that is obtained on the basis of the value probabilities during the calculation of a position.
  • the image-processing means is thereafter arranged to compare the position probability with a limit value (step ⁇ '). If the position probability does not exceed the limit value, the image processing is terminated. If, on the other hand, the position probability exceeds the limit value, the image-processing means 9 is arranged to compare the location of the position that can be determined on the basis of the image with the location of a previously determined acceptable position (step ⁇ ). The processing means is thereafter arranged to decide whether the position that can be determined is acceptable (step ⁇ '). If the position that can be determined on the basis of the image lies within a predetermined distance from said previously determined acceptable position, the position that can be determined is considered to be an acceptable position on the surface.
  • the image-processing means 9 decides that it is possible to determine an acceptable position on the surface on the basis of the position-coding pattern in the recorded image.
  • the image-processing means 9 is, in addition, arranged to cause the writing means to write on the surface if it is decided that an acceptable position on the surface can be determined (step ⁇ ). Writing is carried out at the point on the surface that corresponds to the acceptable position. If, on the other hand, the distance between the position that can be determined on the basis of the image and said previously determined acceptable position is greater than the predetermined distance, the device is arranged to cause the writing means not to write on the surface.
  • Fig. 4 shows an example of a result from a use of a reading pen 1 on a surface.
  • the text "Anoto" 69 was to be written with the reading pen 1 and stored in the pen.
  • images of the surface are recorded continually while the user is writing on the surface.
  • the pen writes/does not write on the surface.
  • the letter "t" in "Anoto" is missing. This is because the image-processing means in the reading pen has decided that it is not possible to determine acceptable positions corresponding to the points on the surface that should have made up said letter "t".
  • the image-processing means has therefore caused the writing means not to write on the surface at these points.
  • the reason for acceptable positions corresponding to said letter "t" not being able to be determined can, for example, be that the position-coding pattern has become unreadable for some reason in the place where said letter "t" should have been.
  • the reason for this can, for example, be that there is dirt on the surface or that the reading pen has been held in an unfavourable position in relation to the surface while recording in this area.
  • a few initial recorded images are processed during one session according to step ⁇ - step ⁇ '.
  • the processing means decides that it is possible to determine the acceptable positions if the position probabilities for the corresponding images exceed the limit value.
  • the subsequently recorded images are then processed according to step ⁇ in those cases when positions can be determined on the basis of the images.
  • the processing means decides that it is possible to determine the acceptable positions if the determined positions lie within the predetermined distance from previously determined acceptable positions.
  • the steps ⁇ ' and ⁇ ' can be combined so that a position is considered to be acceptable depending upon the combination of its position probability and its distance from one or more previously determined acceptable positions. For example, a low position probability can be compensated for by a small distance, and vice versa.
  • the image-processing means is arranged to write on the surface only if an acceptable position can be determined. It is, of course, possible instead for the image-processing means to cause the writing means to write on the surface only when an acceptable position on the surface cannot be determined. It is also possible to have more than one writing means, for example with one dispensing ink the whole time and the other dispensing ink of a different colour when an acceptable position cannot be determined.
  • Appendix I with associated Figures, there is a comprehensive description of various position-coding patterns that can be used in association with the present invention. Appendix I also describes in detail how value probabilities can be calculated for the identified elements in a recorded image, and how a position can be calculated on the basis of the image. In addition, Appendix I describes many other different probability calculations that can be carried out in association with position determination according to the present invention.
  • the value probabilities have been used for calculating information measures and position probabilities.
  • the information measures and the position probabilities can, however, also be calculated on the basis of one or more of the other probabilities that are discussed in Appendix I. This means that the position probability for a position can be determined at different times during the position determination, and in different ways. This also means that the position determination can be terminated at any time if any probability used in the probability calculation is considered to be too small.
  • Fig. 5 shows a part of a device according to an alternative embodiment of the present invention, which device is provided with a first writing means 70 and a second writing means 71.
  • the first writing means 70 is arranged to write on the surface only when an acceptable position can be determined.
  • the second writing means 71 is arranged to write on the surface irrespective of whether or not an acceptable position can be determined.
  • the writing means could, as shown in Fig. 6a , be a ball point 72 for rolling ink onto the surface. When the supply of ink to the surface is cut off, this is suitably carried out by locking the ball so that it can no longer roll on the surface.
  • Fig. 6b Another alternative is shown in which an electromagnet 73 is used as writing means for writing on special paper containing small permanent magnets with a black and a white side. This paper works in such a way that when a magnet is passed across the surface the permanent magnets turn their black side upwards.
  • the supply of electricity to the electromagnet 73 could thus be turned on/and off in order in this way to control the writing of information depending upon whether or not a position has been determined.
  • Yet another alternative, which is shown in Fig. 6c could be to have a heating means 74 as writing means for heating up a surface that has the characteristic that it changes colour when it is heated up.
  • optical recording of the position code for example those that are described in WO 00/73983 and WO 01/2603 .
  • the position-coding pattern to be decoded is of the type described in WO 01/26032 .
  • Fig. 8 shows an enlarged part of an optically readable position-coding pattern 17 on a surface 19.
  • the position-coding pattern consists of marks 18.
  • a reading pen is arranged to record an image of a partial area of the position-coding pattern (step A) by means of a sensor, to identify a plurality of marks 18 in the image (step B), and to fit to the image a reference system in the form of a raster (step C) with raster lines 21 that intersect at raster points 22.
  • the fitting is carried out in such a way that each of the marks 18 is associated with a raster point 22.
  • the mark 23 is associated with the raster point 24. Consequently the raster fitting makes it possible to determine to which raster point each mark belongs.
  • the raster has the form of a square grid, but also other forms are possible.
  • WO 01/75783 , WO 01/26034 and SE 0104088-0 published as US 2005/199 729 , US 2003/122 855 , WO 03/049023 and EP 1 456 811 , disclose in more detail fitting of a raster to marks in an image.
  • one and only one mark is associated with each raster point. Owing to deformations and deficiencies in the imaging of the position-coding pattern, it may be difficult to determine in an image of the position-coding pattern which marks belong to the position-coding pattern and which of a plurality of marks is the one that is to be associated with a certain raster point. For this reason, it is possible to associate in this example a plurality of marks with one and the same raster point in the position determination. The marks associated with a raster point together form an element belonging to the raster point.
  • the value of the marks 18 is defined by their displacement in relation to the raster points 22 with which they are associated. More specifically, it is the position of a point of a mark relative to a raster point that defines the value of the mark. This point is typically the main point of the mark.
  • the ideal locations 25 for a mark are shown enlarged in Figs 9a-d . They have the value "0" in Fig. 9a , the value "1" in Fig. 9b , the value “2" in Fig. 9c and the value "3" in Fig. 9d . Each mark can thus represent four different values "0-3".
  • the reading pen is arranged to calculate, for each identified mark, an associated value probability for each value "0-3" that the mark defines this value (step D).
  • the value probabilities for each mark are a decreasing function of the distances 26 from the mark 27 to each of its ideal locations 25, see Fig. 10 , or more specifically, typically from the main point of the mark 27 to each ideal location.
  • the marks can be assumed to be normally distributed around the ideal locations.
  • the variance can be determined empirically. Four value probabilities can thus be calculated for each mark. It sometimes happens that a mark is found in the centre of a raster point. In these cases, the four value probabilities for the mark will be equal, since the distances from the mark to each of the ideal locations are equally large. The case when there is no mark associated with a raster point, i.e. the associated element contains zero marks, is treated as if there was a mark in the centre of the raster point, that is the value probabilities are equal.
  • step E If there is more than one mark, for example three, associated with a raster point, i.e. three marks in the associated element, there are a total of 3x4 value probabilities for the raster point or element.
  • the reading pen is therefore arranged to determine, for each raster point or element and for each value, a value probability that the marks associated with the raster point together define this value (step E).
  • These value probabilities for a raster point could thus also be called raster point probabilities.
  • By calculating the value probabilities for the raster points all the marks in the recorded image may be taken into consideration in the position determination and the risk of information being lost is minimised. Since the above means that for each element, value probabilities are calculated that the element defines each of the values, the values "0"-"3" are called element values in the rest of the description.
  • the value probabilities for an element can be determined by the value probabilities for the marks in the element being compared, the highest value probability being selected for each possible element value.
  • the value probabilities for the element can be weighted sums of the value probabilities for each of the possible element values for the marks in the element.
  • the value probabilities for the elements can, of course, also be determined in other ways than those mentioned above.
  • Fig. 11a shows a raster point 22 with two associated marks 28 and 29.
  • the marks 28 and 29 together constitute the element belonging to the raster point 22.
  • the Tables 30 and 31 in Fig. 11b contain the value probabilities P 1 for the possible values of the respective marks.
  • the Table 32 in Fig. 11c contains the resulting value probabilities P 2 for the possible element values of the element.
  • the value probabilities for the element are relative. Alternatively, they can instead by normalised in a suitable way. If there is only one mark associated with a raster point, i.e. one mark in the associated element, the value probabilities for the mark and the element are obviously the same.
  • the distance from the reading pen to the surface influences how large a part of the position-coding pattern is recorded and thereby also how large a raster can be fitted to the image.
  • a predetermined number of elements is used, which in this example is 8x8 elements. If more than 8x8 raster points have been fitted to the image, an excess of elements is thus identified.
  • the reading pen is therefore further arranged to choose, from all the identified elements, the set of elements that provides the most information about the position on the surface (step F). This set of element is, but need not be, continuous.
  • the elements in the set of elements correspond in this example to a raster point matrix with raster points fitted to the image, but this is not a requirement.
  • the purpose is to select the elements with associated value probabilities for each element value which maximise a total information value (previously referred to as position probability) for the recorded image.
  • position probability a total information value
  • an entropy is calculated for each of the identified elements. Thereafter the 8x8 elements are chosen that give the smallest entropy sum, which corresponds to the maximum total information value for the recorded image.
  • log 2 is the two-logarithm.
  • the entropy for an element is thus maximal when its value probabilities are equally high and minimal when all except one of the value probabilities are zero.
  • An alternative to choosing 8x8 elements by means of entropy calculations is instead to use the highest value probability for each element as an information value. In this case, the continuous 8x8 elements are selected which maximise a total information value that consists of the sum of the information values for the 8x8 elements.
  • the position-coding pattern used in this example codes two coordinates for a point on the surface. These coordinates are separately decodable. Therefore they can be called data in two different dimensions. Each mark in the position-coding pattern codes more specifically a first bit which is used to decode the first coordinate and a second bit which is used to decode the second coordinate.
  • each possible element value "0"-"3" for an element is therefore converted into a first and a second decoding value which in this example thus are binary.
  • the reading pen is thus arranged to convert, for each of the 8x8 elements in the set of elements, the element values "0"-"3" into the four different bit combinations (0, 1), (0, 0), (1, 0) and (1, 1).
  • the bit combinations have the value probabilities belonging to the element values, for each element, see the continuation of the previous number example in Table 33 in Fig. 12a .
  • the first bit i.e. the first decoding value
  • the second bit i.e.
  • the value probability P 2 for the corresponding element value is associated with the first and second decoding values.
  • the set of elements can thus be used to create a first set of first decoding values with associated value probabilities for the first dimension, and a second set of second decoding values with associated value probabilities for the second dimension (step G).
  • Table 33 describes an element in the set of elements.
  • the Tables 33' and 33" contain the corresponding first decoding values in the first set with associated value probabilities and respectively the second decoding values in the second set with associated value probabilities.
  • Each of the first and the second decoding values is, as is evident from that stated above, either a zero or a one.
  • the reading pen is arranged to associate, for each element in the set of elements, each of the different possible first decoding values in the first set with one value probability, and each of the different possible second decoding values in the second set with one value probability. Since the possible first and second decoding values in this example are zero and one, the above results in one value probability for the decoding value zero and one for the decoding value one in the first and second sets for each element in the set of elements. In the following, the value probability for the decoding value zero is called zero probability and the value probability for the decoding value one is called one probability.
  • the above is carried out for each of the elements in the set of elements by comparing the value probabilities in the first set that correspond to the first decoding value being zero. Then the highest value probability is chosen as zero probability and is saved in a first matrix 34. In the same way, the value probabilities in the first set that correspond to the first decoding value being one, are compared. Then the highest value probability is chosen as one probability and is also saved in the first matrix 34. Referring to Table 33", the above procedure is subsequently repeated for the value probabilities in the second set, the second decoding values and a second matrix 35. The first and second sets are thus used to create a first and a second matrix with zero and one probabilities (step H).
  • a first and a second matrix with zero and one probabilities for the 8x8 elements in the set of elements are created by the value probabilities in the first set that correspond to the first decoding value being zero being added, the sum being stored as the zero probability, and by the value probabilities in the first set that correspond to the first number being one being added, the sum being stored as the one probability.
  • the procedure is then repeated for the value probabilities in the second set and the second decoding values.
  • the 8x8 elements in the set of elements now correspond to two matrices 34 and 35, each with 8x8 matrix elements, where each of the matrix elements contains one zero probability and one one probability.
  • first and second matrices coordinates can be determined for the position.
  • An alternative to choosing the set of elements after the determination of the value probabilities for all elements in the recorded image is to wait until matrices corresponding to the matrices 34 and 35 have been determined for all the identified elements.
  • 8x8 matrix elements in each matrix can then be selected based on the corresponding zero and one probabilities.
  • One way of doing this is to select 8x8 matrix elements in which one of the zero and one probabilities is high and the other low.
  • the matrix elements corresponding to the same elements need not be selected for determination of both coordinates, the calculations proceeding with different corresponding elements for the two matrices.
  • the position-coding pattern is in the first dimension based on a first cyclic main number sequence.
  • the first cyclic main number sequence has the property that the place therein for each partial sequence of a predetermined length is unambiguously determined. In this example the predetermined length is 6. If thus six succeeding numbers are taken in an arbitrary place in the first cyclic main number sequence, these six numbers occur only once in the first main number sequence in this succession. The property also applies if the end of the first main number sequence is connected to the beginning of the first main number sequence. Therefore, the first main number sequence is called cyclic. In this example a binary main number sequence is used.
  • Fig. 13 shows an example of a first cyclic main number sequence that can be used in connection with the position-coding pattern.
  • the partial sequence 0,0,0,0,0 has, for instance, the unambiguous place 0, the partial sequence 1,1,1,1,1,0 the unambiguous place 9 and the partial sequence 1,1,1,0,1,0 the unambiguous place 11 in the first main number sequence.
  • 6x6 elements must be identified in the recorded image.
  • 8x8 elements for a position determination and the reason for this will be evident from the following.
  • the first cyclic main number sequence, on which the position-coding pattern is based in the first dimension has the property that it contains merely mutually unique partial sequences of the length 6. Consequently, also the place in the first cyclic main number sequence for each partial sequence of the length 8 is unambiguously determined. This fact it utilised in the determination of the coordinates for the position on the surface.
  • the reading pen is arranged to match each of the unique partial sequences of the length 8 in the first cyclic main number sequence with each of the columns in the first matrix 34 (step I).
  • the method is illustrated in Fig. 14 .
  • the Figure shows an example of a binary partial sequence 36 of the length 8 and a column 37 in the first matrix 34 ( Fig. 7b ), said column having matrix elements which each contain a zero probability and a one probability corresponding to the first decoding value being zero and one respectively.
  • one of the zero and one probabilities is selected depending on the corresponding number in the partial sequence 36.
  • the first number in the partial sequence 36 is, for instance, zero, which means that the zero probability is selected for the first matrix element in the column 37.
  • the second number in the partial sequence is one, which means that the one probability is selected for the second matrix element in the column 37.
  • the reading pen is in addition arranged to calculate a first sequence probability (step J) by multiplication of the corresponding selected zero and the one probabilities for the matrix elements.
  • the first sequence probability 38 corresponding to the partial sequence 36 and the column 37 has been calculated. After this operation, there will thus be 63 first sequence probabilities with a respective associated unique sequence value for each column in the first matrix 34. These sequence values are defined by the places of the corresponding partial sequences in the first cyclic main number sequence.
  • the reading pen is arranged to select for each column the highest first sequence probability and the corresponding sequence value and save these.
  • the position-coding pattern in the second dimension is here based on a second cyclic main number sequence which in this example has the same properties as the first cyclic main number sequence.
  • the reading pen is further arranged to match, in a manner corresponding to that above, each of the unique partial sequences of the length 8 in the second cyclic main number sequence with each of the rows in the second matrix 35 (step I).
  • the rows in the matrix 35 have, just like the columns in the matrix 34, matrix elements which each contain one zero probability and one probability corresponding to the second decoding value being zero and one respectively.
  • one of the zero and one probabilities is selected depending on the corresponding number in a partial sequence in the second cyclic main number sequence.
  • the reading pen is further arranged to calculate a second sequence probability (step J) by multiplication of the corresponding selected zero and one probabilities for the matrix elements.
  • the position-coding pattern used in this example is based on use of different rotations or circular shifts of the cyclic main number sequences.
  • the first main number sequence is printed or arranged in some other manner rotated or circularly shifted in different ways in columns across the surface, i.e. in the y direction orthogonally to the direction in which positions are to be coded, from above and down.
  • the main number sequence may be printed repeatedly in the same column, which is necessary if more positions than what corresponds to the length of the main number sequence are to be coded in the y direction.
  • the same rotation of the main number sequence is then used in all repetitions. Different rotations may however be used in different columns.
  • Each pair of adjoining columns defines a difference number D.
  • the difference number D is given by the difference between the places in the main number sequence for the first partial sequence in each column. If instead the difference between the places for the partial sequences is taken one step down in the columns, the result will be the same as the places will be offset in the same way.
  • the difference number D will thus always be the same independently of at what "height" in the columns the places of the partial sequences in the main number sequence are compared. For each pair of columns, the difference number D is thus constant in the y direction.
  • the difference numbers between adjoining columns form a set of difference numbers than can be used to obtain a coordinate for a position on the surface in the first dimension.
  • the position-coding pattern in a second direction can be based on the same principle as the position-coding pattern in the first dimension.
  • the second main number sequence is then arranged with different circular shifts in rows on the surface, i.e. in the x direction, from the left to the right. Difference numbers are defined between adjoining rows and these difference numbers form a set of difference numbers that can be used to obtain a coordinate for a position on the surface in the second dimension.
  • the position coding pattern consists of one partial position-coding pattern for the first direction and one partial position-coding pattern for the second direction.
  • the partial sequences are not written with their explicit values, but with a graphical coding.
  • marks define a superposing of the partial position-coding patterns.
  • the position-coding pattern is based on main number sequences which are arranged in predetermined directions on the surface, the marks must be decoded in these directions for the position determination to be correct.
  • the correct decoding directions are, as mentioned above, from above and down and from the left to the right.
  • the reading pen can, when recording an image, be held rotated in different locations relative to the surface and the position-coding pattern. There are four possible recording rotations which are shown as arrows 40 in Fig. 15 .
  • the recorded image of the position-coding pattern does not in itself reveal the relative rotation between the position coding pattern and the reading pen since the position-coding pattern has essentially the same appearance if it is rotated through 0, 90, 180 or 270 degrees.
  • the position-coding pattern has been rotated, the direction of the displacement of each mark in relation to the raster point with which it is associated will, however, be changed. This results in turn in the bit combination (first decoding value, second decoding value) which is coded by the displacement of the mark being changed.
  • the marks are arranged in the correct decoding directions from above and down in the columns as well as from the left to the right in the rows. If the correct rotation of the position-coding pattern is zero, the following applies to the incorrect rotations:
  • the reading pen is arranged to test, as will be described below, different rotations of the partial area of the position-coding pattern in the recorded image.
  • the matrices 46 and 47 correspond to the matrices 34 and 35 respectively for the position-coding pattern 45 turned the right way around
  • the matrices 48 and 49 correspond to the matrices 34' and 35' respectively for the inverted position-coding pattern 45'. If the matrices 48 and 49 for the inverted position-coding pattern are rotated through 180 degrees and inverted, the matrices 46 and 47 will be obtained for the position-coding pattern turned the right way around.
  • inversion is in this context meant that the zero and one probabilities in each matrix element change places.
  • step K the reading pen is then arranged to calculate a rotation probability (step K) by multiplication of the corresponding highest sequence probabilities. Based on the sequence values corresponding to the highest sequence probabilities for that of the matrices 34 and 34' which corresponds to the highest rotation probability, and the sequence values corresponding to the highest sequence probabilities for that of the matrices 35 and 35' which corresponds to the highest rotation probability, coordinates for the position can be calculated.
  • the columns with marks in the "correct” rotation through 0 degrees are, as described above, rows arranged in the correct decoding direction in the position-coding pattern 45.
  • the correct direction causes the sequence probabilities, and consequently the rotation probability, corresponding to these rows, to be high.
  • the rows with marks in the correct rotation are, as described above, columns arranged in the incorrect decoding direction in the position-coding pattern 45.
  • the incorrect direction causes the sequence probabilities, and consequently the rotation probability, corresponding to these columns, to be low.
  • the relationship will be the opposite for the position-coding pattern 45'.
  • the columns with marks in the correct rotation through 0 degrees are, as described above, rows arranged in the incorrect decoding direction in the position-coding pattern 45'.
  • the incorrect direction combined with the inversion causes the sequence probabilities, and consequently the rotation probability, corresponding to these rows, to be low.
  • the rows with marks in the correct rotation are, as described above, columns arranged in the correct decoding direction in the position-coding pattern 45'.
  • the correct direction causes the sequence probabilities, and consequently the rotation probability, corresponding to these columns, to be high.
  • a first coordinate can be calculated based on the sequence values corresponding to the highest sequence probabilities for the matrix 34, and a second coordinate can be calculated based on the sequence values corresponding to the highest sequence probabilities for the matrix 35.
  • a first coordinate can be calculated based on the sequence values corresponding to the highest sequence probabilities for the matrix 34', and a second coordinate can be calculated based on the sequence values corresponding to the highest sequence probabilities for the matrix 35'.
  • the second coordinate is instead calculated based on the sequence values corresponding to the highest sequence probabilities for the matrix 34', and the first coordinate is calculated based on the sequence values corresponding to the highest sequence probabilities for the matrix 35.
  • the same basic principles as the ones used in the rotation detection can be used for error correction.
  • the main number sequence can be selected so that partial sequences of a predetermined length, which is longer than the one required for position determination, do not occur with one bit inverted in the main number sequence. Then, if all bits except one in such a longer partial sequence can be detected with certainty, the incorrect bit can be corrected. This is another reason why 8x8 elements are used for the position determination although only 6x6 are theoretically required.
  • redundant information is thus used to obtain error correction properties.
  • 8x8 elements are used in the decoding, although the position information can be extracted based on 6x6 raster points, i.e. there is 56 bit redundant information [(8 2 -6 2 )x2] for determining the position.
  • information in the current image is matched, by columns and by rows, with the different partial sequences that may occur in the position-coding pattern, while using the value probabilities belonging to the current image.
  • the combination of redundant information, probabilities and a known condition for the relation between the values of the elements gives good insensitivity to interference in the current image.
  • the value of each individual mark thus decreases in importance since the value of the individual mark must correspond to the other values in that of the partial sequences which gives the highest sequence probability.
  • the reading pen can alternatively be arranged to directly select, for each of the columns in the first matrix, and for each of the rows in the second matrix, a sequence, and thus a sequence value, corresponding to the highest of the zero and the one probability for each element.
  • step L the first and the second coordinate of the position can thus be determined (step L). This is carried out as described above, based on sequence values which in Fig. 15 are designated Sx 1 -Sx 8 (41) for the first coordinate and Sy 1 -SY 8 (42) for the second coordinate.
  • the reading pen is arranged to calculate for the sequence values Sx 1 -Sx 8 and Sy 1 -Sy 8 differences between adjacent sequence values, which results in two sets, 43 and 44, of seven difference numbers Dx 1 -Dx 7 and Dy 1 -Dy 7 each. These difference numbers are then used to generate a first coordinate and a second coordinate.
  • the sequence values Sx 1 -Sx 8 For the calculation of the first coordinate, however, only six of the sequence values Sx 1 -Sx 8 , i.e. five of the difference numbers Dx 1 -Dx 7 , are necessary as described above. According to this example, the sequence values Sx 2 -Sx 7 and thus the difference numbers Dx 2 -Dx 6 are used. The same applies to the second coordinate that is then calculated from the sequence values Sy 2 -Sy 7 and thus the difference numbers Dy 2 -Dy 6 . Alternatively, only six sequence values are determined for each direction, Sx 2 -Sx 7 and Sy 2 -Sy 7 , respectively.
  • 8x8 elements have been identified, for the position determination, in a recorded image. However, it may sometimes happen that it is not possible to identify so many elements. "Empty" additional elements are then added to the elements that can be identified in the image to obtain a total of 8x8 elements. As described earlier, all the value probabilities for an "empty" element are equal.
  • Fig. 17 shows a sheet of paper which has a surface 50 that is provided with an alternative position-coding pattern 51 which consists of marks 52 and which for the sake of clarity is greatly enlarged. In this case, the value of the marks 52 is defined by their size.
  • This type of position-coding pattern is described in Patent Publication WO 00/79383 .
  • the reading pen is arranged, just as described above, to record an image of a partial area of the position-coding pattern, to identify a plurality of marks in the image, and to fit a raster to the image so that each of the marks is associated with a raster point.
  • the marks associated with a raster point constitute an element belonging to the raster point.
  • the small mark 53 corresponds to the value zero and the large mark 54 corresponds to the value one, and there is an ideal size of the small and large marks.
  • the identified marks are usually not of an ideal size. In many cases, it can therefore be difficult to unambiguously determine a value for each mark 52.
  • the reading pen is therefore arranged as above to calculate, for each identified mark, an associated value probability for each value "0" and "1" that the mark defines this value.
  • R i and r can be, for instance, areas or radii. The variance can be determined empirically.
  • the value probabilities for an element can be determined, as above, by the value probabilities for the marks in the element being compared, the highest value probability being selected for each element value.
  • the value probabilities for the element can be weighted sums of the value probabilities for the element values for the marks in the element. In the case of this position-coding pattern, the value probabilities for the element can, of course, also be determined in other ways than those mentioned above.
  • the value probabilities for a mark and an element are the same if the element only contains that mark.
  • the value probabilities for the elements are then used to determine a position on the surface in a manner corresponding to that described in detail above.
  • One alternative as regards the latter position-coding pattern is to let the value probabilities to be a function of the total dark area corresponding to a raster point. This alternative could be useful if there is only one mark associated with each raster point. Sometimes it may in fact happen that for some reason a mark in a recorded image of the position-coding pattern is not a completely continuous area. Then there is a risk that the mark appears to be split and thus, is perceived by the reading pen as several marks.
  • Figs 18a and b show two additional types of coding patterns that can be used in connection with the present invention.
  • the coding pattern 55 in Fig. 18a consists of marks 56 in the form of small lines. The values of the marks 56 depend upon the inclination of the lines. The mark 57 corresponds to the value zero and the mark 58 corresponds to the value one. This type of coding pattern is described in the application US-A-5,245,165 .
  • the coding pattern 59 in Fig. 18b consists of a square grid 60, with triangles 61 being placed in the squares.
  • the square 62 has the value zero and the square 63 has the value one.
  • Another coding pattern that can be used in connection with the present invention consists of marks that have two different ideal shapes, a first and a second ideal shape, with the density of the marks on a surface providing information about the position.
  • the density varies in two dimensions, the density of marks with a first ideal shape varying in a first dimension and the density of marks with a second ideal shape varying in a second dimension.
  • the marks are identified by dark continuous areas in the image being searched out. It is, however, the case that the dark continuous areas in the image are not necessarily marks in the position-coding pattern. There are sometimes impurities, for instance in the form of dust, on the surface on which the position-coding pattern is printed. These impurities cause noise marks in the recorded image, which noise marks may then by mistake be identified as marks in the position-coding pattern. Also sensor noise may cause noise marks in the recorded image. Noise marks in the recorded image may also originate from a defect on one of the components in the reading pen, for instance damaged pixels in the sensor.
  • the noise marks In the first case, in which the values of the marks are determined based on their distance from the ideal locations, there is however a factor that prevents any noise marks from having an effect on the result of the position determination. If a good fit of a raster has been made for the recorded image, the noise marks will be located at a greater distance from the ideal locations than the marks of the position-coding pattern. In the second case, there is another factor that prevents the noise marks from having an effect on the result. The noise marks are usually much smaller than the marks of the position coding pattern. When determining the value probabilities for an element, the value probabilities for the noise marks will thus be of less importance since they are much lower than those for the marks of the position-coding pattern.
  • the area of the marks can correspond to a mark probability, which indicates the probability that a current mark is really a mark in the position-coding pattern.
  • the value probabilities for each mark can then be multiplied by its mark probability before the raster point probabilities are calculated.
  • a form of area filter is used in the reading pen to remove the noise marks completely at an early stage. This filter acts in such a way that all marks that have an area that lies between two limit values are identified as marks in the position-coding pattern, while all marks outside the limit values are rejected.
  • the location of the marks in relation to a raster can instead indicate the probability that a mark is a mark in the position-coding pattern.
  • the invention is not limited to use in connection with position-coding patterns that are based on binary number bases.
  • position-coding patterns that are based on binary number bases.
  • other number bases can be used to express the cyclic main number sequences, as well as the element values in first and second decoding values.
  • the invention is not limited to use where the elements assume two or four element values.
  • the elements may instead assume eight element values.
  • Each element value may then be converted into a first, a second and a third decoding value for each of three dimensions. Consequently also a third set and a third matrix may be created for a third dimension. This could be used, for instance, to determine a position in three dimensions.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Image Analysis (AREA)
  • Position Input By Displaying (AREA)
  • Image Input (AREA)
  • Processing Or Creating Images (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Debugging And Monitoring (AREA)
  • Image Processing (AREA)
EP02744043A 2001-06-26 2002-06-26 Device, method and computer program for position determination Expired - Lifetime EP1417636B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
SE0102253A SE0102253L (sv) 2001-06-26 2001-06-26 Läspenna
SE0102253 2001-06-26
PCT/SE2002/001259 WO2003001442A1 (en) 2001-06-26 2002-06-26 Device, method and computer program for position determination

Publications (2)

Publication Number Publication Date
EP1417636A1 EP1417636A1 (en) 2004-05-12
EP1417636B1 true EP1417636B1 (en) 2010-05-26

Family

ID=20284604

Family Applications (1)

Application Number Title Priority Date Filing Date
EP02744043A Expired - Lifetime EP1417636B1 (en) 2001-06-26 2002-06-26 Device, method and computer program for position determination

Country Status (7)

Country Link
EP (1) EP1417636B1 (ja)
JP (1) JP4342936B2 (ja)
CN (1) CN100342318C (ja)
AT (1) ATE469401T1 (ja)
DE (1) DE60236514D1 (ja)
SE (1) SE0102253L (ja)
WO (1) WO2003001442A1 (ja)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7728914B2 (en) * 2004-01-28 2010-06-01 Au Optronics Corporation Position encoded sensing device with amplified light reflection intensity and a method of manufacturing the same
GB2412215B (en) * 2004-03-18 2008-08-13 Hewlett Packard Development Co Position identification pattern
US7240849B2 (en) 2004-08-27 2007-07-10 Hewlett-Packard Development Company, L.P. Glyph pattern generation and glyph pattern decoding
GB2419720B (en) * 2004-10-29 2010-04-14 Hewlett Packard Development Co Data encoding pattern
KR100628463B1 (ko) * 2004-12-13 2006-09-26 핑거시스템 주식회사 절대좌표 인식 시스템 및 그 방법
WO2011163601A1 (en) * 2010-06-25 2011-12-29 Polyvision Corporation Activation objects for interactive systems
JP5948731B2 (ja) * 2011-04-19 2016-07-06 富士ゼロックス株式会社 画像処理装置、画像処理システム及びプログラム
JP5420807B1 (ja) 2012-04-26 2014-02-19 パナソニック株式会社 表示制御システム、指示装置および表示パネル
KR101453467B1 (ko) * 2012-06-05 2014-10-22 (주)펜제너레이션스 광학필름 및 이를 이용한 전자펜 시스템
CN108664958A (zh) * 2017-04-02 2018-10-16 田雪松 数据解码方法和数据解码装置
CN108664835A (zh) * 2017-04-02 2018-10-16 田雪松 一种编码图案有效性的识别方法和识别装置
DE102017113615A1 (de) * 2017-06-20 2018-12-20 Carl Zeiss Smt Gmbh System, Verfahren und Marker zur Positionsbestimmung eines beweglichen Objektes im Raum

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5852434A (en) * 1992-04-03 1998-12-22 Sekendur; Oral F. Absolute optical position determination
US5661506A (en) * 1994-11-10 1997-08-26 Sia Technology Corporation Pen and paper information recording system using an imaging pen
WO2000025293A1 (en) 1998-10-23 2000-05-04 Raphael Cohen Pen-input device
DE29924323U1 (de) * 1999-03-24 2002-12-05 Anitra Medienprojekte Gmbh Träger für Muster und Lesegerät zur Positionsbestimmung
DE60044458D1 (de) 1999-05-28 2010-07-08 Anoto Ab Positionsbestimmung
SE517445C2 (sv) * 1999-10-01 2002-06-04 Anoto Ab Positionsbestämning på en yta försedd med ett positionskodningsmönster
WO2001030591A1 (en) * 1999-10-25 2001-05-03 Silverbrook Research Pty Ltd Electronically controllable pen with sensor
DE60102900T2 (de) 2000-02-16 2004-10-28 Telefonaktiebolaget Lm Ericsson (Publ) Elektronischer griffel mit ein/aus tintenfunktion und kontakterkennungsfunktion mit dem papier

Also Published As

Publication number Publication date
CN1630878A (zh) 2005-06-22
WO2003001442A1 (en) 2003-01-03
JP2004533693A (ja) 2004-11-04
ATE469401T1 (de) 2010-06-15
SE0102253L (sv) 2002-12-27
DE60236514D1 (de) 2010-07-08
EP1417636A1 (en) 2004-05-12
CN100342318C (zh) 2007-10-10
SE0102253D0 (sv) 2001-06-26
JP4342936B2 (ja) 2009-10-14

Similar Documents

Publication Publication Date Title
US6966495B2 (en) Devices method and computer program for position determination
US7195166B2 (en) Method and device for data decoding
US7145556B2 (en) Method and device for decoding a position-coding pattern
US6983886B2 (en) Two-dimensional code reader setting method, two-dimensional code reader, two dimensional code reader setting program and computer readable recording medium
JP5848464B2 (ja) 二次元コード、二次元コードの作成システムおよび解析プログラム
US6830197B2 (en) Compact matrix code and one-touch device and method for code reading
US6689966B2 (en) System and method for determining positional information
EP1417636B1 (en) Device, method and computer program for position determination
KR101122822B1 (ko) ｍ-어레이 디코딩 및 오류 정정에 대한 향상된 접근
US6612497B1 (en) Two-dimensional-code related method, apparatus, and recording medium
US7438232B2 (en) Two-dimensional code and information processing method
US20080000991A1 (en) System and Method for Encoding and Decoding Large Capacity 2-Dimensional Color Bar Code Which Can Be Color-Corrected
EP1620828B1 (en) Methods, apparatus, computer program and storage medium for position decoding
EP1405255B1 (en) Method and device for data decoding
WO2014077187A1 (ja) 二次元コード
US7865043B2 (en) Method, apparatus, computer program and storage medium for recording a movement of a user unit
JP4226291B2 (ja) 二次元コード読取装置
JP2004533693A5 (ja)
JP2004054645A (ja) 二次元コード読取装置、二次元コード読取方法、二次元コード読取プログラムおよびコンピュータ読取可能な記録媒体
EP1557793B1 (en) Method and apparatus for registering, displaying and decoding of information for spatial registration
JP2009230438A (ja) 読み取り装置、筆記情報処理システム、読み取り装置の制御装置およびプログラム

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20040126

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ANOTO IP LIC HB

111L Licence recorded

Free format text: 0100 LEAPFROG ENTERPRISES INC.

Effective date: 20050530

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ANOTO AB

TPAC Observations filed by third parties

Free format text: ORIGINAL CODE: EPIDOSNTIPA

17Q First examination report despatched

Effective date: 20071227

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ANOTO AB

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/033 20060101ALI20091216BHEP

Ipc: G06K 11/00 20060101AFI20091216BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: CH

Ref legal event code: PK

Free format text: ERGAENZUNG LIZENZEINTRAG: AUSSCHLIESSLICHE LIZENZ

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60236514

Country of ref document: DE

Date of ref document: 20100708

Kind code of ref document: P

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20100526

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100526

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100526

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100526

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100526

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100827

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100927

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100526

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100630

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100526

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100526

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100526

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100626

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100630

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100630

26N No opposition filed

Effective date: 20110301

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 60236514

Country of ref document: DE

Effective date: 20110228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100626

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100526

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20130619

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20130624

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100906

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60236514

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20150227

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60236514

Country of ref document: DE

Effective date: 20150101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140630

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20181220

Year of fee payment: 17

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20190626

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190626