Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/04—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
  • H04N1/047—Detection, control or error compensation of scanning velocity or position
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/04—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
  • H04N1/04—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
  • H04N1/10—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using flat picture-bearing surfaces
  • H04N1/107—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using flat picture-bearing surfaces with manual scanning
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
  • H04N2201/024—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof deleted
  • H04N2201/02406—Arrangements for positioning elements within a head
  • H04N2201/02439—Positioning method
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
  • H04N2201/04—Scanning arrangements
  • H04N2201/047—Detection, control or error compensation of scanning velocity or position
  • H04N2201/04701—Detection of scanning velocity or position
  • H04N2201/0471—Detection of scanning velocity or position using dedicated detectors
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
  • H04N2201/04—Scanning arrangements
  • H04N2201/047—Detection, control or error compensation of scanning velocity or position
  • H04N2201/04701—Detection of scanning velocity or position
  • H04N2201/04715—Detection of scanning velocity or position by detecting marks or the like, e.g. slits
  • H04N2201/0472—Detection of scanning velocity or position by detecting marks or the like, e.g. slits on or adjacent the sheet support
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
  • H04N2201/04—Scanning arrangements
  • H04N2201/047—Detection, control or error compensation of scanning velocity or position
  • H04N2201/04701—Detection of scanning velocity or position
  • H04N2201/04734—Detecting at frequent intervals, e.g. once per line for sub-scan control
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
  • H04N2201/04—Scanning arrangements
  • H04N2201/047—Detection, control or error compensation of scanning velocity or position
  • H04N2201/04753—Control or error compensation of scanning position or velocity
  • H04N2201/04758—Control or error compensation of scanning position or velocity by controlling the position of the scanned image area
  • H04N2201/04787—Control or error compensation of scanning position or velocity by controlling the position of the scanned image area by changing or controlling the addresses or values of pixels, e.g. in an array, in a memory, by interpolation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
  • H04N2201/04—Scanning arrangements
  • H04N2201/047—Detection, control or error compensation of scanning velocity or position
  • H04N2201/04753—Control or error compensation of scanning position or velocity
  • H04N2201/04794—Varying the control or compensation during the scan, e.g. using continuous feedback or from line to line

Definitions

• the present invention relates to a method of electronic recording of information. Furthermore, the invention relates to a product intended to be used in connection with electronic recording of information from an information carrier, which product comprises at least one sheet-shaped portion which is provided with a position- coding pattern. In addition, the invention relates to a computer-readable medium, a system, and a device for recording information. Background of the Invention It often happens that a user has text and images in paper form, but would like to convert them to electronic form in order to be able to process them in a computer or to send them electronically, for example in a fax or an e-mail message. GB 2,288,512 discloses a handheld scanner which can be used for recording images.
• the scanner comprises a line sensor, two wheels arranged on the ends of the line sensor, and sensors for detecting the rotation of the wheels.
• the scanner is passed back and forth across an image or a piece of text which the user wishes to record.
• the relative position of the line sensor is recorded with the aid of the sensors and the wheels.
• the recorded position is then used to determine where the image data recorded by the line sensor should be stored in an image memory.
• One drawback associated with the scanner is that it contains moving parts.
• Another drawback is that the wheels only permit the scanner to be moved in certain directions .
• the Applicant's O98/20446 describes another type of handheld scanner or reading pen which is intended for selective recording of text. It comprises a light-sensitive area sensor, which is adapted to record images with partially overlapping content. A signal -processing unit utilises the partially overlapping content of the images to put them together into a composite image. OCR software converts the characters in the composite image to character-coded format.
• This scanner has the advantage that it does not require any moving parts for position determination. However, it is only designed for recording character sequences along one row of text at a time.
• US 5,852,434 describes an arrangement for recording handwritten text by determining absolute positions on a writing surface.
• the arrangement comprises a writing surface provided with a position code, a pen-like device with a pen point and a detector capable of detecting the position code, as well as a computer which is capable of determining the position of the device in relation to the writing surface on the basis of the detected position code.
• a user writes on the writing surface the position code is continuously recorded along the path of pen point with the aid of the detector.
• the recorded position code is transferred to the computer for analysis. Finally, the result is outputted to a display or a printer.
• this arrangement is not suitable for recording existing text or images.
• US 5,852,434 describes three examples of a position code.
• the position code is made up of dots, each of which is made up of three concentric circles.
• the outermost circle represents an X-coordinate and the middle circle represents a Y-coordinate .
• the two outermost circles are divided into 16 parts, which depending upon whether they are filled in or not indicate different numbers. This means that each pair of coordinates X, Y is coded with a dot with a specific appearance .
• This object is achieved by a method of recording information according to claim 1, a product intended to be used in connection with electronic recording of information according to claim 12, a computer-readable medium according to claim 23, a device according to claim 27, and a system according to claim 29.
• a method of electronic recording of information from an information carrier comprises the steps of placing a sheet with a position-coding pattern and the information carrier such that one superimposes the other; imaging the infor- mation on the information carrier and the position-coding pattern with the aid of a plurality of partial images; and using the position-coding pattern for putting together the partial images into a composite image of the imaged information.
• a position-coding pattern is thus applied to the information carrier by placing the position-coding pattern on top of or under the information carrier. Accordingly, the information carrier is not provided with a position-coding pattern from the beginning. Instead, the pattern is applied, temporarily or permanently, at a later stage. This means that any image or text can be recorded with the aid of the position-coding pattern.
• the position-coding pattern is used for put- ting together the partial images, no special or separate position sensors are required. Moreover, it does not matter in which order or relationship the partial images are recorded because their respective positions are determined by the position-coding pattern. For example, the recordings of the partial images can overlap and the recording can start anywhere on the information carrier. The important thing is that the partial images together comprise all the information which is to be recorded because this makes it possible to put together the partial images into a composite image with the aid of the position-coding pattern. Furthermore, the putting-together of the partial images to a composite image can be carried out efficiently with the aid of the position-coding pattern. It requires much less processing capacity than the putting- together of partial images by means of the partially overlapping contents thereof. Moreover, the accuracy and the predictability of the assembly of the partial images are not dependent on the information per se on the information carrier.
• the position-coding pattern can be projected as a pattern of light on the information carrier, be copied in a copying machine on to the information carrier or be placed on top of or under the information carrier in any other suitable way.
• the step of placing comprises placing a sheet with the position- coding pattern on top of or under the information carrier. This way of placing the position-coding pattern is at the moment the easiest and most inexpensive way of placing the position-coding pattern and the information carrier such that one superimposes the other.
• the sheet with the position-coding pattern is furthermore transparent except for the position-coding pattern and is placed on top of the information carrier.
• This embodiment makes it possible to image both the information on the information carrier and the position-coding pattern simultaneously in every partial image. Then the position-coding pattern can be used for unambiguously determining a position for the part of information imaged in each partial image so that the par- tial images can be put together without any distortion. It would, however, also be conceivable to record every second time a partial image of only the information on the information carrier and every second time a partial image of only the position-coding pattern.
• the information and the position- coding pattern may be imaged by electromagnetic radiation of dif- ferent wavelengths and may have different wavelength characteristics.
• the sheet and the position-coding pattern should, in this embodiment, be transparent to the electromagnetic radia- tion by which the information is imaged, but non-transparent to the electromagnetic radiation by which the position-coding pattern is imaged. If the sheet is placed under the information carrier, the information carrier and the information should, on the other hand, be trans- parent to the electromagnetic radiation by which the position-coding pattern is imaged, and non-transparent to the electromagnetic radiation by which the information is imaged. Since a device for recording information in this embodiment need to be able to send out electromagnetic radiation of different wavelengths, it will be more complex and thus more expensive.
• the position-coding pattern and the information to be recorded are imaged by different partial images, there will be a displacement between the partial image from which a position is determined and the next (or previous) partial image including the information for which the ' position is used to put together the partial image with other partial images of the information.
• the method according to the invention comprises the further step of filtering out the position-coding pattern.
• the final, composite image of the information will essentially constitute an image of the information on the information carrier without the position-coding pattern.
• the filte- ring out can be carried out in the composite image or, preferably, in the partial images.
• the filtering out of the position-coding pattern is preferably effected by replacing pixel values representing the position-coding pattern with pixel values which are obtained by averaging pixel values representing the information.
• the averaging is preferably carried out on pixels located close to the pixel which is to be replaced. In this context, averaging also comprises averaging with weighting of the pixel values .
• the position-coding pattern can be made up of symbols.
• the filtering out preferably com- prises the steps of, for each symbol, calculating the average of the pixel values of pixels adjacent to the periphery of the symbol and replacing pixel values representing the symbol with said average of the pixel values.
• the position-coding pattern makes it possible to put together the images into a composite image of the information.
• the putting together of the images preferably comprises the substeps of determining one position for each partial image of the information on the basis of the position-coding pattern in the same or adjacent partial image and determining where the partial image of the information should be stored in a memory area on the basis of the determined position.
• the position obtained from the position-coding pattern represents the location of the same or adjacent partial image on the information carrier it is possible to recreate the information on the information carrier.
• the partial images will overlap to some degree. This can be used for improving the image: if a pixel in the partial image which is to be stored in the memory area overlaps a pixel in a previously stored image in the memory area, the average of the pixel values of these overlapping pixels is preferably calculated and the previously stored pixel value is replaced with said average .
• the method comprises the steps of imaging the information on the information carrier with a first resolution, if a first part of the position-coding pattern on the sheet is detected, and imaging the information on the information carrier with a second resolution, if a second part of the position- coding pattern is detected.
• a user may to some extent select the speed with which the information on the information carrier is recorded, so that a faster recording can be made when a lower resolution is sufficient.
• the different parts of the position-coding pattern may e.g. be parts with different graphical appearances or parts which code co-ordinates from different co-ordinate intervals or areas.
• a product designed to be used in connection with electronic recording of information from an information carrier, which product comprises at least one sheet- shaped portion provided with a position-coding pattern which extends across the sheet and codes a plurality of positions on the sheet.
• the sheet-shaped portion is transparent except for the position-coding pattern, the sheet-shaped portion being adapted to be placed on top of the information carrier for recording information from the same .
• the product can, for example, consist of the sheet- shaped portion or of a plastic folder, whose front is provided with the position-coding pattern and in which an information carrier in the form of a sheet of paper with text and images can be placed.
• each position of said plurality of positions is coded by a specific part of the position-coding pattern and each such part of the position-coding pattern also contributes to the coding of adjacent positions.
• each position is coded with its own individual code or symbol, which is "isolated” from the codes or symbols of the surrounding positions.
• the position resolution is thus limited by the partial surface occupied by the symbol (s) or code(s) of a position.
• a specific part of the position-coding pattern is used for coding several positions. In this way, a "floating" transition between positions is obtained, making it possible to increase the position resolution.
• the position-coding pattern can be any arrangement of lines, figures, surfaces or the like which enable unambiguous coding of positions.
• the position-coding pattern is preferably made up of a plurality of symbols of at least a first type. In the most basic embodiment there are symbols of the first type only and the positions are coded with the aid of the distance between these symbols.
• the coding can be binary, the existence of a symbol representing a one and the absence of a symbol representing a zero.
• the position-coding pattern is made up of a plurality of symbols of a first and a second type or appearance only.
• Such a pattern can be used for binary coding. It is easy to apply to a surface since the symbols can be very simple, for example consisting of two dots of different colours or diameters. The product having a surface with this pattern is thus easy to manufacture since the information content of each symbol is small. Furthermore, it facilitates image processing.
• the symbols are preferably uniformly distributed across the surface, making it particularly easy to create and interpret the pattern.
• each position of said plurality of positions is preferably coded with the aid of a plurality of symbols.
• the symbols coding a position it is advantageous for the symbols coding a position to be distributed in two dimensions in such a way that the same position resolution can be achieved in two perpendicular directions on the surface.
• Each of the symbols preferably contributes to the coding of more than one of said plurality of positions. However, there may be edge effects preventing this from being fulfilled in the case of a very few symbols.
• the position-coding pattern is optically readable so that both the position-coding pattern and the information can be recorded with the same sensor.
• the pattern should thus be capable of reflecting, emitting or absorbing light. However, the light need not be in the visible range.
• the pattern may also be fluorescent, the fluorescence being activated by electromagnetic radiation from the device which is used for recording information from the information carrier.
• the symbols in the pattern can be of any suitable type. They are preferably graphic so that it will not be necessary to carry out character recognition (OCR) rr P. TJ 0 CD TJ cu Hj TJ H- ⁇ 3 H- Hi cr ⁇ rr H rt ⁇ s: ⁇ TJ H ⁇ rt H- ⁇ H-
• each of said plurality of positions can be defined by a first and a second coordinate which can be determined by means of the part of the position- coding pattern which is located on the associated partial surface, the position-coding pattern representing the address of the location where the first and second coordinates are stored.
• a position-coding pattern made up in this way requires a great deal of memory space .
• the position-coding pattern is structured in such a way that the position-coding pattern coding a certain position contains inherent information about that position.
• the position-coding pattern is preferably based on a first string of symbols, which contains a first predetermined number of symbols and which has the characteristic that if a second predeter- mined, preferably successive, number of symbols are taken from the first string of symbols, the location of these symbols in the first string of symbols is unambiguously determined, the first string of symbols being used for determining the position of the partial image in a first dimension on the information carrier. Since the position code is based on a string of symbols with a finite number of symbols arranged in a predetermined order, it is possible to define a "formula" for determining the position in a first dimension on the surface.
• the invention thus relates to a computer- readable medium which stores a computer program for recording information, which computer program comprises instructions for processing a plurality of partial images which together comprise the information to be recorded and a position-coding pattern, the processing comprising the step of using the position-coding pattern for putting the partial images of the information together into a composite image of the information.
• the computer program can be designed to be used in the device which records the information or in another device to which the images are transferred for processing .
• the computer-readable medium with the computer pro- gram has essentially the same advantages as the above method.
• the invention relates to a device for recording information, comprising a sensor for recording partial images of an information car- rier and a position-coding pattern; image-processing means for processing the partial images recorded by the sensor, which image-processing means are adapted to use the position-coding pattern in the partial images to determine where each partial image should be stored in a memory area.
• the invention relates to a system comprising a product and a device of the type described above.
• the device and the system have essentially the same advantages as the product and the method. Features described above with respect to the method and the product may also be found in the device and the system.
• the invention can be used for recording information from any type of information carrier on top of which or under which a position-coding pattern can be placed so that both the information on the information carrier and the position-coding pattern can be recorded either simultaneously or in an alternating manner.
• Fig. 1 is a schematic illustration of an example of a product having a sheet -shaped portion with a position- coding pattern
• Fig. 2 is a schematic illustration of an example of how the symbols can be designed in one embodiment of the position-coding pattern
• Fig. 3 is a schematic view of an example of 4x4 symbols that are used to code a position
• Fig. 4 is a schematic illustration of an embodiment of a device according to the invention.
• Fig. 5 is a schematic illustration of an example of the order in which partial images can be recorded from an information carrier
• Fig. 6 is a flowchart showing how partial images are processed
• Fig. 7 is a schematic illustration of a sheet with a position-coding pattern according to a further embodiment of the invention.
• Fig. 8 is a schematic illustration of a second embodiment of the device.
• Fig. 1 shows a part of a transparent sheet 1 having a surface 2 on which an optically readable position-coding pattern 3 has been applied.
• the sheet 1 can be a part of a product, for example a plastic folder, but in this case the sheet constitutes the entire product.
• the position-coding pattern 3 is made up of symbols 4 of a first and second type 4a, 4b and more specifically of dots of two different appearances, the dots 4a having a black centre dot with a white ring around it representing
• the five-bit group thus provides an unambiguous coding of the location in the series .
• the first five bits in the above number series i.e. 00001, constitute the code for position 0 in the number series
• the next five bits i.e. 00010
• the positions in the x-number series as a function of the five-bit groups are stored in a first table. Naturally, position 31 only exists in the 32-bit series. Table 1 below shows the position coding for the example described above.
• the coding in the Y-direction is based on the same principle.
• a number series is created, hereinafter called the Y-number series, which consists of p numbers, the series being made up in such a way that if r successive numbers are taken from the series, these r numbers will code the position in the series and thus the position in the Y-direction unambiguously.
• the numbers in the Y-number series are coded in the pattern on the sheet as a difference between the positions in the X-direction in two rows, which is calculated in a special way.
• the series are written using the two different sizes of dots.
• the rows start in different positions in the X-number series. More specifi- cally, one begins two successive rows in such a way that if one determines the difference modulo 32 between two position numbers located one above the other, expresses the difference by means of a five-bit binary number, and takes the two most significant bits of said five-bit binary number, this number shall be the same regardless of where one is in the row.
• the maximum displacement is 31 positions or bits and the minimum displacement is 0 positions or 0 bits.
• the displacements along each pair of rows is then within one of the intervals 0-7, 8-15, 16-23, or 24-31 positions/bits.
• the series are written as follows (expressed as position numbers) :
• the difference is determined in the above way, it will be 0 between rows 1 and 2, 0 between rows 2 and 3, 1 between rows 3 and 4, and 3 between rows 4 and 5. Take, for example, 26-18 in rows 3 and 4, which equals 8, which is 01000 in binary code. The two most significant numbers are 01. If instead one takes 0 - 23 in the same rows, which modulo 32 equals 9, the two most significant numbers are 01 just like in the previous example. In this example, four difference numbers 0,0,1,3 are obtained.
• the device translates these five- bit groups into positions with the aid of Table 1. The following positions are obtained: 26 (11010) 26 (11010)
• the magnitude of the displacement between the position numbers in the different rows is determined by taking the difference modulo 32.
• the two most significant numbers of the differences determined in this manner expressed as five-bit binary numbers are 0, 1, 0, 0. According to Table 2, this difference number equals position 3 in the Y-direction.
• the coordinate of the second dimension on the sheet is 3.
• a third table stores the starting position of each row, i.e. the position in the X-numbers series where each row starts.
• the y-coordi- nate 3 it is possible to look up the starting positions of the rows from which the recorded five-bit groups have been taken. Knowing the starting positions of the rows from which the two uppermost five-bit groups have been taken and the X-positions to which these two five-bit groups correspond, i.e. positions 26 and 26, it is possible to determine the x-coordinate, or the position in the first dimension, of the recorded image. For example, suppose that the starting positions of the two uppermost rows are 21 and 20 respectively. In this case, the two rows from which the two uppermost five-bit groups in the recorded image are taken will thus look as follows:
• Row 3 21 22 23....29 30 31 0 1 2...25 26 27..
• Row 4 20 21 22....28 29 30 0 1 2...25 26 27.. It follows from the fact that the y-coordinate is 3 that the two first five-bit groups are taken from rows 3 and 4. It follows from the fact that odd rows are made up of the 32 -bit number series and even rows are made up of the 31 -bit number series that row 3 is made up of a 32 -bit number series while row 4 is made up of a 31-bit number series .
• the accuracy of the position determination can be further increased by determining the location of the middle dot in the 5 x 5 group in relation to the centre of the image.
• the position resolution can thus be better than the distance between two symbols.
• the position-coding pattern can also be used for determining the position in a third dimension in relation to the surface, i.e. in the Z-direction. This is achieved by determining the size of the symbols in the recorded image and comparing it to a reference value representing the size of the symbols when they are imaged by means of an information-recording device which is held next to the surface on which the position-coding pattern is located. In this way, the device can thus automatically determine whether the device is close to the surface, in which case images shall be recorded, or spaced from the surface, in which case images shall not be recorded, and trigger image recording depending on this.
• the above description relates to an example and can thus be generalised. There need not be 32 numbers in the first X-number series.
• the same type of reasoning applies to the Y-number series.
• the bases of these number series can thus be different and the number of symbols which code a position, and consequently also the number of positions coded by the number series, can vary.
• the series can be based on symbols other than numbers and can therefore be described as strings of symbols.
• the symbols can be of many dif- ferent kinds. They can also be numbers, but in that case OCR software is required for carrying out the position determination, which makes the device for image recording more expensive and more complicated. It also leads to increased error sensitivity.
• OCR software is required for carrying out the position determination, which makes the device for image recording more expensive and more complicated. It also leads to increased error sensitivity.
• the above method of coding positions on a surface and of carrying out the position determination on the surface is advantageous in that it only requires a very small amount of memory and processor capacity. In the above example, it is only necessary to store Table 1 with 32 rows, Table 2 with 256 rows, and Table 3 with
• the position determination can be carried out by means of three table look-ups and a simple calculation.
• the method of coding positions on the surface is also advantageous because the image upon which the position determination is based can be captured at any rotation in relation to the surface upon which the position is to be determined.
• an image contains a number of rows which shall be horizon- tal . This means that there are only four possible orientations. In 98% of cases, only one of the four orientations gives a position. In the cases where there is doubt, it can be removed by recording two adjacent images and determining the positions on the basis of these images at all possible orientations of the symbols in the images, the criterion being that the position determination shall result in two adjacent positions.
• position determination can also be carried out in ways other than those described above .
• the recorded image of a partial surface of the posi- tion-coding pattern can be matched with an image of the whole position-coding pattern.
• this requires a great deal of processor capacity.
• This second position-coding pattern comprises a virtual raster, which thus neither is visible to the human eye nor can be detected directly by a device which is to determine positions on the surface, and a plurality of symbols 104, which each are capable of assuming one of four values "i"-"4" as will be described below.
• Figs 2a-d show an embodiment of a symbol which can be used in the position-coding pattern according to the invention.
• the symbol comprises a virtual raster point 106 which is represented by the intersection between the raster lines, and a marking 107 which has the form of a dot .
• the value of the symbol depends on where the marking is located. In the example in Fig. 2, there are four possible positions, one on each of the raster lines extending from the raster points. The displacement from the raster point is equal to all values.
• the symbol in Fig. 2a has the value 1, in Fig. 2b the value 2, in Fig. 2c the value 3 and in Fig. 2d the value 4. Expressed in other words, there are four different types of symbols.
• Each symbol can thus represent four values "1-4".
• This means that the position-coding pattern can be divid- ed into a first position code for the x-coordinate, and a second position code for the y-coordinate .
• the division is effected as follows:
• each symbol is translated into a first digit, in this case bit, for the x-code and a second digit, in this case bit, for the y-code.
• the patterns can be combined to a common pattern, which is coded graphically by means of a plurality of symbols according to Fig. 2.
• Each position is coded by means of a plurality of symbols.
• the position code is made up by means of a number series of ones and zeros which have the characteristic that no sequence of four bits appears more than once in the series.
• the number series is cyclic, which means that the characteristic also applies when one connects the end of the series to the beginning of the series .
• a four-bit sequence always has an unambiguously determined position in the number series.
• the series can maximally be 16 bits long if it is to have the above-described characteristic for sequences of four bits.
• This series contains seven unique sequences of four bits which code a position in the series as follows:
• the number series is written sequentially in columns across the entire surface that is to be coded.
• the coding is based on the difference or position displacement between numbers in adjoining columns.
• the size of the difference is determined by the position (i.e. with which sequence) in the number series, in which one lets the column begin. More specifically, if one takes the difference modulo seven between on the one hand a number which is coded by a four-bit sequence in a first column and which thus can have the value (position) 0-6, and, on the other hand, a corresponding number (i.e. the sequence on the same "level") in an adjoining column, the result will be the same independently of where along the two columns one makes the comparison.
• each position on the surface is coded with 4x4 symbols in this example, three differences (having the value 0-6) as stated above are available to code the x-coordinate. Then the coding is carried out in such manner that of the three differences, one will always have the value 1 or 2 and the other two will have values in the range 3-6. Consequently no differences are allowed to be zero in the x-code.
• the x-code is structured so that the differences will be as follows: (3-6) (3-6) (1-2) (3-6) (3-6) (1-2) (3-6) (3-6) (1-2)...
• Each x-coordinate thus is coded with two numbers between 3 and 6 and a subsequent number which is 1 or 2. If three is subtracted from the high numbers and one from the low, a number in mixed base will be obtained, which directly yields a position in the x-direction, from which the x-coordinate can then be determined directly, as shown in the example below.
• the y-coordinates are coded according to the same principle as used for the x-coordinates.
• the cyclic number series is repeatedly written in horizontal rows across the surface which is to be position-coded. Just like in the case of the x-coordinates, the rows are allowed to begin in different positions, i.e. with different sequences, in the number series.
• y-coordinates one does not use differences but codes the coordinates with numbers that are based on the starting position of the number series on each row.
• the most significant digit is determined by letting this be the only one that has a value in a specific range.
• this row In this example, one lets one row of four begin in the position 0-1 in the number series to indicate that this row relates to the least significant digit in a y-coordinate, and the other three begin in the position 2-6.
• y- direction there is thus a series of numbers as follows: (2-6) (2-6) (2-6) (0-1) (2-6) (2-6) (2-6) (0-1) (2-6)...
• Each y-coordinate thus is coded with three numbers between 2 and 6 and a subsequent number between 0 and 1.
• Fig. 3 shows an example of an image with 4x4 symbols which are read by a device for position determination.
• the vertical x- sequences code the following positions in the number series: 2 0 4 6.
• the position of the uppermost left corner for the 4x4 symbol group is (58,170) .
• the numbers 0-19 are coded in the mixed base, and by adding up the representations of the numbers 0-19 in the mixed base, one obtains the total difference between these columns.
• a naive algorithm to do so is to generate these twenty numbers and directly add up their digits. The resulting sum is called s.
• the sheet of paper or writing surface will then be given by (5-s) modulo7.
• each position is coded with 4 x 4 symbols and a number series with 7 bits is used.
• Positions can be coded with a larger or smaller number of symbols.
• the number of symbols need not be the same in both directions.
• the number series can be of different length and need not be binary, but may be based on another base. Different number series can be used for coding in x-direction and coding in y-direction.
• the symbols can have different numbers of values .
• the marking is a dot but may, of course, have a different appearance.
• it may consist of a dash which begins in the virtual raster point and extends therefrom to a predetermined position.
• it may consist of the above-described dot with an inner circle filled with a first colour and an outer circle filled with a second contrasting colour up to the edge of the inner circle.
• the symbols within a square partial surface are used for coding a position.
• the partial surface may have a different form, such as hexagonal .
• the symbols need not be arranged in rows and columns at an angle of 90° to each other but can also be arranged in some other manner.
• the virtual raster For the position code to be detected, the virtual raster must be determined. This can be carried out by studying the distance between different markings. The shortest distance between two markings must derive from two neighboring symbols having the value 1 and 3 so that the markings are located on the same raster line between two raster points. When such a pair of markings has been detected, the associated raster points can be determined with knowledge of the distance between the raster points and the displacement of the markings from the raster points. When two raster points have once been located, additional raster points can be determined by means of measured distances to other markings and with knowledge of the relative distance of the raster points.
• a nominal spacing of 0.3 mm between the raster lines has been used. If each position is coded by 6 x 6 symbols, an area of 1.8 mm x 1.8 mm is required for each position.
• a position can be calculated with a resolution of 0.03 mm.
• FIG. 4 An embodiment of a device for recording information is schematically shown in Fig. 4. It comprises a casing 11 having approximately the same shape as a pen. In one short side of the casing there is an opening 12. The short side is intended to abut against or be placed a short distance from the information carrier from which information is to be recorded.
• the casing essentially contains an optics part, an electronic circuitry part, and a power supply.
• the optics part comprises at least one light-emitting diode (LED) 13 for illuminating the surface which is to be imaged and a light-sensitive area sensor 14, such as a CCD or CMOS sensor, for recording a two-dimensional image, in colour, black and white, or greyscale.
• the device may also comprise an optical system such as a mirror system or a lens system. It should be noted that the sensor 14 should be designed in such a way that it can capture an image of the information carrier and the superimposed position-coding pattern at the same time.
• the light-emitting diode may be a IR-diode emitting light of about 880 nm.
• the power supply to the device is obtained from a battery 15, which is mounted in a separate compartment in the casing.
• the electronic circuitry part comprises image-processing means 16 comprising a processor unit with a processor which is programmed to read a partial image from the sensor, identify the position-coding pattern in the partial image, determine a position on the basis of the identified position-coding pattern, and store the partial image in a location in a memory forming part of the image-processing means which is indicated by the position determined from the position-coding pattern.
• the device comprises buttons 18 by means of which the user activates and controls the device. It also comprises a transceiver 19 for wireless transfer, e.g. using IR light or radio waves, of information to and from the device.
• the device can also comprise a display 20 for showing recorded information.
• the Applicant's Swedish patent No. 9604008-4 describes a device for recording text. This device can be utilised for recording information using the method according to the invention if programmed in a suitable way.
• the device can be divided into different physical casings, a first casing containing components required for capturing images of information carrier with the superimposed position-coding pattern and for transferring them to components which are located in a second casing and which carry out the position determi- nation and the storing of the images in the memory. Operation
• a user has an information carrier in the form of a sheet of paper with text and an image which he wishes to send in an e-mail message to another person.
• he places the above-mentioned transparent sheet 1 with the first position-coding pattern 3 (example 1) on top of the sheet of paper.
• he turns on the above-mentioned device for recording information, places the device so that the opening 12 abuts against the information carrier and passes the device back and forth across the area on the information carrier containing the text and the image which he wishes to record. It is important for the user to "scan" the whole area which is of interest to him so that the partial images recorded by the device together cover the whole area. However, as will be seen below, it does not matter if several partial images cover the same area.
• Fig. 5 schematically shows an example of how partial images can . be recorded from an information carrier.
• the information on the information carrier is shown as a sun and a cloud in broken lines.
• Partial images 30-33 are recorded in such a way that they overlap using a left-to-right motion.
• the user lifts the device and puts it down slightly to the right of partial image 33, after which partial images 34-39 are recorded using a back-and-forth motion.
• the user continues to pass the device across the information carrier until the whole area that he wishes to record has been scanned.
• the device records images at a predetermined frequency, the LED 13 generating strobe pulses at the same frequency, e.g. 100 Hz.
• the sensor When the sensor has recorded a partial image it is read by the image-processing means 16 and is processed immediately or subsequent to buffering in the memory.
• the partial images are preferably recorded at a frequency such that they partially overlap, making it easier to scan the area from which information is to be recorded.
• Each recorded image is processed as follows by the software in the device, see the flowchart in Fig. 6. First, a partial image is fetched, step 40. This image is scanned, step 41, in a first pass where the processor searches for symbols 4a having a black centre dot with a white ring around it. When it has found the first such dot the searching becomes simpler because it knows the distance between the dots in the position-coding pat- tern.
• the partial image is scanned again, step 42, in a second pass where the processor searches for symbols having a white centre dot with a black ring around it.
• An identified position of a black dot can be used as a starting-point for this search, the processor again utilising the known distance between the dots.
• the processor determines, in the above manner, which position the position-coding pattern in the partial image represents, step 43.
• the position can be indicated as a pair of co-ordinates.
• the rotation of the partial image in relation to the information carrier can be determined based on knowledge of the arrangement of symbols in the position-coding pattern.
• the position of the partial image can be determined more exactly by determining the position of the position-coding pattern on the sensor.
• step 44 the position-coding pattern is filtered out of the partial image. This is effected by the processor determining, for each dot forming part of the position-coding pattern, the value of the pixels closest to the periphery of the dot. The processor then restores the image by replacing, for each symbol, i.e. dot, all the pixels in the partial image which constitute the dot with the average of the pixel values of the pixels adjacent to the periphery of the dot. Alternatively, the processor can replace sectors in the dot with pixels with the average of the pixel values of the pixels adjacent to the sector arc.
• the partial image is stored, step 45, in a location in the memory which is determined by the position coordinates.
• the partial image completely or partially overlaps a previously stored partial image.
• the average value of overlapping pixels is calculated and the average value is stored in the location for each overlapping pair of pixels .
• the location in the memory where the partial image is stored need not be determined exclusively on the basis of the position co-ordinates. More particularly, the position coordinates can be used for carrying out a rough positioning, whereas a fine positioning is carried out by registering (aligning) the partial image with previously stored partial images by using the overlapping content of the partial images.
• the memory contains a composite digital image of the area on the information carrier which has been scanned using the device.
• This digital image can be incorporated into a fax, a document, an e-mail message, or the like.
• the image could also be used as an input signal to OCR or ICR software which interprets the text in the image and stores it in character-coded format.
• the stored partial images can be shown on the display 20 in order to help the user see the areas on the information carrier which he has not covered.
• a pixel on the display 20 may correspond to a certain area on the transparent sheet and be turned on as soon as the corresponding area has been covered.
• the information recorded from the information carrier can be displayed on a screen of a stationary computer to which the partial images are sent successively so that the user can see how the composite image of the information on the information carrier develops .
• the information and the position-coding pattern are recorded simultaneously with the aid of the electromagnetic radiation from one or more LED.s.
• the pattern and the information can be recorded in an alternating manner such that every second partial image comprises the pattern and every second partial image the information.
• the information and the pattern must be recorded by electromagnetic radiation of different wavelengths.
• This embodiment has the advantage that the position-coding pattern may be placed under the information carrier and thus need not be transparent. Another advantage is that there is no position-coding pattern in the partial images of the information that need to be filtered out.
• Fig. 7 shows an embodiment according to which information can be recorded with different resolution.
• the sheet 70 in Fig. 7 has a large image recording area 71 covered by a position-coding pattern like in Fig. 1 (for ease of illustration, the coding pattern is only showed by some dots) , and two small resolution- indicating boxes 72,73, which are also covered by a position-coding pattern.
• the pattern in the boxes codes specific co- ordinates, which have been dedicated for the indication of different degrees of resolution.
• the user wants to record information with a 100 dpi resolution he puts the recording device in box 71.
• the device recognises the co-ordinates coded by the pattern in box 71 as indicating a resolution of 100 dpi and then carries out the recording with this resolution.
• Fig. 8 shows schematically an alternative embodiment of the device for recording information, where the sensor for recording partial images is accomodated in a first casing 80 and the image-processing means are accomodated in a second casing 81.
• the first casing can be the same as that shown in Fig. 4 and include substantially the same components.
• the recorded partial images are not processed in the first casing 80 but transferred to the second casing 81, e.g. a stationary personal computer which has image-processing means 82, schematically shown with broken lines, for carrying out the processing of the recorded partial images.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Image Processing (AREA)
• Editing Of Facsimile Originals (AREA)
• Facsimile Scanning Arrangements (AREA)
• Image Input (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)
• Compression Of Band Width Or Redundancy In Fax (AREA)

Priority Applications (9)

Applications Claiming Priority (4)

Publications (1)

Family

ID=26663604

Family Applications (1)

Country Status (12)

Cited By (36)

Families Citing this family (6)

Citations (2)

• 2000
  • 2000-06-28 CN CN00809739A patent/CN1359587A/zh active Pending
  • 2000-06-28 EP EP00946659A patent/EP1197065A1/en not_active Withdrawn
  • 2000-06-28 KR KR1020017016798A patent/KR20020033111A/ko not_active Application Discontinuation
  • 2000-06-28 JP JP2001506218A patent/JP2003503905A/ja not_active Withdrawn
  • 2000-06-28 MX MXPA02000110A patent/MXPA02000110A/es not_active Application Discontinuation
  • 2000-06-28 CA CA002377187A patent/CA2377187A1/en not_active Abandoned
  • 2000-06-28 AU AU60384/00A patent/AU752626B2/en not_active Ceased
  • 2000-06-28 RU RU2002101922/09A patent/RU2002101922A/ru not_active Application Discontinuation
  • 2000-06-28 WO PCT/SE2000/001367 patent/WO2001001670A1/en not_active Application Discontinuation
  • 2000-06-28 BR BR0011955-5A patent/BR0011955A/pt not_active Application Discontinuation
  • 2000-09-04 TW TW089118038A patent/TW492242B/zh active
• 2003
  • 2003-01-17 HK HK03100438.7A patent/HK1048216A1/zh unknown

Patent Citations (2)

Also Published As

Similar Documents

Legal Events