TWI401607B - Coding and decoding methods and apparatuses - Google Patents

Description

Coding and decoding method and device Cross-references for related applications

This application claims the benefit of the Swedish Patent Application No. 0501400-6, filed on Jun. 17, 2005, and the U.S. Provisional Patent Application No. 60-691,233, filed on Jun. 17, 2005. All of them are incorporated herein by reference.

Field of invention

The present invention is generally related to the encoding and decoding of information, and more particularly to the encoding and decoding of a combined information and location code, which enables the recording of electronic records of the stroke and the simultaneous recording of further information to be used, for example. The handling of these pen attacks.

Background of the invention

Information management systems for managing handwritten information are known; see, for example, US 2003/0061188, US 2003/046256, and US 2002/0091711. In these systems, an electronic pen records a pen stroke that acts on a base that is provided with a position code that encodes a plurality of absolute positions of the base. The pen records the strokes by imaging the position code at the tip of the pen and decoding the encoded positions to obtain a series of positions reflecting the movement of the pen.

The position code on each base is a much larger subset of the abstract position code. Thus, different subsets of the entire position code can be provided on different bases. Similarly, different processing rules can be made different from the location code. The set is associated, thereby creating an information management system in which the processing of the recorded information is determined by which base the information is recorded from.

The position codes proposed in the above information management system contain a very large number of simple symbols that are substantially similar in appearance. The location code does not contain any information about the processing of such recorded pen strokes, it specifically encodes location information. This method is useful from the standpoint of elasticity and printability. However, it may require other units in the system that have processing and routing information about different subsets of the entire location code, and these units are available when needed. Alternatively, a user may need to provide processing and routing information.

In an information management system of the type mentioned above, the pen can store sub-divided information about the entire location code and processing rules associated with different subsets of the location code. In addition, an intermediate server to which the information recorded by the pen is transmitted may have a database that connects a subset of the location codes with addresses to different application servers, wherein the application servers may be recorded differently. The intended recipient of the stroke of the base. Finally, the different application servers can store information about the different bases so that they process the received information in a desired manner.

In some cases, it may be best if the processing and/or routing information can be embedded in the base so that other portions of the system do not need to store this information.

U.S. Patent No. 6,864,880 discloses a product having a writing area provided with a position code pattern for recording handwritten information and a address area having a position code pattern of a position at which the handwritten information is to be sent.

US 2003/0066896 discloses that by changing the code for further The second independent parameter of the tokens of the step information may encode the further information with a location code comprising a plurality of tokens having a first parameter that is changed for encoding the location information. The first parameter can be, for example, the location of the token and the second parameter can be the size of the token. The location code is divided into units for encoding the further information, wherein each unit contains a predetermined number of tokens, and the suggested unit size is 2 * 2 tokens. With this unit size, the pen will always see at least one complete unit in its field of view. However, this unit size may not be sufficient to encode, for example, exhaustive processing and/or routing information. For example, the fourth edition of the Internet Protocol utilizes a 32-bit addressing structure. Yet another disadvantage may be that the system needs to add an algorithm that detects the second independent parameter that is used to encode the further information.

Summary of invention

It is an object of the present invention to overcome, in whole or in part, one or more of the problems identified above.

This object is achieved by a method and apparatus for generating a combined code according to items 1 and 10 of the patent application scope, respectively, and for decoding a combined code according to items 11 and 18 of the patent application scope, respectively. A method and apparatus, and a method and apparatus for decoding a combined code according to items 19 and 21 of the patent application, respectively.

According to one aspect of the invention, a method for generating a combined position and information code to be applied to a base includes the step of generating an electronic representation of a position code, the position code comprising a plurality of coding marks and Encoding a plurality of locations, wherein each location is encoded by a first predetermined number a step of encoding, defining a group of coded tokens in the location code, wherein each group includes a greater number of coded tokens than the predetermined number of coded tokens, and at least some of the coded tokens by using each group The coded token is a step of encoding a message item with the group of coded tokens.

The method is based on comprehending that the pen does not need to see all the coding symbols to be used to encode an information item in its field of view. As long as the user of the pen completes his or her writing on the base, the pen has seen all the coding marks. Thus, for example, if the information item is repeatedly encoded on the base by the method in which the pen sees some of the information item coding marks in its field of view and the pen moves on the base, the pen will eventually I see all the coded tokens that encode the information item and can then decode it.

The information item contains two or more elements. By the time the pen is written on the base, the possibility that the pen will see all of the information item elements can be in the order of the coded token groups by differently encoding the elements in different groups. And increase. For example, a predetermined replacement rule can be used to replace information items between consecutive groups. Other schemes for changing the encoding of such information elements in different groups are also conceivable.

The method for generating the combined code may be part of a method for providing a base intended to be used with a digital pen for electronic recording and pen stroke processing.

According to another aspect of the present invention, an apparatus for generating a combined position and information code to be applied to a base includes an encoding module having the following components: an electronic representation for generating a position code a member of the state, wherein the location code includes a plurality of coded symbols and encodes a plurality of locations, and each location is encoded by a predetermined number of coded tokens for defining a component of the group of coded tokens in the location code, wherein Each group includes a greater number of coded tokens than the predetermined number of coded tokens, and means for encoding an information item with the at least some of the coded tokens of each group by using the coded tokens.

The device can be a general purpose computer or server, a printer, or any other suitably suitable device having a coding module implemented in software, firmware, hardware, or any combination thereof. The resulting components, defined components, and coded components can each be implemented, for example, by a set of instructions executed by a processor or an appropriately suitable hardware circuit.

According to still another aspect of the present invention, a method for decoding a combined position and an information code comprising a plurality of coded symbols encodes a plurality of locations, wherein each location is encoded by a predetermined number of coded symbols and an information item. The method includes the steps of: receiving a series of electronic representations of different portions of the combined code, wherein each representation includes at least the predetermined number of encoded tokens, but only one of the encoded tokens encoding the information item The set determines a location from each of the electronic representations and decodes the information item using at least two coded tokens from the electronic representations.

In this decoding process, each electronic representation then results in a location, and obtaining the information item requires two or more electronic representations. The electronic representation can be any suitable electronic representation of a portion of the combined code. For example, it can correspond to one of the parts of the combined code. Process image or how many versions of the image content have been processed.

According to still another aspect of the present invention, an apparatus for decoding a combined location and an information code, wherein the combined location and information code includes a plurality of coded symbols encoding a plurality of locations and each location is encoded by a predetermined number The symbol and an information item are encoded, and include a decoding module having the following components: a component for receiving a plurality of electronic representations of different portions of the combined code, wherein each representation includes at least the predetermined a number of coded tokens but only a subset of the coded symbols encoding the information item, means for determining a position from each of the electronic representations, and for utilizing from the electronic representations At least two coding tokens in the type to decode the components of the information item.

The device can be any general purpose computer or server, a printer, or any other suitably suitable device having a coding module implemented in software, firmware, hardware, or any combination thereof. The determined components and the encoded components can each be implemented by a set of instructions executed by a processor or a suitably suitable hardware circuit. The receiving component can be an interface to one of the internal or external modules or devices.

According to still another aspect of the present invention, a method for generating a combined position and information code to be applied to a base includes the steps of: generating an electronic representation of a position code encoding one of a plurality of locations, wherein Each location is encoded by a first predetermined number of coded symbols, and an electronic representation of an information code is overlaid on the location code to generate the combined code, wherein the information code is utilized by utilizing the second predetermined a quantity of coded tokens to encode at least one information item, and wherein the location code and the information item Both are encoded by removing the coding symbols from respective nominal positions defined by a grid.

The combined code can be perceived by the user to have and use two separate parameters to encode a more homogeneous appearance of the information item compared to the locations.

The last mentioned method can be implemented in a device comprising an encoding module having one of the components for performing the different steps of the method. The device can be a general purpose computer or server, a printer, or any other suitably suitable device having a coding module implemented in software, firmware, hardware, or any combination thereof. The resulting components and the overlying components can each be implemented, for example, by a set of instructions executed by a processor or an appropriately suitable hardware circuit.

According to still another aspect of the present invention, a method for decoding a combined position and information code includes the steps of: receiving an electronic representation of the combined position and a portion of the information code, and localizing the electronic representation a step of causing at least one position-coding mark of a position code, determining a direction of displacement to be removed from a nominal position of the at least one position-coded mark, localizing the code of the information item in the electronic form At least one information encoding symbol and a displacement amount that is determined to be removed from a nominal position of the at least one information encoding symbol.

The decoding method can be implemented in a device that includes a decoding module having means for performing the steps of the decoding method. The device can be any general purpose computer or server, a printer, a digital pen or any other suitably suitable device having a coding module implemented in software, firmware, hardware or any combination thereof. Localized components and determined components For example, each may be implemented by a processor or a particular suitable hardware circuit executing a set of instructions. The means for receiving may be an interface to a module or device, either internal or external.

Simple illustration

The invention will now be described in more detail by way of example, with reference to the accompanying drawings.

1 is a pictorial overview of a system in which the present invention may be used; FIG. 2 is a diagram of an embodiment of an information code; and FIG. 3 is a diagram showing an encoding symbol in an embodiment of a position code. Four different positions; FIG. 4 is a diagram of an embodiment of a portion of a position code; FIG. 5 is a diagram showing an example of different displacements of the coded symbols in an embodiment of a combined code; An example of a unit of a combined code is illustrated; Figure 7 is an illustration of how an element of an information item can be altered in one embodiment of a combined code; and an overview of Figure 8 can be used to record and decode a combined code One of the examples of a digital pen.

Detailed description of the preferred embodiment

Figure 1 shows an example of a system in which a base of a combined code can be used.

Suppose a person X has generated a file stored in a memory of his computer 10, X requires a person Y to review the contents of the file, and X prints the file 1 using a printer 2, wherein the base can be adapted to any Printed material production. A position code 3, a portion of which is shown in an enlarged form in the figure, is overlaid on the contents of the file in the printing process. The position code 3 enables Y to electronically record the annotation 4 made by him using a digital pen 5 that records the position code on the document.

It would be helpful if the annotation of pen 5 stored in Y can be transmitted back to X's computer 10 and incorporated into the original file for X review. To achieve this, another unit of the pen 5 or Y pen of Y that wants to convert the electronic record annotation 4 needs to know the address to which the annotations are to be sent. One way to solve this problem would be to have an intermediate server that stores the association between the location encoded by the location code 3 on the X file and the network address of the X computer. However, this solution requires that the intermediate server be available and has been informed about what subset of the location code has been printed on the X file and the address to which the annotations are to be sent.

Another method would be to print an indication of the network address of the X computer to a separate range on the file so that it can be recorded by the pen of Y. The network address can be encoded or printed in clear form.

A more flexible solution would be to overlay the information code encoding the desired address information on the location code 3 on the file printed on X. In this method, Y's pen 5 captures the address information and simultaneously records the annotations 4 and uses it to directly use pre-existing general communication concepts like e-mail, SMS, fax, HTTP or FTP. The annotations are sent to X's computer 10 via, for example, a network 6, such as the Internet or a public telecommunications system.

The system shown in Figure 1 is merely an example of a system in which the concept of embedding explicit address or routing information in a base can be beneficial. This overview Many other applications and variations of the mind can be imagined.

Figure 2 illustrates some of the basic principles of an exemplary code that can be overlaid or integrated with or embedded in a base, such as position code 3 on file 1 of X, to create a combined code. The information code may be formed by a plurality of cells 6 laid on the surface of a base 1, such as paper, with the known size of the cells, which may have a fixed position relative to the location code (not shown in Figure 2). And, by the location code, the cell coordinates of the current cell as seen by the digital pen moving on the combined code can be determined. Each unit can encode the same piece of information with multiple code symbols in each unit. Each unit can therefore encode an instance of the information item, wherein the information item can be composed of several information elements. In the example shown in FIG. 2, in the units 6, the information item is composed of 12 elements numbered 1-12, wherein each element can be encoded by one or more coded symbols or symbols. The information item may, for example, be composed of two-bit data, wherein each bit is encoded by one of the code symbols, and thus each information item element may represent one or more data bits.

Once the current position of the pen has been determined using the position code, the unit size can be used to determine the unit currently seen by the pen. Similarly, the number of coded symbols for each information item and the number of elements of the corresponding information item can be determined by using the location code, the size of the unit, and information about how the information item is encoded by the coded symbols.

A user can act on one or more of the pen strokes 7 on the file 1 to record a stroke based on a series of spatially and temporally related locations. For example, the pen can be provided with a contact detector that detects when the pen is dropped The base and subsequent when it is lifted from the base. The position recorded between a "pen down pen" and the next "pen up pen" can be defined as a pen stroke.

While a stroke 7 is being produced, the digital pen typically moves through some of the cells 6. The field of view of the pen is used to record a complete information code unit in a single image for the pen, which may not be large enough. In the example of Figure 2, during a stroke 7, each image 8 captured by the pen will contain only a few information elements. But as the pen moves, a further image 8 containing the different information elements in the different cells will be captured, and finally all elements 1-12 of the information item will be recorded. The pen can then use information about the elements collected from the different units to decode the information item that is repeatedly encoded by the units of the information code.

The information items encoded by the units of the information code may be any information that can be encoded by the available information space in a unit, which may be non-location data. For example, it can be an address indication, such as an email address of one of the creators of a file or a URL to which a file is to be transferred; or information about the layout of the base that facilitates reception from the Basic information to properly process the application of the information; or decrypt information, such as a decryption key, which can be used to decrypt a pen record recorded from the base; or an access information item that can be used to limit The base uses some pens.

The location code overlaid on the information code can be any kind of location code that encodes the absolute location on a surface. Each location may be encoded by a single symbol, depending on the number of locations encoded by the location code, which may be quite complex. Or yes, each location can be compared by two or more Uncomplicated symbol encoding, when each symbol encodes only one or two possible values, the simplest symbol can be used on the position code. In this case, the symbol only has to have two identifiable states.

Likewise, the location code can be laid on the base such that each location is encoded with one or more symbols dedicated to encoding that location. Alternatively, the location code can be "floating" such that a portion of any predetermined size of the location code defines a location. In this case, at least some of the symbols used to encode a location also contribute to the encoding of the other location.

The following is an illustration of a particular location code that can be used for a combined code that encodes both a location indication and one or more recurring information segments. The location code is described in the U.S. Patent No. 6,667,695, the disclosure of which is hereby incorporated by reference in its entirety in its entirety in its entirety.

The position code is based on a sequence of numbers, which is referred to below as a sequence of differences having a characteristic that if a person takes an arbitrary partial sequence of a predetermined length, for example, having 5 differences A portion of the sequence, the partial sequence always has a well-defined position in the difference sequence. In other words, it appears only once in the sequence of differences and can therefore be used for position determination. A sequence with this property is sometimes referred to as a DeBruijn sequence. More specifically, the difference sequence "travels" along the x-axis and the y-axis of the position code.

As the actual position code applied to a base is comprised of simple graphical symbols or indicia 22, the indicia 22 may appear to present four different values, 0-3, relative to a nominal position 23 or individual position of the raster point. As seen in Figure 3, Each symbol 22 has a point shape and is moved a distance 24 in one of four different directions relative to the nominal position 23. The nominal position 23 is at the intersection between the raster lines 21 of a visible or invisible or virtual grating or grid. The value encoded by the symbol is determined by the direction of the displacement, and each symbol value 0-3 can be converted to a bit used to encode an x coordinate and a bit used to encode a y coordinate. That is, it is converted into bit pairs (0, 0), (0, 1), (1, 0) and (1, 1). Thus, the encoding is done separately in the x direction and in the y direction, but the graphics encoding is achieved by a symbol common to the x and y bits.

It should be mentioned that the code can be exemplified as follows:

The distance 24 is preferably not less than about 1/8 of the distance between two adjacent grating lines 21, or greater than about 1/4 of the distance between two adjacent grating lines 21, and the distance 24 is preferably about 1/ 6 The distance between two adjacent grating lines 21.

Each location is encoded with 6 * 6 symbols, which can thus be converted into a 6 * 6 bit matrix for an x coordinate for that location and a 6 * 6 bit matrix for a y coordinate. If the x-bit matrix is considered, the matrix can be divided into six rows of six bits each. Each of the bit sequences in a row constitutes a portion of a sequence of a 63-bit long circular main sequence of numbers having the following characteristics: if a portion of the sequence having a length of six bits is selected, Then it has a well-defined position in the main sequence of numbers. The six lines can then be converted into six position numbers or sequence values, Corresponds to six positions in the main sequence of numbers. Between these six position numbers, five differences can be formed in the form of adjacent pairs, which form a partial sequence of the difference sequence, and thus have an unambiguous decision in the difference sequence The position, and therefore the position determined explicitly along one of the x-axes. For a given x coordinate, the position numbers change with the y coordinate. On the other hand, the differences will be equally irrelevant to the y-coordinate, since the position numbers are always changed according to the main sequence of numbers, wherein the main sequence of numbers periodically is in the entire position-coding form. Repeat in the line.

Correspondingly, the six columns in the y-bit matrix define six position numbers in the main sequence of numbers, and the six position numbers define five differences, and the five differences constitute a partial sequence of the difference sequence. And therefore it has a well-defined position along the y-axis.

Figure 4 shows a very small portion of the above specific location code in 4*4 symbols. These raster lines 21 are shown in the drawings for illustrative purposes only. In general, the raster is virtual.

When a digital pen is used for the position code, it captures an image of a different portion of the position code. The images may contain more than 6 * 6 symbols, so if the image can see a larger number of symbols, the location code can be decoded according to a different set of 6 * 6 symbols. The surrounding symbols can also be used for this decoding, especially for error detection and/or correction. It should be noted, however, that even though the field of view of the pen contains a larger number of symbols than is absolutely necessary to decode a position, the number of useful symbols in the recorded image may be considerably smaller due to, for example, image distortion. .

The above exemplary position code is of the so-called "floating type", which means that a predetermined number of symbols are included, where any 6*6 symbols, any arbitrary partial area will define a position, and at least some of the arbitrary partial areas These symbols contribute to the encoding of more than one location. Differently stated, if the arbitrary partial area is moved by a symbol distance by up, down, left or right, a new position will be defined by the symbols in any partial area thus moved. Thus, for each coded symbol in the position-coding form, a unique x, y coordinate can be determined.

The exemplary position code described above is capable of encoding a very large number of unique absolute positions, which can be considered to collectively define a large virtual surface; the positions encoded on a base are locations on the virtual surface, and the position coordinates The origin is the origin of the virtual surface.

The virtual face or the entire position code can be logically subdivided into pages of different sizes. Any unit having knowledge of the virtual surface, such as a digital pen or a computer, can thereby convert a record from a position on a virtual surface of a base to an indication of the corresponding page and a local location on the page .

Likewise, different bases can be provided with different subsets of the entire position code.

It should be emphasized that the above location code is just an example. Other types of position codes, such as position codes that encode fewer locations and have an origin on the base, can be used similarly to produce a combined code.

Next, an embodiment of an information code will be described in detail with reference to FIGS. 5 to 7.

Generally, an information code can be overlaid on the location code by one of the following conditions, wherein the information is superimposed on the location code, the information is the same The symbol code of the position code used for the coding position; or the position code is inserted, in which case the position code and the information code respectively use individual symbols for encoding the position and the information. The combination of insertion and superposition is equally conceivable. In that case, some of the combined codes are used for position encoding and information encoding, while some are only used for position encoding, and some are only used for information encoding.

An information code can be overlaid on the entire length of the position code on the base, or only part of its length.

An information code and a position code can be coded differently or consistently on a base. If individual symbols are used for the location code and the information code, such as when the codes are inserted, the information symbol symbols and the graphical representations of the position code symbols can be completed independently of each other. The codes of both may use the same graphical parameters, such as points of different sizes, to encode different values of the symbols; or the codes may use different parameters. The information code can, for example, use differently rotated diagonal lines to encode different values, while the position code can use points of different shapes to encode different values.

If the information code shares some symbols with the location code, one or more parameters of the symbols may be used to encode the information code value and the location code value. Alternatively, different parameters can be used. In the first case, different combinations of a position code value and an information code value may be encoded, for example, by different sizes of the symbols or displacements of the symbols in different directions. In the second case, the position code value can be encoded, for example, in a direction of displacement of a point, and the information code can be encoded by a different color or color intensity of the point.

The symbols of a combined location and information code can be divided according to predetermined rules In several groups. Each group may contain a predetermined number of symbols belonging to the location code and a predetermined number of symbols belonging to the information code. The groups may be formed in any understandable manner provided that there is a way of calculating the position of the symbol, i.e., the position determined by the position code on a base, in association with a particular coded symbol of the information code. For example, the symbols can be divided into units that are laid on the combined code, as in Figure 2. A unit can be defined as a coordination area in the combined code, wherein all information encoding symbols encode information items for the same occasion. The size and shape of the units can vary from base to base and depend on the piece of information to be encoded in the information code. The groups may, for example, contain 32, 64, 128, 256 or 1024 symbols belonging to the information code.

As an option for calculating the manner in which the symbol position is associated with a particular coded symbol of the information code, the units may be graphically marked on the base, for example by additional markings on the base, or by A particular feature belonging to the location code and/or the symbol of the information code such that the boundaries of the cells are visually detectable.

As indicated above, each symbol group can contain a greater number of symbols than the pen can see in its field of view.

All groups can encode the same information item, or it may be a small number of different information items. In the latter case, a decoding device capable of distinguishing which groups encode the first information item, which groups encode the second information item, and the like is required.

The following is an example of a specific implementation of a combination code applied to a base, such as a paper, with reference to Figure 5, which shows a combination A small part of the code. In Fig. 5, all the symbols 22 are used for the position encoding because they belong to the position code. Moreover, they are more fully offset from one of the four directions from an individual nominal position 23 defined by an intersection of the grating lines or grid lines 21.

The information code is overlaid on the location code such that the information code is also used to encode the location symbol. In this example, every other symbol (eg, x+y modulo 2≡0) of the position code from the upper left corner is used on the information code. In Fig. 5, point 22i belongs to both the information code and the position code, and point 22p belongs only to the position code. The locations are encoded with a change in the direction of displacement of the coded symbols belonging to the location code, the magnitude of the displacement 24p being the same in all four directions. The information item is encoded with a change in the length of the coded symbol shift belonging to the information code. In this example, each information encoding symbol is offset from the nominal position by a normal distance 24p to encode a "0", or from the nominal position by twice the normal distance 24i to encode a "1."

Figure 6 is a schematic diagram showing an example of a unit of a combined code, the unit of Figure 6 containing 16*16 coded symbols of the position code, wherein every other symbol is used to encode information, as in the example of Figure 5. Each block in Figure 6 corresponds to a coded symbol of the location code, and the numbered blocks correspond to the coded symbols also belonging to the information code. In this case, the information item can be composed of up to 128 bits of data, and each bit is encoded with an information encoding symbol. More generally, an information item can be composed of a plurality of information item elements, each of which can be encoded by one or more coded symbols.

Some symbols can be used for error correction, using, for example, an industry standard binary BCH code, such as BCH (127, 99, 9), which means that 127 bits are used for information encoding, of which 99 bits are used. The data and 28 of these bits are used for error correction so that it corrects for a four-bit error or an octet missing, leaving one bit unused. Other error correction structures are of course conceivable.

The sequence of information bits can be identical in all units of an information code. However, in order to increase the probability that all of the information item elements are captured during the recording of the pen on the base, the sequence can also be changed between units. A permutation function for the information bits 1...128 of Fig. 6 may have the form: P(xi, yi, bit_number) = permuted_bit_number where xi and yi are integers representing the coordinates of the unit, and bit_number Is an integer between 1-128 indicating the contiguous number of bits in the cell. Xi can be calculated as an integer part of x/xsize, where xsize is the unit size in the x direction represented by the number of symbols, and x is the x coordinate of the current coded symbol in the entire position code. Yi can be calculated in the same way as the integer part of y/ysize, where ysize is the unit size in the y direction represented by the number of symbols, and y is the y coordinate of the current coded symbol in the entire position code. Bit_number can be calculated as Bit_number=x mod xsize+C*y mod ysize, where C is a constant equal to the number of information item elements in the x direction, which in this example is 8. Permuted_bit_number will also be a number between 1 and 128 indicating the number of elements of the information item. Thus in this example, the function P is a one-to-one mapping of 1...128 to 1...128.

Skilled practitioners can conceive different functions P that derive more complex or less complex permutations of the sequence of information bits.

Figure 7 outlines the permutation resulting from the following permutation function: P(xi, yi, bit_number) = (bit_number + xi + yi) mod 128 +1

Figure 7 shows six exemplary information code units in which the unit coordinates of each unit are indicated inside each unit. As is apparent from Figure 7, the permutation function moves the sequence of information bits one step forward as moving a cell to the right or moving a cell down.

In the above example, 128 binary bits can be encoded into the information code unit. Thus, any kind of information, including any error corrections, that can be represented in 128 bits can be encoded into the exemplary information code unit of Figure 6. By using a larger portion of the coded symbols in the information code, for example, replacing every other coded symbol with each coded symbol, the information coding density can be increased without increasing the size of the unit. As an option or as a supplement, the size of the unit can be increased. However, this may result in more strokes being applied to the base before the information item is captured.

The above changes are merely intended to increase the likelihood that all elements of the information item will be seen during different types of strokes, and how the encoding of the information item can be changed between the units. Another type of change is not obtained by encoding a complete information item in each unit, but by missing one or more information item elements and/or encoding one or more in one or more units The element is obtained more than once. It is understood that these different methods of changing the encoding of an information item can also be used for combination codes, where the unit contains the same or less than the number required to encode a position code. Coding symbol.

Next, an example of how the combined code can be generated will be explained. In this example, it is assumed that the information item consists of 128 bits without any error correction, and the permutation function P is as indicated above.

A combined code can be generated in an encoding module in a device, which can include a processor of some suitable type, different types of memory, and other units typically used for data processing. The device can be a conventional computer, a printer, another standard device or a special purpose device. It can be a local or remote device for the user.

In a first step of generating the code, the encoding program of the encoding module produces a position code to be provided at the base. For this purpose, the encoding module can receive an indication of the size of the location code to be generated, such as the number of rows and columns included in the location code, and the coordinate region being used, for example from a particular x. The y coordinate pair begins as an input signal that can originate, for example, from a user or the system.

Based on the input, the encoding program can generate a matrix or another data structure representing all of the encoded symbols of the location code. It can then span all of the elements associated with a value in the matrix, which value indicates what graphical state the corresponding encoded symbol will have when applied to the base for encoding the relevant position. In this example, the value indicates the direction in which a symbol is to be replaced.

A more detailed example of how the substitution value of a coded symbol encoding a particular location can be calculated can be found in U.S. 6,667,695.

The output of the position code generating step may have the graphic state value The matrix is an example of an electronic representation of the location code. The location code data can be arranged into different data structures, such as a table.

In the next step, an information item can be input to the encoding module by the user or input to the encoding module from another part of the system. The information item can be, for example, static and made available to all files, which can vary depending on what subset of the location code is used, or it can be freely changed as determined by the user. The conversion of the information item data to the binary format and the calculation of the error correction bit can also be performed in this step.

The unit size may need to be defined before the coding of the information item begins. This can be achieved, for example, by a user selection or by an information item to be encoded. The unit size can also be predetermined and is identical for all combined codes produced by the associated encoding program.

In order to overlay the information code on the location code and encode the information item into the coded symbols of the location code, all points in the location code matrix can be looped by the coding procedure. More specifically, the encoding program can use a predetermined algorithm to determine which of the location codes should be used for the information code. In this example, the encoding program skips every other symbol in the position code matrix to make the information encoding using a Western chessboard, as explained above in relation to Figure 5.

For each of the information code symbols, the coordinates of the position code can be further used to calculate xi, yi and bit_number, as described above. The permutation function P(xi, yi, bit_number) can then be used to decide which information item element is to be encoded by the current information encoding symbol. If the binary value of the information item element is 1, the graphic state of the encoded symbol can be modified. A value to indicate that the offset should be twice as large as the offset used for position encoding. On the other hand, if the binary value of the information item element is 0, the graphical state value of the encoded symbol may not be modified to indicate that the normal offset is to be used when printing the encoded symbol. Thus, this step means that the unit is defined in the location code and the information item is encoded in the units. As a final step, a print archive can be generated from the graphical state matrix and the combined code printed on a base. The print file can also include instructions to the printer to print a document, a shape, an image, or any other type of information along with the combined code.

The combination code on the one hand and any other information on the other hand can be printed on the base using the same ink or different inks, wherein the ink for printing other information is transparent to the pen. When the same ink is used for the combined code and other information, if the other information is overlaid on the combined code, the combined code may be partially darkened, and in the decoding process, a special description of the fact may be necessary. be adopted.

It should be emphasized that the above description of the encoding program is for illustrative purposes only. Those skilled in the art will be able to contemplate other and/or more efficient procedures for implementing the combined code.

Similarly, the above examples relate to an example in which the information item is composed of binary data, and each information encoding symbol encodes one bit of information. Those skilled in the art can readily modify the above examples as an example in which each information item encodes a symbol encoding more than one bit of data, or modified into an instance in which the information item elements are encoded by more than one encoded symbol.

Before describing an example of a method for decoding the combined code, an example of a digital pen that can be used for recording and/or decoding of a combined code will be described. To this end, FIG. 8 schematically shows an embodiment of a digital pen 200. The pen 200 has a pen-shaped housing or a housing 202 defining a window or opening 204 through which images are recorded. The housing includes a photographic system, an electronic system, and a power supply.

The camera system 206 includes at least one illumination source, a lens configuration, and an optical image reader (not shown). The light source, which is preferably a light emitting diode (LED) or a laser diode, illuminates a portion of the area that can be viewed via the window 204 using infrared radiation. An image of the viewing area is projected onto the image reader using the lens configuration. The image reader can be a two-dimensional CCD or CMOS detector that is triggered to capture an image at a fixed rate of about 70-100 Hz on a flexible, suitable or typical. Alternatively, the sensor can include an array of magnetic detectors for detecting the magnetic properties of the symbols. Moreover, the sensor can be designed to form any image of the chemical, audible, capacitive or inductive properties of the symbols.

The power supply of the digital pen is a battery 208, which may alternatively be replaced or supplemented by a primary power source (not shown).

The electronic system includes a control unit 210 coupled to a memory block 212, the control unit 210 being responsible for different functions in the pen, and by a commercial microprocessor, such as a CPU ("Central Processing Unit"), a DSP ("Digital Signal Processor") or some other programmable logic device, such as an FPGA ("Field Programmable Gate Array") or another ASIC ("Special Purpose Integrated Circuit"), Separated analog and digital components, Or some combination of the above, to be beneficially implemented. The memory block 212 preferably includes different types of memory, such as a working memory (e.g., a RAM) and a code, and a persistent storage memory (a non-volatile memory such as a flash memory). The associated software is stored in the memory block 212 and executed by the control unit 210. The software for decoding a combined information and location code can then be stored in memory block 212 and executed by control unit 210.

The shell 202 also has a tip 214 that allows the user to actually write or draw on the surface by a generally pigmented ink that is deposited on a surface. In order to avoid interference with photodetection in the electronic pen, the marking ink in the nib 214 is preferably transparent to the illuminated radius. A touch sensor 216 is operatively coupled to the nib 214 for detection when the pen is applied (pen down) and/or lifted (penned) and selectively considers the force application. Based on the output of the touch sensor 216, the camera system 206 is controlled to capture an image between a pen down and a pen.

The electronic system further includes a communication interface 218 for communicating data to a nearby or remote device, such as a computer, mobile phone, PDA, web server, and the like. The communication interface 218 can thus provide components for wired or wireless short range communication (eg, USB, RS232, radio transmission, infrared transmission, ultrasonic transmission, inductive coupling, etc.), and/or for wired or wireless telematics. The components are typically via a computer, telephone or satellite communication network.

The pen can also include an MMI (Human Machine Interface) that is selectively activated for user feedback. The MMI can include a display, an indicator light, and a Vibrator, a speaker, etc.

Still further, the pen can include one or more buttons 222 that can be utilized to activate and/or control it.

The pen 200 of the above embodiment is merely an example. Other digital pens having the above-described elements and/or some or all of the other elements and/or a subset of some or all of the other designs may be used to record a combined code. For example, a less complex digital pen can only record images and convert them to another device for further processing. In another embodiment, the digital pen can detect certain characteristics of the code, such as the location of the point and the conversion information of another device that is to be further processed for further processing.

Hereinafter, an exemplary embodiment of a method for decoding a combined code will be described with reference to the above-described digital pen 200 and the above-described exemplary combined code.

When the pen 200 is used on a base having a combined code, the contact sensor 216 detects when the tip is pressed against the base and triggers the camera system 206 to capture the combined code in its field of view. The image of the partial area continues to capture the image until the contact sensor 216 detects that the pen is lifted from the base. The continuous image captured by the photographic system 206 constitutes a series of electronic representations of different portions of the combined code.

The decoding of the combined code in a series of electronic representations can be done in one of the decoding modules of the electronic pen or from the decoding module of another device to which the pen is converted. The electronic representations can be converted in a captured form or in a more processed or less processed form. The decoding may be split between the digital pen and another device such that the digital pen performs a first portion of the decoding and the other device performs a second portion.

In a first step in the decoding process of the decoding module, a position is determined for an image captured by the pen. Decoding of a location code of the above exemplary type may include the steps of: localizing the coded symbols in the image, installing a raster to the coded symbols, and determining that the coded symbols are defined from intersections of the raster lines The displacements of the nominal positions are calculated based on the displacement of the coded symbols. For a more detailed description of one of the different steps of how this positional decoding can be achieved, reference is made, for example, to U.S. Patent No. 6,667,695 and U.S.A.

It should also be mentioned that these locations are not necessarily calculated by the location code. In order to establish a correlation position, it is also possible to match a representation of the coded symbol of the captured image with a representation of the position code in a particular region in which the pen is predicted, or by matching a received electronic representation. The coded symbols in the state and a previously received electronic representation form use the position code to determine a position.

When the locations of the coded symbols in an image have been determined and an x-y position of an encoded symbol in the image has been decoded, the portion of the information code seen in the image can be decoded. For this decoding, two buffers associated with the decoding module are used, each having the same size as the information item encoded in the information code, which in this example is 128 bits.

For each coded symbol in the image belonging to the message code, the following steps are completed:

1) Calculate the distance offs between the center of the coded symbol and the associated grid intersection.

2) Calculate the integer xi, the integer yi, and the integer bit_number in the same manner as described above.

3) Calculate the permuted_bit_number using P, xi, yi, and bit_number.

4) Update the accumulator buffer acc:acc[permuted_bit_number]+=offs with offs

5) Update the donation buffer with 1 con:acc[permuted_bit_number]+=1

Thus, the accumulator buffer accumulates the respective displacements of the different code elements of the information code, and the donor buffer tracks how many times a particular bit of the information code has been seen by the pen.

When all images have been processed as indicated above, the derived offsets are calculated for all information item elements: offset[n]=acc[n]/con[n], where n is between 1 and 128. An index between. If con has a value of 0 for any information item element, it means that the information item is missing from this element.

Alternatively, the donor buffer may be updated without a value of one, but with a value that reflects the observed reliability of the associated coded symbol of the information code. For example, coded symbols near the edge of an image may be given less weight because they are typically more affected by perspective distortion.

Then, a criticality is applied, and the bit value is specified accordingly: if offset[n]>threshold_value,than bit[n]=1 else bit[n]=0

If an error detection mechanism is used in encoding the combined code, the decoding program now also uses the same error detection mechanism to detect and correct errors and/or missing bits.

The processing of the above electronic representations derives a series of positions, During an episode of one or more strokes, i.e., an electronic representation of the movement of the pen on the base during one or more electronic pen strokes; it also derives a partially or fully decoded information item.

In a final step, the decoding program can associate the information item with the electronic strokes. As indicated above, each location obtained from the location code can be converted to a page indication on that page and a local location. A stroke can typically be represented as a one-page indication and a series of local locations, in which the pen can track which page a hit was written on. When a message item has been decoded, the decoding program can check if a message item has been decoded and is associated with the current page. If so, the decoding program can optionally check the bit alignment with the previously stored information item. The consistency of the yuan. If the bit data of the current information item is sufficiently similar to the bit data of the previous information item, the bit data for the different pen strokes may be collected. In this way, the possibility of correctly decoding the information item can be increased. Conversely, if the bit information of the decoded information items is completely different, this may indicate that two different pages have been written and the decoding program may take appropriate action.

Sometimes you may want to use a combination of codes on a multi-page file. If the decoding program has the possibility of verifying that a stroke on a different page of a multi-page file belongs to the same file having the same information code on all pages, then it can utilize this fact from the different pages. All of these strokes collect information about the information item and therefore increase the likelihood of correctly decoding the information item. For example, the decoder may use a file indicating that a particular cluster of pages may have not represented a separate file, but only information that appears in a multi-page file. The decoding procedure can also or alternatively be as indicated above The information bit data decoded from the pen hits from different pages is compared, and the assumption of the connected page is made according to the similarity of the data.

Similarly, the decoding program may take information about the unit size for the information code on a particular page; or the decoding program may perform decoding for different unit sizes in parallel. When the information bits collected from different strokes are compared, it will quickly be apparent which unit size is being used for encoding.

In the following, some further examples of information items that the combined code can include can be provided.

A digital pen typically has an identity code stored in its memory that can be encoded as an information item on a base to limit the use of the base. The digital pen may include hardware and/or software for checking an identity code decoded from a combined code on a base, and if the identity code on the base corresponds to the identity code of the pen, the pen only allows recording The storage or output of a stroke from the same base. In this method, the use of a particular base can be limited to a particular pen; or, the use of a base can be limited to a group of digital pens, in which case the pens in the group can store a group of identities, It is encoded at the base to limit the use of the base for this particular group of pens. Alternatively, in order to generate appropriate information items for a combined code to be included on the base, the individual identity codes of the pens in the group may be processed by, for example, a mathematical algorithm. For example, the individual identity codes can be hashed together such that the base outside the intended pen group cannot be used. The identity code of the pen (whether the individual identity code or a group identity code) can be stored in a computer that generates the combination code to be printed on a base Up, or from the pen, for example, when it is placed on a station connected to the computer, retrieved from the pen, or retrieved from any other suitable source connected to the combination code.

In one embodiment, the information item may contain information about an MMI model for use at the current base. For example, the digital pen can store different MMI models, which can be used on different parts of a location code, for example, on different pages, and the information item can indicate which of these MMI models to use. One. For example, an MMI model can, for example, specify a different visual, audible, and/or tactile feedback that the pen is to be given in different situations when recording a predetermined set of coordinates. In one embodiment, for example, when a group of labels associated with a transfer command is detected, a first MMI model specifies that the pen should be given visual feedback by an LED, and conversely, a second MMI model It can be specified that the pen should vibrate under the same conditions.

In another embodiment, the information item includes an indication of how the pen handles the recorded stroke. For example, the information item may indicate that the pen is to store the pen strokes until the user causes the pen to send them to an external unit; or the pen is to automatically and how many of the pen strokes are immediately flown to An external unit. Or other information item may be an address indication indicating which unit the pen stroke is to be sent to; or a routing indication indicating which device the pen is to be routed via, for example, via an action Phone or a PC. The address indication and the routing indication are provided based on a selection made by the user regarding the printing of the file.

In a still further embodiment, the information item can include material to be used by the pen or another suitable device when processing the strokes, or A reference to an algorithm to be used by the pen or another suitable device when processing the strokes. For example, the material may include a melody or tune to be played by the device to be received from the pen, or information about the number of pages of the current page in a multi-page file, or the identity of a file and its number of pages , or the correct answer to the question printed on the file. The information contained in the information item may be selected or specified by a user associated with the printing of the document, and the information may also include a reference to an application or material stored, for example, in the pen or elsewhere.

It has been pointed out in the description of the above exemplary embodiments that the position code can use coded symbols that are moved from the nominal position in different directions to encode the position and can be moved from the nominal positions to one by Different lengths (eg, single or double offsets) are used to encode an information item with the location code. It should be noted that this concept can be used independently of the size of the unit. Thus, the units may contain a larger or smaller number or the same number of coded symbols as used to determine a location. The concept can also be independent of the shape, size or other parameters of the appearance of the encoded symbols, and independent of the number of directions in which the encoded marks can be removed from the nominal positions, and independent of which direction. The data may also be encoded with the code code by placing the coded symbols at more than two different distances from the nominal locations. In this way, more information can be encoded in the information project. In one embodiment, the coded mark is shifted by a first distance in one of a predetermined number of different directions to encode the position, and then the positions of some of the marks are corrected such that they are removed by a second or a first Three distances to encode the information item, wherein the different distances do not need to be multiples of each other. In another embodiment, some The code marks are encoded by shifting a first distance in one of the first predetermined number of directions, and the other code marks are moved by a second or a direction in one of the second predetermined number of directions The third distance encodes a value, wherein the first and second distances may be the same or different. The notion that the code marks are removed in different directions and moved to a different length may also be used in which one code has more than one code mark associated with each nominal position, and/or some of the marks are placed in each of them. Other nominal locations. This concept can also be used with a position code to increase the number of positions.

1‧‧ ‧ documents

2‧‧‧Printer

3‧‧‧Location Code

4‧‧‧Notes

5‧‧‧ digital pen

6‧‧‧Network/Unit

7‧‧‧ pen hit

8‧‧‧ images

10‧‧‧ computer

21‧‧‧ raster lines

22‧‧‧ symbol/symbol

22i, 22p‧‧ points

23‧‧‧ nominal position

24‧‧‧ distance

24i, 24p‧‧‧ displacement

200‧‧‧ digital pen

202‧‧‧ pen shell

204‧‧‧Window/opening

206‧‧‧Photography system

208‧‧‧Battery

210‧‧‧Control unit

212‧‧‧ memory block

214‧‧‧ nib

216‧‧‧Contact Sensor

218‧‧‧Communication interface

222‧‧‧ button

X, Y‧‧‧ people

1 is a pictorial overview of a system in which the present invention can be used; FIG. 2 is a diagram of an embodiment of an information code; and FIG. 3 is a diagram showing an encoding symbol in an embodiment of a position code. Figure 4 is an illustration of an embodiment of a portion of a position code; Figure 5 is an illustration of a different displacement of the coded symbols in an embodiment of a combined code; Figure 6 is an illustration of a An example of a unit of combined code; Figure 7 shows an example of how elements of an information item can be changed in one embodiment of a combined code; and Figure 8 shows an example of an element that can be used to record and decode a combination One example of a digital pen of code.

1‧‧ ‧ documents

2‧‧‧Printer

3‧‧‧Location Code

4‧‧‧Notes

5‧‧‧ digital pen

6‧‧‧Network/Unit

7‧‧‧ pen hit

8‧‧‧ images

10‧‧‧ computer

X, Y‧‧ people

Claims (28)

A method for generating a combined position and information code to be applied to a base, comprising the steps of: generating an electronic representation of a position code, the position code comprising a plurality of coding marks and encoding a plurality of positions, and Each location is encoded by a first predetermined number of coded tokens, defining a plurality of coded token groups in the location code, each group comprising a greater number of coded tokens than the predetermined number of coded tokens, and by An information item is encoded in the group of coded tokens using at least some of the coded tokens in each group of coded tokens. The method of claim 1, wherein the same information item is repeatedly encoded in the group of coded tokens. The method of claim 1 or 2, wherein the information item comprises a plurality of elements, and wherein at least two of the elements are encoded in each group, and the groups are encoded multiple times in common Each of these elements. The method of claim 1 or 2, wherein the information item comprises a plurality of elements, and wherein the elements encoded by at least two of the groups are different. The method of claim 1 or 2, wherein the information item comprises at least two elements, the order of the elements being differently encoded in at least two of the groups. The method of claim 5, wherein the order of the at least two elements is based on a predetermined replacement rule between consecutive groups change. The method of claim 1 or 2, wherein the information item comprises at least two elements, each of which is encoded by a coded symbol. The method of claim 1 or 2, wherein the location and the information item are both encoded by shifting the coded symbols from an individual nominal position defined by a grid. The method of claim 1 or 2, wherein the information item is one of an indication of an address item, a layout of the base, an encrypted item information, and an access information item. A device for generating a combined position and information code to be applied to a base, the device comprising an encoding module having: an electronic representation for generating a position code, wherein The location code includes a plurality of coding symbols and encodes a plurality of locations, and each location is encoded by a predetermined number of coding symbols for defining components of the plurality of coded token groups in the location code, wherein each group A code number containing a greater number of the predetermined number than the coded token, and means for encoding an information item in the group of coded tokens by using at least some of the coded tokens in each group of coded tokens. A method for decoding a combined location and information code, wherein the combined location and information code comprises a plurality of coding symbols encoding a plurality of locations and an information item, and each location is encoded by a predetermined number of coding symbols. The method includes the following steps: Receiving a series of electronic representations of the plurality of different portions of the combined code, wherein each representation includes at least the predetermined number of encoded tokens, but only a subset of the encoded tokens encodes the information item, Each of the isoelectronic representations defines a position to determine a position, and the plurality of coded symbols from the at least two of the electronic representations are used to decode the information item. The method of claim 11, wherein the information item comprises at least two elements, the method further comprising the steps of: identifying a corresponding information item for each of the coding symbols used to decode the information item element. The method of claim 12, further comprising the step of tracking the number of observations of each information item element when decoding the information item. The method of claim 12, wherein the information item is encoded by a predetermined plurality of coded token groups, and wherein the step of identifying the corresponding information item element comprises using the definition between the consecutive groups. A replacement rule for the replacement of the coded token. The method of claim 12, wherein the locations determined by the electronic representations are used in identifying the corresponding information item elements. The method of claim 11, wherein the determining a location and decoding the information item comprises determining that the coding symbols are to be moved from an individual nominal position defined by a grid. The amount of displacement that is open. The method of claim 11, 12 or 13, further comprising processing the positions of the pen strokes produced on a base, and processing the decoded information items for use as the stroke. The step of processing a parameter. An apparatus for decoding a combined location and an information code, wherein the combined location and information code includes a plurality of coding symbols encoding a plurality of locations and an information item, and each location is encoded by a predetermined number of coding symbols; The apparatus includes a decoding module, the encoding module having: a plurality of electronic representations for receiving a plurality of different portions of the combined code, wherein each representation includes at least the predetermined number of coding marks, But only a subset of the coded symbols encodes the information item for determining a positional component from each of the electronic representations and for utilizing at least two of the electronic components A number of coding symbols representing the type to decode the components of the information item. A method for generating a combined position and information code to be applied to a base, the method comprising the steps of: generating an electronic representation of a position code, wherein the position code encodes a plurality of positions, and each position is borrowed Encoded by a first predetermined number of coded symbols, an electronic representation of an information code overlaid on the location code to create the combined code, wherein the information code is encoded by using a second predetermined number of coded symbols At least one information item, and the location and the Both of the information items are encoded by shifting the coded symbols from the individual nominal positions defined by a grid. The method of claim 19, wherein the locations are encoded by shifting the coded symbols of the location code from different nominal locations defined by the grid in different directions, and The information item is encoded by shifting the coded symbols of the information code from a different nominal position defined by the grid. The method of claim 19, wherein the information code use is also used to encode the coded position. A device for generating a combined location and information code to be applied to a base, the device comprising an encoding module, the encoding module having: an electronic representation for generating one of a plurality of locations And a component, wherein each location is encoded by a first predetermined number of coding symbols for overlaying an electronic representation of an information code on the location code to create a component of the combination code, wherein the information code is At least one information item is encoded by utilizing a second predetermined number of coded tokens, wherein the location and the information item are both removed from the individual nominal locations defined by a grid by the coded symbols To code. The device of claim 22, wherein the location is encoded by removing the encoded symbols encoded in the different directions from respective nominal locations defined by the grid, and wherein the information is encoded The item is encoded by shifting the coded symbols of the information from a nominal position defined by the grid to a different degree. The apparatus of claim 22 or 23, wherein the information code usage is also used to encode the coded position. A method for decoding a combined location and an information code, comprising the steps of: receiving an electronic representation of the combined location and a portion of the information code, localizing at least one of the encodings of the electronic representation that facilitates a location a position coding symbol, determining a displacement direction from a nominal position of the at least one position coding symbol, localizing at least one information coding symbol in the electronic representation that causes encoding of an information item, and determining from at least A displacement of a nominal position of an information coding token to remove. The method of claim 25, wherein the information code usage is also used to encode the coded position. A device for decoding a combined position and an information code, the device comprising a decoding module, the decoding module having: an electronic representation for receiving the combined position and a part of the information code, for local Means constituting at least one position-coding symbol of the code that contributes to a position in the electronic representation, for determining a direction of displacement component to be removed from a nominal position of the at least one position-coded symbol, Means for localizing at least one information encoding symbol that facilitates encoding of an information item in the electronic representation, and a displacement for determining a nominal position to be removed from the at least one information encoding symbol The components. The apparatus of claim 27, wherein the information code usage is also used to encode a coded location.