JP2009181516A - Handwriting information creation device, program, and handwriting information management system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent such a situation that an external device cannot recognize written content to which handwriting information has been transmitted from a handwriting information creation device. <P>SOLUTION: In transmitting prescribed information acquired from a code image printed on a medium and/or handwriting information created from the code image to an external device by data group having a predetermined data length, an output management part 613 and a communication part 66 sets the order of transmission for each data group in prescribed information and/or handwriting information, and successively transmits the prescribed information and/or the handwriting information to the external device according to the order of transmission. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a handwriting information generation device, a program, and a handwriting information management system.

2. Description of the Related Art In recent years, attention has been paid to a technique in which characters, figures, and the like written on a medium such as paper are converted into electronic data, which is transferred to a personal computer, a mobile phone, etc., and the written contents are stored.
For example, in the technique described in Patent Document 1, characters written with a pen device using a medium on which code images of various patterns with fine dots are printed and a pen device having an image pickup device, for example, A code image at a position such as a figure is read into the image sensor. Thereby, the position coordinates of characters and figures are specified, and an electronic document composed of written characters and figures is generated, and characters and figures are added to a predetermined electronic document.
For example, in the technique described in Patent Document 2, a code image printed on a predetermined area on a medium is read by a pen device, for example, a command for instructing a computer to open a web browser program is created. Link to a predetermined web address.

JP 2004-94907 A Special table 2003-523572 gazette

Here, in general, a handwriting information generation device such as a pen device that reads a code image on a medium and generates handwriting information transmits handwriting information and the like to an external device such as a terminal device for managing the handwriting information and the like. . At that time, for example, when transmission of handwriting information or the like is delayed due to a decrease in communication speed with an external device that is a transmission destination, handwriting information or the like is accumulated in the handwriting information generation device. At this time, if the stored handwriting information or the like is transmitted in the writing order, a delay occurs in data processing when displaying on the external device side. For this reason, for example, it may be considered that handwriting information or the like has not been captured even though the user has performed a writing operation, and a problem such as writing twice may occur. Furthermore, also in the case of performing a link reference operation, if the reference information is transmitted after completion of transmission of the collected handwriting information or the like, the immediacy of the link is impaired, and the operability is significantly reduced.
An object of this invention is to suppress generation | occurrence | production of the situation where the content of writing cannot be recognized in the external apparatus to which handwriting information was transmitted from the handwriting information generation apparatus.

  The invention according to claim 1 is a code image reading unit that reads a code image printed on a medium, an information acquisition unit that acquires predetermined information from the code image read by the code image reading unit, Handwriting information generation means for generating handwriting information that is information related to a user's writing operation on the medium based on the predetermined information acquired by the information acquisition means; and the predetermined information acquired by the information acquisition means And / or transmitting means for transmitting the handwriting information generated by the handwriting information generating means to an external device in a data group unit having a predetermined data length, the transmitting means includes the predetermined information and The handwriting information is characterized in that a transmission order for each data group is set in the handwriting information, and the predetermined information and / or the handwriting information is transmitted in order according to the transmission order. A generating device.

The invention according to claim 2 is the handwriting information generating apparatus according to claim 1, wherein the transmission means sets the transmission order in association with the writing operation of the user.
According to a third aspect of the present invention, when the transmission unit transmits the predetermined information and / or the handwriting information to the external device as reference information for referring to specific information, the predetermined information and / or The handwriting information generating apparatus according to claim 1, wherein the transmission order of the handwriting information is set highest.
According to a fourth aspect of the present invention, the transmission means uses the transmission order of the handwriting information generated at the beginning and the end of the writing operation as the predetermined information and / or the handwriting information as the reference information. 4. The handwriting information generation apparatus according to claim 3, wherein the handwriting information generation apparatus is set lower than the transmission order when transmitting to an external apparatus.

According to a fifth aspect of the present invention, the transmission means determines the transmission order of the handwriting information generated at predetermined intervals in the writing operation from the transmission order acquired at the beginning and the end of the writing operation. The handwriting information generation apparatus according to claim 4, wherein the handwriting information generation apparatus is set to a low value.
According to a sixth aspect of the present invention, the information acquisition unit acquires the predetermined information in units of the data group and adds identification information for each data group, and the handwriting information generation unit includes the handwriting information. Generated in units of the data group and adds identification information for each data group, and the transmission means sets the transmission order in the predetermined information and / or the handwriting information based on the identification information The handwriting information generating apparatus according to claim 1.

  According to the seventh aspect of the present invention, the computer has a function of acquiring predetermined information from the code image read from the medium on which the code image is printed, and a user who accesses the medium based on the acquired predetermined information. Function for generating handwriting information, which is information related to the writing operation, and the predetermined information and / or the handwriting information for each data group when transmitting the handwriting information to an external device in a data group unit having a predetermined data length. A program for realizing a function of setting a transmission order and a function of transmitting the predetermined information and / or the handwriting information to the external device in order according to the transmission order.

The invention according to claim 8 is the program according to claim 7, wherein the function for setting the transmission order sets the transmission order in association with the writing operation of the user.
According to a ninth aspect of the present invention, the function for setting the transmission order is such that the predetermined information and / or the handwriting information is transmitted to the external device as reference information for referring to specific information. The program according to claim 7, wherein the highest transmission order of the information and / or the handwriting information is set.
According to a tenth aspect of the present invention, the function of setting the transmission order includes the transmission order of the handwriting information generated at the beginning and the end of the writing operation as the predetermined information and / or the handwriting information. The program according to claim 9, wherein the program is set lower than the transmission order when transmitting to the external device as reference information.
In the invention according to claim 11, the function of setting the transmission order is acquired at the beginning and the end of the writing operation of the transmission order of the handwriting information generated at predetermined intervals in the writing operation. 11. The program according to claim 10, wherein the program is set lower than the transmission order of the handwriting information.

  The invention according to claim 12 generates handwriting information that is information related to a user's writing operation on a medium on which a document image and a code image based on an electronic document are printed, and predetermined information is obtained from the code image. The handwriting information generation device to be acquired, the predetermined information and / or the handwriting information is acquired from the handwriting information generation device, and the acquired predetermined information and / or the handwriting information is printed on the medium or the medium A handwriting information management device that manages the handwriting information in association with the electronic document, and the handwriting information generation device is read by a code image reading unit that reads a code image printed on the medium and the code image reading unit. Information acquisition means for acquiring predetermined information from the code image, and a user's writing operation on the medium based on the predetermined information acquired by the information acquisition means Handwriting information generating means for generating handwritten information that is a report, and the predetermined information acquired by the information acquiring means and / or the handwriting information generated by the handwriting information generating means has a predetermined data length. Transmitting means for transmitting to the handwriting information management device in units of data groups, the transmitting means sets a transmission order for each data group in the predetermined information and / or the handwriting information, and sequentially according to the transmission order The handwriting information management system is characterized by transmitting the predetermined information and / or the handwriting information.

According to claim 1 of the present invention, compared to a case where the present invention is not adopted, it is possible to suppress the occurrence of a situation in which the written content cannot be recognized by the external device to which the handwriting information is transmitted.
According to claim 2 of the present invention, even when a part of the written content is not transmitted, at least an outline of the written content can be recognized by the external device to which the handwriting information is transmitted.
According to the third aspect of the present invention, even when the communication speed with the external device is reduced, the occurrence of a situation in which the purpose of referring to specific information in the user cannot be achieved compared to the case where the present invention is not adopted. Can be suppressed.
According to the fourth aspect of the present invention, the fact that writing has been performed can be transmitted to the external device even when the communication speed with the external device is reduced.
According to the fifth aspect of the present invention, the outline of the handwriting can be grasped by the external device to which the handwriting information has been transmitted even in the state where the communication speed with the external device is reduced.
According to the sixth aspect of the present invention, the operation mode in which the predetermined information and / or handwriting information is acquired / generated and the position on the handwriting can be grasped in units of data groups, and the data of the predetermined information and / or handwriting information It is possible to judge the importance in group units.

According to claim 7 of the present invention, compared to a case where the present invention is not adopted, it is possible to suppress the occurrence of a situation in which the written content cannot be recognized by the external device to which the handwriting information is transmitted.
According to claim 8 of the present invention, even when a part of the written content is not transmitted, at least an outline of the written content can be recognized by the external device to which the handwriting information is transmitted.
According to the ninth aspect of the present invention, even when the communication speed with the external device is lowered, compared to the case where the present invention is not adopted, the occurrence of a situation in which the purpose of referring to specific information in the user cannot be achieved. Can be suppressed.
According to claim 10 of the present invention, the fact that writing has been performed can be transmitted to the external device even in a state where the communication speed with the external device is reduced.
According to the eleventh aspect of the present invention, the outline of the handwriting can be grasped by the external device to which the handwriting information has been transmitted even in a state where the communication speed with the external device is reduced.
According to the twelfth aspect of the present invention, compared to the case where the present invention is not adopted, the handwritten information management device that manages the transmitted handwritten information in association with the electronic document printed on the medium or the medium is unclear. The occurrence of a situation where it is managed as irrelevant information can be suppressed.

The best mode for carrying out the present invention (hereinafter referred to as “embodiment”) will be described below in detail with reference to the accompanying drawings.
First, the overall configuration of the handwriting information management system in the present embodiment will be described.
FIG. 1 is a diagram showing an example of the configuration of the handwriting information management system of the present embodiment. As shown in FIG. 1, the handwriting information management system includes a terminal device 10, a document server 20 as an example of a handwriting information management device, an identification information server 30 as an example of a handwriting information management device, and an image forming apparatus. 40 and a terminal device 50 are connected to a network 80. In addition, a digital pen 60 as an example of a handwriting information generation device is connected to the terminal device 50 in a communicable manner.

In the handwriting information management system of the present embodiment, when a print request for an electronic document is made from the terminal device 10, the document server 20, which is an example of the handwriting information management device, receives the print request from the terminal device 10, and the image forming apparatus 40 is instructed to print the electronic document that is the target of the print request. Thereby, the image forming apparatus 40 prints the document image of the electronic document on a medium such as paper. At this time, the image forming apparatus 40 prints a code image on the medium in addition to the document image.
The code image here is an image of the identification code and the position code obtained by encoding the identification information and the position information. The identification information is information for uniquely identifying a medium, and is issued by the identification information server 30 which is an example of a handwriting information management apparatus in the present embodiment. The position information is information for specifying the coordinate position on the medium, and is generated by the document server 20 in the present embodiment.
Then, when the user writes (handwriting) on the medium on which the document image and the code image are printed using the digital pen 60 which is an example of a handwriting information generation device, the digital pen 60 is an example of information included in the code image. Handwritten information (handwriting information) is generated based on the positional information. At the same time, the digital pen 60 recognizes identification information that is an example of information included in the code image. The recognized identification information and handwriting information are sent to the document server 20 via the terminal device 50 which is an example of an external device. The document server 20 that has received the identification information and the handwriting information specifies the electronic document printed on the medium based on the identification information, and stores the specified electronic document and the handwriting information in association with each other.
In addition, the digital pen 60 is set with a function of using the position information and identification information included in the code image as reference information for linking to predetermined information instead of generating handwriting information. For example, the position information and the identification information are used as information for generating a command for opening a predetermined web browser program and linking the terminal device 50 to a predetermined web address or the like. In that case, the terminal device 50 links to a predetermined web address based on the position information and the identification information, and acquires the predetermined information.

In this specification, electronic data that is the basis of an image recorded on a medium is expressed as “electronic document”. However, this does not mean only data obtained by digitizing a “document” including text. For example, "electronic document" including image data (regardless of raster data or vector data) such as pictures, photographs, figures, etc., data recorded by database management software or spreadsheet software, and other printable electronic data It is said.
In the present specification, the “medium” may be any material as long as it can print an image. A typical example is paper, but it may be a plastic sheet such as an OHP sheet or a metal plate.
Furthermore, in this specification, processing is performed using identification information for uniquely identifying each of the electronic document, the medium, and the digital pen 60 and the user. It shall mean the identification information. That is, in the present embodiment, this identification information is used as an example of medium identification information uniquely given to the medium.

Then, each component which comprises the handwriting information management system of this Embodiment is demonstrated in detail.
The terminal device 10 is a computer device that requests the document server 20 to print an electronic document. Here, as the terminal device 10, for example, a personal computer, a workstation, or another computer is used.
The document server 20 is an example of a handwriting information management device, and is a computer device that stores and manages electronic documents. Also, when a request for printing an electronic document is received from the terminal device 10, an image of the electronic document and a code image representing identification information and position information are generated, and a print command for printing a composite image obtained by synthesizing the image on a medium is generated. Output to the forming apparatus 40. Here, as the document server 20, for example, a personal computer, a workstation, or another computer is used.

The identification information server 30 is an example of a handwriting information management device, and is a computer device that issues identification information to be given to a medium. The issued identification information is stored in association with the electronic document printed on the medium to which the identification information is assigned. Here, as the identification information server 30, for example, a personal computer, a workstation, or another computer is used.
The image forming apparatus 40 is an apparatus that prints an image on a medium and outputs it as a print document. The image forming apparatus 40 may be a single printer or printing machine, or may be a so-called “multifunction machine” having a scanner or a communication function. Here, as an image forming method in the image forming apparatus 40, for example, an electrophotographic method may be used, but other methods may be used.

The terminal device 50 transmits information obtained by digitizing writing on the print document (hereinafter referred to as “handwriting information”) to the identification information server 30 in order to reflect the information in the electronic document that is the basis of the image recorded in the print document. A computer device. Further, the electronic document to be reflected in the handwriting information may be displayed on a display unit (not shown) such as a display, and the handwriting information may be displayed on the display unit. Here, as the terminal device 50, for example, a personal computer, a workstation, or another computer is used. In the present embodiment, handwriting information is used as an example of handwriting information obtained by digitizing the contents of writing. The handwriting information is mainly described as handwritten information, but is not limited to this, and includes, for example, information mechanically drawn by a plotter that is a device for outputting drawing data such as architecture and machinery.
The terminal device 50 is also a computer device that links to predetermined information based on position information and identification information sent from the digital pen 60. For example, the terminal device 50 generates a command to open a predetermined web browser program and link to a predetermined web address or the like from the position information and the identification information. And based on position information and identification information, it links to a predetermined web address and acquires predetermined information.
The terminal device 50 is connected to the digital pen 60 by, for example, a USB (Universal Serial Bus) cable, and communicates with the digital pen 60. Then, identification information and handwriting information or position information are acquired from the digital pen 60. Here, as a communication method between the digital pen 60 and the terminal device 50, a wireless method such as Bluetooth (registered trademark) or an infrared communication function may be used in addition to a wired method such as a USB cable.

  The digital pen 60 is an example of a handwriting information generation device, and is a pen device used for writing characters or figures on a printed document. An image sensor that reads a code image printed on the medium is provided. And the positional information which is an example of the information acquired from the code | cord image read with the image pick-up element is detected. Furthermore, handwriting information obtained by converting character or graphics written from the position information into image data is generated and stored based on the position information. Further, identification information which is an example of information acquired from the code image read by the image sensor is detected and stored.

Subsequently, details of each component constituting the handwriting information management system will be described.
First, the configuration of the document server 20 will be described.
FIG. 2 is a block diagram illustrating an example of a functional configuration of the document server 20. As shown in FIG. 2, the document server 20 includes a reception unit 21, an identification information acquisition unit 22, an electronic document management unit 23, a handwriting information management unit 24, and a document / handwriting information storage unit 25. Further, it includes an identification code generation unit 27a, a position code generation unit 27b, a code arrangement unit 27c, a pattern image storage unit 27d, and a code image generation unit 27e. Furthermore, a document image generation unit 26, an image composition unit 28, and a transmission unit 29 are provided.

The receiving unit 21 receives a print request from the terminal device 10. Here, in addition to the electronic document, the print request includes identification information (hereinafter referred to as “document ID”) of the electronic document to be printed and various kinds of information for determining the layout of the electronic document on the printed medium. Settings (hereinafter referred to as “print settings”) are included. The document ID is assigned to each electronic document by the terminal device 10, but may be assigned by the document server 20. Further, the receiving unit 21 receives from the identification information server 30 identification information that is uniquely given to the medium on which the print document is printed. Further, when writing is performed on the print document, the identification information embedded in the print document and handwriting information obtained by digitizing the content of the print document (written image) are received from the identification information server 30. .
The identification information acquisition unit 22 acquires the document ID and print settings from the reception unit 21, passes them to the transmission unit 29, instructs transmission of an identification information issue request, passes this to the document image generation unit 26, and sends the document Instructs generation of an image. Further, the identification information of the medium is acquired from the receiving unit 21, and this is passed to the identification code generating unit 27a to instruct generation of the identification code.

  The electronic document management unit 23 acquires the identification information and the electronic document received by the reception unit 21 and registers them in the document / handwriting information storage unit 25 in association with each other based on the document ID. Also, a new electronic document (second electronic document) that reflects the state of the electronic document stored in the document / handwriting information storage unit 25 printed on the medium according to the print settings is generated, and the generated second The second electronic document is stored in the document / handwriting information storage unit 25. Further, when the display or printing of the electronic document is instructed, the corresponding identification information and electronic document are taken out from the document / handwriting information storage unit 25.

The handwriting information management unit 24 acquires the identification information and handwriting information received by the receiving unit 21 and registers the handwriting information in the document / handwriting information storage unit 25 in association with the electronic document based on the identification information. When the display of handwriting information is instructed, the corresponding identification information and handwriting information are extracted from the document / handwriting information storage unit 25.
The document / handwriting information storage unit 25 stores an electronic document managed by the electronic document management unit 23 and handwriting information managed by the handwriting information management unit 24. Here, in the present embodiment, the document / handwriting information storage unit 25 is provided as an example of a storage unit that stores the identification information, the electronic document, and the handwriting information in association with each other.

The identification code generation unit 27a generates identification code by encoding identification information for specifying a medium.
The position code generation unit 27b encodes position information indicating the coordinate position on the medium to generate a position code.
The code arrangement unit 27c arranges the identification code generated by the identification code generation unit 27a, the position code generated by the position code generation unit 27b, and the like on a two-dimensional plane according to a predetermined layout (see FIG. 3 in the subsequent stage). Then, a two-dimensional code array is generated.
The pattern image storage unit 27d stores a pattern image corresponding to the code value of each code stored in the code array.
The code image generation unit 27e refers to the two-dimensional code array generated by the code arrangement unit 27c, selects a pattern image corresponding to each code value, and generates a code image.

The document image generation unit 26 acquires a document ID and print settings from the identification information acquisition unit 22, and reads an electronic document specified by the document ID from the document / handwriting information storage unit 25. Then, a document image of the electronic document is generated according to the print setting.
The image composition unit 28 synthesizes the code image generated by the code image generation unit 27e and the document image generated by the document image generation unit 26 to generate a composite image.
The transmission unit 29 transmits an identification information issuance request to the identification information server 30. Also, an image print command for the medium is transmitted to the image forming apparatus 40. Furthermore, when the display of handwriting information is instructed, the identification information and handwriting information are transmitted to the identification information server 30.

Here, the code image generated by the document server 20 of the present embodiment will be described.
FIG. 3 is a diagram illustrating an example of an image constituting the code image. First, unit patterns constituting a code image will be described. FIG. 3A shows an example of the unit pattern.
The unit pattern is the minimum unit for embedding information. In FIG. 3A, a black area and a shaded area are areas where dots can be arranged, and a white area between them is an area where dots cannot be arranged. In addition, among the areas where dots can be arranged, dots are arranged in black areas, and dots are not arranged in hatched areas. That is, FIG. 3A shows an example in which a unit pattern is configured by arranging dots at two places (black areas) selected from nine places where dots can be arranged. Here, since there are 36 (= ₉ C ₂ ) combinations for selecting 2 locations out of 9 locations, there are 36 types of unit patterns. Of these, four types of unit patterns are used as synchronization patterns. The synchronization pattern is a pattern for detecting the rotation of the image and specifying the relative positions of the identification code and the position code. In particular, since it is necessary to detect the rotation of the image, the four types of synchronization patterns are selected such that when one of the synchronization patterns is rotated 90 degrees, another synchronization pattern is obtained. Further, the 32 types of unit patterns other than the 4 types of unit patterns are used as information patterns expressing the identification code and the position code, and 5-bit information is expressed.

  By the way, the dots shown in FIG. 3A are only for information representation, and do not necessarily coincide with the dots that mean the minimum points constituting the image. In the present embodiment, dots for information expression (the minimum square in FIG. 3A) have a size of 2 dots × 2 dots at 600 dpi. Since the size of one dot at 600 dpi is 0.0423 mm, one side of a dot for information expression (the minimum square in FIG. 3A) is 84.6 μm (= 0.0423 mm × 2). The larger the dot for information expression, the more likely it is to be noticeable. Therefore, it is preferable that the dot is as small as possible. However, if it is too small, printing with a printer becomes impossible. Therefore, the above values larger than 50 μm and smaller than 100 μm are employed as the size of dots for information expression. However, the above value 84.6 μm is a numerical value to the last, and is about 100 μm in the actually printed toner image. In the present specification, the term “dot” refers to a dot for information expression, not a dot that means the minimum point constituting an image unless otherwise specified.

Next, a code block composed of such unit patterns will be described. FIG. 3B shows an example of the layout of the code block. Here, not the image but the code arrangement immediately before being replaced by the pattern image is shown. That is, a unit pattern as shown in FIG. 3A (any one of 36 unit patterns) is arranged in the smallest square (hereinafter referred to as “unit block”) in FIG. Will be formed.
In the layout of FIG. 3B, the synchronization code is arranged in one unit block at the upper left of the code block. Further, the X position code is arranged in the four unit blocks on the right side of the unit block in which the synchronization code is arranged, and the Y position code is arranged in the four unit blocks on the lower side of the unit block in which the synchronization code is arranged. . Furthermore, identification codes are arranged in 16 (= 4 × 4) unit blocks surrounded by unit blocks in which these position codes are arranged.

Here, encoding of identification information will be described.
When encoding identification information, the bit string which comprises identification information is divided | segmented into a some block in order to perform RS encoding. Although there are several methods for encoding, RS encoding is suitable in this embodiment. This is because the RS code is a multi-value coding method, and in this case, the value represented by the unit block corresponds to the multi-value of the RS code. For example, when 5-bit information is expressed by one unit block, the 60-bit identification information is divided into 12 blocks having a block length of 5 bits. If an RS code capable of correcting two blocks of errors is employed, the code length is 16 blocks, which can be accommodated in a unit block in which the identification code in the code block of FIG. Note that the encoding method is not limited to the RS code, and other encoding methods such as a BCH code may be used.

Subsequently, encoding of position information will be described.
For encoding the position information, an M-sequence code, which is a kind of pseudo-random sequence, is used. Here, the M sequence refers to a sequence having the longest period among a shift register having a certain length and a code sequence generated by feedback. When K is the number of stages in the shift register, the sequence length of the M sequence is 2 ^K −1. Arbitrary consecutive K bits extracted from the M sequence have a property that they do not appear at other positions in the same M sequence. Therefore, the position information is encoded using this property.
By the way, in the present embodiment, a necessary M-sequence order is obtained from the length of position information to be encoded, and an M-sequence is generated. However, if the length of the position information to be encoded is known in advance, it is not necessary to generate the M sequence each time. That is, a fixed M sequence may be generated in advance and stored in a memory or the like.
For example, it is assumed that an M sequence (K = 13) having a sequence length of 8191 is used. In this case, since the position code is also embedded in units of 5 bits, 5 bits are taken out from the M sequence having a sequence length of 8191 and blocked.

  In this specification, the identification information and the position information are clearly distinguished and used for the sake of simplicity. However, there is a technique in which a wide range of position information is prepared, the position information is cut out and embedded from different ranges for each medium, and the medium is identified by the difference in position information. Therefore, in such a method, it is assumed that the position information has a function for identifying the medium, and the position information is also considered as the identification information.

Next, the configuration of the identification information server 30 will be described.
FIG. 4 is a block diagram illustrating an example of a functional configuration of the identification information server 30. As illustrated in FIG. 4, the identification information server 30 includes a reception unit 31, an identification information management unit 32, an identification information storage unit 33, a display information generation unit 34, and a transmission unit 39.
The receiving unit 31 receives an identification information issue request from the document server 20. The receiving unit 31 receives medium identification information and handwriting information from the terminal device 50 when writing is performed on the print document. Here, in the present embodiment, the medium identification information and the handwriting information are received from the terminal device 50, and when the display of the handwriting information is instructed, the medium identification information and the handwriting information are obtained from the document server 20. A receiving unit 31 is provided as an example of receiving means for receiving.

When there is a request for issuing identification information, the identification information management unit 32 issues the identification information without duplication, and stores the document ID and print settings specified at that time in association with the identification information. In response to designation of identification information, a document ID and print settings corresponding to the identification information are extracted.
The identification information storage unit 33 stores the identification information in the used / unused state, the document ID of the electronic document printed on the medium to which the identification information is added, and the electronic document printed on the medium to which the identification information is printed. It is a database that stores print settings in association with each other.
The display information generation unit 34 generates display information for displaying the handwriting information based on the information acquired from the document server 20 when the display of the handwriting information is instructed. As this display information, for example, data serving as a source for generating an image to be displayed on the terminal device 50 is generated.

  The transmission unit 39 transmits identification information issued in response to a request from the document server 20 to the document server 20. In addition, when writing on a print document is performed, medium identification information and handwriting information are transmitted to the document server 20. Further, when the display of handwriting information is instructed, the display information is transmitted to the terminal device 50. Here, in the present embodiment, a transmission unit 39 is provided as an example of a transmission unit that transmits medium identification information and handwriting information.

Next, the digital pen 60 will be described.
FIG. 5 is a diagram illustrating the configuration of the digital pen 60. As shown in FIG. 5, the digital pen 60 has a main body housing 68 with a pen tip 64 for writing on the medium, a control unit 61 for controlling the operation of the entire pen, and an infrared light for irradiating the medium with infrared light. LED 62, infrared CMOS 63 as an example of code image reading means for reading a code image by detecting reflected light from the medium, information memory 65 for storing identification information, handwriting information, and position information, and transmission means for communicating with an external device As an example, a communication unit 66 is provided. Furthermore, a rechargeable battery 67 that supplies power for driving each part of the digital pen 60 is provided.

The digital pen 60 is a cap that detects whether or not a cap 69 for protecting the pen tip 64 is attached to the digital pen 60 as an example of a signal output unit that outputs signals corresponding to various operations performed by the user. A switch SW1, a writing pressure detection switch SW2 for detecting a writing operation by the digital pen 60 by a pressure (writing pressure) applied to the pen tip 64, and a user switch SW3 for receiving an ON / OFF input by a user operation are provided. The cap switch SW1 and the user switch SW3 are provided on the side surface portion of the main body casing 68, and the writing pressure detection switch SW2 is provided inside the main body casing 68.
The infrared LED 62, the infrared CMOS 63, the information memory 65, the communication unit 66, the cap switch SW1, the writing pressure detection switch SW2, and the user switch SW3 are connected to the control unit 61.

The infrared LED 62 is composed of one or a plurality of LEDs (Light Emitting Diodes) that emit infrared light having a wavelength of 700 to 1000 μm. Then, pulse lighting is performed based on a drive signal transmitted from an illumination drive unit 614 in the control unit 61 described later.
The infrared CMOS 63 is a CMOS sensor (Complementary Metal Oxide Semiconductor) having sensitivity in the infrared region, and uses a global shutter system capable of simultaneously transferring captured images. The infrared CMOS 63 captures a code image printed on the medium in units of frames in synchronization with an image capture signal transmitted at a cycle (frame rate) of about 50 fps to 100 fps (frame per second). The “frame” is an area on the medium (imaging area) that the infrared CMOS 63 captures once for each frame rate. A data group having a predetermined data length related to the code image is generated from one frame. Further, the image capture signal is generated by an image capture signal generation unit 615 in the control unit 61 described later, and is transmitted to the infrared CMOS 63.
The communication unit 66 is a functional unit that constitutes a part of the transmission unit, communicates with the terminal device 50, and transmits identification information and handwriting information or position information to the terminal device 50. When the communication unit 66 uses a method in which the communication unit 66 is connected to the terminal device 50 with a USB cable, power may be supplied from the terminal device 50 via the USB cable. Further, the battery 67 may be charged with power supplied via a USB cable.

Next, the control unit 61 provided in the digital pen 60 will be described.
FIG. 6 is a block diagram illustrating an example of a functional configuration of the control unit 61. As shown in FIG. 6, the control unit 61 acquires identification information and position information from an image processing unit 611 that processes a code image read by the infrared CMOS 63, a processing result in the image processing unit 611, and A data processing unit 612 that generates handwriting information, an output management unit 613 that manages output to the information memory 65 or the communication unit 66 regarding the identification information, handwriting information, and position information acquired / generated by the data processing unit 612, and output A buffer memory 618 that temporarily stores identification information, handwriting information, and position information sent to the management unit 613, an illumination drive unit 614 that drives the infrared LED 62, and an image capture signal with a predetermined period that is transmitted to the infrared CMOS 63 An image capture signal generation unit 615 that generates an image, an operation control unit 616 that controls the operation of each unit, and a pen ID memory 617 that stores pen identification information (pen ID). It is provided.
Here, the image processing unit 611 and the data processing unit 612 function as an information acquisition unit that acquires predetermined information from the code image printed on the medium.

The image processing unit 611 includes an image acquisition unit 611a and a dot array generation unit 611b.
The image acquisition unit 611a acquires the code image read from the print document by the infrared CMOS 63 in units of frames. Moreover, the noise contained in a code image is removed as needed.
The dot array generation unit 611b generates a dot array for each frame with reference to the dot positions in the code image. That is, on a two-dimensional array, for example, “1” is stored at a position where there is a dot and “0” is stored at a position where there is no dot, thereby replacing the dot detected as an image with digital data. Then, this two-dimensional array is output as a dot array for each frame.

The data processing unit 612 includes a code array generation unit 612a, an identification information acquisition unit 612b, a position information acquisition unit 612c, and a handwriting information generation unit 612d.
The code array generation unit 612a detects a block corresponding to the unit pattern in the code block on the dot array. Specifically, a frame having the same shape and size as the block in which the unit pattern is arranged is moved on the dot array, and the frame is fixed at a position where the number of dots in the frame becomes equal. For example, if the unit pattern of FIG. 3A is used, a frame having a size corresponding to 3 dots × 3 dots is moved, and the frame is fixed at a position where the number of dots included in the frame is 2. Then, a code array storing code values determined from the dot positions in each block delimited by the frame is generated for each frame. When this code array is generated, the position of the synchronization code is specified by searching for a code value of a predetermined synchronization code.

The identification information acquisition unit 612b detects the identification code based on the position of the synchronization code from the code array. Then, the identification code is decoded using the parameters used in the RS encoding process at the time of image generation, and the identification information is acquired for each frame.
The position information acquisition unit 612c detects a position code with reference to the position of the synchronization code from the code array. Then, an M-sequence partial sequence is extracted from the position code, the position of this partial sequence in the M-sequence used at the time of image generation is referenced, and a value obtained by correcting this position with an offset using a synchronization code is acquired for each frame as position information. . The reason for correcting with the offset is that a synchronization code is arranged between the position codes.
The handwriting information generation unit 612d is an example of handwriting information generation means, and generates handwriting information obtained by connecting the position information acquired by the position information acquisition unit 612c for each frame. Here, the handwriting information is data obtained by connecting and digitizing the locus of the tip of the pen tip 64 when writing (handwriting) by the pen tip 64 is performed.

  By the way, the digital pen 60 is set with a function capable of using a plurality of different operation modes. For example, in the digital pen 60 of the present embodiment, the “writing mode” that is an operation mode in which a writing image drawn on the medium by the pen tip 64 is transmitted as handwriting information to the terminal device 50, and the identification information obtained from the medium And “reference mode” which is an operation mode used as reference information for linking one or both of the position information to specific information. As an operation example in the “reference mode”, as reference information for generating a command for opening a predetermined web browser program for the terminal device 50 and linking to a web address or the like in which specific information is stored and described, The position information acquired by the position information acquisition unit 612c and the identification information acquired by the identification information acquisition unit 612b are used. In the “reference mode”, only one of the position information and the identification information may be used.

  The operation mode such as “writing mode” and “reference mode” in the digital pen 60 is such that the cap switch SW1, the writing pressure detection switch SW2, and the user switch SW3 that output a signal (ON / OFF signal) corresponding to a user operation are ON. The operation control unit 616 sets based on the / off state. Then, the operation control unit 616 sends a control signal instructing the data processing unit 612 to set the “writing mode” or the “reference mode”. At that time, the start of the “writing mode” and the “reference mode” is set by an ON signal of the writing pressure detection switch SW2, and the end of the “writing mode” and the “reference mode” is set by an OFF signal of the writing pressure detection switch SW2. Is done.

The handwriting information generation unit 612d operates according to a control signal that instructs setting of the “writing mode” from the operation control unit 616. Thereby, in the “writing mode”, the identification information acquired by the identification information acquisition unit 612b and the handwriting information generated by the handwriting information generation unit 612d are sent to the output management unit 613.
On the other hand, when the “reference mode” is set by the control signal from the operation control unit 616, the handwriting information generation unit 612d stops its function. Thereby, in the “reference mode”, the identification information acquired by the identification information acquisition unit 612b and the position information acquired by the position information acquisition unit 612c are output to the output management unit 613.
The handwriting information generation unit 612d may be operated in both the “writing mode” and the “reference mode” to generate handwriting information from the position information. At that time, when the “writing mode” is set, the handwriting information is used as it is as handwriting information obtained by connecting the tips of the pen tip 64. When “reference mode” is set, handwriting information is used as reference information.

Further, in the data processing unit 612, one of identification information, position information, and handwriting information generated by the data processing unit 612 corresponding to the “writing mode” and “reference mode” set by the operation control unit 616. Alternatively, a plurality of “operation mode information” indicating that they are generated in “writing mode” or “reference mode” may be added. Thereby, in the terminal device 50 that has acquired the identification information, the position information, and the handwriting information to which the operation mode information is added, based on the operation mode information, writing in an area where writing cannot be performed on the medium or position information serving as reference information It is recognized that an inconvenient operation such as reading of a code image in an area where no is printed is performed. Then, the terminal device 50 notifies the digital pen 60 that the transmitted identification information, position information and handwriting information are based on an inconvenient operation and cannot be used as writing information or reference information.
Further, in the data processing unit 612, error information generated when the identification information acquisition unit 612b acquires the identification information, error information generated when the position information acquisition unit 612c acquires the position information, and a handwriting information generation unit Error information generated when generating handwriting information at 612d may be added to identification information, position information, and handwriting information. As a result, the terminal device 50 that has acquired the identification information, the position information, and the handwriting information to which the error information has been added recognizes that an error has occurred during the acquisition process or the generation process of the information. Then, the terminal device 50 instructs the user about error notification and countermeasures against individual errors.

Subsequently, when communication between the communication unit 66 and the terminal device 50 is established, the output management unit 613 stores the identification information and handwriting information or position information in the buffer memory 618. Then, the identification information and the handwriting information or the position information stored in the buffer memory 618 are transmitted to the communication unit 66 according to a predetermined order (hereinafter also referred to as “transmission order”) indicating the priority when transmitting from the communication unit 66. Output. On the other hand, when communication between the communication unit 66 and the terminal device 50 is not established, the output management unit 613 outputs the identification information and handwriting information or position information to the information memory 65. The information memory 65 stores the acquired identification information and handwriting information or position information.
Further, when communication between the communication unit 66 and the terminal device 50 is established, the output management unit 613 reads the identification information and handwriting information from the information memory 65 according to a predetermined transmission order, and outputs them to the communication unit 66.
Here, the output management unit 613 is a functional unit that constitutes a part of the transmission unit.
The output management unit 613 may be configured to output either the identification information and the handwriting information or the position information to the information memory 65 or the communication unit 66.

The image capture signal generation unit 615 generates an image capture signal having a period (frame rate) of, for example, 50 fps to 100 fps and transmits the image capture signal to the infrared CMOS 63. The infrared CMOS 63 sequentially captures the code image printed on the medium for each frame at the frame rate set by the transmitted image capture signal. Further, the image capture signal generation unit 615 transmits the generated image capture signal to the illumination drive unit 614.
The illumination drive unit 614 generates a drive signal for driving the infrared LED 62 and turns on the infrared LED 62 in pulses. At that time, in order to correspond to the frame rate in the infrared CMOS 63, the drive signal is output in synchronization with the image capture signal generated by the image capture signal generation unit 615. Thereby, the power consumption in the infrared LED 62 is reduced.

In the digital pen 60, first, when the infrared LED 62 driven by the illumination driving unit 614 irradiates the medium with infrared light, the infrared is synchronized with the image capture signal from the image capture signal generation unit 615. The CMOS 63 receives the reflected light and reads the code image printed on the medium for each frame. The code image read by the infrared CMOS 63 is sent to the image processing unit 611 in the control unit 61.
In the image processing unit 611, the image acquisition unit 611a acquires the read code image. At that time, if noise is included in the code image, it is removed. Subsequently, the dot array generation unit 611b converts the dot positions included in the code image into digital data and generates a dot array. Then, the generated dot array is sent to the data processing unit 612.

In the next data processing unit 612, the code array generation unit 612a detects a block from the dot array generated by the dot array generation unit 611b, and generates a code array that stores a code value for each block. Then, the position of the synchronization code is specified in the code array. Thereafter, the identification information acquisition unit 612b detects the identification code based on the position of the synchronization code, decodes it, and acquires the identification information. The identification information acquired by the identification information acquisition unit 612b is sent to the output management unit 613.
Further, the position information acquisition unit 612c detects the position code based on the position of the synchronization code, decodes this, and acquires the position information. When the “writing mode” is set, the position information acquired by the position information acquisition unit 612c is sent to the handwriting information generation unit 612d, and the handwriting information generation unit 612d connects the position information. Handwriting information is generated for each frame. The handwriting information generated by the handwriting information generation unit 612d is sent to the output management unit 613. On the other hand, when the “reference mode” is set, the position information acquired by the position information acquisition unit 612 c is sent to the output management unit 613 as it is.

Here, the identification information acquisition unit 612b of the data processing unit 612 adds frame identification information (frame ID) for identifying the frame from which the identification information is acquired to the acquired identification information. Further, the position information acquisition unit 612c adds a frame ID for identifying the frame from which the position information is acquired to the acquired position information. Furthermore, in the handwriting information generation unit 612d, the same frame ID as that added to the position information from which handwriting information is generated is added to the generated handwriting information.
The added frame ID is set, for example, in ascending order from the start of the writing operation every time the user performs a writing operation on the medium. In addition, a frame ID that can identify the set operation mode is set.

The frame ID will be specifically described. First, a case where the “writing mode” is set by the operation control unit 616 will be described. For the frame ID in the “writing mode”, for example, “W” indicating that the “writing mode” is set is set at the head of the frame ID. In addition, when the start of the “writing mode” is set by the ON signal of the writing pressure detection switch SW2, and the operation control unit 616 instructs the data processing unit 612 to start the “writing mode”, the data after the start instruction is issued. In the first frame where data processing such as acquisition of identification information in the processing unit 612 is started, “000001” indicating that it is a writing start point frame is set as the frame ID. Therefore, “W — 000001” is set as the frame ID of the writing start point frame. Then, “W — 000002”, “W — 000003”,... Are set in the ascending order for the subsequent frame IDs.
When the end of the “writing mode” is set by an OFF signal of the writing pressure detection switch SW2 and the operation control unit 616 instructs the data processing unit 612 to end the “writing mode”, the data processing unit 612 In the last frame of the data processing, “F” indicating that it is a writing end point frame is set at the end of the frame ID. Accordingly, for example, “W — 000111_F” is set as the frame ID of the writing end point frame. That is, “F” at the end of the writing end frame is set as flag data. Here, the numeric data portion set to the frame ID of the frame at the end point of writing, for example, “000111”, indicates the total number of frames read by one writing operation on the medium by the user.

Next, a case where the “reference mode” is set by the operation control unit 616 will be described. For the frame ID in the “reference mode”, for example, “R” indicating that the “reference mode” is set is set at the head of the frame ID. In addition, when the start of the “reference mode” is set by the ON signal of the writing pressure detection switch SW2, and the operation control unit 616 instructs the data processing unit 612 to start the “reference mode”, the data after the start instruction is given. As in the “writing mode”, “000001” indicating the writing start point frame is set in the frame ID in the first frame where data processing such as acquisition of identification information in the processing unit 612 is started. Is done. Therefore, in the “reference mode”, the frame ID of the frame at the writing start point is set to “R_000001”. Then, “R_000002”, “R_000003”,... Are set in the ascending order for the subsequent frame IDs.
Further, when the end of the “reference mode” is set by the OFF signal of the writing pressure detection switch SW2, and the operation control unit 616 instructs the data processing unit 612 to end the “reference mode”, the case of the “writing mode” Similarly to the above, “F” indicating the frame at the end of writing is set at the end of the frame ID in the last frame of the data processing in the data processing unit 612. Therefore, for example, “R_000111_F” is set as the frame ID of the writing end frame.
As described above, the identification information, the handwriting information, and the position information are sent from the data processing unit 612 to the output management unit 613 in a state where the frame from which the code image that has been acquired / generated is read can be identified.

The output management unit 613 describes the identification information and the handwriting information or the position information based on the frame ID added to the identification information and the handwriting information or the position information sent from the data processing unit 612, respectively. These data are combined as a data group in units of frames (hereinafter also referred to as “frame data”). That is, frame data is generated by combining identification information to which the same frame ID is added and handwriting information or position information. At that time, each frame ID is added to the generated frame data.
When communication between the communication unit 66 and the terminal device 50 is established, the output management unit 613 stores the frame data in the buffer memory 618 in the order of acquisition from the data processing unit 612. Thereafter, the output management unit 613 reads the frame data stored in the buffer memory 618 according to a predetermined transmission order, and outputs the frame data to the communication unit 66.
On the other hand, if communication between the communication unit 66 and the terminal device 50 is not established, the output management unit 613 outputs the frame data to the information memory 65. Since the information memory 65 stores the frame data sent from the output management unit 613, the identification information and the handwriting information or the position information are not lost even if communication is not successful. The frame data stored in the information memory 65 is read by the output management unit 613 in accordance with a predetermined transmission order when communication between the communication unit 66 and the terminal device 50 is established, and is transmitted to the communication unit 66. Is output.

Next, output management processing related to identification information, handwriting information, and position information performed by the output management unit 613 will be described.
As described above, the infrared CMOS 63 sequentially captures the code image printed on the medium for each frame at the predetermined frame rate set by the image capture signal from the image capture signal generation unit 615. Then, the code image for each frame imaged at each frame rate is sent to the control unit 61 in the order of image capture, and the image processing unit 611 and the data processing unit 612 obtain identification information and position information from the code image for each frame. get. Handwriting information is generated from the position information for each frame.
Thereafter, the data processing unit 612 sends the generated identification information and handwriting information or position information to the output management unit 613 with a frame ID added for each frame. Then, the output management unit 613 combines the identification information to which the same frame ID is added with the handwriting information or the position information to generate frame data that is a data group in units of frames.

FIG. 7 is a diagram illustrating an example of handwriting formed by a user's writing operation. In FIG. 7, as an example of the handwriting, a case where “tsu” of hiragana is written is shown. Further, it is assumed that handwriting is sequentially formed from the writing start point P1 through the writing positions P2, P3,..., And one writing operation of the user is completed at the writing end point Pm. In addition, the frames in which the code images for calculating the writing positions P1 to Pm are captured by the infrared CMOS 63 are indicated as F (1) to F (m).
As shown in FIG. 7, when a hiragana character “tsu” is formed as a handwriting by a user's writing operation, for example, a pitch (between each writing position) determined by the frame rate in the infrared CMOS 63 and the speed of the user's writing operation. The writing positions P1 to Pm are calculated from the frames F (1) to F (m) separated by (interval). Then, writing information in which the calculated writing positions P1 to Pm are connected is generated.

The writing information generated in this way is sent from the data processing unit 612 to the output management unit 613, and is sent from the output management unit 613 to the terminal device 50 via the communication unit 66. However, for example, an operating state on the receiving side where a large load is generated because an information processing unit (not shown) of the terminal device 50 is processing a large amount of information, a radio wave state when using wireless communication, etc. Due to external factors, the communication speed between the communication unit 66 and the terminal device 50 may decrease or the connection may be intermittent. In that case, the communication speed between the communication unit 66 and the terminal device 50 is slower than the frame rate (= generation speed of writing information or the like) such as 50 fps to 100 fps in the infrared CMOS 63 described above. As a result, writing information or the like is stagnated in the communication unit 66, and frame data that cannot be transmitted from the communication unit 66 to the terminal device 50 may be generated.
Therefore, the output management unit 613 sets a predetermined transmission order for determining the transmission order in the frame data transmitted to the terminal device 50 via the communication unit 66. When the frame data is read from the buffer memory 618 for storing the frame data or the information memory 65, the frame data is read according to a predetermined transmission order. Then, the frame data is output to the communication unit 66 from the read order. As a result, even when the communication speed between the communication unit 66 and the terminal device 50 is slower than the generation speed of writing information or the like, a situation has occurred in which frame data having a higher transmission order is not transmitted to the terminal device 50. Reduced.

  The setting of the transmission order in the output management unit 613 will be described. The output management unit 613 sets the transmission order that determines the transmission order of the frame data based on the importance of each frame data. First, the transmission order of frame data generated in a state where the “reference mode” is set is set higher than the “writing mode”. In the “reference mode”, since frame data is used as reference information for linking to specific information, when the frame data is not transmitted to the terminal device 50, for example, a predetermined web browser program is opened on the terminal device 50. A command for linking to a web address or the like where specific information is stored or described cannot be generated. As a result, the user cannot achieve the purpose of linking to specific information, which is inconvenient. Therefore, the frame data in the state in which the “reference mode” is set is set to a higher transmission order than the “writing mode”.

Next, the transmission order of the frame data generated in the state where the “writing mode” is set is set based on the importance in grasping the writing contents. First, the transmission order of the frame data generated at the start of writing and the frame data generated at the end of writing is set highest in the “writing mode”. For example, in the example shown in FIG. 7, the transmission order of the writing start point P1 and the writing end point Pm is set to the highest. The frame data of the writing start point P1 and the writing end point Pm is the most important handwriting information for grasping the handwriting, and if the frame data of the writing start point P1 and the writing end point Pm is transmitted, the writing is performed. This is because the facts made are immediately transmitted to the terminal device 50.
The frame data set as the next highest transmission order is frame data at a predetermined interval between the start and end of writing. For example, in the example shown in FIG. 7, the writing position between the writing start point P1 and the writing end point Pm is extracted at intervals of 10 pitches, for example. That is, the frame data at the writing positions P11, P21, P31, P41,. Thereby, in addition to the writing start point P1 and the writing end point Pm, the frame data of the writing position representing the middle of the handwriting is transmitted at predetermined intervals, and handwriting information that can grasp the outline of the handwriting is transmitted.

  And the frame data regarding other writing positions is set to the lowest. Therefore, in the example shown in FIG. 7, for example, after the frame data of the writing start point P1 and the writing end point Pm and the frame data of the next writing positions P11, P21, P31, P41,. Frame data at writing positions P2, P3, P4, P5,... Are transmitted in ascending order. Thereby, even when the communication speed between the communication unit 66 and the terminal device 50 is slower than the generation speed of writing information or the like, the frame data that is not transmitted to the terminal device 50 is the writing position P2, It is generated from any of the frame data of P3, P4, P5,. Therefore, the frame data of the writing start point P1 and the writing end point Pm most important for grasping the handwriting and the frame data of the writing positions P11, P21, P31, P41,... Necessary for grasping the outline of the handwriting are included. There is very little that it is not transmitted, and it is possible to increase the possibility that handwritten information that can at least grasp the content of writing is transmitted to the terminal device 50.

FIG. 8 shows a display unit (not shown) of a situation in which frame data is transmitted according to the transmission order when, for example, the hiragana “tsu” in FIG. 7 is written in the state where the “writing mode” is set. It is the figure shown as the content of the handwriting information displayed by).
As shown in FIG. 8A, first, the frame data of the writing start point P1 and the writing end point Pm for which the highest transmission order is set in the “writing mode” is transmitted. When only the frame data of the writing start point P1 and the writing end point Pm is transmitted to the terminal device 50 due to a decrease in communication speed or the like, the terminal device 50 uses the predetermined application software to write the writing start point P1 and the writing. A figure (here, a line segment) connecting the end point Pm is displayed.
In this state, it cannot be determined that the written content is hiragana “tsu”, but the fact that the writing has been performed is grasped. In addition, application software that reproduces handwriting information on the terminal device 50, for example, a process of concatenating sequentially from the smallest numerical data portion set in the frame ID of the transmitted handwriting information, or the large numerical data portion In the case where the processing is sequentially performed, the start point (writing start point P1) and the end point (writing end point Pm) serving as a reference for reproducing the handwriting information are first defined. As a result, the subsequent reproduction processing by the application software for reproducing the handwriting information is smoothly advanced.

Subsequently, as shown in FIG. 8B, frame data at writing positions P11, P21, P31, P41,..., Which are frame data at predetermined intervals (pitch), are transmitted according to the communication state. Then, by the writing positions P11, P21, P31, P41,... Between the writing start point P1 and the writing end point Pm, the reproducibility is still poor from the original handwriting (broken line), but the outline of the handwriting can be grasped. If it is about simple figures, hiragana or katakana, it is highly likely that the original handwriting can be easily guessed. The transmission order within the frame data at the writing positions P11, P21, P31, P41,... Is, for example, performed in ascending / descending order from the smallest numerical data portion set in the frame ID, or even random. Thus, it is determined by a predetermined rule.
Next, as shown in FIG. 8C, frame data at writing positions P2, P3, P4, P5,... Other than the above are transmitted according to the communication state. Thereby, the space between the writing positions for each predetermined interval (pitch) is gradually filled, and the reproducibility is further increased as compared with the state of FIG. Therefore, even at this stage, even if the communication speed between the communication unit 66 and the terminal device 50 is extremely lower than the generation speed of writing information or the like, frame data that cannot be transmitted to the terminal device 50 is generated. , The probability of being able to grasp the written content is high.

Next, a processing method for reading frame data in order of priority from the buffer memory 618 for storing frame data and the information memory 65 in the output management unit 613 will be described. The output management unit 613 reads frame data from the buffer memory 618 and the information memory 65 based on the frame ID added to each frame data. As described above, the data processing unit 612 adds the frame ID to each of the identification information, the position information, and the handwriting information and sends it to the output management unit 613, and the output management unit 613 identifies the same frame ID added thereto. The information and the handwriting information or the position information are combined to generate frame data to which the frame ID is added. Then, the frame data to which the frame ID is added is stored in the buffer memory 618 when communication between the communication unit 66 and the terminal device 50 is established. Further, when communication between the communication unit 66 and the terminal device 50 is not established, the information is stored in the information memory 65.
Therefore, when communication between the communication unit 66 and the terminal device 50 is established, the output management unit 613 sequentially starts with the frame data with the highest transmission order from the frame ID of the frame data stored in the buffer memory 618. The frame data is read out from the buffer memory 618 in order of priority.

FIG. 9 is a flowchart illustrating an example of a processing procedure in which the output management unit 613 reads frame data from the buffer memory 618 in priority order. As shown in FIG. 9, the output management unit 613 first searches for frame data generated with the “reference mode” having the highest transmission order set (step 11). Specifically, “R” is set at the head of the frame ID in the frame data generated with the “reference mode” set. Therefore, the output management unit 613 searches the frame data stored in the buffer memory 618 for frame data in which “R” is set at the head of the frame ID.
As a result of the search, when the frame data generated with the “reference mode” set is extracted (step 12), the output management unit 613 reads it from the buffer memory 618 and outputs it to the communication unit 66. (Step 13). The communication unit 66 transmits the frame data to the terminal device 50. And after the output to the communication part 66 is complete | finished in step 13 (step 14), it returns to step 11. This is because the frame data in the “reference mode” may be newly stored in the buffer memory 618.

Next, when the frame data generated in the state where the “reference mode” is set in step 12 is not extracted, the output management unit 613 searches the frame data of the writing start point and the writing end point (step 15). Specifically, “1” is set at the end of the frame ID of the frame data at the writing start point. Further, “F” is set at the end of the frame ID of the frame data at the writing end point. Therefore, the output management unit 613 searches the frame data stored in the buffer memory 618 for frame data in which “1” or “F” is set at the end of the frame ID.
When at least one of the writing start point and writing end point is extracted as a result of the search (step 16), the output management unit 613 reads it from the buffer memory 618 and outputs it to the communication unit 66 ( Step 17). The communication unit 66 transmits the frame data to the terminal device 50. And after the output to the communication part 66 is complete | finished in step 17 (step 18), it returns to step 11. This is because frame data in the “reference mode” and frame data at the writing start point and writing end point may be newly stored in the buffer memory 618.

Next, when neither the writing start point nor the writing end point is extracted in step 16, the output management unit 613 performs frame data for each predetermined interval between the writing start point and the writing end point. (Step 19). For example, when frame data is extracted every 10 pitches, the frame data is searched while the numeric data portion set in the frame ID is advanced every 10 steps.
If any frame data is extracted at predetermined intervals as a result of the search (step 20), the output management unit 613 reads it from the buffer memory 618 and outputs it to the communication unit 66 (step 21). ). The communication unit 66 transmits the frame data to the terminal device 50. And after the output to the communication part 66 is complete | finished in step 21 (step 22), it returns to step 11. This is because frame data in the “reference mode”, frame data at the writing start point and writing end point, and frame data at predetermined intervals may be newly stored in the buffer memory 618.
In addition to the method of using a predetermined value when setting the frame data extraction interval, a variation value may be used. For example, the numeric data portion (for example, “000111”) set in the frame ID of the frame data at the end point of writing indicates the total number of frames (for example, 111) read by one writing operation on the medium by the user. Show. Therefore, adjustment to increase or decrease the extraction interval according to the total number of frames may be performed.

Next, when no frame data is extracted at predetermined intervals in step 20, the output management unit 613 searches for frame data in ascending order from the frame data next to the writing start point, for example (step 23). ).
If any frame data is extracted in step 23 as a result of the search (step 24), the output management unit 613 reads it from the buffer memory 618 and outputs it to the communication unit 66 (step 25). . The communication unit 66 transmits the frame data to the terminal device 50. And after the output to the communication part 66 is complete | finished in step 25 (step 26), it returns to step 11. This is because the frame data is newly stored in the buffer memory 618.
Similarly, the communication between the communication unit 66 and the terminal device 50 is established using the frame data stored in the information memory 65 because the communication between the communication unit 66 and the terminal device 50 has not been established. Also when reading later, the output management unit 613 reads the frame data stored in the information memory 65 by performing the same processing as the processing flow of FIG.

  As described above, the output management unit 613 sets a predetermined transmission order that determines the transmission order in the frame data transmitted to the terminal device 50 via the communication unit 66. When the frame data is read from the buffer memory 618 for storing the frame data or the information memory 65, the frame data is read according to a predetermined transmission order. Then, the frame data is output to the communication unit 66 in the read order. As a result, even when the communication speed between the communication unit 66 and the terminal device 50 is slower than the generation speed of writing information or the like, the occurrence of a situation in which highly important frame data is not transmitted to the terminal device 50 occurs. Reduced.

Next, FIG. 10 is a diagram illustrating a hardware configuration of the control unit 61 of the digital pen 60.
As illustrated in FIG. 10, the control unit 61 is executed by the CPU 101 and the CPU 101 that execute digital arithmetic processing as a functional module according to a predetermined operation control program (firmware) when performing operation control of the digital pen 60. RAM 102 in which processing programs are stored, ROM 103 in which data such as setting values used in processing programs executed by CPU 101 are stored, EEROM and flash that are rewritable and can retain data even when power supply is interrupted A non-volatile memory 104 such as a memory, and an interface unit 105 that controls input / output of signals to / from each unit connected to the control unit 61 are provided.
Further, the external storage device 106 stores an operation control program to be executed by the control unit 61. When the control unit 61 reads this operation control program, the operation control related to the digital pen 60 is executed.

  That is, an operation control program that realizes the functions of the image processing unit 611, the data processing unit 612, the output management unit 613, and the operation control unit 616 is read from the external storage device 106 into the RAM 102 in the control unit 61. The CPU 101 performs various processes based on the operation control program read into the RAM 102. In this operation control program, for example, a hard disk or a DVD-ROM provided in the terminal device 50 that communicates with the digital pen 60 functions as the external storage device 106 of the digital pen 60, and the RAM 102 is connected from the terminal device 50 via the communication line. Provided to be loaded into. As another providing form, there is a form provided in a state installed in the ROM 103 in advance. Furthermore, after the digital pen 60 is assembled, an operation control program is installed in the nonvolatile memory 104 and loaded from the nonvolatile memory 104 to the RAM 102. Further, there is a form in which a program is transmitted to the digital pen 60 via a network such as the Internet and installed in the RAM 102.

Next, various processes performed on the electronic document in the handwriting information management system of this embodiment will be described.
[Print document generation processing]
FIG. 11 is a sequence diagram illustrating an example of an operation when a print document is generated in the handwriting information management system.
First, the user transmits an instruction to print an electronic document from the terminal device 10 to the document server 20 (step 101). At that time, the terminal device 10 transmits an electronic document to be printed, identification information (document ID) of the electronic document, and print settings designated by the user. Here, the print settings include the page to be printed, the number of copies, the size of the paper that is the medium, the enlargement / reduction ratio, N-up (printing that allocates N pages of the electronic document to one page of the medium), and the size of the margin area. Including settings such as.

The document server 20 receives an electronic document print instruction from the terminal device 10 (step 201). The electronic document to be printed included in the print instruction is sent to the electronic document management unit 23, and the electronic document management unit 23 registers the electronic document in the document / handwriting information storage unit 25 in association with the document ID (step 202). ).
Further, the document server 20 transmits the document ID and print setting of the electronic document instructed to be printed to the identification information server 30 (step 203). Here, for example, a URL (Uniform Resource Locator) may be used as the document ID, but other information may be used as long as the electronic document can be uniquely identified.
Thereby, the identification information server 30 receives the document ID and the print setting (step 301). Then, the identification information management unit 32 that manages the medium identification information acquires unused medium identification information from the identification information storage unit 33 (step 302). Here, the number of pieces of medium identification information to be extracted is determined according to print settings. That is, basically, the number of pieces of medium identification information obtained by multiplying the number of pages to be printed by the number of copies is extracted. However, if N-up printing is specified in the print setting information, this is also taken into consideration. For example, when printing 5 copies of a 10-page electronic document by 2-up printing, 25 (= 10 ÷ 2 × 5) pieces of medium identification information are extracted.
Next, the identification information server 30 associates the identification information, the document ID, and the print settings and registers them in the identification information storage unit 33 (step 303). Then, the identification information server 30 transmits the identification information to the document server 20 (step 304).

Thereby, the document server 20 receives the identification information (step 204). Then, a code image representing the identification information and the position information is generated (step 205).
That is, in the document server 20, the receiving unit 21 receives the medium identification information. Then, the reception unit 21 passes the received medium identification information to the identification information acquisition unit 22. Then, the identification information acquisition unit 22 first passes the acquired medium identification information to the identification code generation unit 27a, and the identification code generation unit 27a encodes the medium identification information using the method described above to generate an identification code. .
In addition, the position code generation unit 27b receives print settings from the reception unit 21, encodes position information in a range corresponding to the print settings using the above-described method, and generates a position code.
Then, the code arrangement unit 27c arranges the medium identification code and the position code according to a predetermined layout, and the code image generation unit 27e converts the image into an image using the pattern image stored in the pattern image storage unit 27d. A code image is generated by.

Thereafter, in the document server 20, the document image generation unit 26 generates a document image of the electronic document (step 206). At that time, the document image generation unit 26 receives the document ID acquired by the identification information acquisition unit 22 in step 201, and reads an electronic document to be printed from the document / handwriting information storage unit 25 based on the document ID. In step 201, the print setting acquired by the identification information acquisition unit 22 is received, and a document image is generated based on the print setting.
Then, the image composition unit 28 synthesizes the code image generated in step 205 and the document image generated in step 206 to generate a composite image (step 207).
Thereafter, the composite image is transferred to the transmission unit 29, and the transmission unit 29 transmits a print command for the composite image to the image forming apparatus 40 (step 208). Here, the composite image print command is transmitted, for example, in a PDL format in which the content to be printed as a code image is set as a PDL command to a PDL (Page Description Language) file including a sequence of print commands for document images. .

  The image forming apparatus 40 receives the composite image (document image and code image of the electronic document) from the document server 20 (step 401). Then, the image forming apparatus 40 develops the document image into an image using Y (yellow), M (magenta), and C (cyan) (step 402). Next, the document image is formed using C, M, and Y toners, and the code image is formed using K (black including carbon) toner (step 403).

In the above-described example, the identification information server 30 simply issues the identification information, and the document server 20 generates a code image including the identification information and instructs the image forming apparatus 40 to form an image. However, the identification information server 30 may generate a code image and instruct the image forming apparatus 40 to form an image.
Further, a configuration in which the code image is generated by the image forming apparatus 40 may be adopted. In that case, the document server 20 or the identification information server 30 adds the identification information to the PDL generated from the electronic document and transmits it to the image forming apparatus 40, and the image forming apparatus 40 generates a code image including the identification information. It will be.

  In the above example, the configuration in which the database (identification information storage unit 33) configured by associating the identification information, the document ID, and the print setting is placed in the identification information server 30 has been described. This is because placing such a database on a sharable device (identification information server 30) makes it possible to handle multiple users and ensure the security of electronic documents using server access control technology. However, such a configuration is not necessarily employed, and a configuration in which the above database is placed in the terminal device 10 or the document server 20 may be employed.

In the image forming apparatus 40 described above, the code image is formed by using K (black containing carbon) toner. This is because the K toner has a larger amount of infrared light absorption than the C (cyan), M (magenta), and Y (yellow) toner, and the digital pen 60 can easily read the code image. is there. However, the code image can also be formed using special toner.
Here, as the special toner, an invisible toner having a maximum absorption rate of 7% or less in the visible light region (400 nm to 700 nm) and an absorption rate of 30% or more in the near infrared region (800 nm to 1000 nm) is exemplified. . Here, “visible” and “invisible” are not related to whether they can be recognized visually. “Visible” and “invisible” are distinguished depending on whether or not an image in a printed document can be recognized by the presence or absence of color development due to absorption of a specific wavelength in the visible light region. Also, “invisible” includes those that have some color developability due to absorption of a specific wavelength in the visible light region but are difficult to be recognized by human eyes.

  Here, the code image is combined with the image of the electronic document and printed. However, the code image may be printed on white paper (notebook, tag, etc.). In that case, the document ID is not included in the print request received in step 201, the identification information is not associated with the document ID and the print setting in step 303, and the generation of the document image in step 206 is not executed. What should I do?

[Handwriting information registration process]
Next, an operation when the digital pen 60 generates handwriting information and registers it in the document server 20 will be described.
As described above, in the digital pen 60, the identification information acquisition unit 612b acquires identification information. In addition, the position information acquisition unit 612c acquires position information. Further, the handwriting information generation unit 612d connects the position information to each other to generate handwriting information. Then, the communication unit 66 transmits the identification information and handwriting information to the identification information server 30 via the terminal device 50. The identification information server 30 registers the handwriting information in the document server 20.
FIG. 12 is a sequence diagram illustrating an example of operations of the identification information server 30 and the document server 20 when registering handwriting information.
In the identification information server 30, first, the receiving unit 31 receives identification information and handwriting information from the digital pen 60 (step 311). Next, the identification information and handwriting information are passed to the identification information management unit 32, and the identification information management unit 32 takes out the document ID associated with the passed identification information from the identification information storage unit 33. Then, the document server 20 (the document server 20 in which the electronic document specified by the document ID exists) is determined as the transmission destination of the identification information and handwriting information received in step 311 (step 312). If the document ID is not associated with the identification information in the identification information storage unit 33, it is considered that the identification information is assigned to a blank sheet (note or tag). In that case, the document server 20 that manages the handwriting information for the white paper may be determined as the transmission destination.
Thereafter, the identification information and the handwriting information are transferred to the transmission unit 39, and the transmission unit 39 transmits the identification information and the handwriting information to the document server 20 determined as the transmission destination in Step 312 (Step 313).

  Thereby, in the document server 20, the receiving part 21 receives identification information and handwriting information (step 211). Then, the reception unit 21 passes the received identification information to the handwriting information management unit 24. Then, the handwriting information management unit 24 stores the identification information and the handwriting information in association with each other in the document / handwriting information storage unit 25 (step 212).

  As described above, in the digital pen 60 used in the handwriting information management system according to the present embodiment, the output management unit 613 determines a predetermined transmission order for the frame data transmitted to the terminal device 50 via the communication unit 66. When the frame data is read from the buffer memory 618 or the information memory 65 which stores the frame data by assigning the transmission rank, the frame data is read according to a predetermined transmission rank. And it outputs to the communication part 66 from the order which read frame data. Accordingly, even when the communication speed between the communication unit 66 and the terminal device 50 is slower than the generation speed of writing information or the like, frame data having a high degree of importance is grasped in the terminal device 50 in order to grasp the contents of writing. Occurrence of a situation that was not transmitted is reduced.

It is the figure which showed an example of the structure of the handwriting information management system of this Embodiment. It is the block diagram which showed an example of the function structure of the document server. It is the figure which showed an example of the image etc. which comprise a code image. It is the block diagram which showed an example of the function structure of the identification information server. It is the figure which showed an example of the structure of a digital pen. It is the block diagram which showed an example of the function structure of the control part. It is the figure which showed an example of the handwriting formed by a user's writing operation. In the state where the “writing mode” is set, for example, when the hiragana character “tsu” in FIG. 7 is written, the situation in which the frame data is transmitted according to the transmission order is displayed on the display unit of the terminal device. It is the figure shown as the content. It is the flowchart which showed an example of the procedure of the process in which an output management part reads frame data from a buffer memory in order of priority. It is the figure which showed the hardware constitutions of the control part of a digital pen. It is the sequence diagram which showed an example of the operation | movement at the time of a printed document being produced | generated in a handwriting information management system. It is the sequence diagram which showed an example of operation | movement of the identification information server at the time of registering handwriting information, and a document server.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Terminal device, 20 ... Document server, 30 ... Identification information server, 40 ... Image forming device, 50 ... Terminal device, 60 ... Digital pen, 61 ... Control part, 63 ... Infrared CMOS, 66 ... Communication part, 611 ... Image processing unit 612 ... Data processing unit 613 ... Output management unit 614 ... Illumination drive unit 616 ... Operation control unit 618 ... Buffer memory SW2 ... Pen pressure detection switch

Claims (12)

Code image reading means for reading a code image printed on a medium;
Information acquisition means for acquiring predetermined information from the code image read by the code image reading means;
Handwriting information generating means for generating handwriting information that is information related to a user's writing operation on the medium based on the predetermined information acquired by the information acquiring means;
Transmission means for transmitting the predetermined information acquired by the information acquisition means and / or the handwriting information generated by the handwriting information generation means to an external device in a data group unit having a predetermined data length. ,
The transmission means sets a transmission order for each data group in the predetermined information and / or the handwriting information, and sequentially transmits the predetermined information and / or the handwriting information according to the transmission order. Handwriting information generation device.   The handwriting information generating apparatus according to claim 1, wherein the transmission unit sets the transmission order in association with the user's writing operation.   When transmitting the predetermined information and / or the handwriting information to the external device as reference information for referring to specific information, the transmission means sets the transmission order of the predetermined information and / or the handwriting information. The handwriting information generating apparatus according to claim 1, wherein the handwriting information generating apparatus is set to the highest value.   The transmission means transmits the transmission order of the handwriting information generated at the beginning and the end of the writing operation when transmitting the predetermined information and / or the handwriting information as the reference information to the external device. The handwriting information generating apparatus according to claim 3, wherein the handwriting information generating apparatus is set lower than the rank.   The transmission means sets the transmission order of the handwriting information generated at predetermined intervals in the writing operation to be lower than the transmission order acquired at the beginning and the end of the writing operation. The handwriting information generation apparatus according to claim 4. The information acquisition means acquires the predetermined information in units of the data group and adds identification information for each data group,
The handwriting information generation means generates the handwriting information in units of the data group and adds identification information for each data group,
2. The handwriting information generation apparatus according to claim 1, wherein the transmission unit sets the transmission order to the predetermined information and / or the handwriting information based on the identification information. On the computer,
A function of acquiring predetermined information from the code image read from the medium on which the code image is printed;
A function of generating handwriting information that is information related to a user's writing operation on the medium based on the acquired predetermined information;
A function for setting a transmission order for each data group when transmitting the predetermined information and / or the handwriting information to an external device in a data group unit having a predetermined data length;
A program for realizing a function of transmitting the predetermined information and / or the handwriting information to the external device in order according to the transmission order.   8. The program according to claim 7, wherein the function for setting the transmission order sets the transmission order in association with the user's writing operation.   The function of setting the transmission order is such that when the predetermined information and / or the handwriting information is transmitted to the external device as reference information for referring to specific information, the predetermined information and / or the handwriting information 8. The program according to claim 7, wherein the highest transmission order is set.   The function of setting the transmission order transmits the transmission order of the handwriting information generated at the beginning and the end of the writing operation to the external device as the predetermined information and / or the handwriting information as the reference information. 10. The program according to claim 9, wherein the program is set lower than the transmission order in the case.   The function of setting the transmission order is such that the transmission order of the handwriting information generated at predetermined intervals in the writing operation is more than the transmission order of the handwriting information acquired at the beginning and the end of the writing operation. The program according to claim 10, wherein the program is set low. A handwriting information generating device that generates handwriting information that is information related to a user's writing operation on a medium on which a document image and a code image based on an electronic document are printed, and obtains predetermined information from the code image;
The predetermined information and / or the handwriting information is acquired from the handwriting information generation device, and the acquired predetermined information and / or the handwriting information is managed in association with the medium or the electronic document printed on the medium. A handwriting information management device,
The handwriting information generation device
Code image reading means for reading a code image printed on the medium;
Information acquisition means for acquiring predetermined information from the code image read by the code image reading means;
Handwriting information generating means for generating handwriting information that is information related to a user's writing operation on the medium based on the predetermined information acquired by the information acquiring means;
Transmission means for transmitting the predetermined information acquired by the information acquisition means and / or the handwriting information generated by the handwriting information generation means to the handwriting information management device in units of a data group having a predetermined data length. And
The transmission means sets a transmission order for each data group in the predetermined information and / or the handwriting information, and sequentially transmits the predetermined information and / or the handwriting information according to the transmission order. Handwriting information management system.

Images