JP5181700B2 - Handwriting information generation apparatus, program, and handwriting information management system - Google Patents

Description

  The present invention relates to a handwriting information generation device, a program, and a handwriting information management system.

2. Description of the Related Art In recent years, attention has been paid to a technique in which characters, figures, and the like written on a medium such as paper are converted into electronic data, which is transferred to a personal computer, a mobile phone, etc., and the written contents are stored.
For example, in the technique described in Patent Document 1, characters written with a pen device using a medium on which code images of various patterns with fine dots are printed and a pen device having an image pickup device, for example, A code image at a position such as a figure is read into the image sensor. Thereby, the position coordinates of characters and figures are specified, and an electronic document composed of written characters and figures is generated, and characters and figures are added to a predetermined electronic document.
For example, in the technique described in Patent Document 2, a code image printed on a predetermined area on a medium is read by a pen device, for example, a command for instructing a computer to open a web browser program is created. Link to a predetermined web address.

JP 2004-94907 A Special table 2003-523572 gazette

Here, in general, in a handwriting information generation device such as a pen device that reads a code image on a medium and generates handwriting information, for example, a terminal device or the like for managing the handwriting information is read handwritten information or the like. Send. At that time, for example, the communication speed to the terminal device that is the transmission destination may decrease, and part of the handwriting information generated by the handwriting information generation device may not be transmitted. In that case, a part of the handwriting information received by the terminal device or the like may be lost, and the reliability of the handwriting information may be reduced.
An object of this invention is to suppress the fall of reliability, such as handwriting information acquired from the handwriting information generation apparatus in the terminal device.

The invention according to claim 1 is a handwriting information generation device that generates handwriting information and transmits the handwriting information to a terminal device directly connected by wire or wirelessly, and reads a code image printed on a medium A code image reading unit; an information acquisition unit that acquires predetermined information from the code image read by the code image reading unit; and a medium that is stored in the medium based on the predetermined information acquired by the information acquisition unit. Handwriting information generation means for generating handwriting information that is information related to the user's writing operation, and the predetermined information acquired by the information acquisition means and / or the handwriting information generated by the handwriting information generation means the and transmitting means for transmitting to the terminal device in a data group unit having a predetermined data length, said transmission means, said sequential from the terminal device at a predetermined interval, the feed A handwriting information generating apparatus characterized by in synchronism with the transmission request signal transmitted to the means for transmitting the predetermined information and / or the handwriting information in order for each of the data groups.

According to a second aspect of the present invention, the code image reading unit reads the code image from the medium at a predetermined cycle, and the information acquisition unit reads the predetermined image from the code image read at the predetermined cycle. The predetermined information of the data length is acquired, the handwriting information generation unit generates the handwriting information of the predetermined data length from the predetermined information of the predetermined data length, and the transmission unit acquires the information acquisition The predetermined information and / or the handwriting information is acquired as the data group from the means and / or the handwriting information generation means, and the acquired data group is transmitted. It is a handwriting information generation apparatus of description.
The invention according to claim 3 is characterized in that the transmitting means transmits the data group acquired after receiving the transmission request signal from the terminal device from the head data of the data group. Handwriting information generation device.
According to a fourth aspect of the present invention, the transmission means detects the top data of the data group acquired after receiving the transmission request signal from the terminal device, and transmits the data group in synchronization with the transmission request signal. 3. The handwriting information generation apparatus according to claim 2, wherein the data group is set to the data group in which the head data is detected.

The invention according to claim 5 is a handwriting information generation device that generates handwriting information and transmits the handwriting information to a terminal device directly connected by wire or wirelessly. A function of acquiring predetermined information from the code image, a function of generating handwriting information which is information related to a user's writing operation on the medium based on the acquired predetermined information, and the acquired predetermined information The predetermined information and / or the handwriting information is synchronized with a transmission request signal transmitted to the handwriting information generation device sequentially at predetermined intervals from a terminal device that transmits the information and / or the generated handwriting information. A program for realizing a function of transmitting data to a terminal device in order for each data group having a predetermined data length.
According to a sixth aspect of the present invention, the function for transmitting acquires the predetermined information and / or the handwriting information as the data group having the predetermined data length in order, and receives the transmission request signal from the terminal device. 6. The program according to claim 5, wherein the data group acquired after the transmission is transmitted from the top data of the data group.
According to a seventh aspect of the present invention, the function for transmitting obtains the predetermined information and / or the handwriting information in order as the data group having the predetermined data length, and receives the transmission request signal from the terminal device. 6. The head data of the data group acquired after detection is detected, and the data group transmitted in synchronization with the transmission request signal is set as the data group in which the head data is detected. It is the program described.

The invention according to claim 8 generates handwriting information which is information related to a user's writing operation on a medium on which a document image and a code image based on an electronic document are printed, and predetermined information is obtained from the code image. a handwriting information producing device for acquiring the handwriting information management device for managing connection with the predetermined information and / or the handwriting information to the electronic document printed on the medium or the medium, predetermined from the handwriting information generating device Information and / or the handwriting information, and the information transmission device that transmits the acquired predetermined information and / or the handwriting information to the handwriting information management device, and the handwriting information generation device A code image reading means for reading a printed code image, an information acquisition means for acquiring predetermined information from the code image read by the code image reading means, and the information acquisition Handwriting information generating means for generating handwriting information which is information related to a user's writing operation on the medium based on the predetermined information acquired by the means, and the predetermined information acquired by the information acquiring means And / or transmitting means for transmitting the handwriting information generated by the handwriting information generating means to the information transmitting apparatus in units of data consisting of a predetermined data length, the transmitting means from the information transmitting apparatus A handwriting information management system characterized by sequentially transmitting the predetermined information and / or the handwriting information for each data group in synchronization with a transmission request signal transmitted to the transmitting unit sequentially at a predetermined interval. .

In the invention according to claim 9, the transmission unit of the handwriting information generation device sequentially acquires the predetermined information and / or the handwriting information as the data group having the predetermined data length, and the information transmission device 9. The handwriting information management system according to claim 8, wherein the data group acquired after receiving the transmission request signal is transmitted from the top data of the data group.
According to a tenth aspect of the present invention, the transmission unit of the handwriting information generation device sequentially acquires the predetermined information and / or the handwriting information as the data group having the predetermined data length, from the information transmission device. Detecting head data of the data group acquired after receiving the transmission request signal, and setting the data group to be transmitted in synchronization with the transmission request signal as the data group in which the head data is detected. 9. The handwriting information management system according to claim 8, wherein
In the invention according to claim 11, the information transmission device determines whether or not data loss has occurred in the predetermined information and / or the handwriting information acquired from the handwriting information generation device in units of the data group. The handwriting information management system according to claim 8, wherein:

The invention according to claim 12 is characterized in that the information transmitting device transmits the transmission request to the handwriting information generating device when determining whether or not data loss has occurred in the predetermined information and / or the handwriting information. 12. The handwriting information management system according to claim 11, wherein the signal transmission timing is changed.
The invention according to claim 13 is the handwriting information management system according to claim 8, wherein the information transmitting apparatus discards the data group determined to have the data loss.
In the invention described in claim 14, the handwriting information generation device determines whether or not data loss has occurred in the predetermined information and / or the handwriting information transmitted to the handwriting information generation device. The handwriting information management system according to claim 8, wherein:

According to Claim 1 of this invention, compared with the case where this invention is not employ | adopted, the fall of reliability, such as handwriting information acquired from the handwriting information generation apparatus in the terminal device, can be suppressed.
According to the second aspect of the present invention, since data transmission is performed as a data group having a data length corresponding to the code image read at a predetermined cycle, the data transmission can be adjusted in units of the read code image. Compared to the case where the communication error is not employed, error processing when a communication error occurs can be smoothly performed.
According to claim 3 of the present invention, compared to the case where the present invention is not adopted, transmission from the middle of each data group is suppressed, and data is transmitted in units of data groups having a data length corresponding to the code image. can do.
According to claim 4 of the present invention, by detecting the head data of each data group, transmission from the middle of each data group is suppressed compared to the case where the present invention is not adopted, and it is made to correspond to the code image. Data can be transmitted in units of data groups of data length.

According to Claim 5 of this invention, compared with the case where this invention is not employ | adopted, the fall of reliability, such as handwriting information acquired from the handwriting information generation apparatus in the terminal device, can be suppressed.
According to the sixth aspect of the present invention, compared to a case where the present invention is not adopted, transmission from the middle of each data group is suppressed, and data is transmitted in units of data groups having a data length corresponding to the code image. can do.
According to claim 7 of the present invention, by detecting the head data of each data group, transmission from the middle of each data group is suppressed compared to the case where the present invention is not adopted, and it is made to correspond to the code image. Data can be transmitted in units of data groups of data length.

According to claim 8 of the present invention, as compared with the case where the present invention is not adopted, the reliability of the handwriting information acquired from the handwriting information generation device by the terminal device that transmits the handwriting information etc. to the handwriting information management device. Deterioration can be suppressed.
According to claim 9 of the present invention, compared to the case where the present invention is not adopted, transmission from the middle of each data group is suppressed, and data is transmitted in units of data groups having a data length corresponding to the code image. can do.
According to claim 10 of the present invention, by detecting the head data of each data group, transmission from the middle of each data group is suppressed as compared with the case where the present invention is not adopted, and it is made to correspond to the code image. Data can be transmitted in units of data groups of data length.

According to the eleventh aspect of the present invention, since error data can be extracted in units of data groups, data loss can be minimized as compared with the case where the present invention is not adopted.
According to the twelfth aspect of the present invention, it is possible to more reliably extract error data and to suppress a decrease in data reliability than in the case where the present invention is not adopted.
According to the thirteenth aspect of the present invention, since error data is discarded, it is possible to suppress a decrease in the reliability of data transmitted to the handwriting information management apparatus, compared to a case where the present invention is not adopted.
According to the fourteenth aspect of the present invention, since error data can be extracted in units of data groups, data loss can be minimized as compared with the case where the present invention is not adopted.

The best mode for carrying out the present invention (hereinafter referred to as “embodiment”) will be described below in detail with reference to the accompanying drawings.
First, the overall configuration of the handwriting information management system in the present embodiment will be described.
FIG. 1 is a diagram showing an example of the configuration of the handwriting information management system of the present embodiment. As shown in FIG. 1, the handwriting information management system includes a terminal device 10, a document server 20 as an example of a handwriting information management device, an identification information server 30 as an example of a handwriting information management device, and an image forming apparatus. 40 and a terminal device 50 as an example of an information transmission device are connected to a network 80. In addition, a digital pen 60 as an example of a handwriting information generation device is connected to the terminal device 50 in a communicable manner.

In the handwriting information management system of the present embodiment, when a print request for an electronic document is made from the terminal device 10, the document server 20, which is an example of the handwriting information management device, receives the print request from the terminal device 10, and the image forming apparatus 40 is instructed to print the electronic document that is the target of the print request. Thereby, the image forming apparatus 40 prints the document image of the electronic document on a medium such as paper. At this time, the image forming apparatus 40 prints a code image on the medium in addition to the document image.
The code image here is an image of the identification code and the position code obtained by encoding the identification information and the position information. The identification information is information for uniquely identifying a medium, and is issued by the identification information server 30 which is an example of a handwriting information management apparatus in the present embodiment. The position information is information for specifying the coordinate position on the medium, and is generated by the document server 20 in the present embodiment.
Then, when the user writes (handwriting) on the medium on which the document image and the code image are printed using the digital pen 60 which is an example of a handwriting information generation device, the digital pen 60 is an example of information included in the code image. Handwritten information (handwriting information) is generated based on the positional information. At the same time, the digital pen 60 recognizes identification information that is an example of information included in the code image. The recognized identification information and handwriting information are sent to the document server 20 via the terminal device 50 which is an example of an information transmission device (external device). The document server 20 that has received the identification information and the handwriting information specifies the electronic document printed on the medium based on the identification information, and stores the specified electronic document and the handwriting information in association with each other.
In addition, the digital pen 60 is set with a function of using the position information and identification information included in the code image as reference information for linking to predetermined information instead of generating handwriting information. For example, the position information and the identification information are used as information for generating a command for opening a predetermined web browser program and linking the terminal device 50 to a predetermined web address or the like. In that case, the terminal device 50 links to a predetermined web address based on the position information and the identification information, and acquires the predetermined information.

In this specification, electronic data that is the basis of an image recorded on a medium is expressed as “electronic document”. However, this does not mean only data obtained by digitizing a “document” including text. For example, "electronic document" including image data (regardless of raster data or vector data) such as pictures, photographs, figures, etc., data recorded by database management software or spreadsheet software, and other printable electronic data It is said.
In the present specification, the “medium” may be any material as long as it can print an image. A typical example is paper, but it may be a plastic sheet such as an OHP sheet or a metal plate.
Furthermore, in this specification, processing is performed using identification information for uniquely identifying each of the electronic document, the medium, and the digital pen 60 and the user. It shall mean the identification information. That is, in the present embodiment, this identification information is used as an example of medium identification information uniquely given to the medium.

Then, each component which comprises the handwriting information management system of this Embodiment is demonstrated in detail.
The terminal device 10 is a computer device that requests the document server 20 to print an electronic document. Here, as the terminal device 10, for example, a personal computer, a workstation, or another computer is used.
The document server 20 is an example of a handwriting information management device, and is a computer device that stores and manages electronic documents. Also, when a request for printing an electronic document is received from the terminal device 10, an image of the electronic document and a code image representing identification information and position information are generated, and a print command for printing a composite image obtained by synthesizing the image on a medium is generated. Output to the forming apparatus 40. Here, as the document server 20, for example, a personal computer, a workstation, or another computer is used.

The identification information server 30 is an example of a handwriting information management device, and is a computer device that issues identification information to be given to a medium. The issued identification information is stored in association with the electronic document printed on the medium to which the identification information is assigned. Here, as the identification information server 30, for example, a personal computer, a workstation, or another computer is used.
The image forming apparatus 40 is an apparatus that prints an image on a medium and outputs it as a print document. The image forming apparatus 40 may be a single printer or printing machine, or may be a so-called “multifunction machine” having a scanner or a communication function. Here, as an image forming method in the image forming apparatus 40, for example, an electrophotographic method may be used, but other methods may be used.

The terminal device 50 transmits information obtained by digitizing writing on the print document (hereinafter referred to as “handwriting information”) to the identification information server 30 in order to reflect the information in the electronic document that is the basis of the image recorded in the print document. A computer device. Alternatively, the electronic document to be reflected in the handwriting information may be displayed on a display (not shown), and the handwriting information may be displayed on the display. Here, as the terminal device 50, for example, a personal computer, a workstation, or another computer is used. In the present embodiment, handwriting information is used as an example of handwriting information obtained by digitizing the contents of writing. The handwriting information is mainly described as handwritten information, but is not limited to this, and includes, for example, information mechanically drawn by a plotter that is a device for outputting drawing data such as architecture and machinery.
The terminal device 50 is also a computer device that links to predetermined information based on position information and identification information sent from the digital pen 60. For example, the terminal device 50 generates a command to open a predetermined web browser program and link to a predetermined web address or the like from the position information and the identification information. And based on position information and identification information, it links to a predetermined web address and acquires predetermined information.
The terminal device 50 is connected to the digital pen 60 by, for example, a USB (Universal Serial Bus) cable, and communicates with the digital pen 60. Then, identification information and handwriting information or position information are acquired from the digital pen 60. Here, as a communication method between the digital pen 60 and the terminal device 50, a wireless method such as Bluetooth (registered trademark) or an infrared communication function may be used in addition to a wired method such as a USB cable.

  The digital pen 60 is an example of a handwriting information generation device, and is a pen device used for writing characters or figures on a printed document. An image sensor that reads a code image printed on the medium is provided. And the positional information which is an example of the information acquired from the code | cord image read with the image pick-up element is detected. Furthermore, handwriting information obtained by converting character or graphics written from the position information into image data is generated and stored based on the position information. Also, identification information, which is an example of information acquired from the code image read by the image sensor, is detected and stored.

Subsequently, details of each component constituting the handwriting information management system will be described.
First, the configuration of the document server 20 will be described.
FIG. 2 is a block diagram illustrating an example of a functional configuration of the document server 20. As shown in FIG. 2, the document server 20 includes a reception unit 21, an identification information acquisition unit 22, an electronic document management unit 23, a handwriting information management unit 24, and a document / handwriting information storage unit 25. Further, it includes an identification code generation unit 27a, a position code generation unit 27b, a code arrangement unit 27c, a pattern image storage unit 27d, and a code image generation unit 27e. Furthermore, a document image generation unit 26, an image composition unit 28, and a transmission unit 29 are provided.

The receiving unit 21 receives a print request from the terminal device 10. Here, in addition to the electronic document, the print request includes identification information (hereinafter referred to as “document ID”) of the electronic document to be printed and various kinds of information for determining the layout of the electronic document on the printed medium. Settings (hereinafter referred to as “print settings”) are included. The document ID is assigned to each electronic document by the terminal device 10, but may be assigned by the document server 20. Further, the receiving unit 21 receives from the identification information server 30 identification information that is uniquely given to the medium on which the print document is printed. Further, when writing is performed on the print document, the identification information embedded in the print document and handwriting information obtained by digitizing the content of the print document (written image) are received from the identification information server 30. .
The identification information acquisition unit 22 acquires the document ID and print settings from the reception unit 21, passes them to the transmission unit 29, instructs transmission of an identification information issue request, passes this to the document image generation unit 26, and sends the document Instructs generation of an image. Further, the identification information of the medium is acquired from the receiving unit 21, and this is passed to the identification code generating unit 27a to instruct generation of the identification code.

  The electronic document management unit 23 acquires the identification information and the electronic document received by the reception unit 21 and registers them in the document / handwriting information storage unit 25 in association with each other based on the document ID. Also, a new electronic document (second electronic document) that reflects the state of the electronic document stored in the document / handwriting information storage unit 25 printed on the medium according to the print settings is generated, and the generated second The second electronic document is stored in the document / handwriting information storage unit 25. Further, when the display or printing of the electronic document is instructed, the corresponding identification information and electronic document are taken out from the document / handwriting information storage unit 25.

The handwriting information management unit 24 acquires the identification information and handwriting information received by the receiving unit 21 and registers the handwriting information in the document / handwriting information storage unit 25 in association with the electronic document based on the identification information. When the display of handwriting information is instructed, the corresponding identification information and handwriting information are extracted from the document / handwriting information storage unit 25.
The document / handwriting information storage unit 25 stores an electronic document managed by the electronic document management unit 23 and handwriting information managed by the handwriting information management unit 24. Here, in the present embodiment, the document / handwriting information storage unit 25 is provided as an example of a storage unit that stores the identification information, the electronic document, and the handwriting information in association with each other.

The identification code generation unit 27a generates identification code by encoding identification information for specifying a medium.
The position code generation unit 27b encodes position information indicating the coordinate position on the medium to generate a position code.
The code arrangement unit 27c arranges the identification code generated by the identification code generation unit 27a, the position code generated by the position code generation unit 27b, and the like on a two-dimensional plane according to a predetermined layout (see FIG. 3 in the subsequent stage). Then, a two-dimensional code array is generated.
The pattern image storage unit 27d stores a pattern image corresponding to the code value of each code stored in the code array.
The code image generation unit 27e refers to the two-dimensional code array generated by the code arrangement unit 27c, selects a pattern image corresponding to each code value, and generates a code image.

The document image generation unit 26 acquires a document ID and print settings from the identification information acquisition unit 22, and reads an electronic document specified by the document ID from the document / handwriting information storage unit 25. Then, a document image of the electronic document is generated according to the print setting.
The image composition unit 28 synthesizes the code image generated by the code image generation unit 27e and the document image generated by the document image generation unit 26 to generate a composite image.
The transmission unit 29 transmits an identification information issuance request to the identification information server 30. Also, an image print command for the medium is transmitted to the image forming apparatus 40. Furthermore, when the display of handwriting information is instructed, the identification information and handwriting information are transmitted to the identification information server 30.

Here, a code image generated by the document server 20 of the present embodiment will be described.
FIG. 3 is a diagram illustrating an example of an image constituting the code image. First, unit patterns constituting a code image will be described. FIG. 3A shows an example of the unit pattern.
The unit pattern is the minimum unit for embedding information. In FIG. 3A, a black area and a shaded area are areas where dots can be arranged, and a white area between them is an area where dots cannot be arranged. In addition, among the areas where dots can be arranged, dots are arranged in black areas, and dots are not arranged in hatched areas. That is, FIG. 3A shows an example in which the unit pattern is configured by arranging dots at two places (black areas) selected from nine places where dots can be arranged. Here, since there are 36 (= ₉ C ₂ ) combinations for selecting two locations out of nine locations, there are 36 types of unit patterns. Of these, four types of unit patterns are used as synchronization patterns. The synchronization pattern is a pattern for detecting the rotation of the image and specifying the relative positions of the identification code and the position code. In particular, since it is necessary to detect the rotation of the image, the four types of synchronization patterns are selected such that when one of the synchronization patterns is rotated 90 degrees, another synchronization pattern is obtained. Further, the 32 types of unit patterns other than the 4 types of unit patterns are used as information patterns expressing the identification code and the position code, and 5-bit information is expressed.

  By the way, the dots shown in FIG. 3A are only for information representation, and do not necessarily coincide with the dots that mean the minimum points constituting the image. In the present embodiment, dots for information expression (the minimum square in FIG. 3A) have a size of 2 dots × 2 dots at 600 dpi. Since the size of one dot at 600 dpi is 0.0423 mm, one side of a dot for information expression (the minimum square in FIG. 3A) is 84.6 μm (= 0.0423 mm × 2). The larger the dot for information expression, the more likely it is to be noticeable. Therefore, it is preferable that the dot is as small as possible. However, if it is too small, printing with a printer becomes impossible. Therefore, the above values larger than 50 μm and smaller than 100 μm are employed as the size of dots for information expression. However, the above value 84.6 μm is a numerical value to the last, and is about 100 μm in the actually printed toner image. In the present specification, the term “dot” refers to a dot for information expression, not a dot that means the minimum point constituting an image unless otherwise specified.

Next, a code block composed of such unit patterns will be described. FIG. 3B shows an example of the layout of the code block. Here, not the image but the code arrangement immediately before being replaced by the pattern image is shown. That is, a unit pattern as shown in FIG. 3A (any one of 36 unit patterns) is arranged in the smallest square (hereinafter referred to as “unit block”) in FIG. Will be formed.
In the layout of FIG. 3B, the synchronization code is arranged in one unit block at the upper left of the code block. Further, the X position code is arranged in the four unit blocks on the right side of the unit block in which the synchronization code is arranged, and the Y position code is arranged in the four unit blocks on the lower side of the unit block in which the synchronization code is arranged. . Furthermore, identification codes are arranged in 16 (= 4 × 4) unit blocks surrounded by unit blocks in which these position codes are arranged.

Here, encoding of identification information will be described.
When encoding identification information, the bit string which comprises identification information is divided | segmented into a some block in order to perform RS encoding. Although there are several methods for encoding, RS encoding is suitable in this embodiment. This is because the RS code is a multi-value coding method, and in this case, the value represented by the unit block corresponds to the multi-value of the RS code. For example, when 5-bit information is expressed by one unit block, the 60-bit identification information is divided into 12 blocks having a block length of 5 bits. If an RS code capable of correcting two blocks of errors is employed, the code length is 16 blocks, which can be accommodated in a unit block in which the identification code in the code block of FIG. Note that the encoding method is not limited to the RS code, and other encoding methods such as a BCH code may be used.

Subsequently, encoding of position information will be described.
For encoding the position information, an M-sequence code, which is a kind of pseudo-random sequence, is used. Here, the M sequence refers to a sequence having the longest period among a shift register having a certain length and a code sequence generated by feedback. When K is the number of stages in the shift register, the sequence length of the M sequence is 2 ^K −1. Arbitrary consecutive K bits extracted from the M sequence have a property that they do not appear at other positions in the same M sequence. Therefore, the position information is encoded using this property.
By the way, in the present embodiment, a necessary M-sequence order is obtained from the length of position information to be encoded, and an M-sequence is generated. However, if the length of the position information to be encoded is known in advance, it is not necessary to generate the M sequence each time. That is, a fixed M sequence may be generated in advance and stored in a memory or the like.
For example, it is assumed that an M sequence (K = 13) having a sequence length of 8191 is used. In this case, since the position code is also embedded in units of 5 bits, 5 bits are taken out from the M sequence having a sequence length of 8191 and blocked.

  In this specification, the identification information and the position information are clearly distinguished and used for the sake of simplicity. However, there is a technique in which a wide range of position information is prepared, the position information is cut out and embedded from different ranges for each medium, and the medium is identified by the difference in position information. Therefore, in such a method, it is assumed that the position information has a function for identifying the medium, and the position information is also considered as the identification information.

Next, the configuration of the identification information server 30 will be described.
FIG. 4 is a block diagram illustrating an example of a functional configuration of the identification information server 30. As illustrated in FIG. 4, the identification information server 30 includes a reception unit 31, an identification information management unit 32, an identification information storage unit 33, a display information generation unit 34, and a transmission unit 39.
The receiving unit 31 receives an identification information issue request from the document server 20. The receiving unit 31 receives medium identification information and handwriting information from the terminal device 50 when writing is performed on the print document. Here, in the present embodiment, the medium identification information and the handwriting information are received from the terminal device 50, and when the display of the handwriting information is instructed, the medium identification information and the handwriting information are obtained from the document server 20. A receiving unit 31 is provided as an example of receiving means for receiving.

When there is a request for issuing identification information, the identification information management unit 32 issues the identification information without duplication, and stores the document ID and print settings specified at that time in association with the identification information. In response to designation of identification information, a document ID and print settings corresponding to the identification information are extracted.
The identification information storage unit 33 stores the identification information in the used / unused state, the document ID of the electronic document printed on the medium to which the identification information is added, and the electronic document printed on the medium to which the identification information is printed. It is a database that stores print settings in association with each other.
The display information generation unit 34 generates display information for displaying the handwriting information based on the information acquired from the document server 20 when the display of the handwriting information is instructed. As this display information, for example, data serving as a source for generating an image to be displayed on the terminal device 50 is generated.

  The transmission unit 39 transmits identification information issued in response to a request from the document server 20 to the document server 20. In addition, when writing on a print document is performed, medium identification information and handwriting information are transmitted to the document server 20. Further, when the display of handwriting information is instructed, the display information is transmitted to the terminal device 50. Here, in the present embodiment, a transmission unit 39 is provided as an example of a transmission unit that transmits medium identification information and handwriting information.

Next, the digital pen 60 will be described.
FIG. 5 is a diagram illustrating the configuration of the digital pen 60. As shown in FIG. 5, the digital pen 60 has a main body housing 68 with a pen tip 64 for writing on the medium, a control unit 61 for controlling the operation of the entire pen, and an infrared light for irradiating the medium with infrared light. LED 62, infrared CMOS 63 as an example of code image reading means for reading a code image by detecting reflected light from the medium, information memory 65 as an example of storage means for storing identification information, handwriting information, and position information, external A communication unit 66 is provided as an example of a transmission unit that communicates with the apparatus. Furthermore, a rechargeable battery 67 that supplies power for driving each part of the digital pen 60 is provided.

The digital pen 60 is a cap that detects whether or not a cap 69 for protecting the pen tip 64 is attached to the digital pen 60 as an example of a signal output unit that outputs signals corresponding to various operations performed by the user. A switch SW1, a writing pressure detection switch SW2 for detecting a writing operation by the digital pen 60 by a pressure (writing pressure) applied to the pen tip 64, and a user switch SW3 for receiving an on / off input by a user operation are provided. The cap switch SW1 and the user switch SW3 are provided on the side surface portion of the main body casing 68, and the writing pressure detection switch SW2 is provided inside the main body casing 68.
The infrared LED 62, the infrared CMOS 63, the information memory 65, the communication unit 66, the cap switch SW1, the writing pressure detection switch SW2, and the user switch SW3 are connected to the control unit 61.

The infrared LED 62 is composed of one or a plurality of LEDs (Light Emitting Diodes) that emit infrared light having a wavelength of 700 to 1000 μm. Then, pulse lighting is performed based on a drive signal transmitted from an illumination drive unit 614 in the control unit 61 described later.
The infrared CMOS 63 is a CMOS sensor (Complementary Metal Oxide Semiconductor) having sensitivity in the infrared region, and uses a global shutter system capable of simultaneously transferring captured images. The infrared CMOS 63 captures a code image printed on the medium in synchronization with an image capture signal transmitted at a cycle (frame rate) of about 50 fps to 100 fps (frame per second). The image capture signal is generated by an image capture signal generation unit 615 in the control unit 61, which will be described later, and transmitted to the infrared CMOS 63.
The communication unit 66 communicates with the terminal device 50 and transmits identification information and handwriting information or position information to the terminal device 50. Further, it receives an image capture timing signal from the terminal device 50, and controls the transmission timing of identification information and handwriting information or position information sent from the output unit 613 in the control unit 61 to the terminal device 50.

Next, the control unit 61 provided in the digital pen 60 will be described.
FIG. 6 is a block diagram illustrating an example of a functional configuration of the control unit 61. As shown in FIG. 6, the control unit 61 acquires identification information and position information from the processing result in the image processing unit 611 and the image processing unit 611 that process the code image read by the infrared CMOS 63, and A data processing unit 612 that generates handwriting information, an output unit 613 that outputs identification information acquired and generated by the data processing unit 612 and handwriting information or position information to the information memory 65 or the communication unit 66, and an infrared LED 62 are driven. Illumination drive unit 614 that performs image capture signal generation unit 615 that generates an image capture signal having a predetermined period to be transmitted to infrared CMOS 63, operation control unit 616 that controls the operation of each unit, and pen identification information (pen ID). A pen ID memory 617 for storing is provided.
Here, the image processing unit 611 and the data processing unit 612 function as an information acquisition unit that acquires predetermined information from the code image printed on the medium.

The image processing unit 611 includes an image acquisition unit 611a and a dot array generation unit 611b.
The image acquisition unit 611a acquires a code image read from a print document by the infrared CMOS 63. Moreover, the noise contained in a code image is removed as needed.
The dot array generation unit 611b generates a dot array with reference to the dot positions in the code image. That is, on a two-dimensional array, for example, “1” is stored at a position where there is a dot and “0” is stored at a position where there is no dot, thereby replacing the dot detected as an image with digital data. Then, this two-dimensional array is output as a dot array.

The data processing unit 612 includes a code array generation unit 612a, an identification information acquisition unit 612b, a position information acquisition unit 612c, and a handwriting information generation unit 612d.
The code array generation unit 612a detects a block corresponding to the unit pattern in the code block on the dot array. Specifically, a frame having the same shape and size as the block in which the unit pattern is arranged is moved on the dot array, and the frame is fixed at a position where the number of dots in the frame becomes equal. For example, if the unit pattern of FIG. 3A is used, a frame having a size corresponding to 3 dots × 3 dots is moved, and the frame is fixed at a position where the number of dots included in the frame is 2. Then, a code array is generated that stores code values determined from dot positions in each block delimited by the frame. When this code array is generated, the position of the synchronization code is specified by searching for a code value of a predetermined synchronization code.

The identification information acquisition unit 612b detects the identification code based on the position of the synchronization code from the code array. Then, the identification code is decoded using the parameters used in the RS encoding process at the time of image generation, and identification information is acquired.
The position information acquisition unit 612c detects a position code with reference to the position of the synchronization code from the code array. Then, an M-sequence partial sequence is extracted from the position code, the position of this partial sequence in the M-sequence used at the time of image generation is referenced, and a value obtained by correcting this position with an offset using a synchronization code is acquired as position information. The reason for correcting with the offset is that a synchronization code is arranged between the position codes.
The handwriting information generation unit 612d is an example of a handwriting information generation unit, and generates handwriting information obtained by connecting the position information acquired by the position information acquisition unit 612c. Here, the handwriting information is data obtained by connecting and digitizing the locus of the tip of the pen tip 64 when writing (handwriting) by the pen tip 64 is performed.

  By the way, the digital pen 60 is set with a function capable of using a plurality of different operation modes. For example, in the digital pen 60 of the present embodiment, the “writing mode” that is an operation mode in which a writing image drawn on the medium by the pen tip 64 is transmitted as handwriting information to the terminal device 50, and the identification information obtained from the medium In addition, a “reference mode” is set as an operation mode used as reference information for linking one or both of position information to specific information. As an operation example in the “reference mode”, as reference information for generating a command for opening a predetermined web browser program for the terminal device 50 and linking to a web address or the like in which specific information is stored and described, The position information acquired by the position information acquisition unit 612c and the identification information acquired by the identification information acquisition unit 612b are used. In the “reference mode”, only one of the position information and the identification information may be used.

  The operation mode such as “writing mode” and “reference mode” in the digital pen 60 is such that the cap switch SW1, the writing pressure detection switch SW2, and the user switch SW3 that output a signal (ON / OFF signal) corresponding to a user operation are ON. The operation control unit 616 sets based on the / off state. Then, the operation control unit 616 sends a control signal instructing the data processing unit 612 to set the “writing mode” or the “reference mode”.

The handwriting information generation unit 612d operates according to a control signal that instructs setting of the “writing mode” from the operation control unit 616. Thereby, in the “writing mode”, the identification information acquired by the identification information acquisition unit 612b and the handwriting information generated by the handwriting information generation unit 612d are sent to the output unit 613.
On the other hand, when the “reference mode” is set by the control signal from the operation control unit 616, the handwriting information generation unit 612d stops its function. Thereby, in the “reference mode”, the identification information acquired by the identification information acquisition unit 612b and the position information acquired by the position information acquisition unit 612c are output to the output unit 613.
The handwriting information generation unit 612d may be operated in both the “writing mode” and the “reference mode” to generate handwriting information from the position information. At that time, when the “writing mode” is set, the handwriting information is used as it is as handwriting information obtained by connecting the tips of the pen tip 64. When “reference mode” is set, handwriting information is used as reference information.

In addition, the data processing unit 612 corresponds to the “writing mode” and the “reference mode” set by the operation control unit 616, and includes identification information, position information, and handwriting information generated by the data processing unit 612. Or, “operation mode information” indicating that it is generated in “writing mode” or “reference mode” is added to a plurality (see FIG. 10 in the subsequent stage). Thereby, in the terminal device 50 that has acquired the identification information, the position information, and the handwriting information to which the operation mode information is added, based on the operation mode information, writing in an area where writing cannot be performed on the medium or position information serving as reference information It is recognized that an inconvenient operation such as reading of a code image in an area where no is printed is performed. Then, the terminal device 50 notifies the digital pen 60 that the transmitted identification information, position information and handwriting information are based on an inconvenient operation and cannot be used as writing information or reference information.
Further, the data processing unit 612 includes error information generated when the identification information acquisition unit 612b acquires the identification information, error information generated when the position information acquisition unit 612c acquires the position information, and a handwriting information generation unit. Error information generated when handwriting information is generated in 612d is added to identification information, position information, and handwriting information (see FIG. 10 at a later stage). As a result, the terminal device 50 that has acquired the identification information, the position information, and the handwriting information to which the error information has been added recognizes that an error has occurred during the acquisition process or the generation process of the information. Then, the terminal device 50 instructs the user about error notification and countermeasures against individual errors.

The output unit 613 is an example of an output unit, and outputs identification information and handwriting information or position information to the information memory 65 or the communication unit 66. That is, when communication between the communication unit 66 and the terminal device 50 is established, the output unit 613 outputs identification information and handwriting information or position information to the communication unit 66. On the other hand, when communication between the communication unit 66 and the terminal device 50 is not established, the output unit 613 outputs identification information and handwriting information or position information to the information memory 65. The information memory 65 stores the acquired identification information and handwriting information or position information.
The output unit 613 reads identification information and handwriting information from the information memory 65 and outputs the identification information and handwriting information to the communication unit 66 when communication between the communication unit 66 and the terminal device 50 is established.
Note that the output unit 613 may be configured to output either one of identification information and handwriting information or position information to the information memory 65 or the communication unit 66.

The image capture signal generation unit 615 generates an image capture signal having a period (frame rate) of, for example, 50 fps to 100 fps and transmits the image capture signal to the infrared CMOS 63. The infrared CMOS 63 sequentially captures the code images printed on the medium at the frame rate set by the transmitted image capture signal. Further, the image capture signal generation unit 615 transmits the generated image capture signal to the illumination drive unit 614.
The illumination drive unit 614 generates a drive signal for driving the infrared LED 62 and turns on the infrared LED 62 in pulses. At that time, in order to correspond to the frame rate in the infrared CMOS 63, the drive signal is output in synchronization with the image capture signal generated by the image capture signal generation unit 615. Thereby, the power consumption in the infrared LED 62 is reduced.

In the digital pen 60, first, when the infrared LED 62 driven by the illumination driving unit 614 irradiates the medium with infrared light, the infrared is synchronized with the image capture signal from the image capture signal generation unit 615. The CMOS 63 receives the reflected light and reads the code image printed on the medium. The code image read by the infrared CMOS 63 is sent to the image processing unit 611 in the control unit 61.
In the image processing unit 611, the image acquisition unit 611a acquires the read code image. At that time, if noise is included in the code image, it is removed. Subsequently, the dot array generation unit 611b converts the dot positions included in the code image into digital data and generates a dot array. Then, the generated dot array is sent to the data processing unit 612.

In the next data processing unit 612, the code array generation unit 612a detects a block from the dot array, and generates a code array that stores a code value for each block. Then, the position of the synchronization code is specified in the code array. Thereafter, the identification information acquisition unit 612b detects the identification code based on the position of the synchronization code, decodes it, and acquires the identification information. The identification information acquired by the identification information acquisition unit 612b is sent to the output unit 613.
Further, the position information acquisition unit 612c detects the position code based on the position of the synchronization code, decodes this, and acquires the position information. When the “writing mode” is set, the position information acquired by the position information acquisition unit 612c is sent to the handwriting information generation unit 612d, and the handwriting information generation unit 612d connects the position information. Handwriting information is generated. The handwriting information generated by the handwriting information generation unit 612d is sent to the output unit 613. On the other hand, when the “reference mode” is set, the position information acquired by the position information acquisition unit 612 c is sent to the output unit 613 as it is.

  As described above, when the communication between the communication unit 66 and the terminal device 50 is established, the output unit 613 sends the identification information and the handwriting information or the position information to the communication unit 66. Output. On the other hand, when communication between the communication unit 66 and the terminal device 50 is not established, the output unit 613 outputs identification information and handwriting information or position information to the information memory 65. The information memory 65 stores identification information sent from the output unit 613 and handwriting information or position information. Thereby, even if communication is unsuccessful, identification information and handwriting information or position information are not lost.

Next, transmission of identification information, handwriting information, and the like from the communication unit 66 to the terminal device 50 will be described.
As described above, the infrared CMOS 63 sequentially captures the code images printed on the medium at the predetermined frame rate set by the image capture signal from the image capture signal generation unit 615. Then, the code image for each frame imaged at each frame rate is sent to the control unit 61 in the order of imaging. That is, the code image for each frame is sent to the control unit 61 as a data group having a predetermined data length. In the control unit 61, the image processing unit 611 and the data processing unit 612 acquire identification information and position information from the code image for each frame. Therefore, in the image processing unit 611 and the data processing unit 612, the identification information and the position information are acquired as a data group having a predetermined data length. If “writing mode” is set, handwriting information is generated. Again, the handwriting information is generated as a data group having a predetermined data length.
The data processing unit 612 sends the acquired / generated identification information, handwriting information, and the like to the output unit 613 in units of frames (data group having a predetermined data length). The identification information, handwriting information, and the like are transmitted from the communication unit 66 to the terminal device 50 in units of frames.

However, when the frame is transmitted from the communication unit 66 to the terminal device 50, for example, the terminal device 50 may be performing an operation that needs to process a large amount of information. In this case, since a large load is generated in the information processing unit (not shown) of the terminal device 50, transmission is performed when the terminal device 50 receives identification information, handwriting information, etc. (frame) from the digital pen 60. There are cases in which all the identification information and handwriting information included in the frame are not received in the received frames.
FIG. 7 is a diagram for explaining a situation where a part of identification information, handwriting information, etc. in the frame is not received. In FIG. 7, it is assumed that data including identification information and handwriting information is generated in the order of frame A, frame B, and frame C in the data processing unit 612 and transmitted to the output unit 613. The frames A, B, and C transmitted to the output unit 613 are sequentially transmitted to the communication unit 66 and stored in, for example, a FIFO (First In First Out) buffer provided in the communication unit 66. The data stored in the FIFO buffer is output to the terminal device 50 in the input order, that is, in the order of frame A, frame B, and frame C.

However, when the frame B is transmitted from the output unit 613 to the communication unit 66, for example, a large load is generated in the information processing unit of the terminal device 50, so that the data reception speed in the terminal device 50 is reduced and the FIFO buffer has insufficient free space. Suppose that it became the state. That is, this is a case where the data transmission rate transmitted from the FIFO buffer to the terminal device 50 is lower than the data reception rate received from the output unit 613 to the FIFO buffer.
In this case, since there is no capacity to store all the data of frame B in the FIFO buffer, a part (shaded portion) of the data of frame B is not received by the communication unit 66. Then, when the free space is generated in the FIFO buffer, the communication unit 66 receives the next frame C. As a result, data loss (shaded part) occurs in part in the frame B stored in the communication unit 66. Therefore, the frame B in which data loss (shaded portion) occurs is transmitted to the terminal device 50.

  After transmitting the frame B in which data loss (shaded portion) occurs, the communication unit 66 transmits the next frame C. In this case, since the terminal device 50 cannot determine that a data loss exists in the frame B, the terminal device 50 receives the frame B in which the data loss has occurred from the communication unit 66, and then receives the next from the communication unit 66. The frame C to be transmitted is accepted as it is. As a result, in the storage area allocated to the frame B in the terminal device 50, a part of the frame C is stored in the area where the data loss occurs (shaded portion). As a result, the frame B data and the frame C data are mixedly stored in the storage area of the frame B, unlike the data of the frame B that is originally assigned. Similarly, in the storage area allocated to the frame C in the terminal device 50, unlike the original frame C data, the data of the frame C and the data of the frame to be transmitted next are mixed and stored. Such a state in which data is mixed in the storage area allocated to each frame also occurs in a chain in subsequent frames. Therefore, the identification information and handwriting information acquired by the terminal device 50 is error information different from that acquired and generated by the digital pen 60.

Therefore, the communication unit 66 according to the present embodiment receives an image capture timing signal as an example of a transmission request signal generated in the terminal device 50 from the terminal device 50. Based on the image capture timing signal, the transmission timing of identification information, handwriting information, and the like from the output unit 613 in the control unit 61 is controlled. That is, the communication unit 66 controls to transmit from the head data of each frame in synchronization with the reception of the image capture timing signal from the terminal device 50.
Specifically, the terminal device 50 transmits an image capture timing signal to the communication unit 66 at a predetermined interval. The interval at that time is set corresponding to the frame rate set by the infrared CMOS 63. Then, the communication unit 66 synchronizes with the image capture timing signal from the terminal device 50, and, for example, the frames A, B, and C stored in the FIFO buffer in the communication unit 66 are input in the order of input. The data is output to the terminal device 50.

FIG. 8 is a diagram illustrating a state in which the communication unit 66 transmits identification information, handwriting information, and the like for each frame in synchronization with the image capture timing signal from the terminal device 50.
As shown in FIG. 8, in the communication unit 66 of the present embodiment, for example, even when a frame B in which data loss (shaded portion) occurs is transmitted, the frame B is transmitted to the terminal device 50. Is transmitted to the terminal device 50 from the head data of the frame B in synchronism with the image capture timing signal from. Further, even in the frame C in which no next data loss exists, the data at the head of the frame C is transmitted to the terminal device 50 in synchronization with the image capture timing signal from the terminal device 50.

Therefore, in the terminal device 50, the data regarding the identification information and the handwriting information received from the communication unit 66 immediately after the terminal device 50 itself transmits the image capture timing signal to the digital pen 60 is based on the data at the head of each frame. It will be transmitted in order. Thereby, in the storage area allocated to each frame in the terminal device 50, the data of each frame is always stored in order from the top, and only the data for each frame generated by the digital pen 60 is accommodated. That is, the above-described data mixing across two frames does not occur in the storage area allocated to each frame.
At this time, for example, since data loss has occurred in the communication unit 66 in the frame B, the storage area allocated to the frame B in the terminal device 50 includes the identification information of the frame B acquired and generated by the digital pen 60 and Error data that does not accurately represent handwriting information is assigned. However, the abnormality of the frame B in the terminal device 50 does not affect the frames after the frame C transmitted next. Therefore, the terminal device 50 accurately stores identification information, handwriting information, and the like acquired and generated by the digital pen 60 based on data included in frames other than the frame B.

Here, FIG. 9 is a sequence diagram for explaining the reception timing of the image capture timing signal in the communication unit 66 and the transmission timing of each frame synchronized therewith.
As shown in FIG. 9, each of the frame A, the frame B, the frame C, and the frame D is transmitted to the terminal device 50 after the time t from the reception of the image capture timing signal in the order of input to the communication unit 66. This time t is, for example, the time until the head data of each frame is input from the output unit 613 to the communication unit 66. That is, after receiving the image capture timing signal, the communication unit 66 starts transmission of a frame triggered by the input of the head data of each frame.
At this time, since data loss occurs in the frame B, the data length of the frame B is shorter than the data length of the frames A and C. However, since each frame is transmitted in synchronization with the reception of the image capture timing signal, the frame C transmitted next to the frame B is not affected by the data length of the frame B. Sent after receiving a signal.
As a result, regardless of whether or not data is lost in the frame, the data of each frame is stored in order from the top in the storage area allocated to each frame in the terminal device 50. For this reason, it is possible to suppress data loss occurring in one frame from causing other normal frames (data) to be error data, thereby reducing the frequency of data errors.
Note that the head data of each frame is recognized by, for example, a header (see FIG. 10 at a later stage) constituting each frame.

Here, FIG. 10 is a flowchart illustrating an example of a processing procedure when the control unit 61 transmits a frame to the terminal device 50 in synchronization with the image capture timing signal from the terminal device 50.
As shown in FIG. 10, the control unit 61 starts generating data composed of identification information, handwriting information, and the like in frame units in the data processing unit 612 (step 11). Then, the generated frame unit data is transmitted to the output unit 613 and is transmitted to the communication unit 66 in the order of generation.
The control unit 61 instructs the communication unit 66 to wait for an image capture timing signal transmitted from the terminal device 50. Then, after receiving an image capture timing signal from the terminal device 50 (step 12), the communication unit 66 is instructed to wait for input of data at the head of the frame. That is, it waits for the rising edge of frame data.
Then, when the head data of the frame after receiving the image capture timing signal is input (step 13), data for one frame is transmitted to the terminal device 50 in order from the head data (step 14). . After transmitting the data for one frame, it waits for the next image capture timing signal.

  As described above, in the digital pen 60 according to the present embodiment, the communication unit 66 transmits identification information, handwriting information, and the like for each frame in synchronization with the image capture timing signal from the terminal device 50. Therefore, an error such as data loss occurring in one frame is suppressed from affecting other frames, and the frequency of error occurrence during data transmission to the terminal device 50 is reduced. Thereby, a decrease in the reliability of data related to identification information, handwriting information, and the like in the terminal device 50 that receives data from the digital pen 60 is suppressed.

Next, processing performed by the digital pen 60 and the terminal device 50 when a communication abnormality occurs when the communication unit 66 transmits identification information, handwriting information, and the like to the terminal device 50 for each frame will be described.
First, FIG. 11A shows a data structure of a frame transmitted from the communication unit 66 to the terminal device 50, and FIG. 11B shows a data content described in each byte constituting the frame. is there.
As shown in FIG. 11A, in each frame, Byte_0 has a header area, Byte_1 has an operation mode information area, Byte_2 has a decoding error information area, Byte_3 to Byte_m have a data field, and checksum has a total byte information area. Allocated.
Also, as shown in FIG. 11B, Byte_0 describes identification information (frame ID) for identifying each frame and information on the number of bytes (number of Byte_0 to Byte_m) included in the frame. . In Byte_1, information on the on / off state of the cap switch SW1, the writing pressure detection switch, as operation mode information indicating whether the operation mode set in the digital pen 60 is “writing mode” or “reference mode”. Information about the on / off state of SW2 and information about the on / off state of user switch SW3 are described. In Byte_2, error information related to data processing generated in the data processing unit 612 is described. In Byte_3 to Byte_m, identification information, position information, and handwriting information acquired / generated in the data processing unit 612 are described. In the checksum, information on the total number of bytes included in each frame calculated by the digital pen 60 is described.

When the terminal device 50 receives the frame having the structure shown in FIG. 11, the terminal device 50 determines, for example, whether communication has been normally performed based on the data length of the frame. That is, the terminal device 50 recognizes the number of bytes from the information regarding the number of bytes described in the header (Byte_0) of the received frame. Then, when the number of received frames is added, and the number obtained by adding “1” to the added number of bytes coincides with the total number of bytes described in checksum, all data included in the frame is transmitted. As a result, it is determined that the communication has been normally performed. In this case, the terminal device 50 transmits a signal (Ack signal) indicating that communication has been normally performed to the digital pen 60.
On the other hand, if the number obtained by adding “1” to the number of added bytes does not match the total number of bytes described in the checksum, it is determined that a communication abnormality has occurred because all the data included in the frame has not been transmitted. . In this case, the terminal device 50 transmits a signal (Nack signal) indicating that a communication abnormality has occurred to the digital pen 60.

  For example, since data loss has occurred in the communication unit 66 in the frame B illustrated in FIG. 8, the terminal device 50 determines that a communication abnormality has occurred, assuming that all data included in the frame B has not been transmitted. . In that case, the terminal device 50 may be set to discard the received frame B. At that time, the terminal device 50 sets a margin of time until it is determined that a communication abnormality has occurred, and delays the transmission timing of the image capture timing signal. Therefore, the transmission of the next image capture timing signal after the transmission of the frame B is after the frame C is transmitted to the communication unit 66. As a result, the frame C is discarded by the communication unit 66 and is transmitted to the terminal device 50 again in synchronization with the image capture timing signal from the frame D next to the frame C.

FIG. 12 is a sequence diagram illustrating a case where the transmission timing of the image capture timing signal is delayed by determining the occurrence of a communication abnormality in frame B. As shown in FIG. 12, the transmission of the next image capture timing signal after the transmission of the frame B is transmitted with a delay in order to provide a determination time for occurrence of communication abnormality. Thus, the frame D is transmitted in synchronization with the next image capture timing signal after the transmission of the frame B. That is, in step 12 of the processing flow of FIG. 10, after receiving the next image capture timing signal after transmission of frame B, the input of the top data of the frame in step 13 is detected in frame D. is there. Therefore, the frame C is skipped and the frame D is transmitted after the frame B. In that case, the frame C is discarded by the communication unit 66 of the digital pen 60.
Then, after the next image capture timing signal after transmission of frame B is transmitted, when input of the head data of frame D is detected, frame D is transmitted from communication unit 66 to terminal device 50. The That is, the frame D is transmitted from the communication unit 66 to the terminal device 50 after the time t ′ from the reception of the image capture timing signal in which the head data of the frame D is input to the communication unit 66.

Here, FIG. 13 is a flowchart illustrating an example of a processing procedure when the terminal device 50 receives a frame from the communication unit 66 of the digital pen 60.
As shown in FIG. 13, the terminal device 50 first transmits an image capture timing signal to the communication unit 66 of the digital pen 60 (step 21). Simultaneously with the transmission of the image capture timing signal, measurement of the time until the frame reception ends is started (step 22). Thereafter, when a frame is transmitted from the communication unit 66, the frame is received (step 23).
Subsequently, for example, based on the number of bytes of the received frame described above, it is determined whether or not all data included in one frame has been normally received (step 24). As a result, if it is determined that the data for one frame has been normally received, the time measurement started in step 22 is terminated (step 25). Then, the frame is stored in the storage area (step 26).

On the other hand, if it is determined in step 24 that all the data included in one frame has not been normally received, the measurement start time in step 22 corresponds to one frame until the predetermined time elapses. Wait until the data is successfully received (step 27). As a result, when it is determined that the data for one frame has been normally received (step 24), the time measurement started in step 22 is ended (step 25). Then, the frame is stored in the storage area (step 26).
On the other hand, if the data for one frame is not normally received by the time when the measurement is started in step 22 before the predetermined time has elapsed (step 27), the reception of the frame is interrupted (step 28). ). That is, transmission of the image capture timing signal is delayed. The received data is discarded (step 29). Frame B in FIG. 12 corresponds to this case.

  Here, let us return to the description of the determination of communication abnormality between the communication unit 66 and the terminal device 50. Regarding the determination of the communication abnormality, it may be determined whether communication is normally performed in the digital pen 60. For example, after the digital pen 60 transmits a frame, it may be determined that a communication abnormality has occurred when the terminal device 50 does not receive a notification that the frame has been received within a predetermined time (for example, 30 seconds). . For example, when the terminal device 50 receives neither the Ack signal indicating that the above communication has been normally performed within a predetermined time or the Nack signal indicating that a communication abnormality has occurred, from the terminal device 50 to the digital pen 60. The digital pen 60 determines that a communication abnormality has occurred.

  Furthermore, when the communication between the communication unit 66 and the terminal device 50 is disconnected after the transmission of the frame from the digital pen 60 to the terminal device 50 is started, both the digital pen 60 and the terminal device 50 are notified. It may be determined that a communication error has occurred. In this case, the digital pen 60 is set to a sleep state in which power consumption is reduced after a predetermined time has elapsed. When the hibernation state is set, the digital pen 60 returns to the operation state when the user turns on the user switch SW3, for example.

When it is determined that a communication abnormality has occurred in the terminal device 50 or the digital pen 60, the digital pen 60 attempts to retransmit (retransmit) the frame to the terminal device 50.
As a result of the retransmission, if the communication is normally performed, the terminal device 50 and the digital pen 60 complete the frame transmission. In that case, the terminal device 50 recognizes that the frame is retransmitted by the frame ID described in the header (Byte_0) of the received frame, and stores the data in a predetermined storage area allocated to the frame. .
On the other hand, if the communication is not normally performed as a result of repeating the retransmission a predetermined number of times (for example, 10 times), the terminal device 50 and the digital pen 60 determine that a retransmission error (retry error) has occurred.
If it is determined that a retry error has occurred, the digital pen 60 sets the communication unit 66 to a standby state and sets the communication unit 66 not to communicate with the terminal device 50.
The standby state of the communication unit 66 is canceled when the user turns on the user switch SW3, for example. When the standby state in the communication unit 66 is canceled, data transmission from the communication unit 66 to the terminal device 50 is permitted.

As described above, in the digital pen 60 according to the present embodiment, when the communication unit 66 transmits the identification information and the handwriting information and the like for each frame in synchronization with the image capture timing signal from the terminal device 50, a communication abnormality occurs. When a communication error is detected, the frame is transmitted again. This increases the certainty of data transmission from the digital pen 60 to the terminal device 50.
When it is determined that a retry error has occurred, it is also assumed that the USB cable or the like is disconnected when the terminal device 50 and the digital pen 60 are connected by a wired connection such as a USB cable. . Therefore, when it is determined that a retry error has occurred, the terminal device 50 may display, for example, that a communication abnormality has occurred on a display unit (not shown). On the other hand, the digital pen 60 may be set so that information indicating that communication has failed due to a communication abnormality has been added to the frame and stored in the information memory 65. Furthermore, you may set so that operation | movement of the digital pen 60 may be stopped with it.

Next, FIG. 14 is a diagram illustrating a hardware configuration of the control unit 61 of the digital pen 60.
As shown in FIG. 14, the control unit 61 is executed as a functional module by the CPU 101 and the CPU 101 that execute digital arithmetic processing according to a predetermined operation control program (firmware) when performing operation control of the digital pen 60. RAM 102 in which processing programs are stored, ROM 103 in which data such as setting values used in processing programs executed by CPU 101 are stored, EEROM and flash that are rewritable and can retain data even when power supply is interrupted A non-volatile memory 104 such as a memory, and an interface unit 105 that controls input / output of signals with each unit connected to the control unit 61 are provided.
Further, the external storage device 106 stores an operation control program to be executed by the control unit 61. When the control unit 61 reads this operation control program, the operation control related to the digital pen 60 is executed.

  That is, an operation control program that realizes the functions of the image processing unit 611, the data processing unit 612, the output unit 613, and the operation control unit 616 is read from the external storage device 106 into the RAM 102 in the control unit 61. The CPU 101 performs various processes based on the operation control program read into the RAM 102. In this operation control program, for example, a hard disk or a DVD-ROM provided in the terminal device 50 that communicates with the digital pen 60 functions as the external storage device 106 of the digital pen 60, and the RAM 102 is connected from the terminal device 50 via the communication line. Provided to be loaded into. As another providing form, there is a form provided in a state installed in the ROM 103 in advance. Furthermore, after the digital pen 60 is assembled, an operation control program is installed in the nonvolatile memory 104 and loaded from the nonvolatile memory 104 to the RAM 102. Further, there is a form in which a program is transmitted to the digital pen 60 via a network such as the Internet and installed in the RAM 102.

Here, the control unit 61 of the digital pen 60 performs failure diagnosis on a predetermined function module that is the minimum necessary for operating the control unit 61 when the digital pen 60 is activated. Then, when it is determined in failure diagnosis that all of the predetermined functional modules are normal, the digital pen 60 is set to be operable. In addition, when a failure is detected in any of the predetermined function modules, a display such as lighting a predetermined LED (not shown) provided on the main body housing 68 of the digital pen 60 is displayed according to the reason for the failure. And notify the user.
FIG. 15 is a flowchart illustrating an example of a procedure of failure diagnosis processing performed by the control unit 61. As shown in FIG. 15, when the digital pen 60 is activated, the control unit 61 first performs a failure diagnosis of the ROM 103 which is one of the minimum functional modules necessary for operating the control unit 61. (Step 31). In the failure diagnosis of the ROM 103 here, the checksum value of the ROM space in which the firmware (operation control program) in the ROM 103 is written is stored at a predetermined address. When the digital pen 60 is activated, the ROM space is added in 2-byte length sequentially from Byte_0 to obtain the added value. If the added value matches the checksum value stored at the designated address, it is determined that the ROM 103 is normal, and if it does not match, it is determined that a failure has occurred.

When it is determined that the ROM 103 is normal (step 32), a failure diagnosis of the RAM 102, which is one of the minimum functional modules necessary for operating the control unit 61, is performed (step 33). In the failure diagnosis of the RAM 102 here, check data is written in all of the RAM space in the RAM 102. Then, the written check data is read, and it is determined whether or not it matches the written check data. If the read data matches the written check data, it is determined that the RAM 102 is normal, and if it does not match, it is determined that a failure has occurred.
When it is determined that the RAM 102 is normal (step 34), the control unit 61 determines that it can operate normally (step 35). Then, the operation control process by the control unit 61 is started.

On the other hand, if it is determined in step 32 that a failure has occurred in the ROM 103, or if it is determined in step 34 that a failure has occurred in the RAM 102, for example, a predetermined provision provided in the main body housing 68 of the digital pen 60 is performed. The LED (not shown) is turned on to notify the user (step 36).
Then, after waiting for the power switch of the digital pen 60 to be turned off (for example, on setting for a predetermined time by the user switch SW3) (step 37), the control unit 61 is stopped (step 38).
By performing such a failure diagnosis, the control unit 61 does not hang up, and the user recognizes that a failure has occurred in the digital pen 60.

Next, a case where identification information and handwriting information or position information are stored in the nonvolatile memory 104 of the control unit 61 will be described.
The nonvolatile memory 104 functions as an information memory 65 that stores identification information and handwriting information or position information, for example, when communication between the communication unit 66 and the terminal device 50 is not established. Therefore, even when the digital pen 60 is separated from the terminal device 50 and reads the code image on the medium alone, the non-volatile memory 104 constituting the information memory 65 includes the identification information, the handwriting information or the position information. Is memorized.
When such a digital pen 60 is used in a single state apart from the terminal device 50, the digital pen 60 operates by receiving power supply from the battery 67. Therefore, the system of the control unit 61 may be reset if the voltage of the battery 67 drops below a predetermined value while data is being stored in the nonvolatile memory 104 (information memory 65). When the control unit 61 is reset, it is not guaranteed that the data being written to the nonvolatile memory 104 is stored in the nonvolatile memory 104 in a normal state.

Therefore, in the nonvolatile memory 104, an area for storing data (data storage area) and a management area (data management area) for storing the state of data writing to the data storage area are set. In the data management area, for example, information indicating that the data has been stored in a normal state or information indicating that the writing process has been interrupted during data writing is stored.
When the data stored in the data storage area in the nonvolatile memory 104 is read after the system of the control unit 61 is reset, the control unit 61 refers to the data management area paired with the data storage area. Is done. Then, as a result of referring to the data management area, if the data read from the data storage area has been interrupted during the writing process, the data is set so that it cannot be transmitted to the terminal device 50. In addition, the control unit 61 notifies the user to discard the data.
Thereby, it is possible to prevent abnormal data from being transmitted to the terminal device 50. In addition, the state in which abnormal data remains stored in the nonvolatile memory 104 (information memory 65) is suppressed, and the storage capacity of the nonvolatile memory 104 is efficiently used.

Next, the voltage of the battery 67 and the operation state set by the control unit 61 will be described.
As described above, if the voltage of the battery 67 drops below a predetermined value while data is being stored in the nonvolatile memory 104 (information memory 65), the system of the control unit 61 may be reset. In that case, it is not guaranteed that the data being written to the nonvolatile memory 104 is stored in the nonvolatile memory 104 in a normal state.
Therefore, the control unit 61 constantly monitors the voltage of the battery 67 and sets the state of the control unit 61 according to the voltage level of the battery 67.

For example, when the voltage of the battery 67 is equal to or higher than a first voltage level (for example, 3.3 V), the control unit 61 is set with a first operation state in which a normal operation is possible. In the first operation state, the user can freely set the operation in the “writing mode” and the “reference mode” and the stop state.
In addition, when the voltage of the battery 67 is equal to or higher than the second voltage level (for example, 3.1 V) and smaller than the first voltage level (for example, 3.3 V), the control unit 61 receives the second voltage level. Is set. In the second operation state, when the digital pen 60 is in operation, the operation can be continued. However, once the stop state is set, the user next moves the digital pen 60 into the operation state. Can not be restored.
Furthermore, when the voltage of the battery 67 is smaller than a second voltage level (for example, 3.1 V), the third operation state is set in the control unit 61. In the third operation state, when the digital pen 60 is operating, it is forcibly shifted to a stop operation. Further, the user cannot subsequently return the digital pen 60 to the operating state.
As described above, the control unit 61 sets the state of the control unit 61 according to the voltage level of the battery 67, thereby suppressing data from being stored in the nonvolatile memory 104 in an abnormal state.

Next, various processes performed on the electronic document in the handwriting information management system of this embodiment will be described.
[Print document generation processing]
FIG. 16 is a sequence diagram illustrating an example of an operation when a print document is generated in the handwriting information management system.
First, the user transmits an instruction to print an electronic document from the terminal device 10 to the document server 20 (step 101). At that time, the terminal device 10 transmits an electronic document to be printed, identification information (document ID) of the electronic document, and print settings designated by the user. Here, the print settings include the page to be printed, the number of copies, the size of the paper that is the medium, the enlargement / reduction ratio, N-up (printing in which N pages of the electronic document are allocated to one page of the medium), Including settings such as.

The document server 20 receives an electronic document print instruction from the terminal device 10 (step 201). The electronic document to be printed included in the print instruction is sent to the electronic document management unit 23, and the electronic document management unit 23 registers the electronic document in the document / handwriting information storage unit 25 in association with the document ID (step 202). ).
Further, the document server 20 transmits the document ID and print setting of the electronic document instructed to be printed to the identification information server 30 (step 203). Here, for example, a URL (Uniform Resource Locator) may be used as the document ID, but other information may be used as long as the electronic document can be uniquely identified.
Thereby, the identification information server 30 receives the document ID and the print setting (step 301). Then, the identification information management unit 32 that manages the medium identification information acquires unused medium identification information from the identification information storage unit 33 (step 302). Here, the number of pieces of medium identification information to be extracted is determined according to print settings. That is, basically, the number of pieces of medium identification information obtained by multiplying the number of pages to be printed by the number of copies is extracted. However, if N-up printing is specified in the print setting information, this is also taken into consideration. For example, when printing 5 copies of a 10-page electronic document by 2-up printing, 25 (= 10 ÷ 2 × 5) pieces of medium identification information are extracted.
Next, the identification information server 30 associates the identification information, the document ID, and the print settings and registers them in the identification information storage unit 33 (step 303). Then, the identification information server 30 transmits the identification information to the document server 20 (step 304).

Thereby, the document server 20 receives the identification information (step 204). Then, a code image representing the identification information and the position information is generated (step 205).
That is, in the document server 20, the receiving unit 21 receives the medium identification information. Then, the reception unit 21 passes the received medium identification information to the identification information acquisition unit 22. Then, the identification information acquisition unit 22 first passes the acquired medium identification information to the identification code generation unit 27a, and the identification code generation unit 27a encodes the medium identification information using the method described above to generate an identification code. .
In addition, the position code generation unit 27b receives print settings from the reception unit 21, encodes position information in a range corresponding to the print settings using the above-described method, and generates a position code.
Then, the code arrangement unit 27c arranges the medium identification code and the position code according to a predetermined layout, and the code image generation unit 27e converts the image into an image using the pattern image stored in the pattern image storage unit 27d. A code image is generated by.

Thereafter, in the document server 20, the document image generation unit 26 generates a document image of the electronic document (step 206). At that time, the document image generation unit 26 receives the document ID acquired by the identification information acquisition unit 22 in step 201, and reads an electronic document to be printed from the document / handwriting information storage unit 25 based on the document ID. In step 201, the print setting acquired by the identification information acquisition unit 22 is received, and a document image is generated based on the print setting.
Then, the image composition unit 28 synthesizes the code image generated in step 205 and the document image generated in step 206 to generate a composite image (step 207).
Thereafter, the composite image is transferred to the transmission unit 29, and the transmission unit 29 transmits a print command for the composite image to the image forming apparatus 40 (step 208). Here, the composite image print command is transmitted, for example, in a PDL format in which the content to be printed as a code image is set as a PDL command to a PDL (Page Description Language) file including a sequence of print commands for document images. .

  The image forming apparatus 40 receives the composite image (document image and code image of the electronic document) from the document server 20 (step 401). Then, the image forming apparatus 40 develops the document image into an image using Y (yellow), M (magenta), and C (cyan) (step 402). Next, the document image is formed using C, M, and Y toners, and the code image is formed using K (black including carbon) toner (step 403).

In the above-described example, the identification information server 30 simply issues the identification information, and the document server 20 generates a code image including the identification information and instructs the image forming apparatus 40 to form an image. However, the identification information server 30 may generate a code image and instruct the image forming apparatus 40 to form an image.
Further, a configuration in which the code image is generated by the image forming apparatus 40 may be adopted. In that case, the document server 20 or the identification information server 30 adds the identification information to the PDL generated from the electronic document and transmits it to the image forming apparatus 40, and the image forming apparatus 40 generates a code image including the identification information. It will be.

  In the above example, the configuration in which the database (identification information storage unit 33) configured by associating the identification information, the document ID, and the print setting is placed in the identification information server 30 has been described. This is because placing such a database on a sharable device (identification information server 30) makes it possible to handle multiple users and ensure the security of electronic documents using server access control technology. However, such a configuration is not necessarily employed, and a configuration in which the above database is placed in the terminal device 10 or the document server 20 may be employed.

In the image forming apparatus 40 described above, the code image is formed by using K (black containing carbon) toner. This is because the K toner has a larger amount of infrared light absorption than the C (cyan), M (magenta), and Y (yellow) toner, and the digital pen 60 can easily read the code image. is there. However, the code image can also be formed using special toner.
Here, as the special toner, an invisible toner having a maximum absorption rate of 7% or less in the visible light region (400 nm to 700 nm) and an absorption rate of 30% or more in the near infrared region (800 nm to 1000 nm) is exemplified. . Here, “visible” and “invisible” are not related to whether they can be recognized visually. “Visible” and “invisible” are distinguished depending on whether or not an image in a printed document can be recognized by the presence or absence of color development due to absorption of a specific wavelength in the visible light region. Also, “invisible” includes those that have some color developability due to absorption of a specific wavelength in the visible light region but are difficult to be recognized by human eyes.

  Here, the code image is combined with the image of the electronic document and printed. However, the code image may be printed on white paper (notebook, tag, etc.). In that case, the document ID is not included in the print request received in step 201, the identification information is not associated with the document ID and the print setting in step 303, and the generation of the document image in step 206 is not executed. What should I do?

[Handwriting information registration process]
Next, an operation when the digital pen 60 generates handwriting information and registers it in the document server 20 will be described.
As described above, in the digital pen 60, the identification information acquisition unit 612b acquires identification information. In addition, the position information acquisition unit 612c acquires position information. Further, the handwriting information generation unit 612d connects the position information to each other to generate handwriting information. Then, the communication unit 66 transmits the identification information and handwriting information to the identification information server 30 via the terminal device 50. The identification information server 30 registers the handwriting information in the document server 20.
FIG. 17 is a sequence diagram illustrating an example of operations of the identification information server 30 and the document server 20 when registering handwriting information.
In the identification information server 30, first, the receiving unit 31 receives identification information and handwriting information from the digital pen 60 (step 311). Next, the identification information and handwriting information are passed to the identification information management unit 32, and the identification information management unit 32 takes out the document ID associated with the passed identification information from the identification information storage unit 33. Then, the document server 20 (the document server 20 in which the electronic document specified by the document ID exists) is determined as the transmission destination of the identification information and handwriting information received in step 311 (step 312). If the document ID is not associated with the identification information in the identification information storage unit 33, it is considered that the identification information is assigned to a blank sheet (note or tag). In that case, the document server 20 that manages the handwriting information for the white paper may be determined as the transmission destination.
Thereafter, the identification information and the handwriting information are transferred to the transmission unit 39, and the transmission unit 39 transmits the identification information and the handwriting information to the document server 20 determined as the transmission destination in Step 312 (Step 313).

  Thereby, in the document server 20, the receiving part 21 receives identification information and handwriting information (step 211). Then, the reception unit 21 passes the received identification information to the handwriting information management unit 24. Then, the handwriting information management unit 24 stores the identification information and the handwriting information in association with each other in the document / handwriting information storage unit 25 (step 212).

  As described above, in the digital pen 60 used in the handwriting information management system of the present embodiment, the communication unit 66 synchronizes with the image capture timing signal from the terminal device 50 and provides identification information and handwriting information for each frame. Send. Therefore, an error such as data loss occurring in one frame is suppressed from affecting other frames, and the frequency of error occurrence during data transmission to the terminal device 50 is reduced. Thereby, a decrease in reliability regarding identification information, handwriting information, and the like in the terminal device 50 that receives data from the digital pen 60 is suppressed.

It is the figure which showed an example of the structure of the handwriting information management system of this Embodiment. It is the block diagram which showed an example of the function structure of the document server. It is the figure which showed an example of the image etc. which comprise a code image. It is the block diagram which showed an example of the function structure of the identification information server. It is the figure which showed an example of the structure of a digital pen. It is the block diagram which showed an example of the function structure of the control part. It is a figure explaining the condition where a part of identification information in a frame, handwriting information, etc. are not received. It is a figure explaining the state in which a communication part transmits identification information, handwriting information, etc. for every frame synchronizing with the image capture timing signal from a terminal device. It is a sequence diagram explaining the reception timing of the image taking-in timing signal in a communication part, and the transmission timing of each flame | frame synchronized with it. It is the flowchart which showed an example of the procedure of the process at the time of a control part transmitting a flame | frame to a terminal device according to the image capture timing signal from a terminal device. (a) shows the data structure of the frame transmitted from the communication unit to the terminal device, and (b) shows the data content described in each byte constituting the frame. It is a sequence diagram explaining the case where the transmission timing of the image capture timing signal due to discarding the frame B due to the occurrence of a communication abnormality is delayed. It is the flowchart which showed an example of the procedure of the process at the time of a terminal device receiving a frame from the communication part of a digital pen. It is the figure which showed the hardware constitutions of the control part of a digital pen. It is the flowchart which showed an example of the procedure of the failure diagnosis process which a control part performs. It is the sequence diagram which showed an example of the operation | movement at the time of a printed document being produced | generated in a handwriting information management system. It is the sequence diagram which showed an example of operation | movement of the identification information server at the time of registering handwriting information, and a document server.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Terminal device, 20 ... Document server, 25 ... Document / handwriting information storage unit, 27b ... Position code generation unit, 30 ... Identification information server, 40 ... Image forming device, 50 ... Terminal device, 60 ... Digital pen, 61 ... Control unit 65 ... Information memory 69 69 Cap 611 Image processing unit 612 Data processing unit 613 Output unit 614 Illumination drive unit 616 Operation control unit SW1 Cap switch SW2 Pen pressure Detection switch, SW3 ... User switch

Claims (14)

A handwriting information generation device that generates handwriting information and transmits the handwriting information to a terminal device directly connected by wire or wirelessly,
Code image reading means for reading a code image printed on a medium;
Information acquisition means for acquiring predetermined information from the code image read by the code image reading means;
Handwriting information generating means for generating handwriting information that is information related to a user's writing operation on the medium based on the predetermined information acquired by the information acquiring means;
Transmitting means for transmitting the predetermined information acquired by the information acquisition means and / or the handwriting information generated by the handwriting information generation means to the terminal device in a data group unit having a predetermined data length; Prepared,
The transmission means sequentially transmits the predetermined information and / or the handwriting information for each data group in synchronization with a transmission request signal transmitted to the transmission means sequentially at a predetermined interval from the terminal device. Characteristic handwriting information generation device. The code image reading unit reads the code image from the medium at a predetermined cycle, and the information acquisition unit acquires the predetermined information having the predetermined data length from the code image read at the predetermined cycle. The handwriting information generation means generates the handwriting information of the predetermined data length from the predetermined information of the predetermined data length,
The transmission means acquires the predetermined information and / or the handwriting information of the predetermined data length as the data group from the information acquisition means and / or the handwriting information generation means, and transmits the acquired data group The handwriting information generation apparatus according to claim 1.   3. The handwriting information generation apparatus according to claim 2, wherein the transmission unit transmits the data group acquired after receiving the transmission request signal from the terminal device from the top data of the data group.   The transmission means detects head data of the data group acquired after receiving the transmission request signal from the terminal device, and the head data is detected for the data group transmitted in synchronization with the transmission request signal. The handwriting information generation apparatus according to claim 2, wherein the handwriting information generation apparatus is set to the data group. In addition to generating handwriting information, the handwriting information generating device that transmits the handwriting information to a terminal device directly connected by wire or wirelessly,
A function of acquiring predetermined information from the code image read from the medium on which the code image is printed;
A function of generating handwriting information which is information related to a user's writing operation on the medium based on the acquired predetermined information;
The predetermined information and / or the terminal information that transmits the generated handwriting information is sequentially synchronized with a transmission request signal transmitted to the handwriting information generation device at predetermined intervals from the terminal device that transmits the predetermined information and A program for realizing the function of transmitting the handwriting information to the terminal device in order for each data group having a predetermined data length.   The function to transmit is to sequentially acquire the predetermined information and / or the handwriting information as the data group of the predetermined data length, and the data group acquired after receiving the transmission request signal from the terminal device 6. The program according to claim 5, wherein the program is transmitted from the top data of the data group.   The function of transmitting is to acquire the predetermined information and / or the handwriting information as the data group of the predetermined data length in order, and the head of the data group acquired after receiving the transmission request signal from the terminal device 6. The program according to claim 5, wherein data is detected and the data group transmitted in synchronization with the transmission request signal is set to the data group in which the head data is detected. A handwriting information generating device that generates handwriting information that is information related to a user's writing operation on a medium on which a document image and a code image based on an electronic document are printed, and obtains predetermined information from the code image;
And handwriting information management device for managing in association with the predetermined information and / or the handwriting information to the electronic document printed on the medium or the medium,
An information transmission device that acquires the predetermined information and / or the handwriting information from the handwriting information generation device, and transmits the acquired predetermined information and / or the handwriting information to the handwriting information management device;
The handwriting information generation device
Code image reading means for reading a code image printed on a medium;
Information acquisition means for acquiring predetermined information from the code image read by the code image reading means;
Handwriting information generating means for generating handwriting information that is information related to a user's writing operation on the medium based on the predetermined information acquired by the information acquiring means;
Transmitting means for transmitting the predetermined information acquired by the information acquiring means and / or the handwriting information generated by the handwriting information generating means to the information transmitting device in units of a data group having a predetermined data length; With
The transmission unit sequentially transmits the predetermined information and / or the handwriting information for each data group in synchronization with a transmission request signal transmitted to the transmission unit sequentially at a predetermined interval from the information transmission device. Handwriting information management system characterized by   The transmission means of the handwriting information generation device sequentially acquires the predetermined information and / or the handwriting information as the data group having the predetermined data length, and acquires the transmission request signal from the information transmission device. 9. The handwriting information management system according to claim 8, wherein the data group is transmitted from the top data of the data group.   The transmission means of the handwriting information generation device sequentially acquires the predetermined information and / or the handwriting information as the data group having the predetermined data length, and acquires the transmission request signal from the information transmission device. 9. The handwriting according to claim 8, wherein the first data of the data group detected is detected, and the data group transmitted in synchronization with the transmission request signal is set to the data group in which the first data is detected. Information management system.   9. The information transmitting apparatus according to claim 8, wherein the information transmitting apparatus determines whether or not data loss has occurred in the predetermined information and / or the handwritten information acquired from the handwritten information generating apparatus. Handwriting information management system.   The information transmitting device changes a transmission timing of the transmission request signal to be transmitted to the handwriting information generating device when determining whether or not data loss has occurred in the predetermined information and / or the handwriting information. The handwriting information management system according to claim 11, wherein   The handwriting information management system according to claim 8, wherein the information transmission device discards the data group determined to have the data loss.   9. The handwriting information generation apparatus determines whether or not data loss has occurred in the predetermined information and / or the handwriting information transmitted to the handwriting information generation apparatus in units of the data group. The handwriting information management system described.

Images