JP2009237769A - Handwriting information creation device and handwriting information management system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently display an operation state in a handwriting information creation device for creating handwriting information in a region with a small area. <P>SOLUTION: A handwriting information creation device includes a pen main unit 60A arranged with a pen chip 64 forming handwriting corresponding to a writing operation by a user on a medium with a code image printed thereon; a cap 60B detachably mounted on the main unit 60A in order to protect the chip 64; a first display unit DSP1 arranged on the main unit 60A for displaying the device operation state containing an operation state generating handwriting information and reference information for referring to specified information; a second display unit DSP2 arranged at the protection cover for displaying the device operation state; and an operation control unit controlling the display setting on the first and the second display units DSP1, DSP2 related to the operation state according to the mounted position of the cap 60B onto the main unit 60A. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a handwriting information generation device and a handwriting information management system.

2. Description of the Related Art In recent years, attention has been paid to a technique in which characters, figures, and the like written on a medium such as paper are converted into electronic data, which is transferred to a personal computer, a mobile phone, etc., and the written contents are stored.
For example, in the technique described in Patent Document 1, characters written with a pen device using a medium on which code images of various patterns with fine dots are printed and a pen device having an image pickup device, for example, A code image at a position such as a figure is read into the image sensor. Thereby, the position coordinates of characters and figures are specified, and an electronic document composed of written characters and figures is generated, and characters and figures are added to a predetermined electronic document.
For example, in the technique described in Patent Document 2, a code image printed on a predetermined area on a medium is read by a pen device, for example, a command for instructing a computer to open a web browser program is created. Link to a predetermined web address.

JP 2004-94907 A Special table 2003-523572 gazette

Here, in general, a pen-type handwriting information generation apparatus that reads handwriting formed on a medium and generates handwriting information is provided with a protective cap for protecting the pen shaft for writing. During the operation of writing or the like, the protective cap is removed from the pen shaft side of the handwriting information generating apparatus main body, and is normally used in a state of being mounted on the end side opposite to the pen shaft side. In that case, various operation states such as a writing operation are set in the handwriting information generation apparatus. On the other hand, no writing operation or the like is performed in a state where the protective cap is attached to the pen shaft side, and the number of operation states set in the handwriting information generation device is small. For this reason, if a pen-type handwriting information generation device with a small outer surface area is provided with a display unit that displays all of the operation states, there is a problem that the area occupied by the display unit is wasted in a setting state with a small number of operation states. there were.
An object of this invention is to display efficiently the operation state in the handwriting information generation apparatus which produces handwriting information within a small area area.

  According to the first aspect of the present invention, a writing unit that forms a handwriting corresponding to a user's writing operation on a medium on which a code image is printed, an apparatus main body in which the writing unit is arranged, and an attachment / detachment to the apparatus main body The user's writing operation based on the code image at the position on the medium, which is freely mounted and protects the writing unit, and is disposed in the apparatus main body part and the handwriting is formed by the writing unit. A first display unit for displaying an operation state of the apparatus including an operation state for generating handwriting information that is information related to the information and an operation state for generating reference information for referring to specific information based on the code image A second display unit that is disposed on the protective cover unit and displays the operation state, and the first display unit related to the operation state according to a mounting position of the protective cover unit on the apparatus main body unit. And said Further comprising a display control unit for controlling the display settings in the second display unit is a handwriting information generating apparatus according to claim.

According to a second aspect of the present invention, the display control unit changes the operation state when the protective cover unit is attached to a side of the apparatus main body opposite to the side where the writing unit is disposed. When the display is set to display using both the first display unit and the second display unit, and the protective cover unit is mounted on the side of the apparatus main body where the writing unit is disposed, the operation is performed. The handwriting information generating apparatus according to claim 1, wherein the control is performed so that the state is set to be displayed using the first display unit.
According to a third aspect of the present invention, the display control unit detects that the protective cover unit is mounted on a side opposite to the side of the apparatus main body where the writing unit is disposed. 3. The handwriting information generating apparatus according to claim 2, wherein the control is performed so that the operation state is displayed using both the first display unit and the second display unit.
In the invention according to claim 4, the display control unit is set to any one of an operation state for generating the handwriting information and an operation state for generating the reference information, and the protective cover unit is the device main unit. 2. A warning display is set on the first display unit when it is not detected that the writing unit is mounted on the side opposite to the side on which the writing unit is arranged. Handwriting information generation device.
According to a fifth aspect of the present invention, when the protective cover portion is attached to a side of the apparatus main body opposite to the side where the writing portion is disposed, the operation state for generating the handwriting information and the reference information The handwriting information generation apparatus according to claim 1, further comprising an operation control unit configured to set any of the operation states for generating the character.

  The invention according to claim 6 is a handwriting information generating device that generates handwriting information that is information related to a user's writing operation on a medium on which a document image and a code image based on an electronic document are printed, and the handwriting information A handwriting information management device that acquires the handwriting information generated by a generation device and manages the acquired handwriting information in association with the medium or the electronic document printed on the medium; Are a writing unit that forms a handwriting corresponding to a user's writing operation on the medium, an apparatus main body in which the writing unit is arranged, and a protection that is detachably attached to the apparatus main body to protect the writing unit. Handwriting information which is information related to the user's writing operation based on the code image at a position on the medium where the handwriting is formed by the writing unit, which is arranged in the cover unit and the apparatus main body unit. A first display unit for displaying an operation state of the handwriting information generation device including an operation state to be formed and an operation state for generating reference information for referring to specific information based on the code image; and the protective cover unit And a second display unit that displays the operation state, and the first display unit and the second display related to the operation state according to a mounting position of the protective cover unit on the apparatus main body unit. A handwriting information management system comprising: a display control unit that controls display settings in the unit.

According to a seventh aspect of the present invention, in the case where the display control unit of the handwriting information generation device is mounted on a side opposite to the side where the writing unit of the device main body is disposed, The operation state is set to be displayed using both the first display unit and the second display unit, and the protective cover unit is attached to the side of the apparatus main body where the writing unit is disposed. The handwriting information management system according to claim 6, wherein the control is performed so that the operation state is set to be displayed using the first display unit when the operation state is displayed.
According to an eighth aspect of the present invention, the display control unit of the handwriting information generation device detects that the protective cover unit is mounted on a side opposite to the side where the writing unit of the apparatus main body is disposed. The handwriting information management system according to claim 7, wherein the control is performed so that the operation state is displayed using both the first display unit and the second display unit. It is.
The invention according to claim 9 is characterized in that the display control unit of the handwriting information generation device is set to one of an operation state for generating the handwriting information and an operation state for generating the reference information, and the protective cover. A warning display is performed on the first display unit when it is not detected that the unit is mounted on the side opposite to the side on which the writing unit of the apparatus main body is disposed. 6. A handwriting information management system according to 6.
The handwriting information generation device generates the handwriting information when the protective cover portion is attached to a side of the device main body opposite to the side where the writing portion is disposed. The handwriting information management system according to claim 6, further comprising an operation control unit configured to set one of an operation state to be performed and an operation state to generate the reference information.

According to the first aspect of the present invention, it is possible to efficiently display the operation state in the handwriting information generating apparatus that generates handwriting information within a small area area, as compared with the case where the present invention is not adopted.
According to claim 2 of the present invention, in the handwriting information generating device in which the type of operation state changes according to the mounting position of the protective cover unit on the apparatus main body, the display corresponding to the number of types of operation states to be set Settings can be made.
According to claim 3 of the present invention, the protective cover portion is attached to the side opposite to the side where the writing portion is arranged, so that the protective cover portion is attached to the side opposite to the side where the writing portion is arranged. The display setting corresponding to the type of operation state in the selected setting can be automatically performed.
According to the fourth aspect of the present invention, it is possible to prompt the user to attach the protective cover part to the side opposite to the side where the writing part of the apparatus main body part is disposed.
According to the fifth aspect of the present invention, when any one of the operation state for generating handwriting information and the operation state for generating reference information is set, the first display is compared with the case where the present invention is not adopted. More types of operation states using both the display unit and the second display unit can be displayed.

According to claim 6 of the present invention, in the handwriting information generation device that generates handwriting information used in the handwriting information management system, the operation state in the handwriting information generation device is smaller than that in the case where the present invention is not adopted. Can be displayed efficiently.
According to the seventh aspect of the present invention, in the handwriting information generation device in which the type of the operation state changes depending on the mounting position of the protective cover unit on the apparatus main body, the display corresponding to the number of types of operation states to be set Settings can be made.
According to claim 8 of the present invention, the protective cover portion is attached to the side opposite to the side where the writing portion is arranged, so that the protective cover portion is attached to the side opposite to the side where the writing portion is arranged. The display setting corresponding to the type of operation state in the selected setting can be automatically performed.
According to the ninth aspect of the present invention, it is possible to prompt the user to attach the protective cover part to the side opposite to the side where the writing part of the apparatus main body part is arranged.
According to the tenth aspect of the present invention, when any one of the operation state for generating the handwriting information and the operation state for generating the reference information is set, the first display is performed as compared with the case where the present invention is not adopted. More types of operation states using both the display unit and the second display unit can be displayed.

The best mode for carrying out the present invention (hereinafter referred to as “embodiment”) will be described below in detail with reference to the accompanying drawings.
First, the overall configuration of the handwriting information management system in the present embodiment will be described.
FIG. 1 is a diagram showing an example of the configuration of the handwriting information management system of the present embodiment. As shown in FIG. 1, the handwriting information management system includes a terminal device 10, a document server 20 as an example of a handwriting information management device, an identification information server 30 as an example of a handwriting information management device, and an image forming apparatus. 40 and a terminal device 50 as an example of an information transmission device are connected to a network 80. In addition, a digital pen 60 as an example of a handwriting information generation device is connected to the terminal device 50 in a communicable manner.

In the handwriting information management system of this embodiment, when a print request for an electronic document is made from the terminal device 10, the document server 20 receives the print request from the terminal device 10, and the print request is sent to the image forming apparatus 40. An instruction to print the electronic document is issued. Thereby, the image forming apparatus 40 prints the document image of the electronic document on a medium such as paper. At this time, the image forming apparatus 40 prints a code image on the medium in addition to the document image.
The code image here is an image of the identification code and the position code obtained by encoding the identification information and the position information. The identification information is information for uniquely identifying a medium, and is issued by the identification information server 30 in the present embodiment. The position information is information for specifying the coordinate position on the medium, and is generated by the document server 20 in the present embodiment.
Then, when the user writes (handwriting) on the medium on which the document image and the code image are printed using the digital pen 60, the digital pen 60 writes the handwritten information (handwriting information) based on the position information included in the code image. Is generated. At the same time, the digital pen 60 recognizes identification information included in the code image. Then, the recognized identification information and handwriting information are sent to the document server 20 via the terminal device 50. The document server 20 that has received the identification information and the handwriting information specifies the electronic document printed on the medium based on the identification information, and stores the specified electronic document and the handwriting information in association with each other.
In addition, the digital pen 60 is set with a function of using the position information and identification information included in the code image as reference information for linking to predetermined information instead of generating handwriting information. For example, the position information and the identification information are used as information for generating a command for opening a predetermined web browser program and linking the terminal device 50 to a predetermined web address or the like. In that case, the terminal device 50 links to a predetermined web address based on the position information and the identification information, and acquires the predetermined information.

In this specification, electronic data that is the basis of an image recorded on a medium is expressed as “electronic document”. However, this does not mean only data obtained by digitizing a “document” including text. For example, "electronic document" including image data (regardless of raster data or vector data) such as pictures, photographs, figures, etc., data recorded by database management software or spreadsheet software, and other printable electronic data It is said.
In the present specification, the “medium” may be any material as long as it can print an image. A typical example is paper, but it may be a plastic sheet such as an OHP sheet or a metal plate.
Furthermore, in this specification, processing is performed using identification information for uniquely identifying each of the electronic document, the medium, and the digital pen 60 and the user. It shall mean the identification information. That is, in the present embodiment, this identification information is used as an example of medium identification information uniquely given to the medium.

Then, each component which comprises the handwriting information management system of this Embodiment is demonstrated in detail.
The terminal device 10 is a computer device that requests the document server 20 to print an electronic document. Here, as the terminal device 10, for example, a personal computer, a workstation, or another computer is used.
The document server 20 is an example of a handwriting information management device, and is a computer device that stores and manages electronic documents. Also, when a request for printing an electronic document is received from the terminal device 10, an image of the electronic document and a code image representing identification information and position information are generated, and a print command for printing a composite image obtained by synthesizing the image on a medium is generated. Output to the forming apparatus 40. Here, as the document server 20, for example, a personal computer, a workstation, or another computer is used.

The identification information server 30 is an example of a handwriting information management device, and is a computer device that issues identification information to be given to a medium. The issued identification information is stored in association with the electronic document printed on the medium to which the identification information is assigned. Here, as the identification information server 30, for example, a personal computer, a workstation, or another computer is used.
The image forming apparatus 40 is an apparatus that prints an image on a medium and outputs it as a print document. The image forming apparatus 40 may be a single printer or printing machine, or may be a so-called “multifunction machine” having a scanner or a communication function. Here, as an image forming method in the image forming apparatus 40, for example, an electrophotographic method may be used, but other methods may be used.

The terminal device 50 is an example of an information transmission device (external device), and information obtained by digitizing writing on a print document (hereinafter referred to as “handwriting information”) is an electronic source of an image recorded in the print document. It is a computer device that transmits to the identification information server 30 to be reflected in the document. Alternatively, the electronic document to be reflected in the handwriting information may be displayed on a display (not shown), and the handwriting information may be displayed on the display. Here, as the terminal device 50, for example, a personal computer, a workstation, or another computer is used.
The terminal device 50 is also a computer device that links to predetermined information based on position information and identification information sent from the digital pen 60. For example, the terminal device 50 generates a command to open a predetermined web browser program and link to a predetermined web address or the like from the position information and the identification information. And based on position information and identification information, it links to a predetermined web address and acquires predetermined information.
The terminal device 50 is connected to the digital pen 60 by a wireless method such as Bluetooth (registered trademark), Zigbee, UWB (Ultra Wide Band), or an infrared communication function, and communicates with the digital pen 60. Then, identification information and handwriting information or position information are acquired from the digital pen 60. Here, as a communication method between the digital pen 60 and the terminal device 50, a wired method such as a USB (Universal Serial Bus) cable may be used.

  The digital pen 60 is an example of a handwriting information generation device, and is a pen device used for writing characters or figures on a printed document. An image sensor that reads a code image printed on the medium is provided. And the positional information which is an example of the information acquired from the code | cord image read with the image pick-up element is detected. Furthermore, handwriting information obtained by converting character or graphics written from the position information into image data is generated and stored based on the position information. Further, identification information which is an example of information acquired from the code image read by the image sensor is detected and stored.

Subsequently, details of each component constituting the handwriting information management system will be described.
First, the configuration of the document server 20 will be described.
FIG. 2 is a block diagram illustrating an example of a functional configuration of the document server 20. As shown in FIG. 2, the document server 20 includes a reception unit 21, an identification information acquisition unit 22, an electronic document management unit 23, a handwriting information management unit 24, and a document / handwriting information storage unit 25. Further, it includes an identification code generation unit 27a, a position code generation unit 27b, a code arrangement unit 27c, a pattern image storage unit 27d, and a code image generation unit 27e. Furthermore, a document image generation unit 26, an image composition unit 28, and a transmission unit 29 are provided.

The receiving unit 21 receives a print request from the terminal device 10. Here, in addition to the electronic document, the print request includes identification information (hereinafter referred to as “document ID”) of the electronic document to be printed and various kinds of information for determining the layout of the electronic document on the printed medium. Settings (hereinafter referred to as “print settings”) are included. The document ID is assigned to each electronic document by the terminal device 10, but may be assigned by the document server 20. Further, the receiving unit 21 receives from the identification information server 30 identification information that is uniquely given to the medium on which the print document is printed. Further, when writing is performed on the print document, the identification information embedded in the print document and handwriting information obtained by digitizing the content of the print document (written image) are received from the identification information server 30. .
The identification information acquisition unit 22 acquires the document ID and print settings from the reception unit 21, passes them to the transmission unit 29, instructs transmission of an identification information issue request, passes this to the document image generation unit 26, and sends the document Instructs generation of an image. Further, the identification information of the medium is acquired from the receiving unit 21, and this is passed to the identification code generating unit 27a to instruct generation of the identification code.

  The electronic document management unit 23 acquires the identification information and the electronic document received by the reception unit 21 and registers them in the document / handwriting information storage unit 25 in association with each other based on the document ID. Also, a new electronic document (second electronic document) that reflects the state of the electronic document stored in the document / handwriting information storage unit 25 printed on the medium according to the print settings is generated, and the generated second The second electronic document is stored in the document / handwriting information storage unit 25. Further, when the display or printing of the electronic document is instructed, the corresponding identification information and electronic document are taken out from the document / handwriting information storage unit 25.

The handwriting information management unit 24 acquires the identification information and handwriting information received by the receiving unit 21 and registers the handwriting information in the document / handwriting information storage unit 25 in association with the electronic document based on the identification information. When the display of handwriting information is instructed, the corresponding identification information and handwriting information are extracted from the document / handwriting information storage unit 25.
The document / handwriting information storage unit 25 stores an electronic document managed by the electronic document management unit 23 and handwriting information managed by the handwriting information management unit 24. Here, in the present embodiment, the document / handwriting information storage unit 25 is provided as an example of a storage unit that stores the identification information, the electronic document, and the handwriting information in association with each other.

The identification code generation unit 27a generates identification code by encoding identification information for specifying a medium.
The position code generation unit 27b encodes position information indicating the coordinate position on the medium to generate a position code.
The code arrangement unit 27c arranges the identification code generated by the identification code generation unit 27a, the position code generated by the position code generation unit 27b, and the like on a two-dimensional plane according to a predetermined layout (see FIG. 3 in the subsequent stage). Then, a two-dimensional code array is generated.
The pattern image storage unit 27d stores a pattern image corresponding to the code value of each code stored in the code array.
The code image generation unit 27e refers to the two-dimensional code array generated by the code arrangement unit 27c, selects a pattern image corresponding to each code value, and generates a code image.

The document image generation unit 26 acquires a document ID and print settings from the identification information acquisition unit 22, and reads an electronic document specified by the document ID from the document / handwriting information storage unit 25. Then, a document image of the electronic document is generated according to the print setting.
The image composition unit 28 synthesizes the code image generated by the code image generation unit 27e and the document image generated by the document image generation unit 26 to generate a composite image.
The transmission unit 29 transmits an identification information issuance request to the identification information server 30. Also, an image print command for the medium is transmitted to the image forming apparatus 40. Furthermore, when the display of handwriting information is instructed, the identification information and handwriting information are transmitted to the identification information server 30.

Here, the code image generated by the document server 20 of the present embodiment will be described.
FIG. 3 is a diagram illustrating an example of an image constituting the code image. First, unit patterns constituting a code image will be described. FIG. 3A shows an example of the unit pattern.
The unit pattern is the minimum unit for embedding information. In FIG. 3A, a black area and a shaded area are areas where dots can be arranged, and a white area between them is an area where dots cannot be arranged. In addition, among the areas where dots can be arranged, dots are arranged in black areas, and dots are not arranged in hatched areas. That is, FIG. 3A shows an example in which a unit pattern is configured by arranging dots at two places (black areas) selected from nine places where dots can be arranged. Here, since there are 36 (= ₉ C ₂ ) combinations for selecting 2 locations out of 9 locations, there are 36 types of unit patterns. Of these, four types of unit patterns are used as synchronization patterns. The synchronization pattern is a pattern for detecting the rotation of the image and specifying the relative positions of the identification code and the position code. In particular, since it is necessary to detect the rotation of the image, the four types of synchronization patterns are selected such that when one of the synchronization patterns is rotated 90 degrees, another synchronization pattern is obtained. Further, the 32 types of unit patterns other than the 4 types of unit patterns are used as information patterns expressing the identification code and the position code, and 5-bit information is expressed.

  By the way, the dots shown in FIG. 3A are only for information representation, and do not necessarily coincide with the dots that mean the minimum points constituting the image. In the present embodiment, dots for information expression (the minimum square in FIG. 3A) have a size of 2 dots × 2 dots at 600 dpi. Since the size of one dot at 600 dpi is 0.0423 mm, one side of a dot for information expression (the minimum square in FIG. 3A) is 84.6 μm (= 0.0423 mm × 2). The larger the dot for information expression, the more likely it is to be noticeable. Therefore, it is preferable that the dot is as small as possible. However, if it is too small, printing with a printer becomes impossible. Therefore, the above values larger than 50 μm and smaller than 100 μm are employed as the size of dots for information expression. However, the above value 84.6 μm is a numerical value to the last, and is about 100 μm in the actually printed toner image. In the present specification, the term “dot” refers to a dot for information expression, not a dot that means the minimum point constituting an image unless otherwise specified.

Next, a code block composed of such unit patterns will be described. FIG. 3B shows an example of the layout of the code block. Here, not the image but the code arrangement immediately before being replaced by the pattern image is shown. That is, a unit pattern as shown in FIG. 3A (any one of 36 unit patterns) is arranged in the smallest square (hereinafter referred to as “unit block”) in FIG. Will be formed.
In the layout of FIG. 3B, the synchronization code is arranged in one unit block at the upper left of the code block. Further, the X position code is arranged in the four unit blocks on the right side of the unit block in which the synchronization code is arranged, and the Y position code is arranged in the four unit blocks on the lower side of the unit block in which the synchronization code is arranged. . Furthermore, identification codes are arranged in 16 (= 4 × 4) unit blocks surrounded by unit blocks in which these position codes are arranged.

Here, encoding of identification information will be described.
When encoding identification information, the bit string which comprises identification information is divided | segmented into a some block in order to perform RS encoding. Although there are several methods for encoding, RS encoding is suitable in this embodiment. This is because the RS code is a multi-value coding method, and in this case, the value represented by the unit block corresponds to the multi-value of the RS code. For example, when 5-bit information is expressed by one unit block, the 60-bit identification information is divided into 12 blocks having a block length of 5 bits. If an RS code capable of correcting two blocks of errors is employed, the code length is 16 blocks, which can be accommodated in a unit block in which the identification code in the code block of FIG. Note that the encoding method is not limited to the RS code, and other encoding methods such as a BCH code may be used.

Subsequently, encoding of position information will be described.
For encoding the position information, an M-sequence code, which is a kind of pseudo-random sequence, is used. Here, the M sequence refers to a sequence having the longest period among a shift register having a certain length and a code sequence generated by feedback. When K is the number of stages in the shift register, the sequence length of the M sequence is 2 ^K −1. Arbitrary consecutive K bits extracted from the M sequence have a property that they do not appear at other positions in the same M sequence. Therefore, the position information is encoded using this property.
By the way, in the present embodiment, a necessary M-sequence order is obtained from the length of position information to be encoded, and an M-sequence is generated. However, if the length of the position information to be encoded is known in advance, it is not necessary to generate the M sequence each time. That is, a fixed M sequence may be generated in advance and stored in a memory or the like.
For example, it is assumed that an M sequence (K = 13) having a sequence length of 8191 is used. In this case, since the position code is also embedded in units of 5 bits, 5 bits are taken out from the M sequence having a sequence length of 8191 and blocked.

  In this specification, the identification information and the position information are clearly distinguished and used for the sake of simplicity. However, there is a technique in which a wide range of position information is prepared, the position information is cut out and embedded from different ranges for each medium, and the medium is identified by the difference in position information. Therefore, in such a method, it is assumed that the position information has a function for identifying the medium, and the position information is also considered as the identification information.

Next, the configuration of the identification information server 30 will be described.
FIG. 4 is a block diagram illustrating an example of a functional configuration of the identification information server 30. As illustrated in FIG. 4, the identification information server 30 includes a reception unit 31, an identification information management unit 32, an identification information storage unit 33, a display information generation unit 34, and a transmission unit 39.
The receiving unit 31 receives an identification information issue request from the document server 20. The receiving unit 31 receives medium identification information and handwriting information from the terminal device 50 when writing is performed on the print document. Here, in the present embodiment, the medium identification information and the handwriting information are received from the terminal device 50, and when the display of the handwriting information is instructed, the medium identification information and the handwriting information are obtained from the document server 20. A receiving unit 31 is provided as an example of receiving means for receiving.

When there is a request for issuing identification information, the identification information management unit 32 issues the identification information without duplication, and stores the document ID and print settings specified at that time in association with the identification information. In response to designation of identification information, a document ID and print settings corresponding to the identification information are extracted.
The identification information storage unit 33 stores the identification information in the used / unused state, the document ID of the electronic document printed on the medium to which the identification information is added, and the electronic document printed on the medium to which the identification information is printed. It is a database that stores print settings in association with each other.
The display information generation unit 34 generates display information for displaying the handwriting information based on the information acquired from the document server 20 when the display of the handwriting information is instructed. As this display information, for example, data serving as a source for generating an image to be displayed on the terminal device 50 is generated.

  The transmission unit 39 transmits identification information issued in response to a request from the document server 20 to the document server 20. In addition, when writing on a print document is performed, medium identification information and handwriting information are transmitted to the document server 20. Further, when the display of handwriting information is instructed, the display information is transmitted to the terminal device 50.

Next, the digital pen 60 will be described.
The digital pen 60 according to the present embodiment is configured as a pen type suitable for a writing operation, and is an example of a pen body portion 60A that is an example of an apparatus body portion and a protective cover portion that protects a pen tip 64 (see the latter stage). It is comprised by two components with the cap part 60B. First, FIG. 5 is an overall configuration diagram of the digital pen 60. FIG. 5A is an external perspective view of the digital pen 60 in a state where the cap portion 60B is attached to the distal end portion of the pen body portion 60A, and FIG. FIG. 6C is an external perspective view of the cap portion 60B of the pen 60, and FIG. 5C is an external perspective view of the digital pen 60 in a state where the cap portion 60B is attached to the rear end portion of the pen body portion 60A. As shown in FIG. 5, the digital pen 60 of the present embodiment is configured such that a cap portion 60B is detachably attached to the front end portion and the rear end portion with respect to the pen body portion 60A.
When the digital pen 60 is not used, as shown in FIG. 5A, the cap part 60B is attached to the tip part of the pen body part 60A. Further, when the digital pen 60 is used in the “writing mode” or the “reference mode” (see the latter stage), as shown in FIG. 5C, from the viewpoint of preventing the cap portion 60B from being lost or damaged, the cap portion 60B is attached to the rear end of the pen body 60A.

  FIG. 6 is a schematic diagram illustrating the internal configuration of the digital pen 60. As shown in FIG. 6, the pen main body 60A of the digital pen 60 includes a pen tip 64, which is an example of a writing unit that writes on the medium, a control / processing unit 61 that performs operation control and signal processing of the entire pen, and a medium. Infrared LED 62 for irradiating infrared light thereon, infrared CMOS 63 for reading a code image by detecting reflected light from the medium, information memory 65 for storing identification information, handwriting information and position information, terminal device (external device) ) A communication unit 66 that communicates with 50 and a first display unit DSP1 as an example of a first display unit that displays the operation state of the digital pen 60 are provided. Furthermore, a rechargeable battery 67 that supplies power for driving each part of the digital pen 60 is provided.

In addition, the pen body 60A of the digital pen 60 is equipped with a cap 60B for protecting the pen tip 64 on the digital pen 60 as a switching member that outputs an on / off signal corresponding to various operations performed by the user. A cap switch SW1 for detecting whether or not there is a writing pressure detection switch SW2 for detecting a writing operation by the digital pen 60 by a pressure (writing pressure) applied to the pen tip 64, and a user switch SW3 for receiving an ON / OFF input by a user operation. I have. The cap switch SW1 and the user switch SW3 are provided on the side surface portion of the main body casing 68, and the writing pressure detection switch SW2 is provided inside the main body casing 68.
Further, an output terminal CNTA that outputs an information signal (state information signal) indicating an operation state of the digital pen 60 generated by the control / processing unit 61 is provided on a side surface portion of the main body housing 68.
The infrared LED 62, the infrared CMOS 63, the information memory 65, and the communication unit 66, as well as the cap switch SW1, the writing pressure detection switch SW2, the user switch SW3, and the output terminal CNTA are connected to the control / processing unit 61. Connected to send and receive signals.

  On the other hand, the cap unit 60 </ b> B of the digital pen 60 includes a second display unit DSP <b> 2 as an example of a second display unit that displays the operation state of the digital pen 60.

Here, the connection between the second display part DSP2 provided in the cap part 60B and the control / processing part 61 of the pen body part 60A will be described.
As shown in FIG. 6, in the digital pen 60 of the present embodiment, an output terminal for outputting a status information signal from the control / processing unit 61 is not provided on the side surface of the pen body portion 60A on the pen tip 64 side. Therefore, in a state where the cap unit 60B is attached to the tip end side of the pen body unit 60A (see FIG. 5A), the second display unit DSP2 provided in the cap unit 60B is connected to the control / processing unit 61. No state information signal is received from the control / processing unit 61. Similarly, power supply from the battery 67 is not performed.

On the other hand, in a state where the cap part 60B is mounted on the rear end side of the pen body part 60A (see FIG. 5C), the second display part DSP2 provided in the cap part 60B and the output on the pen body part 60A side. Terminal CNTA is connected. Thereby, the control / processing unit 61 and the second display unit DSP2 are set in a state in which signals (state information signals) can be transmitted and received. That is, the output terminal CNTA on the pen body 60A side is connected to the second display part DSP2 on the cap 60B side when the cap 60B is mounted at a predetermined position on the rear end side of the pen body 60A. Placed in.
Here, FIG. 7 shows a state in which the cap part 60B is attached to the rear end part of the pen body part 60A, and the second display part DSP2 on the cap part 60B side and the output terminal CNTA on the pen body part 60A side are connected. FIG. As shown in FIG. 7, the cap unit 60B is mounted at a predetermined position on the rear end side of the pen body 60A, so that the second display unit DSP2 and the output terminal CNTA are connected. . In this case, the control / processing unit 61 detects that the second display unit DSP2 and the output terminal CNTA are connected, and transmits a status information signal.

The output terminal CNTA provided on the pen body portion 60A side is provided in an annular shape on the outer peripheral surface of the wall surface of the pen body portion 60A, for example. Accordingly, the second display unit DSP2 and the output terminal CNTA are connected regardless of the relative positions of the cap unit 60B and the pen body unit 60A in the circumferential direction.
Moreover, you may comprise so that the one or several output terminal CNTA may be provided on the same periphery of the wall surface outer peripheral surface of 60 A of pen main-body parts. In this configuration, when the cap unit 60B and the pen body unit 60A are mounted in a predetermined positional relationship with respect to the circumferential direction, the second display unit DSP2 and the output terminal CNTA are connected. Accordingly, the first display mode and the second display mode described later are selected depending on whether or not the cap portion 60B is mounted at a predetermined position in the circumferential direction.

  Here, the second display part DSP2 may be provided with a freely projecting input terminal and the output terminal CNTA on the pen body part 60A side may be provided in a recess that is difficult for the user to make direct contact with. FIG. 8 is a diagram for explaining the connection between the projecting input terminal CNTB and the output terminal CNTA provided in the recess when the cap unit 60B is attached to the rear end of the pen body 60A. As shown in FIG. 8A, until the cap 60B is mounted on the rear end of the pen body 60A, the input terminal CNTB is elastically supported to urge the input terminal CNTB toward the inside of the cap 60B. In response to the elastic force from the body CNTBb, the cap part 60B is projected and positioned. Subsequently, as shown in FIG. 8B, when the cap portion 60B starts to be attached to the rear end portion of the pen main body portion 60A, the elastic support body CNTBb is pressed by the main body housing 68 to be compressed and input. The terminal CNTB slides while being in contact with the surface of the main body casing 68. Then, as shown in FIG. 8C, when the input terminal CNTB reaches the position of the output terminal CNTA, the elastic support CNTBb is released by the concave portion CNTAa in which the output terminal CNTA is disposed, and the input terminal CNTB is again It protrudes and is located inside the cap part 60B. Thereby, the input terminal CNTB and the output terminal CNTA are connected. Further, when the input terminal CNTB reaches the concave portion CNTAa, the user feels a click and recognizes that the cap portion 60B is mounted at a predetermined position.

In this case, the output terminal CNTA may be configured by a push switch, and the connection between the output terminal CNTA and the control / processing unit 61 may be turned on when the input terminal CNTB presses the output terminal CNTA. . As a result, the input terminal CNTB is set at the arrangement position of the output terminal CNTA, so that the control / processing unit 61 detects the connection between the input terminal CNTB and the output terminal CNTA, and the control / processing unit 61 sends a status information signal. Starts to output.
Further, the input terminal CNTB of the cap part 60B is integrally fixed to the openable / closable lid part, and the input terminal CNTB is retracted by opening the lid part until the cap part 60B is attached to the pen body part 60A. deep. The input terminal CNTB and the output terminal CNTA may be connected by closing the lid when the cap part 60B is attached to a predetermined position of the pen body 60A.

  In the digital pen 60 of the present embodiment, a signal (state information signal) is output from the control / processing unit 61 from the output terminal CNTA to the second display unit DSP2 as described above. In addition, although not shown in FIG. 7, the second display unit DSP2 and the output terminal CNTA are connected so that the power supply from the battery 67 to the second display unit DSP2 is similarly performed. Also good. Alternatively, a power line different from the signal line to the output terminal CNTA may be separately arranged, and power may be supplied from the battery 67 to the second display unit DSP2 using this power line.

Next, other functional units provided in the digital pen 60 will be described.
First, the infrared LED 62 is composed of one or a plurality of LEDs (Light Emitting Diodes) that emit infrared light having a wavelength of 700 to 1000 μm. Then, pulse lighting is performed based on a drive signal transmitted from an illumination drive unit 614 in the control / processing unit 61 described later.
The infrared CMOS 63 is a CMOS sensor (Complementary Metal Oxide Semiconductor) having sensitivity in the infrared region, and uses a global shutter system capable of simultaneously transferring captured images. The infrared CMOS 63 captures a code image printed on the medium in synchronization with an image capture signal transmitted at a cycle (frame rate) of about 50 fps to 100 fps (frame per second). The image capture signal is generated by an image capture signal generation unit 615 in the control / processing unit 61 described later, and is transmitted to the infrared CMOS 63.
The first display unit DSP1 displays the operation state of the digital pen 60 when both the first display mode and the second display mode described later are set.
Further, the second display unit DSP2 displays the operation state of the digital pen 60 when the first display mode described later is set.

Next, the control / processing unit 61 will be described. FIG. 9 is a block diagram illustrating an example of a functional configuration of the control / processing unit 61. As shown in FIG. 9, the control / processing unit 61 acquires identification information and position information from the processing result in the image processing unit 611 and the image processing unit 611 that process the code image read by the infrared CMOS 63, Furthermore, a data processing unit 612 that generates handwriting information, an output unit 613 that outputs the identification information acquired and generated by the data processing unit 612 and handwriting information or position information to the information memory 65 or the communication unit 66, and an infrared LED 62 An illumination drive unit 614 for driving the image, an image capture signal generation unit 615 for generating an image capture signal of a predetermined period to be transmitted to the infrared CMOS 63, an operation control unit 616 for controlling the operation of each unit, and pen identification information (pen ID ) Is stored.
Here, the image processing unit 611 and the data processing unit 612 function as handwriting information generation means for generating handwriting information based on the code image printed on the medium.

The image processing unit 611 includes an image acquisition unit 611a and a dot array generation unit 611b.
The image acquisition unit 611a acquires a code image read from a print document by the infrared CMOS 63. Moreover, the noise contained in a code image is removed as needed.
The dot array generation unit 611b generates a dot array with reference to the dot positions in the code image. That is, on a two-dimensional array, for example, “1” is stored at a position where there is a dot and “0” is stored at a position where there is no dot, thereby replacing the dot detected as an image with digital data. Then, this two-dimensional array is output as a dot array.

The data processing unit 612 includes a code array generation unit 612a, an identification information acquisition unit 612b, a position information acquisition unit 612c, and a handwriting information generation unit 612d.
The code array generation unit 612a detects a block corresponding to the unit pattern in the code block on the dot array. Specifically, a frame having the same shape and size as the block in which the unit pattern is arranged is moved on the dot array, and the frame is fixed at a position where the number of dots in the frame becomes equal. For example, if the unit pattern of FIG. 3A is used, a frame having a size corresponding to 3 dots × 3 dots is moved, and the frame is fixed at a position where the number of dots included in the frame is 2. Then, a code array is generated that stores code values determined from dot positions in each block delimited by the frame. When this code array is generated, the position of the synchronization code is specified by searching for a code value of a predetermined synchronization code.

The identification information acquisition unit 612b detects the identification code based on the position of the synchronization code from the code array. Then, the identification code is decoded using the parameters used in the RS encoding process at the time of image generation, and identification information is acquired.
The position information acquisition unit 612c detects a position code with reference to the position of the synchronization code from the code array. Then, an M-sequence partial sequence is extracted from the position code, the position of this partial sequence in the M-sequence used at the time of image generation is referenced, and a value obtained by correcting this position with an offset using a synchronization code is acquired as position information. The reason for correcting with the offset is that a synchronization code is arranged between the position codes.
The handwriting information generation unit 612d generates handwriting information obtained by connecting the position information acquired by the position information acquisition unit 612c. Here, the handwriting information is data obtained by connecting and digitizing the locus of the tip of the pen tip 64 when writing (handwriting) by the pen tip 64 is performed.

  By the way, the digital pen 60 is set with a function capable of using a plurality of different operation modes. For example, in the digital pen 60 of the present embodiment, the “writing mode” that is an operation mode in which a writing image drawn on the medium by the pen tip 64 is transmitted as handwriting information to the terminal device 50, and the identification information obtained from the medium In addition, a “reference mode” is set as an operation mode used as reference information for linking one or both of position information to specific information. As an operation example in the “reference mode”, as reference information for generating a command for opening a predetermined web browser program for the terminal device 50 and linking to a web address or the like in which specific information is stored and described, The position information acquired by the position information acquisition unit 612c and the identification information acquired by the identification information acquisition unit 612b are used. In the “reference mode”, only one of the position information and the identification information may be used.

  The operation modes such as “writing mode” and “reference mode” in the digital pen 60 are on / off states of the cap switch SW1, the writing pressure detection switch SW2, and the user switch SW3 that output an on / off signal corresponding to the user's operation. Is set by the operation control unit 616, which is an example of the operation control unit. Then, the operation control unit 616 sends a control signal instructing the data processing unit 612 to set the “writing mode” or the “reference mode”. The setting of “writing mode” and “reference mode” will be described in detail later.

The handwriting information generation unit 612d operates according to a control signal that instructs setting of the “writing mode” from the operation control unit 616. Thereby, in the “writing mode”, the identification information acquired by the identification information acquisition unit 612b and the handwriting information generated by the handwriting information generation unit 612d are sent to the output unit 613.
On the other hand, when the “reference mode” is set by the control signal from the operation control unit 616, the handwriting information generation unit 612d stops its function. Thereby, in the “reference mode”, the identification information acquired by the identification information acquisition unit 612b and the position information acquired by the position information acquisition unit 612c are output to the output unit 613.
The handwriting information generation unit 612d may be operated in both the “writing mode” and the “reference mode” to generate handwriting information from the position information. At that time, when the “writing mode” is set, the handwriting information is used as it is as handwriting information obtained by connecting the tips of the pen tip 64. When “reference mode” is set, handwriting information is used as reference information.

  The operation control unit 616 functions as a display control unit that controls display settings on the first display unit DSP1 and the second display unit DSP2. That is, the connection between the second display unit DSP2 and the output terminal CNTA is detected. Then, either the first display mode or the second display mode described later is set according to the detection result. For example, when the connection between the second display unit DSP2 and the output terminal CNTA is detected, the first display mode is set. In this case, the operation control unit 616 outputs a state information signal to both the output terminal CNTA (second display unit DSP2) and the first display unit DSP1. Further, when the connection between the second display unit DSP2 and the output terminal CNTA is not detected, the second display mode is set. In this case, the operation control unit 616 outputs a state information signal only to the first display unit DSP1.

The output unit 613 outputs identification information and handwriting information or position information to the communication unit 66 when communication between the communication unit 66 and the terminal device 50 is established. On the other hand, when the communication between the communication unit 66 and the terminal device 50 is not established, the output unit 613 outputs the identification information and the handwriting information or the position information to the information memory 65. The information memory 65 stores the identification information sent from the output unit 613 and the handwriting information or the position information, so that the identification information and the handwriting information or the position information are not lost even if communication is poor.
Note that the output unit 613 may be configured to output either one of identification information and handwriting information or position information to the information memory 65 or the communication unit 66.

The image capture signal generation unit 615 generates an image capture signal having a period (frame rate) of, for example, 50 fps to 100 fps and transmits the image capture signal to the infrared CMOS 63. The infrared CMOS 63 sequentially captures the code images printed on the medium at the frame rate set by the transmitted image capture signal. Further, the image capture signal generation unit 615 transmits the generated image capture signal to the illumination drive unit 614.
The illumination drive unit 614 generates a drive signal for driving the infrared LED 62 and turns on the infrared LED 62 in pulses. At that time, in order to correspond to the frame rate in the infrared CMOS 63, the drive signal is output in synchronization with the image capture signal generated by the image capture signal generation unit 615. Thereby, the power consumption in the infrared LED 62 is reduced.

In the digital pen 60, first, when the infrared LED 62 driven by the illumination driving unit 614 irradiates the medium with infrared light, the infrared is synchronized with the image capture signal from the image capture signal generation unit 615. The CMOS 63 receives the reflected light and reads the code image printed on the medium. The code image read by the infrared CMOS 63 is sent to the image processing unit 611 in the control / processing unit 61.
In the image processing unit 611, the image acquisition unit 611a acquires the read code image. At that time, if noise is included in the code image, it is removed. Subsequently, the dot array generation unit 611b converts the dot positions included in the code image into digital data and generates a dot array. Then, the generated dot array is sent to the data processing unit 612.

In the next data processing unit 612, the code array generation unit 612a detects a block from the dot array, and generates a code array that stores a code value for each block. Then, the position of the synchronization code is specified in the code array. Thereafter, the identification information acquisition unit 612b detects the identification code based on the position of the synchronization code, decodes it, and acquires the identification information. The identification information acquired by the identification information acquisition unit 612b is sent to the output unit 613.
Further, the position information acquisition unit 612c detects the position code based on the position of the synchronization code, decodes this, and acquires the position information. When the “writing mode” is set, the position information acquired by the position information acquisition unit 612c is sent to the handwriting information generation unit 612d, and the handwriting information generation unit 612d connects the position information. Handwriting information is generated. The handwriting information generated by the handwriting information generation unit 612d is sent to the output unit 613. On the other hand, when the “reference mode” is set, the position information acquired by the position information acquisition unit 612 c is sent to the output unit 613 as it is.

The output unit 613 outputs identification information and handwriting information or position information to the communication unit 66 when communication between the communication unit 66 and the terminal device 50 is established. On the other hand, when the communication between the communication unit 66 and the terminal device 50 is not established, the output unit 613 outputs the identification information and the handwriting information or the position information to the information memory 65.
Then, the identification information and the handwriting information or the position information are output to the communication unit 66, so that the communication unit 66 transmits handwriting information and the like to the terminal device 50. By outputting identification information or the like to the information memory 65, the information memory 65 stores handwriting information or the like.

Next, the first display mode and the second display mode set by the operation control unit 616 will be described.
Various operation states occur in the digital pen 60 of the present embodiment. For example, as the above-described operation mode, “writing mode” in which a writing image drawn on a medium by the pen tip 64 is transmitted as handwriting information to the terminal device 50, and one or both of identification information and position information obtained from the medium are used. There is an operation state in which “reference mode” used as reference information for linking to specific information is set.
Further, there are an operation state in which identification information and handwriting information or position information are transmitted from the communication unit 66 to the terminal device 50, and an operation state stored in the information memory 65. Further, in that case, the communication unit 66 has an operation state during transmission to the terminal device 50 and an operation state of communication completion.
In addition, an operation state in which the power source of the digital pen 60 is turned on, an operation state in which the power source is turned off, and a power saving state in which power consumption is reduced are set. In addition, there is a variation in the state of charge in the battery 67.

Here, the setting of “writing mode” and “reference mode” will be described first. As described above, the “writing mode” and the “reference mode” are set by the operation control unit 616 based on the on / off states of the cap switch SW1, the writing pressure detection switch SW2, and the user switch SW3.
As shown in FIG. 7, the cap switch SW1 disposed on the side surface of the main body housing 68 of the pen main body 60A is not provided on the pen main body 60A when the cap 60B is not attached to the pen main body 60A. It is set to protrude from the side. Further, as shown in FIG. 6, when the cap part 60B is mounted, the cap switch SW1 is set in a state of being accommodated inside the cap part 60B by being pushed in by the inner peripheral surface of the cap part 60B. Is done.
When the cap switch SW1 is set in a state in which the cap switch SW1 protrudes from the side surface of the pen main body 60A, the signal “0” indicating that the cap switch SW1 is in an off state with respect to the operation control unit 616. Is output. On the other hand, when the cap switch SW1 is set to be housed in the pen body 60A, the cap switch SW1 outputs a signal “1” indicating that the cap switch SW1 is in the ON state to the operation control unit 616. .

Next, the writing pressure detection switch SW2 disposed inside the main body housing 68 of the pen body portion 60A is subjected to a writing operation by the digital pen 60 when the cap portion 60B shown in FIG. 7 is not attached. The pen tip 64 presses the medium. Thereby, the pen tip 64 moves by a predetermined amount along the axial direction of the pen tip 64 toward the writing pressure detection switch SW2. Thereby, the writing pressure detection switch SW2 receives the pressure (writing pressure) from the pen tip 64 and detects the writing operation by the digital pen 60. In this case, the writing pressure detection switch SW2 outputs a signal “1” indicating that the writing pressure detection switch SW2 is in an ON state.
On the other hand, the pen tip 64 is constantly urged to the opposite side of the writing pressure detection switch SW2 by an urging spring (not shown). Therefore, when the writing operation by the digital pen 60 is not performed, the pen tip 64 is set at a predetermined position so as to protrude from the main body housing 68 by the biasing spring. Therefore, in a state where the writing operation is not performed, the writing pressure detection switch SW2 does not receive pressure (writing pressure) from the pen tip 64. In this case, the writing pressure detection switch SW2 outputs a signal “0” indicating that the writing control switch SW2 is in an off state.

  Next, the user switch SW3 (see FIG. 6 and FIG. 7) disposed on the side surface of the main body housing 68 of the pen main body 60A is turned on / off by a user operation input. That is, when the user switch SW3 is turned on by a user operation, a signal “1” is output. In other cases, a signal “0” is output to the operation control unit 616.

FIG. 10 is a diagram illustrating an example of the relationship between the on / off state of the cap switch SW1, the writing pressure detection switch SW2, and the user switch SW3 and the operation mode. First, referring to FIG. 10, the case where the cap switch SW1 is in the off state (“0”) will be described. This state is set when the cap 60B is not attached to the tip end side of the pen body 60A. In this state, when the pen pressure detection switch SW2 is in the on state (“1”), the digital pen 60 is in a state where writing is performed with the pen tip 64 or the code image of the medium is being read. is there.
Therefore, in this case, the operation control unit 616 sets the operation mode based on the state of the user switch SW3. That is, when the user switch SW3 is in the off state (“0”), the operation control unit 616 sets “writing mode”. When the user switch SW3 is in the on state (“1”), the operation control unit 616 sets “reference mode”.

  In FIG. 10, when the cap switch SW1 is in the off state (“0”) and the writing pressure detection switch SW2 is in the off state (“0”), the pen tip 64 is not pressed by the medium, and the user does not touch the pen tip. 64 is neither writing nor reading the code image of the medium. Therefore, in this case, the operation control unit 616 sets the digital pen 60 to the power saving state. The “power saving state” in this specification means a state in which power supply to some functional units of the digital pen 60 is stopped or reduced, or some functional units in the control / processing unit 61 of the digital pen 60. Is a state in which power supply to almost all functional units is stopped.

  Next, in FIG. 10, the ON state (“1”) of the cap switch SW1 is set when the cap portion 60B is attached to the tip end side of the pen body portion 60A. When the cap unit 60B is attached to the distal end side, the operation control unit 616 saves power by assuming that the user does not intend to use the digital pen 60 regardless of the state of the writing pressure detection switch SW2 and the user switch SW3. Set the state.

  Thus, the operation control unit 616, which is an example of the operation control unit, is based on the relationship between the on / off states of the cap switch SW1, the writing pressure detection switch SW2, and the user switch SW3 illustrated in FIG. “Writing mode” or “reference mode” is set in the digital pen 60. That is, when the cap switch SW1 is in the off state (“0”), the writing pressure detection switch SW2 is in the on state (“1”), and the user switch SW3 is in the off state (“0”), the operation control unit 616 Then, the “writing mode” is set in the digital pen 60. When the cap switch SW1 is in the off state (“0”), the writing pressure detection switch SW2 is in the on state (“1”), and the user switch SW3 is in the on state (“1”), the operation control unit 616 Then, the “reference mode” is set in the digital pen 60. In other settings, the operation control unit 616 sets the power saving state.

As shown in FIG. 10, in the state where the cap part 60B is not attached to the tip part side of the pen body part 60A, the “writing mode”, the “reference mode”, and the power saving state are set. In “writing mode” and “reference mode”, an operation state in which identification information and handwriting information or position information are transmitted from the communication unit 66 to the terminal device 50 and an operation state stored in the information memory 65 are generated. To do. Further, in that case, the communication unit 66 has an operation state during transmission to the terminal device 50 and an operation state of communication completion. In addition, there are an operation state in which the power source of the digital pen 60 is turned on, an operation state in which the digital pen 60 is turned off, and a change in the amount of charge in the battery 67.
On the other hand, in the state where the cap portion 60B is attached to the tip end portion side of the pen body portion 60A, there is no setting of “writing mode” or “reference mode”, and only the power saving state is set. Therefore, there is no operation state in which the identification information and the handwriting information or the position information are transmitted from the communication unit 66 to the terminal device 50 and the operation state stored in the information memory 65. Furthermore, there is neither an operation state in the middle of transmission to the terminal device 50 in the communication unit 66 nor an operation state of communication completion. However, there are variations in the operation state in which the power source of the digital pen 60 is turned on, the operation state in which the power source is turned off, and the amount of charge in the battery 67.

As described above, the number of types of operation states set in the digital pen 60 is different between the state in which the cap unit 60B is not mounted on the tip end side of the pen body unit 60A and the state in which the cap unit 60B is mounted on the tip end side. Different. That is, in the state where the cap part 60B is not attached to the tip part side of the pen body part 60A, the number of types of operation states set in the digital pen 60 is large, but in the state where it is attached to the tip part side, The number of types of operation states set in the digital pen 60 is small.
Therefore, in the digital pen 60 of the present embodiment, the operation control unit 616 as an example of the display control unit is attached to the pen body 60A in a state where the cap 60B is attached to the rear end side of the pen body 60A. A first display mode for displaying the operating state of the digital pen 60 is set using both the first display unit DSP1 arranged and the second display unit DSP2 arranged in the cap unit 60B. Further, in a state where the cap unit 60B is mounted on the tip end side of the pen body 60A, the second display unit displays the operation state of the digital pen 60 using only the first display unit DSP1 disposed on the pen body 60A. Set the display mode.

That is, when the cap unit 60B is mounted at a predetermined position on the rear end side of the pen body unit 60A, and the second display unit DSP2 and the output terminal CNTA are set in a connected state, the control / processing unit The operation control unit 616 of 61 detects that the second display unit DSP2 and the output terminal CNTA are connected. Thereby, the operation control unit 616 sets the first display mode.
In a state where it is not detected that the second display unit DSP2 and the output terminal CNTA are connected, the operation control unit 616 sets the second display mode.

  Here, FIG. 11 is a diagram showing an example of a display form when the first display mode is set, and FIG. 11B is a display form when the second display mode is set. It is the figure which showed an example. As shown in FIG. 11, the first display unit DSP1 on the pen body unit 60A side includes two light emitting units LED11 and LED12 including light emitting elements such as LEDs (Light Emitting Diode). Further, the second display part DSP2 on the cap part 60B side includes three light emitting parts LED21, LED22, LED23 made of similar light emitting elements, and an extra switch SW4.

Then, as shown in FIG. 11A, when the first display mode is set, the light emitting unit LED11, LED12 and the light emitting unit LED21, LED22, LED23 are used to turn on / flash / not display. The operating state of the digital pen 60 is displayed based on the lighting setting, display color, blinking speed, and combinations thereof. That is, using the light emitting units LED11, LED12 of the first display unit DSP1 and the light emitting units LED21, LED22, LED23 of the second display unit DSP2, settings relating to the setting of the “writing mode”, “reference mode”, and power saving state Information indicating the operating state in which information, handwriting information and the like are transmitted to the terminal device 50, information indicating the operating state in which handwriting information and the like are stored in the information memory 65, and an operation in the middle of transmission from the communication unit 66 to the terminal device 50 Information indicating the state of communication, information indicating the operation state of communication completion, information regarding whether or not communication was successful, information indicating the operation state of the digital pen 60 turned on, information indicating the operation state of being turned off, battery 67 The state information of the amount of charge at is displayed.
Further, the extra switch SW4 is set so as to also serve as the user switch SW3, for example. That is, it is set to switch between the “writing mode” and the “reference mode” depending on which the user can easily operate. Moreover, you may set so that transmission of the handwriting information etc. to the terminal device 50 may be started by extra switch SW4. Thereby, for example, handwriting information stored in the information memory 65 is transmitted to the terminal device 50 by the user's intention. Moreover, you may set so that the display color of light emission part LED11, LED12 or light emission part LED21, LED22, LED23 may be changed by extra switch SW4.

  On the other hand, as shown in FIG. 11B, when the second display mode is set, the light emitting unit LED11 and LED12 are used to set lighting / flashing / non-lighting, display color, and flashing. The state of the digital pen 60 is displayed based on the speed, a combination thereof, and the like. That is, using the light emitting units LED11 and LED12 of the first display unit DSP1, setting information regarding the setting of the power saving state, information indicating the operating state in which the power of the digital pen 60 is turned on, information indicating the operating state in which the digital pen 60 is turned off, Information on the state of charge of the battery 67 is displayed.

As described above, in the digital pen 60 according to the present embodiment, when the cap unit 60B is mounted on the rear end side of the pen body unit 60A, the number of types of operation states set in the digital pen 60 is large. Therefore, the first display mode for displaying the state of the digital pen 60 is set by using both the first display unit DSP1 disposed in the pen body unit 60A and the second display unit DSP2 disposed in the cap unit 60B. On the other hand, when the cap part 60B is attached to the tip end part side of the pen body part 60A, the number of types of operation states set in the digital pen 60 is small, and therefore the first part disposed in the pen body part 60A. A second display mode for displaying the state of the digital pen 60 is set using only the one display unit DSP1.
Thereby, in the digital pen 60 having a small outer surface area, the operation state set in the digital pen 60 is displayed by efficiently using the small area region. Further, there is a margin in the mounting of each functional unit inside the pen main body 60A, and the digital pen 60 can be downsized. Furthermore, when there are few types of states of the digital pen 60 to be displayed, display is performed with only a small number of light emitting units, so that power consumption in the digital pen 60 is reduced.
In addition, when the cap unit 60B is attached to the rear end side of the pen body unit 60A, the display is also performed on the cap unit 60B that is close to the position of the user's eyes, so that the state of the digital pen 60 can be grasped. easy.

  Even when the cap portion 60B is not attached to the front end portion side of the pen body portion 60A and the cap portion 60B is not attached to the rear end portion side of the pen body portion 60A, the “writing mode” ”,“ Reference mode ”, and power saving state are set. However, in this case, since the connection between the second display unit DSP2 and the output terminal CNTA is not detected, the first display mode is not set. Therefore, for example, the cap unit 60B is removed from the tip end side of the pen body unit 60A, the cap switch SW1 is turned off (“0”), and “writing mode” or “reference mode” is set. When the control unit 616 does not detect that the second display unit DSP2 and the output terminal CNTA are connected, a warning display for quickly blinking the light emitting units LED11 and LED12 of the first display unit DSP1 in red, for example, is performed. It may be set. This prompts the user to attach the cap portion 60B to the rear end side of the pen body portion 60A.

FIG. 12 is a diagram illustrating a hardware configuration of the control / processing unit 61 of the digital pen 60.
As shown in FIG. 12, the control / processing unit 61 executes digital arithmetic processing according to a predetermined program (firmware) when performing operation control and signal processing of the digital pen 60, and processing executed by the CPU 101 RAM 102 in which programs are stored, ROM 103 in which data such as setting values used in processing programs executed by CPU 101 are stored, EEROM and flash memory that can be rewritten and can retain data even when power supply is interrupted And an interface unit 105 that controls input / output of signals to / from each unit connected to the control / processing unit 61.
The external storage device 106 stores a program to be executed by the control / processing unit 61. When the control / processing unit 61 reads this program, operation control and signal processing with the digital pen 60 are executed. Is done.

  That is, a program for realizing the functions of the image processing unit 611, the data processing unit 612, the output unit 613, and the operation control unit 616 is read from the external storage device 106 into the RAM 102 in the control / processing unit 61. Then, based on the program read into the RAM 102, the CPU 101 performs various processes. For example, a hard disk or a DVD-ROM provided in the terminal device 50 that communicates with the digital pen 60 functions as the external storage device 106 of the digital pen 60, and this program is loaded into the RAM 102 from the terminal device 50 via the communication line. To be provided. As another providing form, there is a form provided in a state installed in the ROM 103 in advance. Furthermore, after the digital pen 60 is assembled, a program is installed in the nonvolatile memory 104 and loaded from the nonvolatile memory 104 to the RAM 102. Further, there is a form in which a program is transmitted to the digital pen 60 via a network such as the Internet and installed in the RAM 102.

Furthermore, various processes performed on the electronic document in the handwriting information management system of the present embodiment will be described.
[Print document generation processing]
FIG. 13 is a sequence diagram illustrating an example of an operation when a print document is generated in the handwriting information management system.
First, the user transmits an instruction to print an electronic document from the terminal device 10 to the document server 20 (step 101). At that time, the terminal device 10 transmits an electronic document to be printed, identification information (document ID) of the electronic document, and print settings designated by the user. Here, the print settings include the page to be printed, the number of copies, the size of the paper that is the medium, the enlargement / reduction ratio, N-up (printing that allocates N pages of the electronic document to one page of the medium), and the size of the margin area. Including settings such as.

The document server 20 receives an electronic document print instruction from the terminal device 10 (step 201). The electronic document to be printed included in the print instruction is sent to the electronic document management unit 23, and the electronic document management unit 23 registers the electronic document in the document / handwriting information storage unit 25 in association with the document ID (step 202). ).
Further, the document server 20 transmits the document ID and print setting of the electronic document instructed to be printed to the identification information server 30 (step 203). Here, for example, a URL (Uniform Resource Locator) may be used as the document ID, but other information may be used as long as the electronic document can be uniquely identified.
Thereby, the identification information server 30 receives the document ID and the print setting (step 301). Then, the identification information management unit 32 that manages the medium identification information acquires unused medium identification information from the identification information storage unit 33 (step 302). Here, the number of pieces of medium identification information to be extracted is determined according to print settings. That is, basically, the number of pieces of medium identification information obtained by multiplying the number of pages to be printed by the number of copies is extracted. However, if N-up printing is specified in the print setting information, this is also taken into consideration. For example, when printing 5 copies of a 10-page electronic document by 2-up printing, 25 (= 10 ÷ 2 × 5) pieces of medium identification information are extracted.
Next, the identification information server 30 associates the identification information, the document ID, and the print settings and registers them in the identification information storage unit 33 (step 303). Then, the identification information server 30 transmits the identification information to the document server 20 (step 304).

Thereby, the document server 20 receives the identification information (step 204). Then, a code image representing the identification information and the position information is generated (step 205).
That is, in the document server 20, the receiving unit 21 receives the medium identification information. Then, the reception unit 21 passes the received medium identification information to the identification information acquisition unit 22. Then, the identification information acquisition unit 22 first passes the acquired medium identification information to the identification code generation unit 27a, and the identification code generation unit 27a encodes the medium identification information using the method described above to generate an identification code. .
In addition, the position code generation unit 27b receives print settings from the reception unit 21, encodes position information in a range corresponding to the print settings using the above-described method, and generates a position code.
Then, the code arrangement unit 27c arranges the medium identification code and the position code according to a predetermined layout, and the code image generation unit 27e converts the image into an image using the pattern image stored in the pattern image storage unit 27d. A code image is generated by.

Thereafter, in the document server 20, the document image generation unit 26 generates a document image of the electronic document (step 206). At that time, the document image generation unit 26 receives the document ID acquired by the identification information acquisition unit 22 in step 201, and reads an electronic document to be printed from the document / handwriting information storage unit 25 based on the document ID. In step 201, the print setting acquired by the identification information acquisition unit 22 is received, and a document image is generated based on the print setting.
Then, the image composition unit 28 synthesizes the code image generated in step 205 and the document image generated in step 206 to generate a composite image (step 207).
Thereafter, the composite image is transferred to the transmission unit 29, and the transmission unit 29 transmits a print command for the composite image to the image forming apparatus 40 (step 208). Here, the composite image print command is transmitted, for example, in a PDL format in which the content to be printed as a code image is set as a PDL command to a PDL (Page Description Language) file including a sequence of print commands for document images. .

  The image forming apparatus 40 receives the composite image (document image and code image of the electronic document) from the document server 20 (step 401). Then, the image forming apparatus 40 develops the document image into an image using Y (yellow), M (magenta), and C (cyan) (step 402). Next, the document image is formed using C, M, and Y toners, and the code image is formed using K (black including carbon) toner (step 403).

In the above-described example, the identification information server 30 simply issues the identification information, and the document server 20 generates a code image including the identification information and instructs the image forming apparatus 40 to form an image. However, the identification information server 30 may generate a code image and instruct the image forming apparatus 40 to form an image.
Further, a configuration in which the code image is generated by the image forming apparatus 40 may be adopted. In that case, the document server 20 or the identification information server 30 adds the identification information to the PDL generated from the electronic document and transmits it to the image forming apparatus 40, and the image forming apparatus 40 generates a code image including the identification information. It will be.

  In the above example, the configuration in which the database (identification information storage unit 33) configured by associating the identification information, the document ID, and the print setting is placed in the identification information server 30 has been described. This is because placing such a database on a sharable device (identification information server 30) makes it possible to handle multiple users and ensure the security of electronic documents using server access control technology. However, such a configuration is not necessarily employed, and a configuration in which the above database is placed in the terminal device 10 or the document server 20 may be employed.

In the image forming apparatus 40 described above, the code image is formed by using K (black containing carbon) toner. This is because the K toner has a larger amount of infrared light absorption than the C (cyan), M (magenta), and Y (yellow) toner, and the digital pen 60 can easily read the code image. is there. However, the code image can also be formed using special toner.
Here, as the special toner, an invisible toner having a maximum absorption rate of 7% or less in the visible light region (400 nm to 700 nm) and an absorption rate of 30% or more in the near infrared region (800 nm to 1000 nm) is exemplified. . Here, “visible” and “invisible” are not related to whether they can be recognized visually. “Visible” and “invisible” are distinguished depending on whether or not an image in a printed document can be recognized by the presence or absence of color development due to absorption of a specific wavelength in the visible light region. Also, “invisible” includes those that have some color developability due to absorption of a specific wavelength in the visible light region but are difficult to be recognized by human eyes.

  Here, the code image is combined with the image of the electronic document and printed. However, the code image may be printed on white paper (notebook, tag, etc.). In that case, the document ID is not included in the print request received in step 201, the identification information is not associated with the document ID and the print setting in step 303, and the generation of the document image in step 206 is not executed. What should I do?

[Handwriting information registration process]
Next, an operation when the digital pen 60 generates handwriting information and registers it in the document server 20 will be described.
As described above, in the digital pen 60, the identification information acquisition unit 612b acquires identification information. In addition, the position information acquisition unit 612c acquires position information. Further, the handwriting information generation unit 612d connects the position information to each other to generate handwriting information. Then, the communication unit 66 transmits the identification information and handwriting information to the identification information server 30 via the terminal device 50. The identification information server 30 registers the handwriting information in the document server 20.
FIG. 14 is a sequence diagram illustrating an example of operations of the identification information server 30 and the document server 20 when registering handwriting information.
In the identification information server 30, first, the receiving unit 31 receives identification information and handwriting information from the digital pen 60 (step 311). Next, the identification information and handwriting information are passed to the identification information management unit 32, and the identification information management unit 32 takes out the document ID associated with the passed identification information from the identification information storage unit 33. Then, the document server 20 (the document server 20 in which the electronic document specified by the document ID exists) is determined as the transmission destination of the identification information and handwriting information received in step 311 (step 312). If the document ID is not associated with the identification information in the identification information storage unit 33, it is considered that the identification information is assigned to a blank sheet (note or tag). In that case, the document server 20 that manages the handwriting information for the white paper may be determined as the transmission destination.
Thereafter, the identification information and the handwriting information are transferred to the transmission unit 39, and the transmission unit 39 transmits the identification information and the handwriting information to the document server 20 determined as the transmission destination in Step 312 (Step 313).

  Thereby, in the document server 20, the receiving part 21 receives identification information and handwriting information (step 211). Then, the reception unit 21 passes the received identification information to the handwriting information management unit 24. Then, the handwriting information management unit 24 stores the identification information and the handwriting information in association with each other in the document / handwriting information storage unit 25 (step 212).

As described above, in the digital pen 60 used in the handwriting information management system of the present embodiment, the operation set for the digital pen 60 when the cap unit 60B is attached to the rear end side of the pen body unit 60A. Since the number of types of states is large, the first display unit displays the state of the digital pen 60 using both the first display unit DSP1 disposed in the pen body unit 60A and the second display unit DSP2 disposed in the cap unit 60B. Set the display mode. On the other hand, when the cap part 60B is attached to the tip end part side of the pen body part 60A, the number of types of operation states set in the digital pen 60 is small, and therefore the first part disposed in the pen body part 60A. A second display mode for displaying the state of the digital pen 60 is set using only the one display unit DSP1.
Thereby, in the digital pen 60 having a small outer surface area, the operation state set in the digital pen 60 is displayed by efficiently using the small area region. Further, there is a margin in the mounting of each functional unit inside the pen main body 60A, and the digital pen 60 can be downsized. Furthermore, when there are few types of states of the digital pen 60 to be displayed, display is performed with only a small number of light emitting units, so that power consumption in the digital pen 60 is reduced. In addition, when the cap unit 60B is attached to the rear end side of the pen body unit 60A, the display is also performed on the cap unit 60B that is close to the position of the user's eyes, so that the state of the digital pen 60 can be grasped. An easy configuration is realized.

It is the figure which showed an example of the structure of the handwriting information management system of this Embodiment. It is the block diagram which showed an example of the function structure of the document server. It is the figure which showed an example of the image etc. which comprise a code image. It is the block diagram which showed an example of the function structure of the identification information server. 1 is an overall configuration diagram of a digital pen. It is the schematic explaining the internal structure of a digital pen. It is the figure which showed the state in which the cap part was mounted | worn with the rear-end part of the pen main-body part, and the 2nd display part by the side of a cap part and the output terminal by the side of a pen main-body part were connected. It is a figure explaining the connection of the input terminal which can be protruded when a cap part is mounted | worn with the rear-end part of a pen main-body part, and the output terminal provided in the recessed part. It is the block diagram which showed an example of the function structure of the control / processing part. It is the figure which showed an example of the relationship between the on / off state of each switch, and an operation mode. (a) It is the figure which showed an example of the display form when a 1st display mode is set, (b) It is the figure which showed an example of the display form when a 2nd display mode is set. It is the figure which showed the hardware constitutions of the control / processing part of a digital pen. It is the sequence diagram which showed an example of the operation | movement at the time of a printed document being produced | generated in a handwriting information management system. It is the sequence diagram which showed an example of operation | movement of the identification information server at the time of registering handwriting information, and a document server.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Terminal device, 20 ... Document server, 25 ... Document / handwriting information storage part, 30 ... Identification information server, 40 ... Image forming apparatus, 50 ... Terminal device, 60 ... Digital pen, 60A ... Pen main-body part, 60B ... Cap 61: Control / Processing Unit, 65 ... Information Memory, 66 ... Communication Unit, 611 ... Image Processing Unit, 612 ... Data Processing Unit, 613 ... Output Unit, 616 ... Operation Control Unit, SW1 ... Cap Switch, SW2 ... Brush Pressure detection switch, SW3 ... User switch, SW4 ... Extra switch, DSP1 ... First display unit, DSP2 ... Second display unit, CNTB ... Input terminal, CNTA ... Output terminal, LED11, LED12, LED21, LED22, LED23 ... Light emitting unit

Claims (10)

A writing unit that forms a handwriting corresponding to a user's writing operation on a medium on which a code image is printed;
An apparatus main body in which the writing unit is disposed;
A protective cover part that is detachably attached to the apparatus main body part and protects the writing part;
An operation state that is arranged in the apparatus main body and generates handwriting information that is information related to the user's writing operation based on the code image at a position on the medium where the handwriting is formed by the writing unit; A first display unit for displaying an operation state of the apparatus including an operation state for generating reference information for referring to specific information based on a code image;
A second display unit disposed on the protective cover unit and displaying the operating state;
A display control unit for controlling display settings on the first display unit and the second display unit related to the operation state according to a mounting position of the protective cover unit on the apparatus main body unit. Characteristic handwriting information generation device.   The display control unit displays the operating state when the protective cover unit is mounted on the side opposite to the side where the writing unit of the apparatus main body is disposed, the first display unit and the second display unit. The display is set to be displayed using both of the display units, and when the protective cover unit is attached to the side of the apparatus main body where the writing unit is disposed, the operation state is displayed on the first display unit. The handwriting information generation apparatus according to claim 1, wherein the control is performed so that the display is set to be displayed.   The display control unit detects the first display unit and the second display unit by detecting that the protective cover unit is attached to a side of the apparatus main body opposite to the side where the writing unit is disposed. The handwriting information generation apparatus according to claim 2, wherein the control is performed so that the operation state is displayed using both of the display units.   The display control unit is set to any one of an operation state for generating the handwriting information and an operation state for generating the reference information, and the protective cover unit is a side on which the writing unit of the apparatus main body is disposed. The handwriting information generating apparatus according to claim 1, wherein a warning is displayed on the first display unit when it is not detected that it is mounted on the opposite side of the handwriting.   When the protective cover part is attached to the side of the apparatus main body opposite to the side where the writing part is disposed, either the operating state for generating the handwriting information or the operating state for generating the reference information The handwriting information generating apparatus according to claim 1, further comprising an operation control unit for setting. A handwriting information generating device that generates handwriting information that is information related to a user's writing operation on a medium on which a document image and a code image based on an electronic document are printed;
A handwriting information management device that acquires the handwriting information generated by the handwriting information generation device, manages the acquired handwriting information in association with the medium or the electronic document printed on the medium, and
The handwriting information generation device
A writing unit for forming a handwriting corresponding to a user's writing operation on the medium;
An apparatus main body in which the writing unit is disposed;
A protective cover part that is detachably attached to the apparatus main body part and protects the writing part;
An operation state that is arranged in the apparatus main body and generates handwriting information that is information related to the user's writing operation based on the code image at a position on the medium where the handwriting is formed by the writing unit; A first display unit that displays an operation state of the handwriting information generation device including an operation state of generating reference information for referring to specific information based on a code image;
A second display unit disposed on the protective cover unit and displaying the operating state;
A display control unit for controlling display settings on the first display unit and the second display unit related to the operation state according to a mounting position of the protective cover unit on the apparatus main body unit. Characteristic handwriting information management system.   The display control unit of the handwriting information generation device displays the operating state when the protective cover unit is mounted on the side opposite to the side where the writing unit of the apparatus main body is disposed. If the protective cover part is attached to the side of the apparatus main body where the writing part is arranged, the operation state is changed to the display part. The handwriting information management system according to claim 6, wherein the control for setting to display using the first display unit is performed.   The display control unit of the handwriting information generation device detects the first display by detecting that the protective cover unit is attached to a side of the device main body opposite to the side where the writing unit is disposed. The handwriting information management system according to claim 7, wherein the control for setting the operation state to be displayed is performed using both the display unit and the second display unit.   The display control unit of the handwriting information generation device is set to any one of an operation state for generating the handwriting information and an operation state for generating the reference information, and the protective cover unit is the writing of the device main body unit. The handwriting information management system according to claim 6, wherein a warning is displayed on the first display unit when it is not detected that the unit is mounted on the side opposite to the side where the unit is disposed.   The handwriting information generating device generates an operation state and the reference information for generating the handwriting information when the protective cover portion is attached to a side of the device main body opposite to the side where the writing portion is disposed. The handwriting information management system according to claim 6, further comprising an operation control unit configured to set any of the operation states to be performed.

Images