JP2009181243A - Handwriting information processor and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology for, even when completed information is changed, properly processing unchanged or changed handwriting information by simple operation. <P>SOLUTION: A server acquires handwriting information or the like (step 241). When one of the acquired handwriting information has been already written in a completion region (step 243), and the handwriting information is determined to show the intention of correction (step 246), new handwriting information associated by the processing in step 245 is associated with completed information associated by the processing in step 248 through the handwriting information showing the intention of the correction (step 249). Then, when both handwriting information is written in the same region (step 250), new handwriting information is registered in the region where the completed information has been written (step 251). <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a handwriting information processing apparatus and a program.

  A technique is known in which an electronically stored document is changed by manually editing a printout surface (see, for example, Patent Document 1). In the technique of Patent Document 1, first, an electronically stored document is printed on a surface provided with a position coding pattern. Next, the printout surface is manually edited with a digital pen provided with position-coding pattern reading means and a pen point for marking the surface. The marking is then transferred to the computer, interpreted within the computer, and changes are made to the stored document based on this interpretation.

Special table 2003-528388 gazette

When a normal ink pen is used and a document written on a sheet is corrected, generally, a double line is drawn on the document to be corrected and, for example, a correct character is written below the double line. Similarly, when making corrections or other changes to electronically stored documents using a digital pen, instead of simply registering handwriting information as it is, instead of handwriting information already registered, It is desirable to manage the added handwriting information as a new document. Further, it is desirable that the operation for realizing it is a simple operation.
An object of the present invention is to provide a technique capable of appropriately processing handwriting information before and after a change even if a change to completed information is entered by a simple operation.

  The invention described in claim 1 includes handwriting information acquisition means for acquiring a plurality of handwriting information obtained by digitizing a new handwriting for a medium having position information which is information indicating each position and having a plurality of entered information. Of the plurality of handwriting information acquired by the handwriting information acquisition means, suggestion information that suggests a change to any of the plurality of written information, and a predetermined handwriting in the plurality of handwriting information First associating means for associating information; second associating means for associating the suggestion information with predetermined entered information suggested to be changed by the suggestion information in the plurality of entered information; and A handwriting information processing apparatus including: a third association unit that associates the predetermined handwriting information with the predetermined completed information through suggestion information.

The invention according to claim 2 is characterized in that the first association means associates the time when the suggestion information is entered with the time when the predetermined handwriting information is entered. This is a handwriting information processing apparatus.
The invention according to claim 3 is characterized in that the first association means associates the area governed by the suggestion information with the area governed by the predetermined handwriting information. It is a processing device.
The invention according to claim 4 is the handwriting information processing apparatus according to claim 1, wherein the first associating means associates based on the center of gravity of the suggestion information and the center of gravity of the predetermined handwriting information. .

The invention according to claim 5 is characterized in that the second associating means associates based on a polygon area formed by the suggestion information and a polygon area formed by the predetermined filled information. A handwriting information processing apparatus according to claim 1.
The invention according to claim 6 is the handwriting information processing apparatus according to claim 1, wherein the second associating means associates based on the centroid of the suggestion information and the centroid of the predetermined written information. is there.
The invention according to claim 7 is characterized in that the second associating means associates based on the centroid of the polygon formed by the suggestion information and the centroid of the polygon formed by the predetermined written information. A handwriting information processing apparatus according to claim 1.

The invention according to claim 8 includes a plurality of handwriting information acquisition means for acquiring a plurality of handwriting information obtained by digitizing a new handwriting for a medium having a plurality of divided areas and having written information, and the handwriting information acquisition. Of the plurality of handwriting information acquired by the means, first associating means for associating suggestion information suggesting a change to the completed information with predetermined handwriting information in the plurality of handwriting information, the suggestion information, The second association means for associating any one of the plurality of divided areas with the predetermined handwriting information and the area associated with the second association means via the suggestion information A handwriting information processing apparatus including third association means.
The invention according to claim 9 is the handwriting according to claim 8, wherein the second association means associates the area of the polygon formed by the suggestion information with the area of the divided area. Information processing apparatus.
The invention according to claim 10 is the handwriting information processing apparatus according to claim 8, wherein the second associating means associates based on the centroid of the suggestion information and the centroid of the divided area. .
The invention according to claim 11 is characterized in that the second associating means associates based on the center of gravity of the polygon formed by the suggestion information and the center of gravity of the segmented area. Information processing apparatus.

The invention according to claim 12 has an acquisition function of acquiring a plurality of handwriting information obtained by digitizing a new handwriting with respect to a medium having position information which is information indicating each position and having a plurality of entered information; Among the plurality of handwritten information acquired by the acquisition function, suggestion information that suggests a change to any of the plurality of completed information, and predetermined handwriting information in the plurality of handwritten information A first associating function for associating; a second associating function for associating the suggested information with predetermined filled information suggested to be changed by the suggested information in the plurality of filled-in information; and the suggested information A third associating function for associating the predetermined handwriting information with the predetermined completed information via a computer.
The invention according to claim 13 is an acquisition function for acquiring a plurality of handwriting information obtained by digitizing a new handwriting for a medium having a plurality of divided areas and having filled-in information, and acquisition by the acquisition function. A first associating function for associating suggestion information suggesting a change to the completed information with predetermined handwriting information in the plurality of handwriting information, the suggestion information, and the plurality of handwriting information A second association function for associating any one of the divided regions with the second association function for associating the predetermined handwriting information with the region associated by the second association function via the suggestion information This is a program for causing a computer to realize the functions.

According to claim 1 of the present invention, when the suggestion information suggesting a change to the entered information is entered in a medium having a plurality of entered information, the predetermined handwriting information obtained by digitizing a new handwriting on the medium Can be associated with the completed information. For example, these can be registered and managed in association with each other. Therefore, handwriting information before and after the change can be appropriately processed even if a change to the entered information is entered by a simple operation.
According to claim 2 of the present invention, for example, the handwriting information entered at the time closest to the time when the suggestion information was entered can be associated as the predetermined handwriting information. It is possible to associate with related predetermined handwriting information.
According to the third aspect of the present invention, for example, the handwriting information that controls the closest area to the area that is controlled by the suggestion information can be associated as the predetermined handwriting information. It can be associated with predetermined handwriting information.
According to the fourth aspect of the present invention, for example, the handwriting information having the closest center of gravity to the center of gravity of the suggestion information can be associated as the predetermined handwriting information, so that the suggestion information and the predetermined handwriting related to the suggestion information are accurately determined. Can be associated with information.

According to claim 5 of the present invention, for example, the handwriting information that forms the most overlapping area with the polygonal area formed by the suggestion information can be associated as predetermined filled information. It is possible to correlate with completed information in which suggestion information suggests a change.
According to the sixth aspect of the present invention, for example, handwriting information having the nearest centroid to the centroid of the suggestion information can be associated as predetermined filled information. Can be associated with completed information.
According to the seventh aspect of the present invention, for example, the handwriting information that forms a polygon having the closest centroid to the centroid of the polygon formed by the suggestion information can be associated as predetermined filled-in information. The information can be associated with the completed information that suggests a change by the suggestion information.

According to claim 8 of the present invention, when the suggestion information suggesting a change to the entered information is entered in the medium having the entered information, the predetermined handwriting information and the medium obtained by digitizing a new handwriting on the medium Therefore, for example, predetermined handwriting information can be registered and managed in the divided area. Even if a change to the entered information is entered by a simple operation, the handwriting information before and after the change can be appropriately processed.
According to the ninth aspect of the present invention, for example, the suggestion information can be associated with the segmented area having the most overlapping area with the polygonal area formed by the suggestion information. Associated regions can be associated.
According to the tenth aspect of the present invention, for example, since the suggestion information can be associated with the segmented area having the closest centroid to the centroid of the suggestion information, the suggestion information is accurately associated with the segmented area. Can do.
According to the eleventh aspect of the present invention, for example, the suggestion information can be associated with the segmented area having the closest centroid to the polygonal centroid formed by the suggestion information. Associated areas.

According to the twelfth aspect of the present invention, when the suggestion information suggesting a change to the entered information is entered in a medium having a plurality of entered information, predetermined handwriting information obtained by digitizing a new handwriting on the medium Can be associated with the completed information. For example, these can be registered and managed in association with each other. Therefore, handwriting information before and after the change can be appropriately processed even if a change to the entered information is entered by a simple operation.
According to the thirteenth aspect of the present invention, when the suggestion information suggesting a change to the entered information is entered in the medium having the entered information, the predetermined handwriting information and medium obtained by digitizing a new handwriting on the medium Therefore, for example, predetermined handwriting information can be registered and managed in the divided area. Even if a change to the entered information is entered by a simple operation, the handwriting information before and after the change can be appropriately processed.

The best mode for carrying out the present invention will be described below in detail with reference to the accompanying drawings.
<First Embodiment>
First, the overall configuration of the computer system in the first embodiment will be described.
FIG. 1 shows a configuration example of a computer system according to the first embodiment.
As shown in the figure, this computer system is configured by connecting a terminal device 10, a document server 20, an identification information server 30, an image forming device 40, and a terminal device 50 to a network 80. A digital pen 60 is connected to the terminal device 50 via a communication device 70.

The terminal device 10 is a computer device that requests the document server 20 to print an electronic document. Here, for example, a personal computer, a workstation, or another computer may be used as the terminal device 10.
The document server 20 is a computer device that stores and manages electronic documents. Further, when there is a print request for an electronic document from the terminal device 10, an electronic document image (hereinafter referred to as “document image”) and a code image representing identification information and position information are generated and combined. A print command for printing an image on a medium is output to the image forming apparatus 40. In this case, the identification information is information for uniquely identifying the medium. The position information is information for specifying the coordinate position (X coordinate, Y coordinate) on each medium. For example, the upper left point of the medium is the origin, the X axis is the right direction of the medium, and the downward direction It is conceivable that the coordinates are expressed in a coordinate system set by taking the Y axis. Here, as the document server 20, for example, a personal computer, a workstation, or another computer may be used.

The identification information server 30 is a computer device that issues identification information to be given to a medium. The issued identification information is stored in association with the electronic document printed on the medium to which the identification information is assigned. Here, as the identification information server 30, for example, a personal computer, a workstation, or another computer may be used.
The image forming apparatus 40 is an apparatus that prints an image on a medium and outputs it as a print document. The image forming apparatus 40 may be a single printer or printing machine, or may be a so-called multifunction machine having a scanner or a communication function. Here, as an image forming method in the image forming apparatus 40, for example, an electrophotographic method may be used, but other methods may be used.

  The terminal device 50 transmits information obtained by digitizing writing on the print document (hereinafter referred to as “handwriting information”) to the identification information server 30 in order to reflect the information in the electronic document that is the basis of the image recorded in the print document. A computer device. Further, the electronic document to be reflected in the handwriting information may be displayed on a display (not shown), and the handwriting information may be displayed on the display. Here, as the terminal device 50, for example, a personal computer, a workstation, or another computer may be used. In the present embodiment, the handwriting information is mainly described as handwritten information. However, the present invention is not limited to this, and is, for example, information mechanically drawn by a plotter that is a device that outputs drawing data such as architecture and machinery. There may be.

The digital pen 60 is an example of an electronic writing instrument, and is a pen device used for writing characters or figures on a printed document. An image sensor that reads a code image printed on the medium is provided. Then, position information is detected from the code image read by the image sensor, and handwriting information obtained by converting written characters or figures into image data is generated and stored based on the position information.
The communication device 70 is a device that acquires handwriting information from the digital pen 60 and transmits it to the terminal device 50. For example, an insertion port into which the digital pen 60 is inserted may be provided, and when the digital pen 60 is inserted into the insertion port, handwriting information stored in the digital pen 60 may be transmitted to the terminal device 50. Here, various methods such as USB (Universal Serial Bus), Bluetooth (registered trademark), and an infrared communication function are conceivable as a method of communication with the terminal device 50. Further, in the figure, the communication device 70 is shown as a separate body from the digital pen 60, but it is not necessarily a separate body and may be configured integrally.

In this specification, electronic data that is the basis of an image to be recorded on a medium is referred to as “electronic document”. However, this does not mean only data obtained by digitizing a “document” including text. For example, "electronic document" including image data (regardless of raster data or vector data) such as pictures, photographs, figures, etc., data recorded by database management software or spreadsheet software, and other printable electronic data It is said.
In the present specification, the “medium” may be any material as long as it can print an image. A typical example is paper, but an OHP sheet or a metal plate may be used.

Next, the configuration of the document server 20 will be described.
FIG. 2 is a block diagram illustrating a functional configuration example of the document server 20.
As illustrated, the document server 20 includes a reception unit 21, an identification information acquisition unit 22, a handwriting information management unit 23, and a handwriting management information storage unit 24. In addition, an identification code generation unit 25a, a position code generation unit 25b, a code arrangement unit 25c, a pattern image storage unit 25d, and a code image generation unit 25e are provided. Furthermore, a document image generation unit 26, an image composition unit 27, and a transmission unit 29 are provided.

The receiving unit 21 receives a print request from the terminal device 10. Here, the print request includes identification information of an electronic document to be printed (hereinafter referred to as “document ID”) and various settings relating to printing (hereinafter referred to as “print setting”). The receiving unit 21 receives identification information from the identification information server 30. Further, when writing is performed on the print document, the identification information server 30 writes the identification information embedded in the print document, handwriting information obtained by digitizing the content of the writing on the print document, and writing on the print document. Date and time information (hereinafter referred to as “date and time information”) is received. Here, in the present embodiment, the receiving unit 21 is provided as an example of handwriting information acquisition means for acquiring handwriting information obtained by digitizing new writing on a printed document.
The identification information acquisition unit 22 acquires the document ID and print settings from the reception unit 21, passes them to the transmission unit 29 to instruct transmission of an identification information issuance request, passes this to the document image generation unit 26, and sends the document Instructs generation of an image. Also, identification information is acquired from the receiving unit 21, and this is passed to the identification code generation unit 25a to instruct generation of the identification code.

  The handwriting information management unit 23 acquires the identification information, handwriting information, and date / time information received by the receiving unit 21 and registers them in the handwriting management information storage unit 24. At that time, in order to appropriately register in the handwriting management information storage unit 24, a predetermined process is performed on the handwritten information acquired as necessary, such as executing handwriting information processing described below. Here, in the present embodiment, the handwriting information management unit 23 is provided as an example of the first association unit, the second association unit, the third association unit, and the determination unit. The handwriting management information storage unit 24 stores handwriting management information managed by the handwriting information management unit 23.

The identification code generation unit 25a encodes identification information for specifying the medium to generate an identification code.
The position code generation unit 25b generates position codes by encoding position information indicating coordinate positions on the medium.
The code arrangement unit 25c arranges the identification code generated by the identification code generation unit 25a, the position code generated by the position code generation unit 25b, etc. on a two-dimensional plane according to a predetermined layout, and arranges a two-dimensional code array. Generate.
The pattern image storage unit 25d stores a pattern image corresponding to the code value of each code stored in the code array.
The code image generation unit 25e refers to the two-dimensional code array generated by the code arrangement unit 25c, selects a pattern image corresponding to each code value, and generates a code image.

The document image generation unit 26 acquires a document ID and print settings from the identification information acquisition unit 22, reads an electronic document specified by the document ID from a storage unit (not shown), and generates a document image of the electronic document according to the print settings. To do.
The image composition unit 27 synthesizes the code image generated by the code image generation unit 25e and the document image generated by the document image generation unit 26 to generate a composite image.
The transmission unit 29 transmits an identification information issuance request to the identification information server 30. Also, an image print command for the medium is transmitted to the image forming apparatus 40. Furthermore, when the display of handwriting information is instructed, identification information, handwriting information, and date / time information are transmitted to the identification information server 30.

Here, the code image generated in the present embodiment will be described.
FIG. 3 is a diagram illustrating an example of an image constituting the code image.
First, unit patterns constituting a code image will be described.
FIG. 3A shows an example of the unit pattern.
The unit pattern is the minimum unit for embedding information. In the figure, the black area and the shaded area are areas where dots can be arranged, and the white area between them is an area where dots cannot be arranged. In addition, among the areas where dots can be arranged, dots are arranged in black areas, and dots are not arranged in hatched areas. That is, the figure shows an example in which a unit pattern is configured by arranging dots at two locations selected from nine locations where dots can be arranged. Here, since there are 36 (= ₉ C ₂ ) combinations for selecting 2 locations out of 9 locations, there are 36 types of unit patterns. Of these, four types of unit patterns are used as synchronization patterns. The synchronization pattern is a pattern for detecting the rotation of the image and specifying the relative positions of the identification code and the position code. In particular, since it is necessary to detect the rotation of the image, the four types of synchronization patterns are selected such that when one of the synchronization patterns is rotated 90 degrees, another synchronization pattern is obtained. Further, the 32 types of unit patterns other than the 4 types of unit patterns are used as information patterns expressing the identification code and the position code, and 5-bit information is expressed.

  By the way, the dots shown in FIG. 3A are only for information representation, and do not necessarily coincide with the dots that mean the minimum points constituting the image. In the present embodiment, the dots for information expression (the smallest square in FIG. 3A) have a size of 2 dots × 2 dots at 600 dpi. Since the size of one dot at 600 dpi is 0.0423 mm, one side of a dot for information expression (the minimum square in FIG. 3A) is 84.6 μm (= 0.0423 mm × 2). The larger the dot for information expression, the more likely it is to be noticeable. Therefore, it is preferable that the dot is as small as possible. However, if it is too small, printing with a printer becomes impossible. Therefore, the above values larger than 50 μm and smaller than 100 μm are employed as the size of dots for information expression. However, the above value 84.6 μm is a numerical value to the last, and is about 100 μm in the actually printed toner image. It should be noted that the term “dot” in this specification refers to a dot for information expression, not a dot that means the minimum point constituting an image, unless otherwise specified.

Next, a code block composed of such unit patterns will be described.
FIG. 3B shows an example of the layout of the code block. Here, not the image but the code arrangement immediately before being replaced by the pattern image is shown. That is, a unit pattern as shown in FIG. 3A (any one of 36 unit patterns) is arranged in the smallest square (hereinafter referred to as “unit block”) in FIG. Will be formed.
In the layout of FIG. 3B, the synchronization code is arranged in one unit block at the upper left of the code block. Further, the X position code is arranged in the four unit blocks on the right side of the unit block in which the synchronization code is arranged, and the Y position code is arranged in the four unit blocks on the lower side of the unit block in which the synchronization code is arranged. . Further, identification codes are arranged in 16 (= 4 × 4) unit blocks surrounded by unit blocks in which these position codes are arranged.

Here, encoding of identification information will be described.
When encoding identification information, the bit string which comprises identification information is divided | segmented into a some block in order to perform RS encoding. Although there are several methods for encoding, RS encoding is suitable in this embodiment. This is because the RS code is a multi-value coding method, and in this case, the value represented by the unit block corresponds to the multi-value of the RS code. For example, when 5-bit information is expressed by one unit block, the 60-bit identification information is divided into 12 blocks having a block length of 5 bits. If an RS code capable of correcting two blocks of errors is employed, the code length is 16 blocks, which can be accommodated in a unit block in which the identification code in the code block of FIG. The encoding method is not limited to the RS code, and other encoding methods such as a BCH code may be used.

Next, encoding of position information will be described.
For encoding the position information, an M-sequence code, which is a kind of pseudo-random sequence, is used. Here, the M sequence refers to a sequence having the longest period among code sequences generated by a shift register having a certain length and feedback. When K is the number of stages in the shift register, the sequence length of the M sequence is 2 ^K −1. Arbitrary consecutive K bits extracted from the M sequence have a property that they do not appear at other positions in the same M sequence. Therefore, the position information is encoded using this property.
By the way, in this embodiment, the required M-sequence order is obtained from the length of the position information to be encoded, and the M-sequence is generated. However, if the length of the position information to be encoded is known in advance, it is not necessary to generate the M sequence each time. That is, a fixed M sequence may be generated in advance and stored in a memory or the like.
For example, it is assumed that an M sequence (K = 13) having a sequence length of 8191 is used. In this case, since the position code is also embedded in units of 5 bits, 5 bits are taken out from the M sequence having a sequence length of 8191 and blocked.

  In this specification, the identification information and the position information are clearly distinguished and used for the sake of simplicity. However, there is a technique in which a wide range of position information is prepared, the position information is cut out and embedded from different ranges for each medium, and the medium is identified by the difference in position information. Therefore, in such a method, it is assumed that the position information has a function for identifying the medium, and the position information is also considered as the identification information.

Next, the configuration of the identification information server 30 will be described.
FIG. 4 is a block diagram illustrating a functional configuration example of the identification information server 30.
As illustrated, the identification information server 30 includes a reception unit 31, an identification information management unit 32, an identification information storage unit 33, a display information generation unit 34, and a transmission unit 39.

  The receiving unit 31 receives an identification information issue request from the document server 20. The receiving unit 31 receives identification information, handwriting information, and date / time information from the terminal device 50 when writing is performed on the print document. On the other hand, when the display of handwriting information is instructed, identification information, handwriting information, and date / time information are received from the document server 20.

When there is a request for issuing identification information, the identification information management unit 32 issues the identification information without duplication, and stores the document ID and print settings specified at that time in association with the identification information. In response to designation of identification information, a document ID and print settings corresponding to the identification information are extracted.
The identification information storage unit 33 stores the identification information in the used / unused state, the document ID of the electronic document printed on the medium to which the identification information is added, and the electronic document printed on the medium to which the identification information is printed. It is a database that stores print settings in association with each other.
The display information generation unit 34 generates display information for displaying the handwriting information based on the information acquired from the document server 20 when the display of the handwriting information is instructed. As this display information, for example, data serving as a source for generating an image to be displayed on the terminal device 50 is generated.

  The transmission unit 39 transmits identification information issued in response to a request from the document server 20 to the document server 20. In addition, when writing is performed on the print document, identification information, handwriting information, and date / time information are transmitted to the document server 20.

Next, the configuration of the digital pen 60 will be described.
FIG. 5 is a diagram illustrating a configuration example of the digital pen 60.
As illustrated, the digital pen 60 includes a control circuit 61 that controls the operation of the entire pen. The control circuit 61 includes an image processing unit 61a that processes the read code image, and a data processing unit 61b that extracts identification information and position information from the processing result.
The control circuit 61 is connected to a pressure sensor 62 that detects a writing operation by the digital pen 60 by a pressure applied to the pen tip 69. Further, an infrared LED 63 that irradiates the medium with infrared light and an infrared CMOS 64 that reads a code image by detecting reflected light are also connected. Furthermore, an information memory 65 for storing identification information and position information, a communication circuit 66 for communicating with an external device, a battery 67 for driving the pen, and pen identification information (pen ID) are stored. A pen ID memory 68 is connected.

Next, the functional configuration realized in the control circuit 61 will be described in more detail.
FIG. 6 is a block diagram illustrating a functional configuration example of the control circuit 61. In the figure, a functional configuration example is shown separately for the image processing unit 61 a and the data processing unit 61 b in the control circuit 61.
As illustrated, the image processing unit 61 a includes an image acquisition unit 611 and a dot array generation unit 612. The data processing unit 61 b includes a code array generation unit 613, an identification information acquisition unit 614, a position information acquisition unit 615, and a handwriting information generation unit 616. Further, a date / time information acquisition unit 617 and a transmission unit 618 are provided.

The image acquisition unit 611 acquires a code image read from the print document by the infrared CMOS 64. Moreover, the noise contained in a code image is removed as needed.
The dot array generation unit 612 generates a dot array with reference to the dot positions in the code image. That is, on a two-dimensional array, for example, “1” is stored at a position where there is a dot and “0” is stored at a position where there is no dot, thereby replacing the dot detected as an image with digital data. Then, this two-dimensional array is output as a dot array.

  The code array generation unit 613 detects a block corresponding to the unit pattern in the code block on the dot array. Specifically, a frame having the same shape and size as the block in which the unit pattern is arranged is moved on the dot array, and the frame is fixed at a position where the number of dots in the frame becomes equal. For example, if the unit pattern of FIG. 3A is used, a frame having a size corresponding to 3 dots × 3 dots is moved, and the frame is fixed at a position where the number of dots included in the frame is 2. Then, a code array is generated that stores code values determined from dot positions in each block delimited by the frame. When this code array is generated, the position of the synchronization code is specified by searching for a code value of a predetermined synchronization code.

The identification information acquisition unit 614 detects the identification code based on the position of the synchronization code from the code array. Then, the identification code is decoded using the parameters used in the RS encoding process at the time of image generation, and identification information is acquired.
The position information acquisition unit 615 detects the position code based on the position of the synchronization code from the code array. Then, an M-sequence partial sequence is extracted from the position code, the position of this partial sequence in the M-sequence used at the time of image generation is referenced, and a value obtained by correcting this position with an offset using a synchronization code is acquired as position information. The reason why the correction is made by the offset is that a synchronization code is arranged between the position codes.

  The handwriting information generation unit 616 generates handwriting information by connecting the position information acquired by the position information acquisition unit 615. Here, the handwriting information includes at least data obtained by digitizing the locus of the pen tip of the digital pen 60, but may include other information. Information other than the locus of the pen tip includes, for example, information on the color set for the pen when writing, information on writing pressure, and the like.

The date and time information acquisition unit 617 acquires date and time information for specifying the date and time when writing was made, for example, from a time measuring unit (not shown) that holds the current time. As an example of this date / time information, in the present embodiment, information in the format of YYYYMMDDDHMMSS is acquired. For example, if writing was made at 0:11:22 on January 1, 2007, “200701001122” is acquired as date information. In the present embodiment, the date / time information is acquired at the same time every time position information is acquired. Here, in the present embodiment, date information is used as an example of writing time information indicating the time when writing was performed on the medium, and further as an example of writing date information indicating the date when writing was performed.
The transmission unit 618 passes the identification information acquired by the identification information acquisition unit 614, the handwriting information generated by the handwriting information generation unit 616, and the date / time information acquired by the date / time information acquisition unit 617 to the communication circuit 66, Information transmission to the communication device 70 is realized. Here, in the present embodiment, a transmission unit 618 is provided as an example of a transmission unit that transmits medium identification information, writing information, writing date and time information, and writing instrument identification information.

Next, the operation of the computer system of this embodiment will be described.
The operation in this embodiment is roughly divided into output of a print document, writing to the print document, and management of handwriting information, and will be described separately below. Note that the health check table 100 shown in FIG. The health checkup table 100 is provided with both classified areas and non-divided areas as areas for writing handwriting information. A segmented area (hereinafter sometimes referred to as “segmented area”) is an area surrounded by a ruled line. For example, item names such as name, gender, date of birth, and age are described in advance. The entry field provided next to the area. The undivided area is an area not surrounded by ruled lines, and corresponds to the year, month, and day of “examination date__year_month_day” described in the upper part of the health checkup table 100, for example. Refers to the area to enter numbers.

A. Output of Print Document FIG. 8 is a sequence diagram showing operations of the document server 20 and the identification information server 30 at this time.
In the document server 20, the receiving unit 21 first receives a print request for an electronic document from the terminal device 10 (step 211). Among these, a print request for an electronic document includes a document ID and print settings. Here, for example, a URL (Uniform Resource Locator) may be used as the document ID, but other information may be used as long as the electronic document can be uniquely identified. The print settings include settings such as page, number of copies, paper size, N-up (printing that allocates N pages of an electronic document to one page of the medium), margins, and the like.
When receiving the information, the receiving unit 21 passes the information to the identification information acquiring unit 22. Then, the identification information acquisition unit 22 passes the document ID and print settings of the received information to the transmission unit 29, and the transmission unit 29 transmits the information to the identification information server 30, thereby identifying the information. Request to issue information (step 212).

Thereby, in the identification information server 30, the receiving unit 31 receives the document ID and the print setting (step 311). Then, the document ID and the print setting are transferred to the identification information management unit 32, and the identification information management unit 32 extracts unused identification information from the identification information storage unit 33 (step 312). Here, the number of pieces of identification information to be extracted is determined according to print settings. In other words, basically, the number of pieces of identification information obtained by multiplying the number of pages to be printed by the number of copies is extracted. However, if there is an N-up designation or the like in the setting information, that is also taken into consideration. For example, when printing 5 copies of a 10-page electronic document in 2 ups, 25 (= 10 ÷ 2 × 5) pieces of identification information are extracted.
Next, the identification information management unit 32 associates the identification information, the document ID, and the print settings and stores them in the identification information storage unit 33 (step 313). Then, the identification information issued in step 312 is transferred to the transmission unit 39, and the transmission unit 39 transmits the identification information to the document server 20 (step 314).

As a result, in the document server 20, the receiving unit 21 receives the identification information (step 213). Then, the reception unit 21 passes the received identification information to the identification information acquisition unit 22.
Then, the document server 20 generates a code image representing the identification information and the position information (Step 214). The generation of the code image is specifically performed by the following process.
That is, first, the identification information acquisition unit 22 passes the identification information acquired in step 213 to the identification code generation unit 25a, and the identification code generation unit 25a generates an identification code by encoding the identification information. Further, the position code generation unit 25b receives the print setting from the reception unit 21, and generates a position code by encoding position information in a range corresponding to the print setting.
Thereafter, the code arrangement unit 25c arranges the identification code and the position code in accordance with a predetermined layout, and the code image generation unit 25e visualizes this using the pattern image stored in the pattern image storage unit 25d. A code image is generated.

In the document server 20, the document image generation unit 26 generates an image (document image) of the electronic document (step 215). At that time, the document image generation unit 26 receives the document ID acquired by the identification information acquisition unit 22 in step 211, and reads the target electronic document from a storage unit (not shown) based on the document ID. In addition, the print setting acquired by the identification information acquisition unit 22 in step 211 is received, and a document image is generated based on the print setting. In the health checkup table 100 shown in FIG. 7, document images such as characters such as name, gender, date of birth, and age, and ruled lines are generated.
Then, the image composition unit 27 synthesizes the code image generated at step 214 and the document image generated at step 215 to generate a composite image (step 216). Thereafter, the document image information and the position information are defined (step 217). In the health checkup table 100 shown in FIG. 7, for example, it is defined in what region coordinates the divided regions exist.
Thereafter, the composite image is transferred to the transmission unit 29, and the transmission unit 29 transmits a print command for the composite image to the image forming apparatus 40 (step 218). Here, the composite image print command is transmitted, for example, in a PDL format in which the content to be printed as a code image is set as a PDL command to a PDL (Page Description Language) file including a sequence of print commands for document images. .

As a result, the image forming apparatus 40 prints the document image on the medium using, for example, C (cyan), M (magenta), and Y (yellow) toner. The code image is printed on a medium using, for example, K (black containing carbon) toner or special toner.
Here, as the special toner, an invisible toner having a maximum absorption rate of 7% or less in the visible light region (400 nm to 700 nm) and an absorption rate of 30% or more in the near infrared region (800 nm to 1000 nm) is exemplified. . Here, “visible” and “invisible” are not related to whether they can be recognized visually. “Visible” and “invisible” are distinguished depending on whether or not an image in a printed document can be recognized by the presence or absence of color development due to absorption of a specific wavelength in the visible light region. Also, “invisible” includes those that have some color developability due to absorption of a specific wavelength in the visible light region but are difficult to be recognized by human eyes.
In this example, the code image is combined with the document image and printed. However, the code image may be printed on a white paper (notebook, tag, etc.). In that case, the document ID is not included in the print request received in step 211, the identification information is not associated with the document ID and the print setting in step 313, and the generation of the document image in step 215 is not executed. What should I do?

B. Writing to a Print Document In this embodiment, handwriting information for a print document is transmitted from the digital pen 60 to the terminal device 50 via the communication device 70 and finally registered in the document server 20.
First, an operation when the digital pen 60 generates handwriting information and registers it in the document server 20 will be described.
In the digital pen 60, first, the infrared LED 63 irradiates the medium with infrared light, and the infrared CMOS 64 receives the reflected light to read the code image. Then, the image acquisition unit 611 acquires the read code image. If the code image contains noise, it is removed. Next, the dot array generation unit 612 converts the dot positions included in the code image into digital data, and generates a dot array. Then, the code array generation unit 613 detects a block from the dot array, and generates a code array that stores a code value for each block. Then, the position of the synchronization code is specified in the code array. Thereafter, the identification information acquisition unit 614 detects the identification code based on the position of the synchronization code, decodes it, and acquires the identification information. Further, the position information acquisition unit 615 detects a position code based on the position of the synchronization code, decodes this, and acquires position information. The handwriting information generation unit 616 generates handwriting information by connecting the position information. Further, in the present embodiment, the date / time information acquisition unit 617 acquires date / time information from a time measuring means (not shown). Then, the transmission unit 618 transmits these pieces of information to the identification information server 30 via the communication device 70 and the terminal device 50.

FIG. 9 is a sequence diagram showing subsequent operations of the identification information server 30 and the document server 20.
In the identification information server 30, the receiving unit 31 first receives identification information, handwriting information, and date / time information (step 321). Next, these pieces of information are passed to the identification information management unit 32, and the identification information management unit 32 takes out the document ID associated with the passed identification information from the identification information storage unit 33. Then, the document server 20 (the document server 20 in which the electronic document specified by the document ID exists) is determined as the transmission destination of the information received in step 321 (step 322). If the document ID is not associated with the identification information in the identification information storage unit 33, the identification information is considered to be assigned to a blank sheet (note or tag). In that case, the document server 20 that manages the handwriting information for the white paper may be determined as the transmission destination.
Thereafter, the information is passed to the transmission unit 39, and the transmission unit 39 transmits identification information, handwriting information, and date / time information to the document server 20 determined as the transmission destination in step 322 (step 323).

  Thereby, in the document server 20, the receiving unit 21 receives the identification information, handwriting information, and date / time information (step 221). The receiving unit 21 passes the received information to the handwriting information management unit 23. Then, the handwriting information management unit 23 associates the identification information, the handwriting information, and the date / time information, and stores them in the handwriting management information storage unit 24 as handwriting management information (step 222). In addition, the handwriting information management unit 23 performs predetermined processing on the handwriting information acquired as necessary, such as executing handwriting information processing described below, in order to appropriately register in the handwriting management information storage unit 24.

C. Management of handwriting information Next, specific contents of handwriting management information will be described.
FIG. 7B is a diagram showing a specific example of the handwriting management information. The handwriting management information when the health examination examinee enters the health examination table 100 as a printed document as shown in FIG. Show.
As shown in the drawing, the handwriting management information is associated with item names, document IDs, identification information, area coordinates, handwriting information, and date / time information. In FIG. 7 (b), as shown in FIG. 7 (a), the name, gender, date of birth, and age are currently entered in the health checkup table 100. Registered and managed. In FIG. 7B, the image data as it is is associated as handwriting information, but information (URL or the like) of the storage location of handwriting information may be associated.

Next, handwriting information processing, which is a feature point of the present embodiment, will be described.
When filling in a print document using the digital pen 60, it is possible to correct the already entered items or to delete them. For example, in the case where a health checkup examiner fills in the health checkup table 100 using the digital pen 60, in addition to the case where necessary items are first filled in, necessary characters are corrected first, Changes may be made to previously entered characters, such as adding characters between previously entered characters or adding notes to previously entered characters.
And, for example, when correcting a previously entered character using the digital pen 60, it is the same as correcting by writing a double line etc. on the wrong character with a normal ink pen and entering the correct character in the nearby margin. It is possible to do so. FIG. 10A is a diagram illustrating a mode in which characters entered in the health checkup table 100 are corrected. For example, as shown in FIG. 10A, a letter indicating the intention of correction, such as a double line, is written on the age “35”, which is a typo, and the correct character “36” is written in the lower space. It can be corrected by filling in.

FIG. 10B shows suitable handwriting management information when the health checkup table 100 is entered as shown in FIG. In the handwriting management information in FIG. 10B, the date information is omitted.
When the correction is made as shown in FIG. 10A, the information as it is written (“35”, “double line” above “35”, and “36”) is not registered and managed. As shown in b), it is desirable that a new character (“36”) is registered and managed as an alternative to the previously entered character (“35”).

Therefore, in the present embodiment, handwriting information processing described below is executed.
FIG. 11 is a flowchart of handwriting information processing according to the first embodiment. This handwriting information processing is processing performed by the document server 20 as a handwriting information processing apparatus.
This process is performed when the document server 20 receives handwriting information or the like from the identification information server 30 as a trigger. After receiving the handwriting information and the like from the communication device 70, the identification information server 30 executes the processing shown in FIG. 9 and sequentially transmits the handwriting information and the like to the document server 20. Examples of the timing at which the communication device 70 transmits an image include the following. (1) The digital pen 60 transmits images as soon as they are read. (2) Transmit when the pressure sensor 62 detects that the digital pen 60 has been lifted. (3) Transmit when the brightness of the image being read is above a certain level or below a certain level. (4) Transmit when a decode switch (not shown) provided in the digital pen 60 is pressed by the user. (5) When the communication device 70 is provided with an insertion port into which the digital pen 60 is inserted, the transmission is performed when the digital pen 60 is inserted into the insertion port.

In this handwriting information processing, the document server 20 first acquires handwriting information described by the digital pen 60 (step 241).
Thereafter, the document server 20 performs grouping of the handwriting information acquired in Step 241 (Step 242). In this method, the handwriting information acquired this time is divided into one or a plurality of groups. As a method for recognizing handwriting information of a different group, the following methods can be exemplified. (1) A method of recognizing handwriting information before and after the brightness of an image read by the digital pen 60 as handwriting information of a different group when the brightness of the image becomes a certain value or less. (2) A method in which when the pressure sensor 62 of the digital pen 60 detects that pressure is no longer applied to the pen tip 69, the handwriting information before and after that is recognized as handwriting information of a different group. (3) When a predetermined time elapses after the pressure sensor 62 of the digital pen 60 detects that pressure is no longer applied to the pen tip 69 and before the pressure starts to be applied to the pen tip 69 again, the pressure by the pressure sensor 62 A method of recognizing handwriting information before and after detection as handwriting information of a different group.

  Thereafter, the document server 20 sets one piece of handwriting information among the handwriting information grouped in step 242 as handwriting information to be processed, and performs the following processing. Note that the order of processing of the plurality of handwritten information divided into groups is, for example, the order of entry. First, it is determined whether or not the handwriting information entry area to be processed is already the handwriting information entry area (step 243). This is to determine whether or not information such as handwriting information has already been entered in the handwriting information entry area to be processed, that is, whether or not the position information of both handwriting information overlaps. If it is determined that the area has not been filled in, it is recognized that the area has been filled in for the first time, and the handwriting information to be processed is an item indicating the handwriting information that has been initially written in the area. It is registered in the item of handwriting information 1 (step 244).

On the other hand, if it is determined that it is registered, collation association processing is performed (step 245). As the collation association processing, collation processing is performed as a pre-stage for determining whether or not the handwriting information to be processed is handwriting information indicating the intention of correction, and grouped with the handwriting information to be processed in step 242. A first association process is performed for associating with other handwriting information of the handwritten information. The collation processing uses similar image retrieval means such as well-known similar image retrieval software, and collates whether or not the handwriting information to be processed corresponds to one of the registered images of correction processing patterns registered in advance. It is. FIG. 12 shows an example of a registration image of a correction processing pattern. Specific contents of the collation process and the first association process will be described in detail later.
Next, as a result of the collation processing performed in step 245, it is determined whether or not the handwriting information to be processed corresponds to the correction processing pattern, that is, whether or not the handwriting information to be processed is handwriting information indicating the intention of correction. (Step 246). When it is determined that the handwriting information to be processed is not the handwriting information indicating the correction intention, the handwriting information to be processed is registered in accordance with the position information (step 247).

On the other hand, when it is determined that the handwriting information to be processed is handwriting information indicating the intention of correction, first, the handwriting information indicating the intention of correction that is the handwriting information to be processed and the handwriting indicating the intention of correction A second associating process for associating the completed handwritten information that is the target of the information correction is executed (step 248). The specific contents of this process will be described in detail later.
Thereafter, a third association process is performed for associating other handwriting information associated in the first association process with the handwritten information associated in the second association process via the handwriting information to be processed (step 249). ). This is because the other handwriting information associated with the handwriting information to be processed in the first associating process and the second associating process are related to each other, and the handwritten information is related to each other. It is.

Thereafter, it is determined whether or not the other handwritten information associated in the third association process and the completed handwritten information are entered in the same segmented area (step 250). If it is determined that the information is not written in the same divided area, other handwriting information associated in the third association process is registered in accordance with the position information (step 247). On the other hand, if it is determined that the same area has been entered, the other handwritten information associated in the third association process is the handwritten information entered in this area after the associated handwritten information. Therefore, other handwriting information associated in the third association processing is registered in the item indicating the latest handwriting information entered in this area (step 251). Thereafter, handwriting information indicating the correction intention is registered in accordance with the position information (step 252).
Thereafter, it is determined whether or not there is handwriting information that has not been registered among the handwriting information grouped in step 242 (step 253). And when affirmation determination is carried out, the process after step 243 is performed. On the other hand, if a negative determination is made, the process ends.

Next, the collating / associating process performed in step 245 will be described.
FIG. 13 is a flowchart showing this collating / associating process.
First, using similar image search means such as well-known similar image search software, it is searched whether or not the handwriting information to be processed corresponds to any of the registered images of the correction processing pattern in FIG. (Step 401). It is preferable that the registration image of the correction processing pattern shown in FIG. 12 can be freely set by the user. Further, registration may be performed in advance, or a registration image may be added after handwriting information is entered, and handwriting information processing may be executed thereafter.
As a result of the search in step 401, it is determined whether or not the handwriting information to be processed corresponds to any of the registered images of the correction processing pattern in FIG. 12 (step 402). If it is determined that it is applicable, the handwriting information to be processed is recognized as handwriting information indicating the intention of correction, and it is assumed that the handwriting information to be processed and the correct information have been entered for correction below. Associate handwriting information. Before that, first, it is determined whether or not handwriting information other than the handwriting information to be processed exists in the handwriting information grouped in step 242 (step 403). And when it determines with existing, the handwriting information to be processed and the other handwriting information of the handwriting information grouped in step 242 and the handwriting information that seems to have been correctly entered for correction The first association process for associating is performed (step 404).

  The following method can be exemplified as a method of associating the handwriting information to be processed with other handwriting information in the first association processing. (1) A method of associating based on the time when the handwriting information to be processed is entered and the time when other handwriting information is entered, (2) the area controlled by the handwriting information to be processed and the area controlled by other handwriting information (3) A method of associating based on the center of gravity of handwritten information to be processed and the center of gravity of other handwritten information.

  In the method (1), since the correct handwriting information is assumed to be written immediately after the handwriting information indicating the correction intention is entered, the time closest to the time when the handwriting information to be processed is entered. It is preferable to associate the handwriting information entered in as correct handwriting information. The time when the handwriting information is entered is transmitted by the digital pen 60 together with the handwriting information. In the method (2), since it is assumed that correct handwriting information is entered near the position where handwriting information indicating the intention of correction is entered, the area closest to the area controlled by the handwriting information to be processed is selected. It is preferable to associate the handwriting information to be governed as correct handwriting information. The handwriting information area refers to a rectangle formed by the minimum XY coordinates and the maximum XY coordinates in the position information that is the basis of the handwriting information. Even in the method (3), since it is assumed that correct handwriting information is entered near the position where handwriting information indicating correction intention is written, the center of gravity closest to the center of handwriting information indicating correction intention is calculated. It is preferable to associate handwriting information possessed as correct handwriting information. The centroid of the handwriting information is to calculate the XY coordinates that are the center of gravity based on all the XY coordinates of the position information that is the basis of the handwriting information. More specifically, the X coordinate of the center of gravity is calculated by dividing the sum of the X coordinates of all the position information by the number of position information, and the Y coordinate of the center of gravity is obtained by adding the Y coordinates of all the position information. It is calculated by dividing the object by the number of position information.

  On the other hand, if a negative determination is made in step 402, that is, if it is determined that the handwriting information to be processed does not correspond to any of the registered images of the correction processing pattern in FIG. The association process is terminated. If the determination in step 403 is negative, there is no handwriting information other than the handwriting information to be processed, that is, the handwriting information received this time is one piece of handwriting information to be processed. Exit.

  In the method (2) and the method (3) of the first association process, when the handwriting information to be corrected of the handwriting information to be processed is the handwriting information received at the same timing, The handwriting information that indicates the intention of correction, which is the handwriting information to be processed, or the handwriting information that is the area or the center of gravity closest to the center of gravity may become handwriting information to be corrected. For this reason, in the process of step 404, it is preferable that only handwriting information entered after the entry time of the handwriting information to be processed is the target of association.

Next, the second association process performed in step 248 of FIG. 11 will be described.
As the second association processing, the following three modes can be exemplified.
FIG. 14 is a flowchart showing a first embodiment of the second association process.
First, all of the handwriting information already written on the medium (here, the sheet of the health checkup table 100) and the handwriting information to be processed are converted into polygon information (step 501). This is because position information having the minimum XY coordinate, position information having the maximum XY coordinate, position information having an X coordinate smaller than the position information having the minimum XY coordinate, Position information having a smaller Y coordinate than position information having the smallest XY coordinate, position information having a larger X coordinate than position information having the largest XY coordinate, and a larger Y coordinate than position information having the largest XY coordinate A plurality of position coordinates, such as position information, are connected by lines to form a polygon that includes the handwriting information.
After that, the handwriting information that forms the polygon having the largest area overlapping with the polygon of the handwriting information indicating the intention of correction, which is the handwriting information to be processed, is searched from the polygons of all the handwriting information. (Step 502).
Then, the handwriting information corresponding to the search result in step 502 is recognized as handwriting information describing an error to be corrected in the handwriting information indicating the correction intention, and the handwriting information and the handwriting information indicating the correction intention are obtained. Associate (step 503).

Next, a second example of the second association process will be described. FIG. 15 is a flowchart showing a second embodiment of the second association process.
First, all the handwriting information already entered in the medium (here, the health checkup table 100) and the barycentric position of the handwriting information to be processed are calculated (step 511). This is to calculate the XY coordinates as the center of gravity based on all the XY coordinates of the position information that is the basis of the handwriting information. More specifically, the X coordinate of the center of gravity is calculated by dividing the sum of the X coordinates of all the position information by the number of position information, and the Y coordinate of the center of gravity is obtained by adding the Y coordinates of all the position information. It is calculated by dividing the object by the number of position information.
Thereafter, handwriting information having a centroid closest to the centroid of the handwriting information to be processed is searched from the centroids of all the handwriting information (step 512).
Then, the handwriting information corresponding to the search result in step 512 is recognized as handwriting information describing the error to be corrected in the handwriting information indicating the correction intention, and the handwriting information and the handwriting information indicating the correction intention are obtained. Associate (step 513).

Next, a third example of the second association process will be described. FIG. 16 is a flowchart showing a third embodiment of the second association process.
First, all of the handwriting information already entered in the medium (here, the medical examination table 100) and the handwriting information to be processed are polygonized (step 521). Since this process is the same as the step 501 of the first embodiment of the second association process, detailed description thereof is omitted here.
Next, the gravity center position of each polygon formed in step 521 is calculated (step 522).
Thereafter, the handwriting information that is the origin of the polygon having the center of gravity closest to the center of gravity of the polygon of the handwriting information to be processed, which is handwriting information indicating the intention of correction, out of the center of gravity of all the polygons calculated in step 522 Is searched (step 523).
Then, the handwriting information corresponding to the search result in step 523 is recognized as handwriting information describing an error to be corrected in the handwriting information indicating the correction intention, and the handwriting information and the handwriting information indicating the correction intention are obtained. Associate (step 524).

  In the first embodiment, when the document server 20 that is the handwriting information processing apparatus executes the handwriting information processing described above, and handwriting information indicating the correction intention is entered, the second association processing is performed. Other areas associated with handwritten information indicating the intention of correction in the first association process in the area where the completed handwritten information associated with the handwritten information that is the target of correction of the handwritten information indicating the intention of correction is entered. Will be registered as the latest handwriting information.

  In the example shown in FIG. 10A, the case where the handwriting information of “double line” and the handwriting information of “36” are additionally entered will be described in more detail. In this case, in the handwriting information processing shown in the flowchart of FIG. 11, since “35” has already been entered in the handwriting information entry area of “double line” that is the handwriting information to be processed, in step 243. An affirmative determination is made and processing proceeds to step 245. Then, in the collating and associating process, the handwriting information of “double line”, which is the handwriting information to be processed, coincides with the registered image of the correction processing pattern in FIG. 12, and the handwriting information indicating the intention of correction in the subsequent step 246 It is determined that Further, it is associated with the handwriting information “36” in the first association process. And since the handwriting information of “double line” which is the handwriting information to be processed is entered on the handwriting information of “35”, the handwriting information already entered in the second association processing in step 248. Is associated with the handwriting information of “35”. Then, in the third associating process in step 249, the handwriting information “35” and the handwriting information “36” are associated through the handwriting information “double line”. Since both handwriting information is entered in the same divided area whose area coordinates are ((180,22)-(200,50)), the determination in step 250 is affirmative. As a result, in step 251, as shown in FIG. 10 (b), the third handwriting information is entered in the item indicating the latest handwriting information in the divided area of the handwriting information “35” which is the handwriting information already entered. The handwriting information “36”, which is other handwriting information associated in the association processing, is registered.

The entry example in FIG. 10A is an example in which handwriting information indicating the intention of correction and handwriting information of correct characters are written in the divided areas of the health checkup table 100, but are written in undivided areas. Even in such a case, by executing the handwriting information processing described above, correct handwriting information can be registered and managed in an area where erroneous handwriting information is entered. At this time, it is assumed that a range that is considered to be the same region in the determination of step 250 in the handwriting information processing flowchart is determined in advance.
In the following, for example, when handwriting information in which “examination date: November 26, 2007” is corrected in the entry location of the examination date, which is an uncategorized area of the health checkup table 100 in FIG. State. For example, when a double line, which is handwriting information indicating correction intention, is drawn on “26” on the 26th and “27” is written in the margin above it, in the handwriting information processing shown in the flowchart of FIG. Since “26” has already been entered in the handwriting information entry area of “double line”, which is the handwriting information to be processed, an affirmative determination is made in step 243 and processing proceeds to step 245. Then, in the collating and associating process, the handwriting information of “double line”, which is the handwriting information to be processed, coincides with the registered image of the correction processing pattern in FIG. 12, and the handwriting information indicating the intention of correction in the subsequent step 246 It is determined that Further, it is associated with the handwriting information “27” in the first association process. And since the handwriting information of “double line” which is the handwriting information to be processed is entered on the handwriting information of “26”, the handwritten information already entered in the second association processing in step 248. Is associated with the handwriting information of “26”. In the third associating process in step 249, the handwriting information “26” and the handwriting information “27” are associated with each other through the handwriting information “double line”. If the handwriting information “26” and the handwriting information “27” are entered in advance within the range that is considered to be the same area, an affirmative determination is made in step 250. As a result, in step 251, the handwriting information “27” is registered as the latest handwriting information for the handwriting information area “26”, which is the handwritten information already entered.

  In the handwriting information processing described above, “double line” handwriting information indicating the intention of correction is used as an example of suggestion information that suggests a change to the written handwriting information. Suggestion information suggesting other changes includes handwriting information (for example, “∧”, “∨”) that indicates the intention to add to the completed handwritten information, and handwriting information that indicates the intention of the written notes regarding the completed handwritten information. (For example, “*”, “(Note)”). In addition, in the handwriting information processing described above, filled-in handwritten information that is subject to correction of handwritten information indicating the intention of correction is used as an example of completed information that suggests a change by suggestion information that suggests a change. .

By the way, in this embodiment, the document server 20 processes and manages handwriting information. However, various variations can be considered as to which apparatus performs these processes. For example, handwriting information processing may be performed by the identification information server 30, the terminal device 50, the digital pen 60, or the communication device 70. When the configuration in which handwriting information is processed by the terminal device 50 is adopted, the handwriting management information may be held by the terminal device 50. Further, when a configuration in which handwriting information is processed by the digital pen 60 is adopted, handwriting management information may be held by the terminal device 50 or the digital pen 60.
Therefore, the hardware configuration of the computer 90 will be described assuming that these processes are performed by the computer 90.

FIG. 17 is a diagram illustrating a hardware configuration of the computer 90.
As shown in the figure, the computer 90 includes a CPU (Central Processing Unit) 91 that is a calculation means, a main memory 92 that is a storage means, and a magnetic disk device (HDD: Hard Disk Drive) 93. Here, the CPU 91 executes various software such as an OS (Operating System) and an application, and realizes each function described above. The main memory 92 is a storage area for storing various software and data used for execution thereof, and the magnetic disk device 93 is a storage area for storing input data for various software, output data from various software, and the like. .
Further, the computer 90 includes a communication I / F 94 for performing communication with the outside, a display mechanism 95 including a video memory and a display, and an input device 96 such as a keyboard and a mouse.

  The program for realizing the present embodiment can be provided not only by communication means but also by storing it in a recording medium such as a CD-ROM.

<Second Embodiment>
The second embodiment is different from the first embodiment mainly in the second association process and the third association process. Here, only different portions will be described, and description of the same portions will be omitted. In the second embodiment, in the second association process, the handwritten information to be processed is associated with the segmented area. Then, in the third association processing, the other handwritten information associated with the handwriting information to be processed in the first association processing, and the partitioned region associated with the handwriting information to be processed in the second association processing There is a feature in associating with.

The second associating process according to the second embodiment is a process of associating handwritten information indicating the intention of correction, which is the handwritten information to be processed, with a segmented region considered to be filled with the handwritten information. The following three modes can be exemplified as this processing mode.
FIG. 18 is a flowchart illustrating a first example of the second association process according to the second embodiment.
First, the handwriting information to be processed, which is handwriting information indicating the intention of correction, is converted into polygon information (step 601). Since the method for converting to polygon information is the same as that described above, a detailed description thereof will be omitted.
Thereafter, a segmented region having the largest area overlapping with the polygon of the handwriting information indicating the correction intention is searched from all the segmented regions (step 602).
Then, the divided area corresponding to the search result in step 602 is recognized as an area in which handwriting information indicating correction intention is entered, and the divided area is associated with handwriting information indicating correction intention ( Step 603).

Next, a second example of the second association process according to the second embodiment will be described. FIG. 19 is a flowchart showing a second embodiment of the second association process.
First, the position of the center of gravity of handwritten information to be processed, which is handwritten information indicating the region and correction intention on the medium (for example, a sheet of a health checkup table), is calculated (step 611). Since the method for calculating the position of the center of gravity is the same as the method described above, detailed description thereof is omitted.
Thereafter, a segmented region having a centroid closest to the centroid of the handwriting information indicating the correction intention is retrieved from all the segmented regions (step 612).
Then, the divided area corresponding to the search result in step 612 is recognized as an area in which handwriting information indicating the correction intention is written, and the divided area is associated with the handwriting information indicating the correction intention ( Step 613).

Next, a third example of the second association process according to the second embodiment will be described. FIG. 20 is a flowchart showing a third embodiment of the second association process.
First, the handwriting information to be processed, which is handwriting information indicating the intention of correction, is converted into polygon information (step 621). Since this process is the same process as step 601 described above, a detailed description thereof is omitted here.
Next, the centroid position of the polygon formed in step 621 and the centroid position of the area divided on the medium (for example, the sheet of the health checkup table) are calculated (step 622).
Thereafter, a segmented region having a centroid closest to the polygonal centroid of the handwriting information indicating the correction intention is searched from the centroids of all the segmented regions calculated in step 622 (step 623).
Then, the divided area corresponding to the search result in step 623 is recognized as an area in which handwriting information indicating the correction intention is entered, and the divided area is associated with the handwriting information indicating the correction intention ( Step 624).

And in the 3rd correlation process of 2nd Embodiment, the classified area linked | related by the 2nd correlation process with the other handwriting information linked | related by the 1st correlation process via the handwriting information of a process target, Are related. This is because the areas separated from other handwriting information associated with the handwriting information to be processed in the first associating process and the second associating process are related to each other and are associated with each other.
Then, in the processing of the subsequent step 250 shown in FIG. 11, whether or not the area where the other handwriting information associated in step 249 is entered and the segmented area are the same, that is, the association in step 249. It is determined whether or not the other handwritten information entry area is an associated divided area. If the determination is affirmative, other handwriting information associated with the associated segmented area is registered (step 252).

  In the second embodiment, when the document server 20 that is the handwriting information processing apparatus executes the handwriting information processing described above, and handwriting information indicating the correction intention is entered, the second association processing is performed. The other handwritten information associated with the handwritten information indicating the correction intention in the first association processing is registered as the latest handwritten information in the divided area associated with the handwritten information indicating the correction intention. It becomes.

  In the example shown in FIG. 10A, the case where the handwriting information of “double line” and the handwriting information of “36” are additionally entered will be described in more detail. In this case, in the handwriting information processing shown in the flowchart of FIG. 11, since “35” has already been entered in the handwriting information entry area of “double line” that is the handwriting information to be processed, in step 243. An affirmative determination is made and processing proceeds to step 245. Then, in the collating and associating process, the handwriting information of “double line”, which is the handwriting information to be processed, coincides with the registered image of the correction processing pattern in FIG. 12, and the handwriting information indicating the intention of correction in the subsequent step 246 It is determined that Further, it is associated with the handwriting information “36” in the first association process. Then, the handwriting information of “double line”, which is the handwriting information to be processed, is associated with the divided area in which the handwriting information of “double line” is entered in the second association processing in step 248. Then, in the third associating process in step 249, the segmented area in which the “double line” handwriting information is entered via the “double line” handwriting information is associated with the handwriting information of “36”, Since both are the same divided area, an affirmative determination is made in step 250. As a result, in step 251, as shown in FIG. 10 (b), the third handwriting information is entered in the item indicating the latest handwriting information in the divided area of the handwriting information “35” which is the handwriting information already entered. The handwriting information “36”, which is other handwriting information associated in the association processing, is registered.

Also in the second embodiment, the document server 20 processes and manages handwriting information. However, various variations can be considered as to which apparatus performs these processes. For example, handwriting information processing may be performed by the identification information server 30, the terminal device 50, the digital pen 60, or the communication device 70. When the configuration in which handwriting information is processed by the terminal device 50 is adopted, the handwriting management information may be held by the terminal device 50. Further, when a configuration in which handwriting information is processed by the digital pen 60 is adopted, handwriting management information may be held by the terminal device 50 or the digital pen 60. These processes are preferably performed by the computer 90 having the hardware configuration shown in FIG.
The program for realizing the present embodiment can be provided not only by communication means but also by storing it in a recording medium such as a CD-ROM.

<Third Embodiment>
The third embodiment is different from the first or second embodiment in the handwriting information processing performed in the document server 20. Here, only different portions will be described, and description of the same portions will be omitted.
FIG. 21 is a flowchart of handwriting information processing according to the third embodiment performed by the document server 20. The handwriting information processing according to the third embodiment is partially different from the handwriting information processing according to the first embodiment. Here, only different portions will be described, the same portions are denoted by the same reference numerals, and description thereof will be omitted.

The document server 20 performs grouping in step 242 and then performs the following processing with one handwriting information of the handwriting information grouped in step 242 as a processing target.
First, region association processing is performed for associating the handwriting information to be processed with the partitioned region considered to have been filled with the handwriting information (step 261). The mode of the process is the same as the second association process according to the second embodiment. Since the specific processing contents have been described above, the description thereof is omitted here.

Thereafter, it is determined whether or not the handwriting information has already been entered in the divided area associated with the handwriting information to be processed in step 261 (step 262). If the determination is negative, that is, it is determined that no entry has been made, the process proceeds to step 244. On the other hand, if the determination is affirmative, that is, if it is determined that the entry has been made, the process proceeds to step 245. Since the processing in step 244 and step 245 has been described above, detailed description thereof will be omitted.
If it is determined in step 246 that the handwriting information to be processed is handwriting information indicating the intention of correction, a third association process is executed (step 263). The third association process is a process of associating the other handwriting information associated in the first association process with the classified area associated in the area association process (second association process) via the handwriting information to be processed. And is the same as the third association process of the second embodiment.

  In the subsequent processing of step 250, it is determined whether or not the region where the other handwriting information associated in step 263 is entered and the segmented region are the same, that is, the other region associated in step 263. It is determined whether or not the handwriting information entry area is a related area. If a negative determination is made, the process proceeds to step 247. On the other hand, if a positive determination is made, the process proceeds to step 251. Since the processing in step 247 and step 251 has been described above, detailed description thereof will be omitted. Further, since the processing of step 252 and step 253 has also been described above, detailed description thereof will be omitted.

  In the third embodiment, when the document server 20 which is a handwriting information processing apparatus executes the handwriting information processing described above, and handwriting information indicating the intention of correction is entered, correction is performed in the area association processing. The other handwritten information associated with the handwritten information indicating the correction intention in the first association processing is registered as the latest handwritten information in the divided area associated with the handwritten information indicating the intention of .

  In the example shown in FIG. 10A, the case where the handwriting information of “double line” and the handwriting information of “36” are additionally entered will be described in more detail. In such a case, in the handwriting information processing shown in the flowchart of FIG. 21, the handwriting information of “double line” is associated with the divided region in which the handwriting information is entered in the region association processing in step 261. In subsequent step 262, since “35” has already been entered in the classified area associated in step 261, an affirmative determination is made and processing proceeds to step 245. Then, in the collating and associating process, the handwriting information of “double line”, which is the handwriting information to be processed, coincides with the registered image of the correction processing pattern in FIG. 12, and the handwriting information indicating the intention of correction in the subsequent step 246 It is determined that Further, it is associated with the handwriting information “36” in the first association process. Then, in the third associating process in step 263, the segmented area where the “double line” handwriting information is entered is associated with the “36” handwriting information via the “double line” handwriting information. Since both are in the same segmented area, that is, the handwritten information of “36” is entered in the segmented area in which the “double line” handwritten information is entered, an affirmative determination is made in step 250. As a result, in step 251, as shown in FIG. 10 (b), the third handwriting information is entered in the item indicating the latest handwriting information in the divided area of the handwriting information “35” which is the handwriting information already entered. The handwriting information “36”, which is other handwriting information associated in the association processing, is registered.

Also in the third embodiment, the document server 20 processes and manages handwriting information. However, various variations can be considered as to which apparatus performs these processes. For example, handwriting information processing may be performed by the identification information server 30, the terminal device 50, the digital pen 60, or the communication device 70. When the configuration in which handwriting information is processed by the terminal device 50 is adopted, the handwriting management information may be held by the terminal device 50. Further, when a configuration in which handwriting information is processed by the digital pen 60 is adopted, handwriting management information may be held by the terminal device 50 or the digital pen 60. These processes are preferably performed by the computer 90 having the hardware configuration shown in FIG.
The program for realizing the present embodiment can be provided not only by communication means but also by storing it in a recording medium such as a CD-ROM.

It is a figure showing an example of composition of a computer system of a 1st embodiment. It is the block diagram which showed the function structure of the document server in 1st Embodiment. It is the figure which showed the example of the code | symbol image produced | generated by 1st Embodiment. It is the block diagram which showed the function structure of the identification information server in 1st Embodiment. It is the figure which showed the structural example of the digital pen in 1st Embodiment. It is the block diagram which showed the function mechanism of the control circuit of the digital pen in 1st Embodiment. (A) is a figure which shows the health checkup table used as an example of a printed document. (B) is the figure which showed the specific example of handwriting management information. FIG. 5 is a sequence diagram illustrating an operation when outputting a print document according to the first embodiment. It is the sequence diagram which showed the operation | movement at the time of writing in the printed document in 1st Embodiment. (A) is a figure which shows the aspect which corrects the character entered in the medical examination table | surface used as an example of a printed document. (B) is the figure which showed the specific example of handwriting management information when correct | amending like (a). It is a flowchart of handwriting information processing in a 1st embodiment. It is the figure which showed the registration image of the pattern of the correction process in 1st Embodiment. It is the flowchart which showed the collation correlation process in 1st Embodiment. It is the flowchart which showed the 1st Example of the 2nd correlation process in 1st Embodiment. It is the flowchart which showed the 2nd Example of the 2nd correlation process in 1st Embodiment. It is the flowchart which showed the 3rd Example of the 2nd correlation process in 1st Embodiment. It is a hardware block diagram of the computer which can implement | achieve 1st Embodiment. It is the flowchart which showed the 1st Example of the 2nd correlation process in 2nd Embodiment. It is the flowchart which showed the 2nd Example of the 2nd association process in 2nd Embodiment. It is the flowchart which showed the 3rd Example of the 2nd correlation process in 2nd Embodiment. It is a flowchart of handwriting information processing concerning a 3rd embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10,50 ... Terminal device, 20 ... Document server, 30 ... Identification information server, 40 ... Image forming device, 60 ... Digital pen, 70 ... Communication device, 80 ... Network

Claims (13)

Handwriting information acquisition means for acquiring a plurality of handwriting information obtained by digitizing a new handwriting for a medium having position information which is information indicating each position and having a plurality of entered information;
Among the plurality of handwriting information acquired by the handwriting information acquisition means, suggestion information that suggests a change to any of the plurality of completed information, and predetermined handwriting information in the plurality of handwriting information A first association means for associating
Second associating means for associating the suggestion information with predetermined completed information suggested to be changed by the suggestion information among the plurality of completed information;
Third associating means for associating the predetermined handwriting information with the predetermined completed information via the suggestion information;
Handwriting information processing device including   2. The handwriting information processing apparatus according to claim 1, wherein the first association unit associates the time when the suggestion information is written and the time when the predetermined handwriting information is written.   2. The handwriting information processing apparatus according to claim 1, wherein the first association unit associates the area based on the suggestion information with the area governed by the predetermined handwriting information.   2. The handwriting information processing apparatus according to claim 1, wherein the first association unit associates the center of gravity of the suggestion information with the center of gravity of the predetermined handwriting information.   2. The handwriting information processing apparatus according to claim 1, wherein the second associating unit associates a polygon area formed by the suggestion information with a polygon area formed by the predetermined filled-in information. .   2. The handwriting information processing apparatus according to claim 1, wherein the second association unit associates the centroid of the suggestion information with the centroid of the predetermined written information.   2. The handwriting information processing apparatus according to claim 1, wherein the second association unit associates the centroid of the polygon formed by the suggestion information with the centroid of the polygon formed by the predetermined written information. . Handwriting information acquisition means for acquiring a plurality of handwriting information obtained by digitizing a new handwriting for a medium having a plurality of divided areas and having written information;
Of the plurality of handwriting information acquired by the handwriting information acquisition means, first associating means for associating suggestion information suggesting a change to the completed information and predetermined handwriting information in the plurality of handwriting information;
A second association means for associating the suggestion information with any one of the plurality of divided regions;
Third associating means for associating the predetermined handwriting information with the area associated with the second associating means via the suggestion information;
Handwriting information processing device including   9. The handwriting information processing apparatus according to claim 8, wherein the second associating unit associates the area of the polygon formed by the suggestion information with the area of the divided area.   9. The handwriting information processing apparatus according to claim 8, wherein the second association means associates the centroid of the suggestion information and the centroid of the segmented area.   9. The handwriting information processing apparatus according to claim 8, wherein the second associating means associates based on a centroid of a polygon formed by the suggestion information and a centroid of the divided area. An acquisition function for acquiring a plurality of handwriting information obtained by digitizing a new handwriting with respect to a medium having position information that is information indicating each position and having a plurality of entered information;
Among the plurality of handwritten information acquired by the acquisition function, suggestion information that suggests a change to any of the plurality of completed information, and predetermined handwriting information in the plurality of handwritten information A first association function to associate;
A second associating function for associating the suggested information with predetermined filled information suggested to be changed by the suggested information among the plurality of filled information;
A third association function for associating the predetermined handwriting information with the predetermined completed information via the suggestion information;
A program to make a computer realize. An acquisition function for acquiring a plurality of handwriting information obtained by digitizing a new handwriting for a medium having a plurality of divided areas and having written information;
Of the plurality of handwriting information acquired by the acquisition function, a first association function for associating suggestion information suggesting a change to the completed information and predetermined handwriting information in the plurality of handwriting information;
A second association function for associating the suggestion information with any one of the plurality of divided regions;
A third association function that associates the predetermined handwriting information with the region associated by the second association function via the suggestion information;
A program to make a computer realize.

Images