JP5316104B2 - WRITING INFORMATION PROCESSING DEVICE AND PROGRAM - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To relate writing information on one medium to writing information on the other medium when writing to both the mutually different media is done. <P>SOLUTION: At an image processing part 61a for a digital pen, an image acquisition part 611 acquires a code image read out of a medium, and a dot array generation part 612 generates a dot array from the code image. At a data processing part 61b, a code array generation unit 613 generates a code array from the dot array, an identification information acquisition part 614 detects an identification code from the code array and decodes it to acquire identification information, and a position information acquisition unit 615 detects a position code from the code array and decodes it to acquire position information. A handwriting information generation part 616 generates handwriting information by connecting position information, a relation information generation part 617 generates relation information for relating media when writing to the media is done, and a communication control part 619 transmits the identification information, handwriting information, and relation information to the outside. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to a writing information processing apparatus and a program.

  A technique for associating contents handwritten on a medium such as paper with various information such as audio information, image information, and moving image information is known (see, for example, Patent Document 1). In the technique of Patent Document 1, first, the content of handwritten information written on a code sheet by a user is associated with the handwritten time and stored in a paper information processing server, and the information provided from various terminals is associated with the provided time. Stored in the integrated processing server. Next, the handwriting time stored in the paper information processing server is specified by indicating a predetermined portion of the handwritten code sheet with the electronic pen, and the provision information associated with the provision time is integrated using the handwriting time. It is read from the processing server and displayed on the terminal.

JP 2007-133550 A

  An object of the present invention is to associate writing information for one medium with writing information for the other medium when writing is performed across different media.

According to the first aspect of the present invention, the identification information acquisition means for acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed, and the read from the medium Writing information acquisition means for acquiring writing information for the medium generated based on the position information, first identification information, and second identification information different from the first identification information includes the identification information acquisition. And the writing information acquisition means on condition that no attempt was made to read the identification information from when the first identification information was read until the second identification information was read. The first writing information for the first medium printed with the first identification information and the second for the second medium printed with the second identification information among the writing information acquired by Brush Writing to the fact that information and is associated, characterized in that a generating means for generating association information indicating the fact that the said first medium and said second medium are arranged to overlap Information processing apparatus.
According to a second aspect of the present invention, the generation means further includes that a time from when the first identification information is read to when the second identification information is read is within a predetermined time. The handwritten information processing apparatus according to claim 1, wherein the association information is generated as a condition.
According to a third aspect of the present invention, the generation means determines whether the first identification information has been read from an area defined as an end of the first medium, or the second identification information is the based on whether read from the area defined as an end of the second medium, according to claim 1 to produce the said association information sequence further indicates the overlap of the first medium and the second medium This is a writing information processing device.
According to a fourth aspect of the present invention, there is provided identification information acquisition means for acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed, and the read from the medium Writing information acquisition means for acquiring writing information for the medium generated based on the position information, first identification information, and second identification information different from the first identification information includes the identification information acquisition. The reading of the identification information is attempted between the time when the first identification information is acquired and the time when the second identification information is read, and the reading is not successful. As conditions, among the writing information acquired by the writing information acquisition means, the first writing information for the first medium on which the first identification information is printed and the second identification information are printed. And that the second writing information with respect to the second medium is associated, and a generating means for generating association information indicating the fact that the said first medium and said second medium are spaced apart It is the writing information processing apparatus characterized by having provided.
According to a fifth aspect of the present invention, the generating means includes a position of the first medium from which the first identification information is read, and a position of the second medium from which the second identification information is read. If, based on the moving speed of the electronic writing instrument used for writing, according to claim 4, characterized in that to generate the association information away degree further shows a of the first medium and the second medium This is a writing information processing apparatus.
According to a sixth aspect of the invention, an image representing the first medium, the second medium, the first writing information, and the second writing information is displayed based on the association information. a writing information processing apparatus according to any one of claims 1 to 5, characterized in that further comprising control means for controlling.
According to a seventh aspect of the present invention, the identification information acquisition means for acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed, and the read from the medium Writing information acquisition means for acquiring writing information for the medium generated based on the position information, first identification information, and second identification information different from the first identification information includes the identification information acquisition. When continuously acquired by the means, among the writing information acquired by the writing information acquiring means, the first writing information for the first medium on which the first identification information is printed, and the second Association indicating that the second writing information for the second medium on which the identification information is printed is related, and that the first medium and the second medium are arranged to overlap each other Generator that generates information A writing information processing apparatus characterized by comprising and.
According to an eighth aspect of the present invention, the generation means determines whether the first identification information is read from an area defined as an end of the first medium, or the second identification information is the 8. The association information is further generated, which further indicates an overlapping order of the first medium and the second medium, based on whether or not an area defined as an end of the second medium is read. This is a writing information processing device.
The invention according to claim 9 is an identification information acquisition means for acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed, and the read from the medium Writing information acquisition means for acquiring writing information for the medium generated based on the position information, first identification information, and second identification information different from the first identification information includes the identification information acquisition. The writing information is acquired when it is acquired discontinuously by the means and the time from when the first identification information is acquired until the second identification information is acquired is within a predetermined time. Of the writing information acquired by the means, the first writing information for the first medium on which the first identification information is printed and the second on the second medium on which the second identification information is printed. The writing information of A writing information processing apparatus comprising: generating means for generating association information indicating that the first medium and the second medium are arranged apart from each other is there.
According to a tenth aspect of the present invention, there is provided a computer having a function of acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed, and the read from the medium A function of acquiring writing information for the medium generated based on the position information, first identification information, and second identification information different from the first identification information are acquired , and the first The first medium on which the first identification information is printed on condition that no attempt is made to read the identification information between the time when the first identification information is read and the time when the second identification information is read. That the first writing information for the second medium is related to the second writing information for the second medium on which the second identification information is printed , and the first medium and the second medium. Must be placed one on top of the other Which is a program for realizing the function of generating association information indicating.
According to an eleventh aspect of the present invention, there is provided a computer having a function of acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed, and the read from the medium. A function of acquiring writing information for the medium generated based on the position information, first identification information, and second identification information different from the first identification information are acquired, and the first The first identification information is obtained on the condition that an attempt is made to read the identification information between the time when the first identification information is read and the time when the second identification information is read, and the reading is not successful. The first writing information for the first medium printed with the second writing information for the second medium printed with the second identification information, and the first medium And the second medium Is a program for realizing the function of generating the association information indicating with being spaced apart.

According to the first aspect of the present invention, when writing is performed over different media, it can be shown that these media are arranged in an overlapping manner .
According to the invention of claim 2, when writing is performed over different media, the writing information for one medium is not associated with the writing information for the other medium if these media are separated to some extent. can do.
According to the invention of claim 3 , when writing is performed over different media, the overlapping order of these media can be indicated.
According to the invention of claim 4 , when writing is performed over different media, it can be shown that these media are arranged apart from each other.
According to the fifth aspect of the present invention, when writing is performed across different media, the degree of separation between these media can be indicated.
According to the sixth aspect of the present invention, writing over different media can be reproduced as a display image.
According to the seventh aspect of the present invention, when writing is performed over different media, it can be shown that these media are arranged in an overlapping manner.
According to the invention of claim 8, when writing is performed over different media, the overlapping order of these media can be indicated.
According to the ninth aspect of the present invention, when writing is performed over different media, it can be shown that these media are arranged apart from each other.
According to the tenth aspect of the present invention, when writing is performed across different media, it can be shown that these media are arranged in an overlapping manner .
According to the eleventh aspect of the present invention, when writing is performed over different media, it can be shown that these media are arranged apart from each other.

It is the figure which showed the system configuration | structure with which embodiment of this invention is applied. It is the figure which showed the outline | summary of the process of handwriting information in embodiment of this invention. It is the block diagram which showed the function structure of the document server in embodiment of this invention. It is the block diagram which showed the function structure of the identification information server in embodiment of this invention. It is the sequence diagram which showed the operation | movement at the time of the printing document output in embodiment of this invention. It is the figure which showed the example of the code | symbol image produced | generated by embodiment of this invention. It is the figure which showed the example of the medium management information memorize | stored in embodiment of this invention. It is the figure which showed the mechanism of the digital pen in embodiment of this invention. It is the block diagram which showed the function mechanism of the control circuit of the digital pen in embodiment of this invention. It is the flowchart which showed the operation | movement at the time of writing in the printed document in embodiment of this invention. It is the figure which showed the example of the correlation information memorize | stored in embodiment of this invention. It is a figure for demonstrating the calculation method of the coordinate in the correlation information memorize | stored in embodiment of this invention, and an inclination angle. It is the sequence diagram which showed the operation | movement at the time of the display of the handwriting information in embodiment of this invention. It is a hardware block diagram of the computer which can implement | achieve embodiment of this invention.

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.
First, the overall configuration of the computer system in the present embodiment will be described.
FIG. 1 shows a configuration example of a computer system according to the present embodiment.
As shown in the figure, this computer system is configured by connecting a terminal device 10, a document server 20, an identification information server 30, an image forming device 40, and a terminal device 50 to a network 80. A digital pen 60 is connected to the terminal device 50 via a communication device 70.

The terminal device 10 is a computer device that requests the document server 20 to print an electronic document. Here, for example, a personal computer, a workstation, or another computer may be used as the terminal device 10.
The document server 20 is a computer device that stores and manages electronic documents. Also, when there is a print request for an electronic document from the terminal device 10, an image of the electronic document and a code image representing identification information and position information are generated, and a print command for printing a composite image obtained by synthesizing the image on a medium is generated. Output to the forming apparatus 40. In this case, the identification information is information for uniquely specifying the medium, and the position information is information for specifying the coordinate position on the medium. Here, as the document server 20, for example, a personal computer, a workstation, or another computer may be used.

The identification information server 30 is a computer device that issues identification information to be given to a medium. The issued identification information is stored in association with the electronic document printed on the medium to which the identification information is assigned. Here, as the identification information server 30, for example, a personal computer, a workstation, or another computer may be used.
The image forming apparatus 40 is an apparatus that prints an image on a medium and outputs it as a print document. The image forming apparatus 40 may be a single printer or printing machine, or may be a so-called multifunction machine having a scanner or a communication function. Here, as an image forming method in the image forming apparatus 40, for example, an electrophotographic method may be used, but other methods may be used. In the following description, the identification information to be given to the medium is described as being issued by the identification information server 30, but the identification information may be issued by any apparatus as long as it can be issued without duplication in the system. It may be issued by the device 40. In this case, for example, a combination of the machine number of the image forming apparatus 40 and the print count value in the image forming apparatus 40 may be used as the identification information.

  The terminal device 50 transmits information obtained by digitizing writing on the print document (hereinafter referred to as “handwriting information”) to the identification information server 30 in order to reflect the information in the electronic document that is the basis of the image recorded in the print document. A computer device. Further, the electronic document to be reflected in the handwriting information may be displayed on a display (not shown), and the handwriting information may be displayed on the display. Here, as the terminal device 50, for example, a personal computer, a workstation, or another computer may be used. In the present embodiment, handwriting information is used as an example of writing information obtained by digitizing the contents of writing. The handwriting information is mainly described as handwritten information. However, the present invention is not limited thereto, and may be information mechanically drawn by a plotter that is a device that outputs drawing data such as architecture and machinery.

The digital pen 60 is an example of an electronic writing instrument, and is a pen device used for writing characters or figures on a printed document. An image sensor that reads a code image printed on the medium is provided. Then, position information is detected from the code image read by the image sensor, and handwriting information obtained by converting written characters or figures into image data is generated and stored based on the position information.
The communication device 70 is a device that acquires handwriting information from the digital pen 60 and transmits it to the terminal device 50. For example, an insertion port into which the digital pen 60 is inserted may be provided, and when the digital pen 60 is inserted into the insertion port, handwriting information stored in the digital pen 60 may be transmitted to the terminal device 50. Here, as a method of communication with the terminal device 50, various methods such as USB (Universal Serial Bus), Bluetooth (registered trademark), and an infrared communication function are conceivable. Further, in the figure, the communication device 70 is shown as a separate body from the digital pen 60, but it is not necessarily a separate body and may be configured integrally.

In this specification, electronic data that is the basis of an image to be recorded on a medium is referred to as “electronic document”. However, this does not mean only data obtained by digitizing a “document” including text. For example, "electronic document" including image data such as pictures, photos, figures (regardless of raster data or vector data), data recorded by database management software or spreadsheet software, and other printable electronic data It is said.
In the present specification, the “medium” may be any material as long as it can print an image. A typical example is paper, but an OHP sheet or a metal plate may be used.
Further, in this specification, processing is performed using identification information for uniquely identifying each of the electronic document, the medium, and further the digital pen 60 and the user. It shall mean the identification information of the medium.

By the way, there are cases where writing is performed across a plurality of print documents output by such a computer system.
In such a case, if handwriting information is managed for each printed document on which writing has been performed, for example, when handwriting information is confirmed by a PC (Personal Computer) or the like, it cannot be viewed as one continuous image.
Therefore, in the present embodiment, handwriting information across a plurality of print media is managed in association with each other, and is reproduced as one continuous image.

FIG. 2 is a diagram showing a schematic operation of the present embodiment.
(A) is an example in which writing is performed across two paper documents in a state where two paper documents with code images are superimposed. In this case, the paper document A and the paper document B are overlapped as shown in (a-1), and writing across them is performed with the digital pen 60 as shown in (a-2). Thereafter, for example, when the paper document A is called by the PC, a series of handwriting information is displayed as one image together with the paper document B as shown in (a-3). Specifically, the writing on the paper document B is displayed by inquiring the continuous writing management information in which the writing on the paper document A is associated with the writing performed continuously. At this time, the display position is adjusted so that the boundary of the handwriting information touches in a natural manner.

  Further, (b) shows an example in which writing is performed across two paper documents in a state where the two paper documents with code images are slightly separated. In this case, the paper document C and the paper document D are slightly separated as shown in (b-1), and writing is performed across the digital pen 60 as shown in (b-2). Thereafter, for example, when the paper document C is called by the PC, a series of handwriting information is displayed as one image together with the paper document D as shown in (b-3). Specifically, the writing on the paper document D is displayed by referring to the continuous writing management information that associates the writing on the paper document C with the writing performed continuously. At this time, the distance between the paper document C and the paper document D is estimated on the basis of the time when the code image is not read and the stroke speed of the pen before and after that, and is reflected in the display. Further, the display position is adjusted so that the boundary of the handwriting information touches in a natural manner.

Hereinafter, the present embodiment that performs such a schematic operation will be specifically described.
In the present embodiment, when the document server 20 manages handwriting information and an instruction to display handwriting information is given, the identification information server 30 generates display information for displaying the handwriting information.
As described above, in the present embodiment, the document server 20 and the identification information server 30 operate mainly, and the configuration of these servers will be described in detail.
First, the configuration of the document server 20 will be described.
FIG. 3 is a block diagram illustrating a functional configuration example of the document server 20.
As illustrated, the document server 20 includes a reception unit 21, an identification information acquisition unit 22, a handwriting management unit 23, and a handwriting management information storage unit 24. In addition, an identification code generation unit 25a, a position code generation unit 25b, a code arrangement unit 25c, a pattern image storage unit 25d, and a code image generation unit 25e are provided. Furthermore, a document image generation unit 26, an image composition unit 27, and a transmission unit 29 are provided.

The receiving unit 21 receives a print request from the terminal device 10. Here, the print request includes identification information of an electronic document to be printed (hereinafter referred to as “document ID”) and various settings relating to printing (hereinafter referred to as “print setting”). In addition, when writing is performed on the print document, the receiving unit 21 digitizes the document ID and page number of the electronic document that is the origin of the print document and the content of the writing on the print document from the identification information server 30. Handwriting information is received.
The identification information acquisition unit 22 acquires the document ID and print settings from the reception unit 21, passes them to the transmission unit 29 to instruct transmission of an identification information issuance request, passes this to the document image generation unit 26, and sends the document Instructs generation of an image. Also, identification information is acquired from the receiving unit 21, and this is passed to the identification code generation unit 25a to instruct generation of the identification code.

The handwriting management unit 23 acquires the document ID, page number, and handwriting information received by the receiving unit 21 and registers them in the handwriting management information storage unit 24. When the handwriting information display is instructed, handwriting information corresponding to the designated document ID and page number is extracted from the handwriting management information storage unit 24.
The handwriting management information storage unit 24 stores handwriting management information managed by the handwriting management unit 23.

The identification code generation unit 25a encodes identification information for specifying the medium to generate an identification code.
The position code generation unit 25b generates position codes by encoding position information indicating coordinate positions on the medium.
The code arrangement unit 25c arranges the identification code generated by the identification code generation unit 25a, the position code generated by the position code generation unit 25b, etc. on a two-dimensional plane according to a predetermined layout, and arranges a two-dimensional code array. Generate.
The pattern image storage unit 25d stores a pattern image corresponding to the code value of each code stored in the code array.
The code image generation unit 25e refers to the two-dimensional code array generated by the code arrangement unit 25c, selects a pattern image corresponding to each code value, and generates a code image.

The document image generation unit 26 acquires a document ID and print settings from the identification information acquisition unit 22, reads an electronic document specified by the document ID from a storage unit (not shown), and generates a document image of the electronic document according to the print settings. To do.
The image composition unit 27 synthesizes the code image generated by the code image generation unit 25e and the document image generated by the document image generation unit 26 to generate a composite image.
The transmission unit 29 transmits an identification information issuance request to the identification information server 30. Also, an image print command for the medium is transmitted to the image forming apparatus 40. Further, when the display of handwriting information is instructed, the electronic document and handwriting information are transmitted to the identification information server 30.

Next, the configuration of the identification information server 30 will be described.
FIG. 4 is a block diagram illustrating a functional configuration example of the identification information server 30.
As shown in the figure, the identification information server 30 includes a receiving unit 31, a medium management unit 32, a medium management information storage unit 33, a display information generation unit 34, an association information storage unit 35, and a transmission unit 39. .

  The receiving unit 31 receives an identification information issue request from the document server 20. The receiving unit 31 receives identification information, handwriting information, and association information from the terminal device 50 when writing is performed on the print document. Furthermore, when the display of handwriting information is instructed, the terminal device 50 receives identification information that is a key for extracting handwriting information to be displayed, and the document server 20 receives electronic information related to the associated print document. Receive document and handwriting information.

  When there is a request for issuing identification information, the medium management unit 32 issues the identification information without duplication, and stores the document ID and print settings specified at that time in association with the identification information. Further, when writing on the print document is performed, the association information is stored in the association information storage unit 35. Further, when the display of handwriting information is instructed, the print document identification information (hereinafter referred to as “related identification information”) associated with the print document with the specified identification information is acquired and the specified identification is obtained. The document ID and the print setting corresponding to the information and the related identification information are acquired.

The medium management information storage unit 33 displays the identification information, the document ID of the electronic document printed on the medium to which the identification information is assigned, and the print settings when the electronic document is printed on the medium to which the identification information is assigned. It is a database to memorize.
The display information generation unit 34 generates display information for displaying the handwriting information based on the information acquired from the document server 20 when the display of the handwriting information is instructed. As this display information, for example, data serving as a source for generating an image to be displayed on the terminal device 50 is generated. In the present embodiment, a display information generation unit 34 is provided as an example of a control unit that controls to display an image.

  The association information storage unit 35 is a database that stores identification information, related identification information, and positional relationship information indicating the positional relationship between the print document specified by the identification information and the print document specified by the related identification information. .

  The transmission unit 39 transmits identification information issued in response to a request from the document server 20 to the document server 20. In addition, when writing is performed on the print document, the document ID and page number (included in the print settings) corresponding to the identification information, and handwriting information are transmitted to the document server 20. Further, when the display of handwriting information is instructed, the document ID and page number (included in the print settings) are transmitted to the document server 20, and the display information is transmitted to the terminal device 50.

Next, the operation of the present embodiment will be described.
The operation in the present embodiment is roughly divided into output of a print document, writing on the print document, and display of handwriting information, and will be described separately below.

A. Output of Print Document FIG. 5 is a sequence diagram showing operations of the document server 20 and the identification information server 30 at this time.
In the document server 20, the receiving unit 21 first receives a print request for an electronic document from the terminal device 10 (step 211). Among these, a print request for an electronic document includes a document ID and print settings. Here, as the document ID, for example, a URL (Uniform Resource Locator) may be used, but other information may be used as long as the electronic document can be uniquely identified. The print settings include settings such as page, number of copies, paper size, enlargement / reduction ratio, N-up (printing that allocates N pages of an electronic document to one page of the medium), margins, and the like.
When receiving the information, the receiving unit 21 passes the information to the identification information acquiring unit 22. Then, the identification information acquisition unit 22 passes the document ID and print settings of the received information to the transmission unit 29, and the transmission unit 29 transmits the information to the identification information server 30, thereby identifying the information. Information issuance is requested (step 212).

Thereby, in the identification information server 30, the receiving unit 31 receives the document ID and the print setting (step 311). Then, the document ID and the print setting are transferred to the medium management unit 32, and the medium management unit 32 extracts unused identification information from the medium management information storage unit 33 (step 312). Here, the number of pieces of identification information to be extracted is determined according to print settings. In other words, basically, the number of pieces of identification information obtained by multiplying the number of pages to be printed by the number of copies is extracted. However, if there is an N-up designation or the like in the setting information, that is also taken into consideration. For example, when printing 5 copies of a 10-page electronic document in 2 ups, 25 (= 10 ÷ 2 × 5) pieces of identification information are extracted.
Next, the medium management unit 32 stores the identification information, the document ID, and the print setting in association with each other in the medium management information storage unit 33 (step 313). Then, the identification information issued in step 312 is transferred to the transmission unit 39, and the transmission unit 39 transmits the identification information to the document server 20 (step 314).

As a result, in the document server 20, the receiving unit 21 receives the identification information (step 213). Then, the reception unit 21 passes the received identification information to the identification information acquisition unit 22.
Then, the document server 20 generates a code image representing the identification information and the position information (Step 214). The generation of the code image is specifically performed by the following process.
That is, first, the identification information acquisition unit 22 passes the identification information acquired in step 213 to the identification code generation unit 25a, and the identification code generation unit 25a generates an identification code by encoding the identification information. Details of the encoding of the identification information will be described later.
Further, the position code generation unit 25b receives the print setting from the reception unit 21, and generates a position code by encoding position information in a range corresponding to the print setting. Details of the encoding of the position information will be described later.
Thereafter, the code arrangement unit 25c arranges the identification code and the position code in accordance with a predetermined layout, and the code image generation unit 25e visualizes this using the pattern image stored in the pattern image storage unit 25d. A code image is generated.

In the document server 20, the document image generation unit 26 generates a document image of the electronic document (step 215). At that time, the document image generation unit 26 receives the document ID acquired by the identification information acquisition unit 22 in step 211, and reads the target electronic document from a storage unit (not shown) based on the document ID. In addition, the print setting acquired by the identification information acquisition unit 22 in step 211 is received, and a document image is generated based on the print setting.
Then, the image composition unit 27 synthesizes the code image generated in step 214 and the document image generated in step 215 to generate a composite image (step 216).
Thereafter, the composite image is transferred to the transmission unit 29, and the transmission unit 29 transmits a print command for the composite image to the image forming apparatus 40 (step 217). Here, the composite image print command is transmitted, for example, in a PDL format in which the content to be printed as a code image is set as a PDL command to a PDL (Page Description Language) file including a sequence of document image print commands. .

Accordingly, the image forming apparatus 40 prints the document image on a medium using, for example, C (cyan), M (magenta), and Y (yellow) toner. The code image is printed on a medium using, for example, K (black containing carbon) toner or special toner.
Here, as the special toner, an invisible toner having a maximum absorption rate of 7% or less in the visible light region (400 nm to 700 nm) and an absorption rate of 30% or more in the near infrared region (800 nm to 1000 nm) is exemplified. . Here, “visible” and “invisible” are not related to whether they can be recognized visually. “Visible” and “invisible” are distinguished depending on whether or not an image in a printed document can be recognized by the presence or absence of color development due to absorption of a specific wavelength in the visible light region. Also, “invisible” includes those that have some color developability due to absorption of a specific wavelength in the visible light region but are difficult to be recognized by human eyes.

  Here, the code image is combined with the image of the electronic document and printed. However, the code image may be printed on a white paper (notebook, tag, etc.). In that case, the document ID is not included in the print request received in step 211, the identification information is not associated with the document ID and the print setting in step 313, and the generation of the document image in step 215 is not executed. What should I do?

Next, the code image generated in the present embodiment will be described.
FIG. 6 is a diagram illustrating an example of an image or the like constituting the code image.
First, unit patterns constituting a code image will be described.
FIG. 6A shows an example of a unit pattern.
The unit pattern is the minimum unit for embedding information. In the figure, the black area and the shaded area are areas where dots can be arranged, and the white area between them is an area where dots cannot be arranged. In addition, among the areas where dots can be arranged, dots are arranged in black areas, and dots are not arranged in hatched areas. That is, the figure shows an example in which a unit pattern is configured by arranging dots at two locations selected from nine locations where dots can be arranged. Here, since there are 36 (= ₉ C ₂ ) combinations for selecting two locations out of nine locations, there are 36 types of unit patterns. Of these, four types of unit patterns are used as synchronization patterns. The synchronization pattern is a pattern for detecting the rotation of the image and specifying the relative positions of the identification code and the position code. In particular, since it is necessary to detect the rotation of the image, the four types of synchronization patterns are selected such that when one of the synchronization patterns is rotated 90 degrees, another synchronization pattern is obtained. Further, the 32 types of unit patterns other than the 4 types of unit patterns are used as information patterns expressing the identification code and the position code, and 5-bit information is expressed.

  By the way, the dots shown in FIG. 6A are only for information representation, and do not necessarily match the dots that mean the minimum points that constitute the image. In the present embodiment, the dots for information expression (the minimum square in FIG. 6A) have a size of 2 dots × 2 dots at 600 dpi. Since the size of one dot at 600 dpi is 0.0423 mm, one side of a dot for information expression (the minimum square in FIG. 6A) is 84.6 μm (= 0.0423 mm × 2). The larger the dot for information expression, the more likely it is to be noticeable, so it is preferable that the dot be as small as possible. However, if it is too small, printing with a printer becomes impossible. Therefore, the above values larger than 50 μm and smaller than 100 μm are employed as the size of dots for information expression. However, the above value 84.6 μm is a numerical value to the last, and is about 100 μm in the actually printed toner image. It should be noted that the term “dot” in this specification refers to a dot for information expression, not a dot that means the minimum point constituting an image, unless otherwise specified.

Next, a code block composed of such unit patterns will be described.
FIG. 6B shows an example of the layout of the code block. Here, not the image but the code arrangement immediately before being replaced by the pattern image is shown. That is, a unit pattern (any one of 36 unit patterns) as shown in FIG. 6A is arranged in the smallest square (hereinafter referred to as “unit block”) in FIG. Will be formed.
In the layout of FIG. 6B, the synchronization code is arranged in one unit block at the upper left of the code block. Further, the X position code is arranged in the four unit blocks on the right side of the unit block in which the synchronization code is arranged, and the Y position code is arranged in the four unit blocks on the lower side of the unit block in which the synchronization code is arranged. . Furthermore, identification codes are arranged in 16 (= 4 × 4) unit blocks surrounded by unit blocks in which these position codes are arranged.

Here, encoding of identification information will be described.
When encoding identification information, the bit string which comprises identification information is divided | segmented into a some block in order to perform RS encoding. Although there are several methods for encoding, RS encoding is suitable in this embodiment. This is because the RS code is a multi-value coding method, and in this case, the value represented by the unit block corresponds to the multi-value of the RS code. For example, when 5-bit information is expressed by one unit block, the 60-bit identification information is divided into 12 blocks having a block length of 5 bits. If an RS code capable of correcting two blocks of errors is adopted, the code length is 16 blocks, which can be accommodated in the unit block in which the identification code in the code block of FIG. 6B is arranged. The encoding method is not limited to the RS code, and other encoding methods such as a BCH code may be used.

Next, encoding of position information will be described.
For encoding the position information, an M-sequence code, which is a kind of pseudo-random sequence, is used. Here, the M sequence refers to a sequence having the longest period among code sequences generated by a shift register having a certain length and feedback. When K is the number of stages in the shift register, the sequence length of the M sequence is 2 ^K −1. Arbitrary consecutive K bits extracted from the M sequence have a property that they do not appear at other positions in the same M sequence. Therefore, the position information is encoded using this property.
By the way, in the present embodiment, a necessary M-sequence order is obtained from the length of position information to be encoded, and an M-sequence is generated. However, if the length of the position information to be encoded is known in advance, it is not necessary to generate the M sequence each time. That is, a fixed M sequence may be generated in advance and stored in a memory or the like.
For example, it is assumed that an M sequence (K = 13) having a sequence length of 8191 is used. In this case, since the position code is also embedded in units of 5 bits, 5 bits are taken out from the M sequence having a sequence length of 8191 and blocked.

  In this specification, the identification information and the position information are clearly distinguished and used for the sake of simplicity. However, there is a technique in which a wide range of position information is prepared, the position information is cut out and embedded from different ranges for each medium, and the medium is identified by the difference in position information. Therefore, in such a method, it is assumed that the position information has a function for identifying the medium, and the position information is also considered as the identification information.

Here, specific contents of the medium management information stored in the medium management information storage unit 33 will be described.
FIG. 7 is a diagram showing a specific example of the medium management information.
As illustrated, the medium management information is stored in association with identification information, a document ID, and print settings.
Among these, the identification information is information for uniquely identifying the medium as described above.
The document ID is information for uniquely identifying the electronic document as already described.
Furthermore, as described above, the print setting is information such as a page, a paper size, and an enlargement / reduction ratio set when the terminal device 10 requests printing of an electronic document.

In the figure, the first page of the electronic document with the document ID “DocA” is printed at 100% on the A4 size medium with the identification information “000101”, and the second page of the electronic document with the document ID “DocB” is identified. The information “000102” is printed on an A4 size medium at 100%.
Also, the first page of the electronic document with the document ID “DocC” is printed at 100% on an A4 size medium with the identification information “000103”, and the second page of the electronic document with the document ID “DocD” is printed with the identification information “ It is also shown that 100% printing was performed on an A4 size medium of “000104”.

B. Writing to a Print Document In this embodiment, handwriting information for a print document is transmitted from the digital pen 60 to the terminal device 50 via the communication device 70 and registered in the document server 20.
First, the mechanism of the digital pen 60 will be described.
FIG. 8 is a diagram illustrating a configuration example of the digital pen 60.
As illustrated, the digital pen 60 includes a control circuit 61 that controls the operation of the entire pen. The control circuit 61 includes an image processing unit 61a that processes the read code image, and a data processing unit 61b that extracts identification information and position information from the processing result.
The control circuit 61 is connected to a pressure sensor 62 that detects a writing operation by the digital pen 60 by a pressure applied to the pen tip 69. Further, an infrared LED 63 that irradiates the medium with infrared light and an infrared CMOS 64 that reads a code image by detecting reflected light are also connected. Furthermore, an information memory 65 for storing identification information and position information, a communication circuit 66 for communicating with an external device, a battery 67 for driving a pen, and pen identification information (pen ID) are stored. A pen ID memory 68 is also connected.

Next, the functional configuration realized in the control circuit 61 will be described in more detail.
FIG. 9 is a block diagram illustrating a functional configuration example of the control circuit 61. In the figure, a functional configuration example is shown separately for the image processing unit 61 a and the data processing unit 61 b in the control circuit 61.
As illustrated, the image processing unit 61 a includes an image acquisition unit 611 and a dot array generation unit 612. The data processing unit 61 b includes a code array generation unit 613, an identification information acquisition unit 614, a position information acquisition unit 615, and a handwriting information generation unit 616. Further, an association information generation unit 617 and a communication control unit 619 are provided.

The image acquisition unit 611 acquires a code image read from the print document by the infrared CMOS 64. Moreover, the noise contained in a code image is removed as needed.
The dot array generation unit 612 generates a dot array with reference to the dot positions in the code image. That is, on a two-dimensional array, for example, “1” is stored at a position where there is a dot and “0” is stored at a position where there is no dot, thereby replacing the dot detected as an image with digital data. Then, this two-dimensional array is output as a dot array.

  The code array generation unit 613 detects a block corresponding to the unit pattern in the code block on the dot array. Specifically, a frame having the same shape and size as the block in which the unit pattern is arranged is moved on the dot array, and the frame is fixed at a position where the number of dots in the frame becomes equal. For example, if the unit pattern shown in FIG. 6A is used, a frame having a size corresponding to 3 dots × 3 dots is moved, and the frame is fixed at a position where the number of dots included in the frame is two. Then, a code array is generated that stores code values determined from dot positions in each block delimited by the frame. When this code array is generated, the position of the synchronization code is specified by searching for a code value of a predetermined synchronization code.

The identification information acquisition unit 614 detects the identification code based on the position of the synchronization code from the code array. Then, the identification code is decoded using the parameters used in the RS encoding process at the time of image generation, and identification information is acquired. In the present embodiment, an identification information acquisition unit 614 is provided as an example of an identification information acquisition unit that acquires identification information.
The position information acquisition unit 615 detects the position code based on the position of the synchronization code from the code array. Then, an M-sequence partial sequence is extracted from the position code, the position of this partial sequence in the M-sequence used at the time of image generation is referenced, and a value obtained by correcting this position with an offset using a synchronization code is acquired as position information. The reason why the correction is made by the offset is that a synchronization code is arranged between the position codes. In the present embodiment, a position information acquisition unit 615 is provided as an example of position information acquisition means for acquiring position information.

The handwriting information generation unit 616 generates handwriting information by connecting the position information acquired by the position information acquisition unit 615. Here, the handwriting information includes at least data obtained by digitizing the locus of the pen tip of the digital pen 60, but may include other information. Information other than the locus of the pen tip includes, for example, information on the color set for the pen when writing, information on writing pressure, and the like. In the present embodiment, a handwriting information generation unit 616 is provided as an example of writing information acquisition means for acquiring writing information.
The association information generation unit 617 generates association information that associates a plurality of print documents and indicates their positional relationship when writing is performed across the plurality of print documents. Here, since the handwriting information is associated with the print document, the handwriting information is also associated by associating the print document. That is, in this embodiment, the association information generation unit 617 is provided as an example of a generation unit that generates association information indicating that handwriting information is related.

  The communication control unit 619 passes the identification information acquired by the identification information acquisition unit 614, the handwriting information generated by the handwriting information generation unit 616, and the association information generated by the association information generation unit 617 to the communication circuit 66. The information transmission to the communication device 70 is realized.

Next, an operation when the digital pen 60 generates handwriting information and registers it in the document server 20 will be described.
In the digital pen 60, first, the infrared LED 63 irradiates the medium with infrared light, and the infrared CMOS 64 receives the reflected light to read the code image. Then, the image acquisition unit 611 acquires the read code image. If the code image contains noise, it is removed. Next, the dot array generation unit 612 converts the dot positions included in the code image into digital data, and generates a dot array. Then, the code array generation unit 613 detects a block from the dot array, and generates a code array that stores a code value for each block. Then, the position of the synchronization code is specified in the code array. Thereafter, the identification information acquisition unit 614 detects the identification code based on the position of the synchronization code, decodes it, and acquires the identification information. Further, the position information acquisition unit 615 detects a position code based on the position of the synchronization code, decodes this, and acquires position information. The handwriting information generation unit 616 generates handwriting information by connecting the position information. Furthermore, in the present embodiment, the association information generation unit 617 generates association information for associating a plurality of media on which writing has been performed.

FIG. 10 is a flowchart showing an operation example of the association information generation unit 617 at this time.
The association information generation unit 617 first receives identification information from the identification information acquisition unit 614 and receives position information from the position information acquisition unit 615 (step 621). Then, by determining some conditions regarding the identification information or the position information received here, it is recognized how and where the writing across the two media is made.
That is, first, the association information generation unit 617 determines whether or not the elapsed time from the time when the identification information and the position information have been successfully read most recently is within a predetermined time (step 622). If a certain amount of time has passed since the last successful reading and the reading of the identification information and position information is successful again, the two media are located far apart, and it can be said that writing is done across the two media. Since there is no such condition, such a condition is judged. If the identification information and the position information are not successfully read, the dot array generation unit 612 and the code array generation unit 613 cannot be processed. Judgment is possible.

As a result of this determination, if the elapsed time from the last successful reading is not within the predetermined time, the process proceeds to step 630, but if the elapsed time from the most recent reading is within the predetermined time, the next Proceed to the determination.
That is, secondly, the association information generation unit 617 determines whether or not the identification information received in step 621 is the same as the identification information received when reading was most recently successful (step 623). By verifying whether the identification information read this time is different from the identification information read last time, it is understood that the medium has been switched between the previous reading and the current reading. .

As a result of the determination, if the identification information received in step 621 is the same as the identification information received in the last successful reading, the process proceeds to step 630, but the identification information received in step 621 is the identification received in the last successful reading. If it is different from the information, the process proceeds to the next determination.
That is, thirdly, the association information generation unit 617 determines whether at least one of the position information received in step 621 and the position information received when the reading was most recently performed is the position information of the edge of the medium. Is determined (step 624). Since writing over two media always passes through the edge of one of the media, such a condition is determined. As the end of the medium, a predetermined region at the edge of the medium may be used.

As a result of this determination, if neither the position information received at step 621 nor the position information received at the time of the last successful reading is the position information of the edge of the medium, the process proceeds to step 630. If at least one of the position information received at the last successful reading is the position information of the edge of the medium, the process proceeds to the next determination.
That is, fourthly, the association information generation unit 617 determines whether or not the previous identification information and position information have been successfully read (step 625). If the identification information and the position information are not successfully read, the dot array generation unit 612 and the code array generation unit 613 cannot be processed. Judgment is possible.

As a result of this determination, if reading of the immediately preceding identification information and position information is successful, that is, if no attempt is made to read the identification information and position information between the previous reading success and the current reading success, The association information generation unit 617 determines whether or not the position information received in step 621 is the position information of the edge of the medium (step 626). As the end of the medium, a predetermined region at the edge of the medium may be used.
If the positional information received in step 621 is positional information on the edge of the medium, it is determined that the writing is from one medium to another medium placed on the medium, and the association in the case of such writing Information is generated (step 627). Specifically, association information including a layer number that is one larger than the layer number of the medium previously written is generated. The layer number is an example of information indicating the overlapping order.

If the positional information received in step 621 is not positional information on the edge of the medium, it is determined in step 624 that at least one of the positional information is positional information on the edge of the medium. Is the position information of the edge of the medium. Accordingly, in this case, it is determined that writing is performed from a certain medium to another medium placed under the medium, and association information for such writing is generated (step 628). Specifically, association information including a layer number that is one smaller than the layer number of the medium previously written is generated.
Here, it is determined whether or not the position information received in step 621, that is, the position information of the current medium is the position information of the edge of the medium, but the previous position information of the medium is the end of the medium. It may be determined whether or not the position information is a part position information.

On the other hand, if it is determined in step 625 that the previous identification information and position information have not been successfully read, that is, an attempt was made to read the identification information and position information between the previous reading success and the current reading success. If the reading of the object is not successful, it is determined that the writing is for another medium placed at a position slightly away from the certain medium, and association information for such writing is generated (step 629). Specifically, association information including the same layer number as the layer number of the medium previously written is generated.
Then, the association information generation unit 617 determines whether or not the stroke signal is continuously received (step 630). If the stroke signal is received, the process returns to step 621 to continue the process. finish.

  Thereafter, the association information generation unit 617 passes the association information to the communication control unit 619. Then, the communication control unit 619 outputs the identification information acquired from the identification information acquisition unit 614, the handwriting information acquired from the handwriting information generation unit 616, and the association information acquired from the association information generation unit 617 to the communication circuit 66. . As a result, the communication circuit 66 transmits these pieces of information to the identification information server 30, and the identification information server 30 stores the association information in the association information storage unit 35. The handwriting information is further sent from the identification information server 30 to the document server 20 that manages the electronic document having the document ID corresponding to the identification information, and is stored as handwriting management information in association with the document ID in the document server 20. Will be.

Here, specific contents of the association information stored in the association information storage unit 35 will be described.
FIG. 11A is a diagram illustrating a specific example of association information.
As shown in the figure, the association information is obtained by associating identification information, association identification information, and positional relationship information.
Among these, the identification information is information for uniquely identifying the medium as described above.
Further, as already described, the related identification information is information for uniquely identifying a medium associated with the medium specified by the identification information.

  Further, as described above, the positional relationship information is information indicating the positional relationship between the medium specified by the identification information and the medium specified by the related identification information. In the figure, the positional relationship information is shown in the form of (X coordinate of upper left point of medium, Y coordinate of upper left point of medium, tilt angle of medium, layer number of medium). Here, among the plurality of media associated with each other, the medium on which writing is performed first is used as the reference medium. A coordinate system in which the origin is set at the upper left point of the reference medium, the X axis in the X direction in the code image on the reference medium, and the Y axis in the Y direction in the code image on the reference medium is set as the reference coordinate system. The Y direction in the code image on the medium is defined as a reference direction, and the layer in which the reference medium exists is defined as a reference layer (layer 0). In this state, the coordinates of the upper left point of the medium other than the reference medium are represented by coordinates in the reference coordinate system. Further, the inclination angle of the medium other than the reference medium is represented by a clockwise angle from the reference direction. Furthermore, the layer number of the medium other than the reference medium is represented by a difference from the reference layer (a positive number if it is above the reference layer and a negative number if it is below the reference layer).

  In the figure, regarding the medium of the identification information “000101” and the medium of the identification information “000102”, it is shown that these media are associated with each other by the related identification information. The positional relationship information (0, 0, 0, 0) indicates that the medium of the identification information “000101” is the reference medium written first. Further, according to the positional relationship information (Xa, Ya, α, −1), the coordinate of the upper left point of the medium of the identification information “000102” is (Xa, Ya) in the reference coordinate system, and the medium of the identification information “000102” It is indicated that the inclination angle is α with respect to the reference direction, and the medium layer of the identification information “000102” is a layer immediately below the reference layer.

  Further, regarding the medium with the identification information “000103” and the medium with the identification information “000104”, the related identification information indicates that these media are associated with each other. The positional relationship information (0, 0, 0, 0) indicates that the medium of the identification information “000103” is the reference medium written earlier. Further, according to the positional relationship information (Xb, Yb, β, 0), the coordinate of the upper left point of the medium of the identification information “000104” is (Xb, Yb) in the reference coordinate system, and the inclination of the medium of the identification information “000104” It is indicated that the angle is β with respect to the reference direction, and the medium layer of the identification information “000104” is the same layer as the reference layer. The reason why the layers are the same is that it is assumed that the medium of the identification information “000103” and the medium of the identification information “000104” do not overlap.

Next, a method for calculating (Xa, Ya) and α in (a) will be described.
FIG. 11B is a diagram for explaining a method of calculating these values. Here, it is assumed that the medium (reference medium) having the identification information “000101” is “print document A” and the medium having the identification information “000102” is “print document B”. Further, as the coordinate system, a reference coordinate system based on the print document A is used, but an x axis and ay axis based on the print document B are also shown for explanation.
In the figure, the handwriting indicated by the bold line moves from the print document A to the print document B at the point (X1, Y1). At this time, the direction angle of the handwriting with respect to the Y axis can be determined from the position information acquired from the print document A within a predetermined range immediately before the point (X1, Y1). Further, the direction angle of the handwriting with respect to the y-axis is also known from the position information acquired from the print document B within a predetermined range immediately after the point (X1, Y1). Therefore, α can be calculated under the condition that the former direction angle is equal to the direction angle obtained by converting the latter direction angle into the direction angle with respect to the Y axis.

  Further, (Xa, Ya) may be obtained by subtracting the vector (x1, y1) from (X1, Y1) if the inclination angle α is not taken into consideration. However, since there is actually an inclination angle α, a vector obtained by rotating the vector (x1, y1) by α is subtracted from (X1, Y1). That is, (Xa, Ya) = (X1−x1 * cos α + y1 * sin α, Y1−x1 * sin α−y1 * cos α).

Next, a method for calculating (Xb, Yb) and β in (b) will be described.
FIG. 11-2 (c) is a diagram for explaining a method of calculating these values. Here, the medium (reference medium) of the identification information “000103” is “print document C”, and the medium of the identification information “000104” is “print document D”. Further, as the coordinate system, a reference coordinate system based on the print document C is used, but an x axis and ay axis based on the print document D are also shown for explanation.
In the figure, the handwriting indicated by the bold line disappears from the printed document C at the point (X2, Y2), and appears on the printed document D at the point (X2 ′, Y2 ′). At this time, the direction angle of the handwriting with respect to the Y axis can be obtained from the position information acquired from the print document C within a predetermined range immediately before the point (X2, Y2). In addition, the direction angle of the handwriting with respect to the y-axis can be determined from the position information acquired from the print document D within a predetermined range immediately after the point (X2 ′, Y2 ′). Therefore, if it is guaranteed that the handwriting from leaving the print document C to touching the print document D is a straight line, the former direction angle and the latter direction angle are converted into a direction angle with respect to the Y axis. Β can be calculated under the condition that the obtained direction angle is equal.

  Further, (Xb, Yb) may be the value obtained by subtracting the vector (x2, y2) from (X2 ′, Y2 ′) unless the inclination angle β is taken into account (x2 indicates that the handwriting is added to the printed document D). X coordinate in the coordinate system based on the printed document D of the reached point). However, since there is actually an inclination angle β, a vector obtained by rotating the vector (x2, y2) by β is subtracted from (X2 ′, Y2 ′). That is, (Xb, Yb) = (X2′−x2 * cosβ + y2 * sinβ, Y2′−x2 * sinβ−y2 * cosβ).

In the case of this example, (X2 ′, Y2 ′) is not immediately known from the position information acquired from the print document. Therefore, the following calculation is performed. That is, first, the first movement is performed by dividing the distance traveled by the digital pen 60 within a predetermined range before and after the point (X2, Y2) by the time required for the digital pen 60 to travel the distance. Find the speed. Next, the distance traveled by the digital pen 60 within a predetermined range before and after the point (X2 ′, Y2 ′) is divided by the time required for the digital pen 60 to travel the distance, and the second Find the moving speed. Then, the moving speed of the digital pen 60 is obtained by averaging the first moving speed and the second moving speed. Further, the time required for the digital pen 60 to move from the point (X2, Y2) to the point (X2 ′, Y2 ′) is multiplied by the moving speed, so that the point (X2, Y2) to the point (X2 ′, Y2 ') is determined. Finally, the X component and the Y component of the vector from the point (X2, Y2) to the point (X2 ′, Y2 ′) are obtained from this distance and the inclination angle β of the printed document D, and (X2, Y2) (X2 ′, Y2 ′) is obtained by adding this vector to.
In this example, the positional relationship between the print document C and the print document D on a plane including these, such as a vector from (Xb, Yb), β, (X2, Y2) to (X2 ′, Y2 ′), is This is an example of the degree of separation between the print document C and the print document D.

C. Display of handwriting information In the present embodiment, handwriting information spanning a certain print medium and another print medium is displayed based on the association information.
In that case, the user first instructs the print medium with the digital pen 60. Then, the digital pen 60 reads the identification information and outputs it to the terminal device 50 via the communication device 70.
Then, the terminal device 50 transmits the identification information transmitted from the digital pen 60 to the identification information server 30.

FIG. 12 is a sequence diagram showing subsequent operations of the identification information server 30 and the document server 20.
In the identification information server 30, the receiving unit 31 first receives identification information from the terminal device 50 (step 331). Next, the identification information is transferred to the medium management unit 32, and the medium management unit 32 refers to the association information and acquires the related identification information corresponding to the identification information (step 332). In addition, the medium management unit 32 searches the medium management information and the association information using the identification information acquired in step 331 and the related identification information acquired in step 332 as keys, and a plurality of document IDs corresponding to these identification information and Print settings are acquired from the medium management information, and a plurality of pieces of positional relationship information corresponding to the identification information are acquired from the association information (step 333). A plurality of print settings and positional relationship information are passed to the display information generation unit 34, a plurality of document IDs and page numbers (included in the print settings) are passed to the transmission unit 39, and the transmission unit 39 receives these documents. The ID and page number are transmitted to the document server 20 (step 334).

  Thereby, in the document server 20, the receiving unit 21 receives a plurality of document IDs and page numbers (step 231). These pieces of information are transferred to the handwriting management unit 23, and the handwriting management unit 23 refers to the handwriting management information stored in the handwriting management information storage unit 24, and sets each of the plurality of document IDs and page numbers that have been passed. Corresponding handwriting information is extracted (step 232). Thereafter, the extracted information is transferred to the transmission unit 29, and the transmission unit 29 transmits the information to the identification information server 30 together with a plurality of electronic documents specified by a plurality of document IDs (step 233).

Thereby, in the identification information server 30, the receiving unit 31 receives a plurality of electronic documents and handwriting information (step 335). These pieces of information are passed to the display information generation unit 34.
Thereafter, the display information generation unit 34 generates display information including objects representing print images of individual electronic documents in consideration of the print settings and positional relationship information retrieved and passed by the medium management unit 32 in step 333. On top of that, the handwriting information received in step 335 is added (step 336). In this case, since the print settings include attributes such as the size and color of each medium, these attributes are also reflected in the object representing the print image of the electronic document for each medium. Also, the positional relationship such as the coordinates of the upper left point, the tilt angle, and the layer is reflected in the object.
Then, the display information generation unit 34 passes the display information generated in this way to the transmission unit 39, and the transmission unit 39 transmits the display information to the terminal device 50 (step 337).
Thereby, in the terminal device 50, the image of each electronic document can be operated as an independent object.
This is the end of the description of the operation of the present embodiment.

  In the above embodiment, writing over two media is recognized by detecting the switching of the identification information of the media, but the present invention is not limited to this. For example, focusing on the fact that the position information read when writing on the same medium has regular continuity, it may be recognized by detecting this discontinuity of continuity.

  In the above-described embodiment, the case where writing is performed across two media has been described. However, the present invention can be applied even when writing is performed across a plurality of media. Since writing over a plurality of media is a collection of writings over two media, the present invention is applied to writing over a plurality of media by applying the present invention to writing over two media. Is applied. Note that the overlapping order of the media may not be specified depending on how the media are overlapped or written. In such a case, the overlap order is estimated to some extent using medium size information, etc., and if the overlap order cannot be estimated, the overlap order is appropriately determined on the system side and the user's operation on the display screen is performed. You can make it changeable.

By the way, in the present embodiment, the digital pen 60 generates handwriting information and association information, the identification information server 30 stores the association information and controls the display of the handwriting information, and the document server 20 stores the handwriting information. I made it. However, various variations can be considered as to which apparatus performs these processes. For example, the handwriting information and the association information may be generated by the terminal device 50 or the identification information server 30, and the storage of the association information and the control of the display of the handwriting information may be performed by the terminal device 50 or the document server 20. Good. Further, the identification information server 30 may store the handwriting information.
Therefore, the hardware configuration of the computer 90 will be described assuming that these processes are performed by the computer 90.

FIG. 13 is a diagram illustrating a hardware configuration of the computer 90.
As shown in the figure, the computer 90 includes a CPU (Central Processing Unit) 91 as a calculation means, a main memory 92 as a storage means, and a magnetic disk device (HDD: Hard Disk Drive) 93. Here, the CPU 91 executes various types of software such as an OS (Operating System) and applications to realize the above-described functions. The main memory 92 is a storage area for storing various software and data used for execution thereof, and the magnetic disk device 93 is a storage area for storing input data for various software, output data from various software, and the like. .
Further, the computer 90 includes a communication I / F 94 for performing communication with the outside, a display mechanism 95 including a video memory and a display, and an input device 96 such as a keyboard and a mouse.

  The program for realizing the present embodiment can be provided not only by communication means but also by storing it in a recording medium such as a CD-ROM.

DESCRIPTION OF SYMBOLS 10,50 ... Terminal device, 20 ... Document server, 30 ... Identification information server, 40 ... Image forming device, 60 ... Digital pen, 80 ... Network

Claims (11)

Identification information acquisition means for acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed;
Writing information acquisition means for acquiring writing information for the medium generated based on the position information read from the medium;
The first identification information and the second identification information different from the first identification information are acquired by the identification information acquisition means , and the second identification information is read after the first identification information is read. The first identification information printed out of the writing information acquired by the writing information acquisition means on the condition that no attempt was made to read the identification information before the identification information was read . That the first writing information for the medium and the second writing information for the second medium on which the second identification information is printed are related, and the first medium and the second medium. A writing information processing apparatus, comprising: generating means for generating association information indicating that and are arranged in an overlapping manner .   The generation unit generates the association information on a further condition that a time from when the first identification information is read to when the second identification information is read is within a predetermined time. The writing information processing apparatus according to claim 1. The generating means determines whether the first identification information is read from an area defined as an end portion of the first medium, or determines the second identification information as an end portion of the second medium. The handwriting information processing apparatus according to claim 1 , wherein the association information further generating an overlapping order of the first medium and the second medium is generated based on whether or not the read area is read. Identification information acquisition means for acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed;
Writing information acquisition means for acquiring writing information for the medium generated based on the position information read from the medium;
The first identification information and the second identification information different from the first identification information are acquired by the identification information acquisition means , and the second identification information is read after the first identification information is read. Of the writing information acquired by the writing information acquisition means, the first reading is performed on the condition that reading of the identification information is attempted before the identification information is read and the reading is not successful . The first writing information for the first medium on which the identification information is printed is related to the second writing information for the second medium on which the second identification information is printed , and the first A writing information processing apparatus comprising: generating means for generating association information indicating that the medium and the second medium are arranged apart from each other . The generating means includes a position of the first medium from which the first identification information is read, a position of the second medium from which the second identification information is read, and an electronic writing instrument used for writing. The writing information processing apparatus according to claim 4 , wherein the association information that further indicates a degree of separation between the first medium and the second medium is generated based on a moving speed. Control means for controlling to display an image representing the first medium, the second medium, the first writing information, and the second writing information based on the association information. The writing information processing apparatus according to any one of claims 1 to 5 , wherein: Identification information acquisition means for acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed;
Writing information acquisition means for acquiring writing information for the medium generated based on the position information read from the medium;
When the first identification information and the second identification information different from the first identification information are continuously acquired by the identification information acquisition means, the writing information acquired by the writing information acquisition means The first writing information for the first medium on which the first identification information is printed and the second writing information on the second medium on which the second identification information is printed are related to each other. Generating means for generating association information indicating that the first medium and the second medium are arranged to overlap each other
A writing information processing apparatus characterized by comprising: The generating means determines whether the first identification information is read from an area defined as an end portion of the first medium, or determines the second identification information as an end portion of the second medium. The handwritten information processing apparatus according to claim 7, wherein the association information further generating an overlapping order of the first medium and the second medium is generated based on whether or not the read area is read. Identification information acquisition means for acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed;
Writing information acquisition means for acquiring writing information for the medium generated based on the position information read from the medium;
The first identification information and the second identification information different from the first identification information are acquired discontinuously by the identification information acquisition means, and the first identification information is acquired and then the first identification information is acquired. When the time until the second identification information is acquired is within a predetermined time, among the writing information acquired by the writing information acquisition means, the first identification information is printed. That the first writing information for the first medium and the second writing information for the second medium on which the second identification information is printed are related to each other, and that the first medium and the second medium Generating means for generating association information indicating that the medium is arranged apart from the medium;
A writing information processing apparatus characterized by comprising: On the computer,
A function of acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed;
A function of acquiring writing information for the medium generated based on the position information read from the medium;
From when the first identification information and the second identification information different from the first identification information are acquired and after the first identification information is read until the second identification information is read The first writing information for the first medium on which the first identification information is printed and the second identification information on which the second identification information is printed on the condition that no reading of the identification information is attempted during Realizing a function for generating association information indicating that the second writing information for the second medium is related and that the first medium and the second medium are arranged to overlap each other Program to let you. On the computer,
A function of acquiring the identification information read from the medium on which the identification information of the medium and the position information on the medium are printed;
A function of acquiring writing information for the medium generated based on the position information read from the medium;
From when the first identification information and the second identification information different from the first identification information are acquired and after the first identification information is read until the second identification information is read The first writing information for the first medium on which the first identification information is printed, and the second, on the condition that the reading of the identification information is attempted during the period and the reading is not successful. Association indicating that the second writing information for the second medium on which the identification information is printed is related, and that the first medium and the second medium are arranged apart from each other With the ability to generate information
A program to realize

Images