JP5906608B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to an information processing apparatus and a program.

Patent Document 1 discloses a character recognition processing device including an input screen for handwriting input in which a predetermined number of character frames are initially set on predetermined orthogonal coordinates.
In Patent Document 2, the written data indicating the written character string is corrected, and the written data is appropriately overlapped with the form by matching the display position of the written data with the entry field in which the character string is to be filled. A writing data input device 108 to be displayed is disclosed.
In Patent Document 3, handwritten characters are read as image information, the coordinates of a rectangular character image cut out in character units from the image information are stored, and specified together with a rectangular character image having a high similarity to the specified rectangular character image. A character recognition system that displays rectangular character images in the vicinity of rectangular character images side by side is disclosed.
Japanese Patent Laid-Open No. 2004-228561 extracts from the paper the paper surface information described at a predetermined position, and edits the extracted paper surface information based on command information corresponding to the command described at the predetermined position. A system is disclosed.
Patent Document 5 discloses a pattern recognition apparatus that performs at least one pattern recognition process in accordance with a state to be processed.

Japanese Patent Laid-Open No. 10-293812 JP 2005-038077 A JP-A-2005-050134 JP 2005-346415 A JP 2007-058882 A

  An object of the present invention is to provide an information processing apparatus that accurately associates a display result of a created electronic document with a print result of image data of the electronic document.

[Information processing equipment]
An information processing apparatus according to the present invention includes an electronic document setting information acquisition unit that acquires electronic document setting information including information that can identify a specific area included in an electronic document, and image data of the electronic document when printed Recording medium information acquisition means for acquiring recording medium information indicating a state of the recording medium including information indicating a predetermined position on the recording medium, electronic document setting information acquired by the electronic document setting information acquisition means, and the recording medium Corresponding means for associating the recording medium information acquired by the information acquiring means with information that can identify the specific area, information that can identify the specific area included in the electronic document, and image data of the electronic document Embedded in the image data of the electronic document to be printed with information that can identify the recording medium to be printed .

Preferably, the association unit includes a combination of information that can identify the specific area included in the electronic document and information that can identify a recording medium on which image data of the electronic document is printed. The electronic document setting information acquired by the document setting information acquisition unit is associated with the recording medium information created by the recording medium information acquisition unit.

  Preferably, the printing apparatus further includes a print image creation unit that creates a print image indicating an image on which image data of the electronic document is printed, and the recording medium information acquisition unit is configured to print from the print image created by the print image creation unit. The recording medium information is acquired.

Preferably, the embedding unit records image data in which information capable of identifying the specific area included in the electronic document and information capable of identifying a recording medium on which image data of the electronic document is printed are embedded. When printing is performed on a printing unit that prints on a medium and a recording medium on which image data is printed by the printing unit, writing to the recording medium and identification of the specific area included in the electronic document is performed from the recording medium Reading means for reading the information that can be identified and the recording medium on which the image data of the electronic document is printed, and the electronic document read by the reading means read by the reading means the electronic document set associated with the information image data information and electronic document may identify a particular region may identify a recording medium to be printed included in the Further comprising an update unit that updates to broadcast is reflected in the setting electronic document.

Preferably, the printing unit includes a recording medium on which image data of the electronic document is printed, information that can identify the specific area included in the electronic document, and a recording medium on which the image data of the electronic document is printed. Image data indicating information that can be identified is further printed.

Preferably, the printing means identifies information that can identify the specific area included in the electronic document and a recording medium on which the image data of the electronic document is printed while printing the image data of the electronic document. The image data indicating the information to be obtained is printed.

[program]
A program according to the present invention includes a step of acquiring electronic document setting information including information that can identify a specific area included in an electronic document and an image data of the electronic document printed in an information processing apparatus including a computer A step of acquiring recording medium information indicating a state of the recording medium including information indicating a predetermined position on the recording medium, the acquired electronic document setting information, and the acquired recording medium information in the specific area A step of associating with information that can be identified, information that can identify the specific area included in the electronic document, and information that can identify a recording medium on which image data of the electronic document is printed The computer is caused to execute the step of embedding in the image data of the electronic document .

According to the first aspect of the present invention, there is provided an information processing apparatus for accurately and easily associating a display result of a created electronic document and a print result of image data of the electronic document, as compared with a case without this configuration. Can be provided.

  According to the second aspect of the present invention, in addition to the effect of the first aspect of the present invention, the display result of the created electronic document and the print result of the image data of the electronic document are compared with the case without the present configuration. It is possible to provide an information processing apparatus that more accurately associates.

According to the third aspect of the present invention, there is provided an information processing apparatus that accurately associates a display result of a created electronic document with a print result of image data of the electronic document, as compared to a case without the present configuration. it is, it is possible to provide an information processing apparatus to easily create a record medium information.

According to the fourth aspect of the present invention, in addition to the effect of the first aspect of the present invention, it is possible to provide an information processing apparatus in which writing to a recording medium is easily reflected as compared with the case where the present configuration is not provided. Can do.

According to the fifth aspect of the present invention, in addition to the effect of the present invention according to the fourth aspect , the display result of the created electronic document and the print result of the image data of the electronic document are compared with the case without the present configuration. Can be provided.

According to the sixth aspect of the present invention, in addition to the effect of the present invention according to the fourth aspect , the display result of the created electronic document and the print result of the image data of the electronic document are compared with the case where the present configuration is not provided. Can be provided.

According to the seventh aspect of the present invention, it is possible to provide a program for accurately associating the display result of the created electronic document with the print result of the image data of the electronic document, as compared with the case without this configuration. .

1 is a diagram illustrating an information processing system in which an information processing apparatus and an image forming apparatus according to an embodiment of the present invention are connected to each other via a network. It is a figure which shows the hardware constitutions of information processing apparatus. It is a block diagram which shows the structure of the information processing program which operate | moves with information processing apparatus. It is an example of a setting of a coordinate axis and a coordinate component. It is an example of a setting of a coordinate axis and a coordinate component. It is an example of embedding a recording medium ID and coordinate components. It is an example of embedding a recording medium ID and coordinate components. It is an example of the electronic document setting information memorize | stored in a memory | storage part. It is an example of the recording medium information memorize | stored in a memory | storage part. It is a block diagram which shows the structure of the 1st modification of an information processing program. It is a block diagram which shows the structure of the 2nd modification of an information processing program. It is a block diagram which shows the structure of the 3rd modification of an information processing program. It is a figure which shows the structure of the electronic pen illustrated as a reader. 6 is a flowchart illustrating a processing flow from when an electronic document is created in the information processing apparatus to when an information processing program is executed until image data of the electronic document is printed in the image forming apparatus. It is an example of the electronic document created using Excel. It is a flowchart which shows the processing flow when the 1st modification of an information processing program is performed. It is a flowchart which shows the processing flow when the 2nd modification of an information processing program is performed. It is a flowchart which shows the processing flow when the 3rd modification of an information processing program is performed. 10 is a flowchart illustrating a processing flow from when an image on a recording medium is recognized in the reading apparatus to when an information processing program is executed and writing in the recording medium is reflected in the electronic document in the information processing apparatus. It is an example of the written electronic document. It is an example of the electronic document in which writing was reflected. It is an example of the electronic document in which the calculation based on the reflected writing was made.

  Embodiments of the present invention will be described below. In addition, the following description is only an example in implementing this invention, and this invention is not necessarily limited to the matter demonstrated below, It can change suitably as needed.

[Information processing system 1]
FIG. 1 is a diagram showing an information processing system 1 configured by connecting information processing apparatuses 10-1 to 10-n and an image forming apparatus 12 according to an embodiment of the present invention to each other via a network 14. is there.
Applications such as Word and Excel (both are registered trademarks) are installed in the information processing apparatuses 10-1 to 10-n, and have general computer functions.
An operator of the information processing apparatuses 10-1 to 10-n creates an electronic document using an installed application, and stores the electronic document in a storage device (FIG. 2) in the information processing apparatuses 10-1 to 10-n. And an instruction to print image data of the electronic document (print instruction) is transmitted to the image forming apparatus 12.
In addition to the application, an information processing program to be described later with reference to FIG. 3 is installed in the information processing apparatuses 10-1 to 10-n.

The image forming apparatus 12 is a multifunction machine having functions such as printing, copying, and facsimile transmission.
With such a configuration, image data of an electronic document created by an operator of the information processing apparatuses 10-1 to 10-n is printed on a recording medium by the image forming apparatus 12. The recording medium is a plastic sheet such as paper or an OHP sheet, a metal plate, or the like, as long as it can print image data.

Further, the recording medium on which the image data is printed by the image forming apparatus 12 is read by the reading devices 18-1 to 18-18 connected to the information processing devices 10-1 to 10-n via the communication devices 16-1 to 16-n. Read by -n.
Information (read information) read by the reading devices 18-1 to 18-n is transmitted to the information processing devices 10-1 to 10-n via the communication devices 16-1 to 16-n.
Note that the reading devices 18-1 to 18-n are electronic pens, handy scanners, mobile phones, and the like, and may be any devices that have a reading function. Although the reading devices 18-1 to 18-n are illustrated as being separate from the communication devices 16-1 to 16-n, the reading devices 18-1 to 18-n may be incorporated. Good.

However, n is an integer greater than or equal to 1, and n does not always show the same number.
In the following drawings, substantially the same components are denoted by the same reference numerals.
Hereinafter, when any of a plurality of components such as “information processing apparatuses 10-1 to 10-n” is indicated without being specified, it is simply abbreviated as “information processing apparatus 10” or the like. There is.
The information processing system 1 shown in FIG. 1 has only one image forming apparatus 12, but there may be a plurality of image forming apparatuses 12.

[Information processing apparatus 10]
FIG. 2 is a diagram illustrating a hardware configuration of the information processing apparatus 10 of FIG.
As shown in FIG. 2, the information processing apparatus 10 includes a main body 104 including a CPU 100 and a memory 102, an input device 108, an output device 110, a communication interface (communication IF) 112, a storage device 114, and a storage medium 116. .
That is, the information processing apparatus 10 includes a component as a computer that can communicate with other apparatuses such as the image forming apparatus 12 of FIG.

The memory 102, the storage device 114, or the storage medium 116 includes software such as an application and the information processing program 20, an electronic document created using the application, information created when the information processing program 20 is executed, and the information shown in FIG. Information used for recognition of information read by the reading device 18 is stored.
Note that details of information created as a result of the execution of the information processing program 20 and information used for recognizing information read by the reading device 18 will be described later with reference to FIG.
An electronic document created using an application and information created when the information processing program 20 is executed may be stored in a file server (not shown) connected via the network 14 in FIG. Absent.

  The CPU 100 executes predetermined processing based on the information processing program 20 stored in the memory 102, the storage device 114, or the storage medium 116, and controls the operation of the information processing device 1010. Details of the information processing program 20 will be described later with reference to FIG.

The input device 108 is a keyboard, a mouse, a joystick, and the like, and the output device 110 is a display device such as a display.
The storage device 114 is an HDD (Hard Disk Drive) or the like, and the storage medium 116 is a CD-ROM or a floppy disk (registered trademark).

[Information processing program 20]
FIG. 3 is a block diagram showing a configuration of the information processing program 20 that operates in the information processing apparatus 10 of FIG.
As illustrated in FIG. 3, the information processing program 20 includes a storage unit 200, a print instruction creation unit 22, a print instruction transmission unit 202, a read information reception unit 204, a read information recognition unit 206, and an electronic document update unit 208. .
Further, the print instruction creation unit 22 includes an electronic document setting information acquisition unit 220, a print image creation unit 222, a recording medium ID creation unit 224, a recording medium information acquisition unit 226, and an embedded image creation unit 228.

[Storage unit 200]
The storage unit 200 stores an electronic document, reference information, embedding information, electronic document setting information, recording medium information, and recognition information created by an operator of the information processing apparatus 10 using an application.

  The reference information is information indicating coordinate axes and coordinate components that are used as a reference when the print image creation unit 222 creates a print image or when the embedded image creation unit 228 creates an embedded image. The reference coordinate axes and coordinate components are set in advance based on the size of the recording medium, for example. As shown in FIG. 4A, the X coordinate and the Y coordinate may be set with the point at the lower left of A0 (the maximum size that the recording medium can take) as the origin, and as shown in FIG. 4B, the center of A0 The X coordinate and the Y coordinate may be set with the origin as the origin.

The embedding information is information indicating the content of information embedded in the recording medium on which the image data of the electronic document is printed and the position where the information is embedded. The information embedded in the recording medium is, for example, a recording medium ID for identifying the recording medium and a coordinate component of a position where the information is embedded, and is encoded and then embedded as an encoded image. The position where information is embedded is set in advance based on, for example, a reference coordinate axis and coordinate components. As shown in FIG. 5A, embedding of each of the recording medium ID and the coordinate component may be set according to the size of the recording medium, or as shown in FIG. 5B, each pattern composed of the recording medium ID and the coordinate component. Embedding may be set.
Details of the electronic document setting information and the recording medium information will be described later.
The recognition information is information indicating correspondence between character codes and strokes (handwriting). The character code is, for example, an ASCII code for numbers and alphabets.

[Printing instruction creation unit 22]
The print instruction creating unit 22 creates a print instruction to be transmitted to the image forming apparatus 12 in FIG. 1 when an operation for printing image data of an electronic document (print operation) is accepted in the input device 108 in FIG.
For example, when an electronic document is created using a Microsoft (registered trademark) application, the print operation is performed by pressing the print button after pressing the file button displayed by opening the electronic document. , Making settings related to printing and pressing the OK button.
The settings relating to printing are, for example, settings of the size of the recording medium on which the image data of the electronic document is printed, the number of copies and the print range, and the image forming apparatus 12 that prints the image data of the electronic document.

When a printing operation is accepted by the input device 108, the electronic document setting information acquisition unit 220 acquires information (electronic document setting information) set when the electronic document is created from the electronic document stored in the storage unit 200. To do.
The electronic document setting information includes information manually set by the operator of the information processing apparatus 10 and information automatically set by functions provided by the application. When an electronic document is created using Excel, the electronic document setting information includes, for example, a file name, a sheet name, a cell name, a cell width, a cell height, and a cell format. As shown in FIG. 6, in addition to these, the electronic document setting information is added with a cell ID for identifying a cell by a combination of a file name, a sheet name, and a cell name, and is output to the print image creation unit 222. The data is output to the storage unit 200 and stored.

The print image creation unit 222 uses the reference information stored in the storage unit 200, the setting information regarding printing received by the input device 108, and the electronic document setting information acquired by the electronic document setting information acquisition unit 220. Thus, a print image indicating an image on which the image data of the electronic document is printed is created and output to the recording medium information acquisition unit 226.
The print image includes, for example, the size of the recording medium on which the image data of the electronic document is printed, the coordinate axes and coordinate components corresponding to the size, the number of copies and the print range, and the printer of the image forming apparatus 12 that prints the image data of the electronic document. It is created in JPEG format using information acquired by the driver (resolution, recording medium size, printable area, etc.), cell width, and cell height.
In addition, for example, when an electronic document is created using a Microsoft application, the print image is opened by pressing a file button displayed by opening the electronic document, and then pressing a print preview button, whereby the output device of FIG. 110 can be displayed.

  When a printing operation is accepted by the input device 108, the recording medium ID creation unit 224 creates a recording medium ID that identifies the recording medium, and outputs the recording medium ID to the recording medium information acquisition unit 226 and the embedded image creation unit 230. The recording medium ID creation unit 224 creates a recording medium ID based on the number of copies set via the input device 108. For example, when the set number of prints is 30, the recording medium ID creation unit 224 creates 1 to 30 recording medium IDs.

The recording medium information acquisition unit 226 acquires recording medium information indicating the state of the recording medium when the image data of the electronic document is printed from the print image created by the print image creation unit 222.
The recording medium information acquisition unit 226 performs, for example, general projection processing on the print image created by the print image creation unit 222, and recognizes how the ruled lines are drawn and where the cells are. Then, a coordinate component (cell position coordinate) indicating the position of the cell printed on the recording medium is acquired from the print image.

As shown in FIG. 7, the cell position coordinates are added with a recording medium ID created by the recording medium ID creation unit 224 or a cell ID for identifying a cell by a combination of the recording medium ID and the cell position coordinates. The information is stored in the storage unit 200 as information. Here, the cell position coordinates are shown as a combination of the coordinate component of the point located at the upper left and the coordinate component of the point located at the lower right when the cell is regarded as a rectangle.
The recording medium information is stored in the storage unit 200 in a one-to-one correspondence with the electronic document setting information by the cell ID. Therefore, as shown in FIG. 7, the recording medium information further includes a method of reading a cell printed on the recording medium (cell reading method) so as to correspond to the cell format included in the electronic document setting information. May be.
The embedded image creating unit 228 creates an embedded image to be embedded in the recording medium using the recording medium ID created by the recording medium ID creating unit 224 and the embedding information stored in the storage unit 200, and print instructions The data is output to the transmission unit 202. As described above, the encoded image of the recording medium ID and the encoded image of the coordinate component indicating the position where the information is embedded are created as the embedded image. Note that an encoded image of a pattern made up of the recording medium ID and coordinate components may be created as an embedded image.

[Print instruction transmission unit 202]
The print instruction transmission unit 202 outputs a print instruction based on the electronic document stored in the storage unit 200, the print image created by the print image creation unit 222, and the embedded image created by the embedded image creation unit 228. The image is transmitted to the image forming apparatus 12 via the communication IF 112 in FIG.
The print instruction is to print the image data of the electronic document on a recording medium so that the result of printing the image data of the electronic document matches the print image, but the embedded image is embedded in the image data of the electronic document before printing. The image data in which the embedded image and the embedded image are embedded may be printed, or the embedded image may be printed over the recording medium on which the image data of the electronic document is printed. Further, the embedded image may be printed in an overlapping manner while printing the image data of the electronic document.

[Reading information receiving unit 204]
The read information receiving unit 204 receives the read information from the reading device 18 of FIG. 1 via the communication IF 112 and outputs it to the read information recognizing unit 206.

[Reading information recognition unit 206]
The read information recognition unit 206 recognizes the read information from the read information reception unit 204 using the recognition information stored in the storage unit 200.
As will be described later, the read information is, for example, a stroke image, an encoded image of a recording medium ID, and an encoded image of coordinate components. The stroke image is recognized as a character code associated with a stroke that approximates the stroke of the image among the strokes included in the recognition information. The encoded image of the recording medium ID is decoded and recognized as the recording medium ID, and the encoded image of the coordinate component is decoded and recognized as the coordinate component.
A recognition result (here, a character code, a recording medium ID, and a coordinate component) by the read information recognition unit 206 is output to the electronic document update unit 208.

[Electronic document update unit 208]
The electronic document update unit 208 updates the electronic document stored in the storage unit 200 using the electronic document setting information and recording medium information stored in the storage unit 200 and the recognition result by the read information recognition unit 206.
Specifically, the electronic document update unit 208 first uses the recording medium information and the recognition result to record a recording medium ID that is the same as the recognized recording medium ID among the recording medium IDs included in the recording medium information, Among the cell position coordinates included in the medium information, the cell ID corresponding to the combination of the recognized coordinate component and the same cell position coordinate is specified.
Next, the electronic document update unit 208 specifies a combination of a file name, a sheet name, and a cell name corresponding to the specified cell ID using the electronic document setting information.
Finally, the electronic document update unit 208 inputs numbers, alphabets, and the like in which recognized character codes are assigned to the cells identified by the combination of the specified file name, sheet name, and cell name in the electronic document. To do.

Hereinafter, a modification of the information processing program 20 described with reference to FIG. 3 will be described.
FIG. 8 is a block diagram showing a configuration of a first modification of the information processing program 20, FIG. 9 is a block diagram showing a configuration of a second modification of the information processing program 20, and FIG. It is a block diagram which shows the structure of the 3rd modification of the information processing program.
Hereinafter, in describing the configuration of each modified example, only points different from the configuration of the information processing program 20 in FIG. 3 will be described, and description of the same points will be omitted.

[First modification]
The information processing program 20 shown in FIG. 8 differs from the information processing program 20 described with reference to FIG. 3 in that no information is output from the print image creation unit 222 to the recording medium information acquisition unit 226.
The print image created by the print image creation unit 222 is not output to the recording medium information acquisition unit 226 but is output and stored in the storage unit 200.
The recording medium information acquisition unit 226 reads a print image from the storage unit 200 and acquires recording medium information from the read print image.
As described above, the information created in the print image creation unit 222 has been described as being output to the recording medium information acquisition unit 226 via the storage unit 200, but between other components (for example, the electronic document setting information acquisition unit 220 and Information may be output via the storage unit 200 between the print image creation unit 222 and between the recording medium ID creation unit 224 and the recording medium information acquisition unit 226).

[Second modification]
The information processing program 20 shown in FIG. 9 differs from the information processing program 20 described with reference to FIG. 3 in place of the embedded image generating unit 228 and the first embedded image generating unit 230 and the second embedded image. The difference is that an image creation unit 232 is provided.
The first embedded image creating unit 230 creates an encoded image of the coordinate component indicating the position where the information is to be embedded, using the embedded information stored in the storage unit 200, and issues a print instruction as the first embedded image The data is output to the transmission unit 202.
The second embedded image creating unit 232 creates an encoded image of the recording medium ID using the recording medium ID created by the recording medium ID creating unit 224, and a print instruction transmitting unit as the second embedded image To 202.
The print instruction transmission unit 202 includes an electronic document stored in the storage unit 200, a print image created by the print image creation unit 222, a first embedded image created by the first embedded image creation unit 230, and Then, a print instruction based on the second embedded image created by the second embedded image creating unit 232 is transmitted to the image forming apparatus 12 via the communication IF 112 in FIG.

[Third Modification]
The information processing program 20 shown in FIG. 10 is different from the information processing program 20 described with reference to FIG. 3 in that information is not output from the print image creation unit 222 to the recording medium information acquisition unit 226. The difference is that a first embedded image generating unit 230 and a second embedded image generating unit 232 are provided instead of the embedded image generating unit 228. That is, the third modification is configured by combining the first modification and the second modification.

[Reader 18]
FIG. 11 is a diagram illustrating a configuration of an electronic pen exemplified as the reading device 18 of FIG.
As illustrated in FIG. 11, the electronic pen includes a writing unit 180, an irradiation unit 182, a writing pressure detection unit 184, an image acquisition unit 186, and a communication unit 188.

The writing unit 180 is a pen tip, for example, and writes on a recording medium.
The irradiation unit 182 is, for example, an infrared LED (Light Emitting Diode), and irradiates the recording medium with light.
The writing pressure detection unit 184 detects the writing pressure transmitted from the writing unit 180.

The image acquisition unit 186 is, for example, an infrared CMOS (Complementary Metal Oxide Semiconductor), and starts detecting light reflected from the recording medium at a timing when the writing pressure detection unit 184 detects the writing pressure. Get the image.
The acquired image is, for example, an image of a stroke indicating a trace of writing by the writing unit 180, or an embedded image (here, a recording medium ID) printed based on the print instruction transmitted by the print instruction transmitting unit 202 of FIG. Encoded image and encoded image of coordinate components).

  The communication unit 188 communicates with the information processing apparatus 10 illustrated in FIG. 1 or the like via the communication device 16 illustrated in FIG. 1, and uses the image acquired by the image acquisition unit 186 as read information read by the reading device 18. It transmits to the processing apparatus 10.

FIG. 12 shows the information processing apparatus 10 shown in FIG. 1 and the like. After the electronic document is created, the information processing program 20 shown in FIG. 3 is executed, and the image forming apparatus 12 shown in FIG. It is a flowchart which shows the processing flow (S10) until this.
Steps 100 to 116 (S100 to 116) in FIG. 12 are processes in the information processing apparatus 10, and step 118 (S118) is a process in the image forming apparatus 12.

As shown in FIG. 12, in step 100 (S100), the storage device 114 in FIG. 2 stores an electronic document created by an operator of the information processing apparatus 10 using an application (including overwriting storage). Here, for example, the order table shown in FIG. 13 is created and stored using Excel. As shown in FIG. 13, it is assumed that only the product name, product code, and unit price are described in the order table.
In step 102 (S102), the input device 108 in FIG. 2 receives an input of an operation for printing the image data of the electronic document stored in step 100.

In step 104 (S104), the electronic document setting information acquisition unit 220 in FIG. 3 acquires electronic document setting information from the electronic document stored in step 100.
In step 106 (S106), the print image creation unit 222 of FIG. 3 converts the reference information stored in the storage unit 200, the print operation received in step 102, and the electronic document setting information acquired in step 104. Based on this, a print image is created.

In step 108 (S108), the recording medium ID creation unit 224 in FIG. 3 creates a recording medium ID based on the printing operation accepted in step 102.
In step 110 (S110), the recording medium information acquisition unit 226 in FIG. 3 acquires recording medium information from the print image created in step 106.

In step 112 (S112), the storage device 114 or the like associates the electronic document setting information acquired in step 104 with the recording medium information acquired in step 110 by the recording medium ID generated in step 108. Remember.
In step 114 (S114), the embedded image creating unit 228 in FIG. 3 uses the embedding information stored in the storage unit 200 and the recording medium ID created in step 108 to create an embedded image to be embedded in the recording medium. create.
In addition, although it has been described that the process of step 114 is performed after the process of step 112, the process of step 112 may be performed after the process of step 114.

In step 116 (S116), the print instruction transmission unit 202 in FIG. 3 prints instructions based on the electronic document stored in step 100, the print image created in step 106, and the embedded image created in step 114. Is transmitted to the image forming apparatus 12.
In step 118 (S118), the image forming apparatus 12 prints the image data of the electronic document based on the print instruction transmitted in step 116.
Although it has been described that the embedded image is embedded in the image data of the electronic document and the image data of the electronic document is printed after the print instruction is transmitted in step 116, as described above, step 102 In step 116, the image data of the electronic document may be printed and then the embedded image may be overprinted. In step 116, the print instruction is transmitted. While the image data is being printed, the embedded image may be printed in an overlapping manner.

Hereinafter, the flow of processing when the modified example of the information processing program 20 described with reference to FIGS. 8 to 10 is executed will be described.
FIG. 14 is a flowchart showing a processing flow when the first modification (FIG. 8) of the information processing program 20 is executed, and FIG. 15 is a second modification (FIG. 9) of the information processing program 20. FIG. 16 is a flowchart showing a processing flow (S10) when the third modification (FIG. 10) of the information processing program 20 is executed. is there.
Hereinafter, in describing the processing flow when each modification is executed, only the points different from the processing flow (FIG. 12) when the information processing program 20 of FIG. 3 is executed will be described. The description about is omitted.

[First modification]
The processing flow shown in FIG. 14 differs from the processing flow of FIG. 12 in that steps 120 and 122 are provided instead of steps 106 and 110.
In step 120 (S120), the print image creation unit 222 in FIG. 8 performs the reference information stored in the storage unit 200 in FIG. 8, the print operation accepted in step 102, and the electronic document setting acquired in step 104. A print image is created based on the information and stored in the storage unit 200.
In step 122 (S122), the recording medium information acquisition unit 226 in FIG. 8 reads a print image from the storage unit 200, and acquires recording medium information from the read print image.

[Second modification]
The processing flow shown in FIG. 15 is different from the processing flow of FIG. 12 in that steps 124 and 126 are provided instead of step 114, and step 128 is provided instead of step 116.
In step 124 (S124), the first embedded image creating unit 230 in FIG. 9 uses the embedded information stored in the storage unit 200 in FIG. Is output to the print instruction transmission unit 202 of FIG. 9 as a first embedded image.
In step 126 (S126), the second embedded image creation unit 232 of FIG. 9 creates an encoded image of the recording medium ID using the recording medium ID created in step 108, and performs the second embedding. The image is output to the print instruction transmission unit 202 as an image.
In step 128 (S128), the print instruction transmission unit 202 prints the electronic document stored in step 100, the print image created in step 106, the first embedded image created in step 124, and in step 126. A print instruction based on the created second embedded image is transmitted to the image forming apparatus 12.

[Third Modification]
The processing flow shown in FIG. 16 is different from the processing flow of FIG. 12 in that steps 120 and 122 are present instead of steps 106 and 110, steps 124 and 126 are present instead of step 114, and steps 116 are replaced. Is different in that there is a step 128. That is, the processing flow shown in FIG. 16 is a processing flow in which the processing flow in FIG. 14 and the processing flow in FIG. 15 are combined.

17 shows that the image processing program 20 in FIG. 3 is executed after the image on the recording medium is recognized by the reading device 18 in FIG. 1 and the like, and the information processing device 10 in FIG. 5 is a flowchart showing a processing flow (S20) until is reflected in an electronic document.
As a premise of this processing flow, it is assumed that writing is performed on a recording medium on which image data of an electronic document is printed in step 118 of FIG. For example, as shown in FIG. 18A, it is assumed that a numerical value representing a quantity is written by hand on a recording medium on which the order table shown in FIG. 13 is printed.
Step 200 in FIG. 17 is processing in the reading device 18, and steps 202 and 204 are processing in the information processing device 10.

As shown in FIG. 17, in step 200 (S200), the reading device 18 irradiates light to a recording medium written by handwriting, so that the stroke image, the encoded image of the recording medium ID, and the coordinate component are recorded. The encoded image is read and transmitted to the information processing apparatus 10.
In step 202 (S202), the read information recognition unit 206 in FIG. 3 recognizes the read information transmitted in step 200 as a character code, a recording medium ID, and a coordinate component.
In step 204 (S204), the electronic document update unit 208 in FIG. 3 corresponds to the recording medium ID and coordinate components recognized in step 202, such as the numbers and alphabets to which the character codes recognized in step 202 are assigned. Enter the cell to be attached.
For example, as shown in FIG. 18B, the quantity written by handwriting is reflected in the order table shown in FIG.
In the order table of FIG. 18B, the consumption tax is determined as shown in FIG. 18C by setting a mathematical expression (5% of the unit price multiplied by the quantity) in the “consumption tax” column. Further, by setting the mathematical formula (105% of the unit price multiplied by the quantity) in the “Amount” column, the amount is obtained as shown in FIG. 18C. By setting the function (SUM function for summing consumption tax and amount) in the 'subtotal' row, a subtotal is obtained as shown in FIG. 18C.

As described above, when an operation of printing an electronic document created by an operator of the information processing apparatus 10 is accepted, electronic document setting information that is information set when the electronic document is created, and an image of the electronic document A print image showing an electronic document displayed on a display or the like and an image on which image data of the electronic document is printed by associating and storing the recording medium information indicating the state of the recording medium when the data is printed Even if they do not match, they can be associated.
Furthermore, the image data of the electronic document was printed by embedding the image obtained by encoding the recording medium ID for identifying the recording medium or the image obtained by encoding the coordinate component of the position where the information is embedded into the recording medium. Even when the print image indicating the image and the image data of the electronic document printed by the image forming apparatus 12 do not match, they can be associated with each other.

As described above, the electronic document displayed on the display, the print image indicating the image on which the image data of the electronic document is printed, and the image data of the electronic document printed by the image forming apparatus 12 are associated with each other, thereby Writing to the recording medium on which the image data of the document is printed can be reflected in the original electronic document.
When an electronic document displayed on a display or the like does not match a printed image showing an image printed with image data of the electronic document (or a printed image showing an image printed with image data of the electronic document and image formation) The case where the image data of the electronic document printed by the device 12 does not match is, for example, the case where the character string of the electronic document displayed in one row on the display is displayed in two rows in the print preview (or In the print preview, the character string of the electronic document displayed in one row is printed in two rows).

DESCRIPTION OF SYMBOLS 1 Information processing system 10 Information processing apparatus 12 Image forming apparatus 14 Network 16 Communication apparatus 18 Reading apparatus 180 Writing part 182 Irradiation part 184 Writing pressure detection part 186 Image acquisition part 188 Communication part 20 Information processing program 200 Storage part 202 Print instruction transmission part 204 Reading Information Receiving Unit 206 Reading Information Recognizing Unit 208 Electronic Document Updating Unit 22 Print Instruction Creating Unit 220 Electronic Document Setting Information Obtaining Unit 222 Print Image Creating Unit 224 Recording Medium ID Creating Unit 226 Recording Medium Information Obtaining Unit 228 Embedded Image Creating Unit

Claims (7)

Electronic document setting information acquisition means for acquiring electronic document setting information including information that can identify a specific area included in the electronic document;
Recording medium information acquisition means for acquiring recording medium information indicating a state of the recording medium including information indicating a predetermined position on the recording medium when image data of the electronic document is printed;
Association means for associating the electronic document setting information acquired by the electronic document setting information acquisition means with the recording medium information acquired by the recording medium information acquisition means by information that can identify the specific area ;
Embedding means for embedding information capable of identifying the specific area included in the electronic document and information capable of identifying the recording medium on which the image data of the electronic document is printed in the image data of the electronic document to be printed When,
An information processing apparatus. The association means obtains the electronic document setting information by combining information that can identify the specific area included in the electronic document and information that can identify a recording medium on which image data of the electronic document is printed. The information processing apparatus according to claim 1, wherein the electronic document setting information acquired by the means is associated with the recording medium information created by the recording medium information acquisition means. Electronic document setting information acquisition means for acquiring electronic document setting information including information that can identify a specific area included in the electronic document;
Recording medium information acquisition means for acquiring recording medium information indicating a state of the recording medium including information indicating a predetermined position on the recording medium when image data of the electronic document is printed;
Association means for associating the electronic document setting information acquired by the electronic document setting information acquisition means with the recording medium information acquired by the recording medium information acquisition means by information that can identify the specific area;
Print image creation means for creating a print image indicating an image on which image data of an electronic document is printed ;
I have a,
The recording medium information acquiring unit, from the print image created by the print image-forming device, information processing apparatus you get the recording medium information. The embedding unit prints on the recording medium image data in which information that can identify the specific area included in the electronic document and information that can identify the recording medium on which the image data of the electronic document is printed are embedded. Printing means;
When writing is performed on the recording medium on which the image data is printed by the printing unit, writing to the recording medium from the recording medium, information that can identify the specific area included in the electronic document, and the electronic document Reading means for reading information capable of identifying a recording medium on which image data is printed;
Writing to the recording medium read by the reading unit identifies information that can identify the specific area included in the electronic document read by the reading unit and a recording medium on which image data of the electronic document is printed The information processing apparatus according to claim 1 , further comprising: an updating unit configured to update the electronic document setting information associated with possible information to be reflected in the set electronic document. The printing means has information that can identify the specific area included in the electronic document and information that can identify the recording medium on which the image data of the electronic document is printed on the recording medium on which the image data of the electronic document is printed. Print further image data indicating
The information processing apparatus according to claim 4 . The printing means includes information that can identify the specific area included in the electronic document while printing the image data of the electronic document, and information that can identify a recording medium on which the image data of the electronic document is printed. Print the image data shown
The information processing apparatus according to claim 4 . In an information processing apparatus including a computer,
Obtaining electronic document setting information including information that can identify a specific area included in the electronic document;
Acquiring recording medium information indicating a state of the recording medium including information indicating a predetermined position on the recording medium when the image data of the electronic document is printed;
Associating the acquired electronic document setting information and the acquired recording medium information with information capable of identifying the specific area ;
Embedding information capable of identifying the specific area included in the electronic document and information capable of identifying the recording medium on which the image data of the electronic document is printed in the image data of the electronic document to be printed;
A program for causing the computer to execute.

Images