JP4738978B2 - WRITING INFORMATION PROCESSING SYSTEM, WRITING INFORMATION PROCESSING METHOD, AND PROGRAM - Google Patents

Description

  The present invention relates to a writing information processing system, a writing information processing method, and a program for processing a paper document and writing information handwritten on the paper document.

While the digitization of business is progressing and the number of electronic documents in circulation is increasing, the quality of displays such as CRT and LCD is still inferior to printing on paper. Opportunities to print on paper as paper documents are increasing. In order to effectively use the handwriting work performed on these paper documents, means for digitizing written information is required. However, the handwriting input devices currently used are low in functionality and are easy to use. It ’s bad.
For example, there are devices called tablets and digitizers that use a plate-shaped sensor and a pen-type device to input handwriting to a computer, but these devices simply acquire handwritten mark information. In order to reflect the handwritten work on the paper document on the electronic document, a problem occurs. For example, when writing an electronic document on printed paper, it is impossible to reflect the written content on the original electronic document. Even if a scanner device is used, a paper document can be converted into an electronic document. However, in this case as well, there is a problem in reflecting the handwriting operation on the paper document in the electronic document. For example, if a paper document printed with an electronic document is digitized again with a scanner, an image document is only created as another electronic document, even though the original electronic document created with word processing software exists. It is impossible to insert written information into the original electronic document.
These conventional devices only have the function of acquiring the writing coordinates or the function of acquiring the image, cannot identify what the original electronic document printed on the paper is, and the acquired writing coordinates The above-mentioned problem has occurred because the electronic document into which is inserted is unknown.
In order to solve these problems, a writing information input device has been proposed in which document identification information for specifying an original electronic document is printed on a sheet, and an electronic document that is a source of a handwritten paper document can be specified. (For example, refer to Patent Document 1). First, when printing an electronically created document, document identification information for specifying the original electronic document is simultaneously printed with a pattern such as a barcode that can be easily identified by a machine. Here, the document identification information is information indicating the storage location, file name, page number, etc. of the original electronic file printed on the paper document, or information for managing them. For example, “// C: \ MyDocument \ Tmp.doc, pp1 ". When handwritten on a printed paper document, document identification information is acquired together with coordinate information such as handwritten characters.
To reflect handwritten characters, etc. in an electronic document, identify the electronic document printed by handwritten paper document according to the document identification information, and insert the handwritten content into the appropriate electronic document Is possible. In addition, the writing information input device can load and install a plurality of paper documents, and can automatically identify the document identification information while turning the handwritten information applied to a large amount of paper documents. It is possible to appropriately reflect the result in the electronic document and more efficiently carry out the work by using the electronic document and the paper document mutually.

  FIG. 1 shows an overall configuration diagram of a writing information processing system. According to the overall configuration diagram of the writing information processing system, a form creation PC 101, a printing apparatus 102, a form processing PC 103, a scanner 105, a digital PAD (hereinafter referred to as D-PAD) 104, and a photographing apparatus 99 are provided. Are connected to the data server 106 via the network 107.

  The form creation PC 101 creates a form for printing on paper. The printing apparatus 102 prints a form on paper. The form processing PC 103 performs processing related to data written from a written paper document according to the form of the form. The scanner 105 reads a written form as an image. The D-PAD 104 acquires coordinates of characters and the like handwritten over time, and as a result, acquires handwritten information handwritten on a form. The imaging device 99 captures a written form with an area camera such as a CCD camera and acquires it as an image.

It should be noted that a form read as an image by the scanner 105 or the photographing device 99 is represented as a scan image and handwritten coordinates acquired by the D-Pad 104 as stroke data, and when these are collectively referred to as writing information, the scanner 105, the D-Pad 104, and The photographing device 99 is collectively referred to as a writing information input device. The data server 106 is a database for form processing.
In the following description, the form creation PC 101 and the printing apparatus 102 are combined into a form creation apparatus 108, the form processing PC 103 and the scanner 105, the D-PAD 104, and the photographing apparatus 99 are combined into a form processing apparatus 109 and a data server 106. Sometimes expressed as a storage device 100.
JP 2005-122682 A

By the way, various types of writing information input devices for acquiring writing information and paper ID information are considered, and examples include a scanner, a D-Pad, and a photographing device.
Here, let us consider a case where information is acquired using a different information acquisition device for a form having the same paper ID. For example, when information is acquired with the D-Pad 104, if the D-Pad 104 is depleted or the D-Pad 104 is damaged without being noticed, it will be written with a pen or the like. Despite being handwritten, a part of the written information acquired because the D-Pad 104 does not perform the original operation may be lost. In such a case, paper ID information and writing information can be acquired by acquiring a form written with a pen or the like as a scan image using the scanner 105 or the photographing apparatus 99 again.
Here, a part of the writing information obtained from the D-PAD 104 and the scanner 105 is different. First, it is possible and necessary to acquire writing information and paper ID information in any information acquisition apparatus. On the other hand, examples of acquired information different for each device include the following.
In D-Pad 104, writing information is acquired for each stroke. When the D-Pad 104 includes a clock for driving the apparatus, it is possible to measure and save the writing information acquisition time for each writing information acquisition for each stroke.
Similarly, the paper ID information acquisition time can be measured and stored when the paper ID information is acquired. On the other hand, the scanner 105 and the imaging device 99 acquire an image of the entire paper form at a time, and it is difficult to measure the information acquisition time for each stroke and paper ID. Therefore, it is difficult to completely supplement information that could not be acquired by the D-Pad 104 using the scanner 105.
The D-Pad 104 is a device that acquires writing information with a dedicated writing instrument, and it is difficult to acquire information written with a general-purpose stationery. For example, a form may be stamped or attached to a slip on a daily basis, but it is difficult to obtain such writing information and attached documents with the D-Pad 104. On the other hand, since the scanner 105 and the photographing device 99 are devices that acquire and process an image of the entire form, it is possible to acquire the above-mentioned stamps and attached documents.
In addition, even when the writing information is appropriately acquired by the D-Pad 104 and the scanner 105 or the imaging device 99, the characteristics of the writing information obtained by the respective devices are different. As described above, the writing information obtained by the D-Pad 104 is time-series coordinate information, and the writing information obtained by the scanner 105 or the imaging device 99 is image information. It is known that when the writing information having such different personalities is acquired from the same paper document, for example, the recognition rate of character recognition is improved.
In view of such a problem, the present invention provides a writing information processing system, a writing information processing method, and a program for processing writing information handwritten on a paper document, and writing information that can be processed by acquiring writing information from different writing information acquisition devices. It is an object to provide a processing system, a writing information processing method, and a program.

  In order to solve the above problem, the present invention includes an ID encoding unit that encodes a paper ID for identifying paper, an ID granting unit that associates a document ID that identifies an electronic document and the paper ID, and grants the paper to the paper. A printing means for printing the encoded paper ID created by the ID encoding means on paper, an ID management means for managing the document ID associated with the paper ID, and the encoded paper ID is given, and the handwriting is handwritten Information acquisition means for acquiring the encoded paper ID and writing information from the printed paper, ID decoding means for decoding the encoded paper ID acquired by the information acquisition means, and information acquired by the information acquisition means And a processing ID management means for associating a processing ID indicating processing performed with the paper ID. If the writing information acquired by the first information acquisition unit and the writing information acquired by the second information acquisition unit and the writing information compared by the comparison unit are equal, And writing information combining means for combining the writing information acquired by the information acquisition means and the writing information acquired by the second information acquisition means.

  According to the present invention, it is possible to provide a writing information processing system capable of complementing and processing each other's information by acquiring writing information handwritten on a paper document as different writing information from different writing information acquisition devices.

  The present invention also provides an ID encoding unit that encodes a paper ID for identifying paper, an ID adding unit that associates a document ID for identifying an electronic document with the paper ID, and assigns the paper to the paper, and an ID encoding unit. Printing means for printing the encoded paper ID created on the paper, ID management means for managing the document ID associated with the paper ID, and the paper on which the encoded paper ID is printed and handwritten Information acquisition means for acquiring encoded paper ID and writing information, ID decoding means for decoding encoded paper ID acquired by the information acquisition means, and writing information acquired by the information acquisition means A writing information processing system comprising: a process ID management unit that associates a process ID indicating a process with a paper ID. If the comparison unit that compares the paper ID acquired by the first information acquisition unit and the paper ID acquired by the second information acquisition unit matches the paper ID compared by the comparison unit, the first information And writing information synthesizing means for synthesizing the writing information acquired by the acquiring means and the writing information acquired by the second information acquiring means.

  According to the present invention, it is possible to provide a writing information processing system capable of processing writing information handwritten on a paper document as different writing information from different writing information acquisition devices and complementing each other's writing information.

  In one embodiment of the present invention, the first or second information acquisition means includes additional information acquisition means for acquiring additional information when writing information or paper ID is acquired, and the writing information composition means is writing information. In the case of synthesizing, the additional information is synthesized with the writing information.

  According to the present invention, since not only writing information but also additional information can be synthesized, the acquired writing information can be used in more detail.

  In one embodiment of the present invention, the additional information is a time when the encoded paper ID is acquired.

  According to the present invention, it is possible to complement each other's writing information and combine the time when the paper ID is acquired, so that the acquired writing information can be used in more detail.

  In one embodiment of the present invention, the additional information is a time when the writing is handwritten.

  According to the present invention, the handwritten time can be synthesized while complementing each other's writing information, so that the acquired writing information can be used in more detail.

  In one embodiment of the present invention, the additional information is position information indicating a position where the encoded paper ID is acquired.

  According to the present invention, since the mutual writing information is complemented and the position information indicating the handwritten position can be synthesized, the acquired writing information can be used in more detail.

  In one embodiment of the present invention, when the writing information synthesizing unit synthesizes the writing information, an input as to whether to synthesize the writing information is requested.

  According to the present invention, the reliability of the writing information processing system can be improved by asking whether or not the composition is possible.

It is possible to provide a writing information processing system, a writing information processing method, and a program capable of acquiring and processing writing information handwritten on a paper document from different writing information acquisition devices.

[Outline]
An outline of the writing information processing system of the present invention will be described. The configuration diagram of the writing information processing system is the same as FIG. That is, a form creation PC 101, a printing apparatus 102, a form processing PC 103, a scanner 105, a digital PAD (hereinafter referred to as D-PAD) 104, a photographing apparatus 99, and a data server 106 are connected via a network 107. Connected.

  In the writing information processing system of the present invention, a plurality of writing information acquisition means such as different scanners 105 for acquiring writing information handwritten on a paper document and paper ID information assigned to the paper document can be used.

  In the following, the writing information acquired by the D-PAD 104 is stroke data that is a coordinate point of the pen, and the writing information acquired from the scanner 105 or the imaging device 99 is a scan image as image data, but is particularly distinguished. If there is no need, it is called written information.

The writing information processing system of the present embodiment includes an information comparison device that compares writing information obtained from each device, and an information synthesis device that synthesizes the writing information. Here, each of the information comparison device and the information synthesis device can be configured as a single device, or can be configured as a program on a computer. In the present invention, it is considered that there are many cases in which a form creation PC and a form processing PC already exist. Therefore, it is efficient that the information comparison apparatus and the information synthesis apparatus exist as programs.
First, the D-PAD 104 and the scanner 105 acquire writing information from a form to which the same paper ID is assigned. Next, the writing information obtained from each device is compared, and if they match, each writing information is synthesized.

  When comparing writing information, paper ID information or writing information is used as writing information included in each. When comparing using the paper ID information, it is compared whether or not the paper IDs match. When comparing using writing information, the writing position and shape of each writing information are compared and it is determined whether it can be judged that it corresponds. The information to be combined is supplementary information such as paper ID information, writing information and other paper ID acquisition time, writing time, or position information included in each writing information.

[Hardware configuration]
Next, the hardware configuration of the form creation PC 101, form processing PC 103, and data server 106 (hereinafter simply referred to as a PC) will be described with reference to FIG. The hardware configuration diagram of FIG. 2 includes an input device 31, a display device 32, a drive device 33, a recording medium 34, an auxiliary storage device 35, a memory device 36, and The CPU 37 and the interface device 38 are included.

  The input device 31 includes a keyboard and a mouse operated by a user of the PC, and is used to input various operation signals to the PC. The display device 32 displays various windows and data necessary for operating the PC. The interface device 38 is an interface for connecting a PC to a network, and includes, for example, a NIC (Network Interface Card) or a modem.

  A program for operating the PC is provided by a recording medium 34 such as a CD-ROM, a DVD-ROM, or a memory card, or downloaded through a network. The recording medium 34 is set in the drive device 33, and data and programs are installed from the recording medium 34 to the auxiliary storage device 35 via the drive device 33.

  The auxiliary storage device 35 that is a storage stores data and programs, and stores necessary files and the like. The memory device 36 reads the program from the auxiliary storage device 35 and stores it when the PC is activated. The CPU 37 executes processing according to the program read and stored in the memory device 36.

  Each means for causing the CPU 37 to function as the writing information processing system of the present embodiment is stored in the auxiliary storage device 35 as a program. For example, a program that causes the PC of the form creation device 108 to function as the ID assigning unit 121, the ID management unit 122, and the ID encoding unit 126 is installed in the auxiliary storage device 35. A program that causes the form processing PC 109 to function as the ID decoding unit 126, the writing information processing unit 130, the document ID acquisition unit 131, the comparison unit 132, and the writing information synthesis unit 133 is installed in the auxiliary storage device 35. A program that causes the PC of the storage device 100 to function as the layout management unit 129 is installed in the auxiliary storage device 35.

[Relationship between each means to realize the writing information processing system, paper document, and paper ID]
FIG. 3 is a diagram showing the relationship between each means, paper document, and paper ID of the writing information processing system realized by the PC executing the program. FIG. 3 shows the relationship between the user, the external processing program 111 and the storage 134 described later.

The user uses a writing information input system. The external processing program 111 is a program that performs a predetermined operation based on written content, and this program is prepared in advance. The storage 112 is a storage device that stores writing information and the like, and includes, for example, the hard disk, the MO drive, and the semiconductor disk.
Next, each means will be described. The ID assigning unit 121 assigns and prints a paper ID 127 on the paper, and associates the document ID and the processing ID with the paper ID.

The paper ID is uniquely assigned to each paper, and all the paper IDs are basically different IDs. Alternatively, when printing a plurality of the same pages of the same document, the paper IDs of a plurality of sheets may be the same.
The ID management unit 122 manages the paper ID. The paper document 123 is a paper printed with a paper ID, and the user writes on the paper document 123. The information acquisition unit 124 acquires writing information and a paper ID from paper. There is at least one information acquisition unit 124. The ID encoding unit 126 encodes the paper ID. The ID encoding means 125 decodes the paper ID. The process ID management unit 128 associates the process ID with the external process program 111 and manages the process ID.

The process ID is an ID assigned to a process for writing information input by the writing information processing system. The document ID is an ID assigned to an electronic document and may be expressed as an original document ID.
The layout management means 129 edits and manages form layout information and processing methods. The writing information processing means 130 decomposes and stores writing information into writing information from form layout information and processing methods. The document ID acquisition unit 131 converts a paper ID into a document ID and a processing method.
The comparison unit 132 is a comparison device that compares information obtained from a plurality of information acquisition units 124. The written information synthesizing means 133 is an information synthesizing device that synthesizes information according to the information comparison result.

  When these configurations are adapted to the overall configuration diagram of FIG. 1, the ID assigning unit 121, the ID management unit 122, and the ID encoding unit 125 are mounted on the form creation device 108, and the layout management unit 129 is mounted on the storage device 100. The information acquisition unit 124 includes a D-PAD 104, a scanner 105, a photographing device 99, an ID decoding unit 126, a writing information processing unit 130, a document ID acquisition unit 131, a comparison unit 132, and a writing information combining unit 133 mounted on the form processing PC 109. ing. Note that the overall configuration of the writing information processing system described above is merely an example, and it is only necessary to include each unit described in FIG. 3, and it is a matter of design on which PC each unit is executed.

  As described above, each unit in FIG. 3 may be realized by either software or hardware, but can be executed by a general-purpose computer and can be configured by software because it is easy to upgrade. Preferred.

[Details of Written Information Processing System]
Subsequently, processing of the writing information processing system will be described in detail. First, the external processing program 111 and the writing information processing system will be described. Since the interface between the external processing program 111 and the writing information processing system is predetermined, the external processing program 111 corresponding to the interface is created.

  The external processing program 111 created in this way can be classified into two types. One is an external processing program 111 that performs atypical processing for processing the writing information itself, and the other is writing information. This is an external processing program 111 that decomposes data according to a paper form and performs standard processing on the data.

  Here, the standard processing is called so-called form processing, which is provided with a pre-filled column in a paper document, and processing for the written information is determined depending on where it is written. . For example, anything entered in the address field is treated as an address. In other words, the processing is determined by the place of writing.

  Here, the atypical process means a process other than the above-described standard process.

  In the present embodiment, in the atypical process, writing information is stored as a data file in a predetermined folder of the storage 134. The external processing program 111 that performs atypical processing is a program that periodically monitors this folder and database, acquires a new file if it is created, and processes the new file.

  Alternatively, it may be a program that uses an OS (Operating System) that generates an event when a new file is stored in a folder or database, and performs processing by catching this event.

  As an example of the external processing program 111 that performs such atypical processing, writing information is superimposed on an original electronic document corresponding to a written paper document, and an e-mail is sent to a predetermined person as an attached file. And so on.

  Next, in the present embodiment, since data such as writing information is stored in a predetermined database in this embodiment, an external processing program that performs the routine processing periodically monitors the database to create new data. If so, it is created as a program that acquires and processes it.

  Alternatively, the external processing program may be created as a program that uses a database that generates an event when new data is registered in the database and performs processing by catching this event. Examples of such an external processing program for routine processing include questionnaire processing.

  Note that both the external processing program 111 that performs non-standard processing and the external processing program 111 that performs standard processing are not necessarily required, and at least one of them may be used for performing some processing.

  Further, in the following description, the external processing program 111 that performs atypical processing is referred to as an atypical processing program, and the external processing program 111 that performs standard processing is referred to as a standard processing program.

  The external processing program described above is registered in the writing information processing system to be associated with the writing information processing system.

  First, details of a module for registering an atypical processing program are described in the processing ID management means 128. Processing information is registered using this module.

  The processing information represents an interface method between the writing information input system and the atypical processing program 111, and is, for example, a folder name in which data is stored. The data format at this time is determined in advance.

  Further, as will be described later, since it is necessary to select which external processing program 111 is to be activated at the time of printing, explanations necessary for that purpose are also registered. By registering, the process ID management unit 128 automatically assigns a process ID, and the process ID is reused as described later.

  Next, the standard processing will be described. In order to perform fixed processing, you must first design a form for the form. Details of the module for that purpose are described in the layout management means 129. This is for editing and registering layout information and processing information in the form input field. In this embodiment, the routine process is registered in advance with a process ID of 0.

  The layout information here represents the position and data type of the input field on paper, for example, and the processing information is assumed to be the content of which input field is registered in which database and whether to perform character recognition. For example, it indicates what the character type is.

  A user who uses the writing information input system first prints a paper document. For this purpose, an electronic document to be printed is first printed using the ID assigning means 121. This document is stored as a file, and the file name includes an extension that is typically used to determine what kind of file the file is.

  Since the document for the standard processing has a specific extension, the standard processing or the non-standard processing is determined depending on the extension of the electronic document to be printed.

  In the case of non-standard processing, when printing is instructed to the module, the module presents information related to the external processing program 111 registered in the processing ID management means 128 to the user, and requests selection of processing performed after writing. The process ID is determined by selecting which process the user performs.

  When the processing ID is determined, the module registers the ID of the electronic document and the processing ID in the ID management unit 122 and acquires the paper ID. Thereafter, the paper ID is assigned to the paper and printing is performed, and a paper with the paper ID, that is, a paper document, is obtained.

  In the case of standard processing, when printing is instructed to the module, unlike the case of non-standard processing, the processing ID is set to 0, so the operator is not required to select processing and ID management is performed. The document ID and processing ID of the electronic document are registered in the means 122, and the paper ID is acquired. After that, as before, printing is performed and a paper document is obtained.

  Through the above processing, the processing to be performed is associated with the paper document, the corresponding electronic document, and the writing information. In other words, a paper ID is attached to the paper, and a document ID and a processing ID are associated with the paper. When writing on a paper document, which paper is written and what processing is performed after writing It is registered in the system.

  Next, the operation after writing on a paper document will be described. The user writes on the created paper document, and inputs the paper document as scan data using the scanner device 105 or a scanner unit of, for example, an MFP (Multi Function Printer). As a result, the paper ID is acquired by the ID encoding means 125 of the scanner device 105. These paper ID and scan data are sent to the document ID acquisition means 131.

Alternatively, the user places a paper document on the D-PAD 104 and performs writing. Then, the paper ID is acquired by the D-PAD 104 by the writing information and the ID encoding means 125 included in the D-PAD 104. These paper ID and writing information are sent to the document ID acquisition means 131.
A case where the scanner 105 or the imaging device 99 and the D-PAD 104 are used together as the information acquisition unit 124 will be described. First, in the same manner as described above, a form or the like, which is a paper document assigned with a paper ID, is placed on the D-PAD 104 and written. Then, the D-PAD 104 acquires the writing information as coordinate data, and the paper ID is acquired by the ID encoding means 125 of the D-PAD 104. These paper ID and writing information are sent to the comparison means 132.
Next, a form or the like which is a paper document to which the same paper ID is assigned is input as image data using the scanner 105 or, for example, a scanner unit of an MFP (Multi Function Printer). As a result, the paper ID is acquired by the ID decoding means of the scanner 105. These paper ID and scan image are sent to the comparison means 132.
Next, the comparison unit 132 compares the paper IDs obtained from the D-PAD 104 and the scanner 105 and, if they match, sends the paper ID and writing information to the writing information combining unit 133. The writing information combining means 133 combines the sent paper ID and writing information. The synthesized paper ID and writing information are sent to the document ID acquisition unit 131.
When comparing paper ID or writing information, paper ID information and writing information are used as information included in each information. When comparing using the paper ID information, it is determined whether or not the paper IDs match. When comparing using writing information, the writing position and shape of each writing information are compared and it is judged whether it corresponds.

  The information to be combined is paper ID information, writing information, and other information included in each information.

  The document ID acquisition unit 131 specifies the document ID and the processing ID by inquiring of the ID management unit 122 based on the acquired paper ID. This identification is possible because the electronic document ID and the processing ID are registered by the ID management unit 122 and the paper ID is acquired.

  Next, the document ID acquisition unit 131 can obtain the folder in which the writing information is stored from the processing ID by inquiring the processing ID management unit 128, and the document ID and the scan image are stored together there.

  Next, a case where the process ID is 0 will be described. When the process ID is 0, the standard process is performed. First, the document ID and the scan image are passed to the writing information processing means 130. The handwritten information processing unit 130 makes an inquiry to the layout management unit 129 to obtain form layout information and processing information from the document ID. Information to be processed here is data storage destination, character recognition / mark recognition of writing information, and the like.

  Therefore, first, based on the layout information, the scan image is decomposed into input fields as fields, and when the scanner device 105 is used, the image data obtained by rasterizing the electronic document is compared with the scan image of the written paper document. As a result, image data of only writing information is obtained.

  When the D-PAD 104 is used, the written coordinate string (stroke data) is obtained as it is, so that character recognition or mark recognition is performed according to the processing information, and the result is stored in the database.

  The above is a detailed description of a series of writing information processing. Next, details of each means in FIG. 3 will be described.

ID giving means 121
First, the ID assigning unit 121 will be described. In the description of the ID assigning means 121, five embodiments will be described. First, the first embodiment will be described with reference to FIG.

  The flowchart shown in FIG. 4 shows processing when a document is independently printed on a stand-alone PC without using a network.

  First, in step S101, the layout editor is activated to display the created electronic document. This layout editor can browse / select process IDs, obtain paper IDs, and display / edit / print electronic documents. Specifically, the ID management unit 122, the ID encoding unit 125, the processing ID management unit 128, the “form creation program” of the layout management unit 129 in the case of a standard document, and the word processor software in the case of an atypical document are linked. The above functions are realized. In step S102, the electronic document is edited as necessary.

  In the next step S103, when the user makes a print request, the standard document / non-standard document is discriminated based on the extension of the electronic document as described above. In the case of the non-standard process, it is registered in the process ID management unit 128. Information related to the external processing program is presented to the user, and the processing ID of processing performed after writing is determined. In the case of the standard processing, when the printing instruction is given, unlike the case of the non-standard processing, the processing ID is set to 0, so that the user is not prompted to select the processing.

  In the next step S104, the paper ID is acquired. In step S105, the paper ID is encoded into a two-dimensional code, and in step S106, the two-dimensional code is pasted at a predetermined position in the electronic document. In step S107, the electronic document is printed.

  The ID management means 122 is used to acquire the paper ID in this processing, and the paper ID is associated with each page of the electronic document and the processing ID, and the management database is used for these. The ID encoding means 125 generates a two-dimensional code from the paper ID after acquiring the paper ID.

  The created two-dimensional code is superimposed at a designated position in the electronic document when a superimposition position is designated, and is superposed at a predetermined position in a predetermined electronic document when no superposition position is designated. . A series of flow from obtaining the ID to inserting the two-dimensional code into the document is automatically performed when the user executes printing with word processing software. Alternatively, it is prepared in a menu and the user explicitly executes it at an arbitrary time.

  For this purpose, if the word processing software has a macro function, it can be realized by using the macro function. In this case, if the ID management means 122 and the paper ID are software modules, and if the format is Windows (registered trademark) COM, these modules can be called from the macro function, and the AddPicture method of the module called WordObjectLibrary can be called. If used, the image can be inserted at an arbitrary position in the electronic document. In this way, a paper document is printed.

  Step S104 corresponds to a paper ID management step, a processed paper ID management step, a document paper ID related step, and a paper ID provision step. When acquiring the paper ID in this step S104, first, the ID management means 122 is used. At this time, the ID management means 122 also manages the paper ID. Further, the process ID is associated with the paper ID, and the document ID is associated with the paper ID. Step S105 corresponds to an encoding step. Step S107 corresponds to a printing step.

  Next, a second embodiment will be described with reference to FIG. FIG. 5 is a flowchart showing a process when printing is performed by the print service after a document is created / edited. First, in step S201, the user creates an electronic document. Each component (object) and its characteristics are described in this electronic document.

  In step S202, the user activates / displays / modifies the layout editor as necessary. In the next step S203, processing ID selection / paper ID acquisition is performed using the function of the layout editor. In this process, the process ID management unit 128 is used to select a process ID, and the ID management unit 122 is used to acquire a paper ID. The paper ID is associated with each page of the electronic document, and the process ID. A database that manages them is used. The process ID is selected only for an atypical document. In the case of a standard process, the process ID is set to 0, and the user is not prompted to select a process.

  In step S204, the ID encoding unit 125 creates a two-dimensional code from the paper ID. In step S205, the created two-dimensional code is displayed at a designated position in the electronic document when the superimposition position is designated, or at a predetermined position in the electronic document that is predetermined when the superposition position is not designated. Is superimposed on.

  In the next step S206, the created two-dimensional code superimposed electronic document or the storage location of the electronic document is transmitted to the print service using SOAP (Simple Object Access Protocol). When transmitting the storage location of the electronic document, the two-dimensional code superimposed electronic document is stored in a location accessible from the print service.

  In step S207, the process branches depending on whether the transmitted document is an electronic document or an electronic document storage location. In the case of an electronic document, the electronic document is printed in step S209 by the function of the layout editor or viewer.

  When the storage location of the electronic document is transmitted, the electronic document is acquired from the storage location received inside the print service in step S208, and the electronic document is printed in step S209.

  The second embodiment described above enables printing even when a printing environment such as a printer driver is not installed in a PC that performs layout editing.

  Note that the printing service operates on a predetermined PC, and the printing environment installed on the PC is open to other PCs as a service. Can be used to print electronic documents. In other words, an electronic document printing command can be issued even on a PC without a printing environment. Also, since there is no need to edit inside the print service, it is only necessary that a viewer having a print command is installed in the PC on which the print service operates.

  Next, the third embodiment will be described with reference to FIG. FIG. 6 is a flowchart illustrating a process for printing using a print service without editing an electronic document.

  After the user creates an electronic document in step S301, in step S302, the electronic document, the storage location of the electronic document, and the process ID are transmitted to the print service using SOAP. At this time, when transmitting the storage location of the electronic document, the electronic document to be printed is stored in a location accessible from the print service.

  When the electronic document is an atypical document, the process ID to be transmitted is determined by obtaining a list of process IDs by the process ID management unit 128 and prompting the user to select a process ID. In this case, 0 is used as the process ID.

  In step S303, the process branches depending on whether the transmitted document is an electronic document or an electronic document storage location. When the electronic document is transmitted, the process proceeds from step S303 to step S305. When the storage location of the electronic document is transmitted, the process proceeds from step S303 to step S304, and the electronic document is acquired from the storage location received in the print service.

  When the electronic document is acquired or received, in step S305, the PC on which the printing service operates acquires a paper ID. The ID management means 122 is used to acquire the paper ID in this processing, and the database that manages the paper ID and each page of the electronic document and the processing ID is used.

  In the next step S306, the ID encoding means 125 creates a two-dimensional code from the paper ID. In step S307, the created two-dimensional code is displayed at a designated position in the electronic document when the superimposition position is designated, or at a predetermined position in the electronic document that is predetermined when the superposition position is not designated. Is superimposed on.

  In step S308, the electronic image printing image file on which the two-dimensional code is superimposed is printed on paper. Among these, the functions of the layout editor already installed in the PC on which the printing service operates are used for paper ID acquisition, two-dimensional code creation, two-dimensional code pasting, and printing.

  The third embodiment described above enables printing even if an electronic document is created on a PC in which no layout editor is installed. If the print service operates on a predetermined PC and the layout editor is installed only on the PC, the electronic document can be printed using the function. That is, a print command for an electronic document can be issued even on a PC without a layout editor.

  Next, a fourth embodiment will be described with reference to FIG. FIG. 7 is a flowchart illustrating processing for printing using a print service without editing an electronic document.

  In step S401, after the user creates an electronic document, in step S402, the electronic document or the storage location of the electronic document, and in addition, the processing ID is transmitted to the print service using SOAP. At this time, when transmitting the storage location of the electronic document, the electronic document to be printed is stored in a location accessible from the print service. When the electronic document is an atypical document, the process ID to be transmitted is determined by obtaining a list of process IDs by the process ID management unit 128 and prompting the user to select a process ID. In the case of a document, 0 is used as the process ID.

  In step S403, the process branches depending on whether the transmitted document is an electronic document or an electronic document storage location. When the electronic document is transmitted, the process proceeds from step S403 to step S405. If the storage location of the electronic document is transmitted, the electronic document is acquired from the storage location received in the print service in step S404.

  In step S405, the acquired or received electronic document is converted into a print image file by the layout editor or the viewer function in the print service. In the next step S406, the PC on which the print service operates acquires the paper ID. The ID management means 122 is used to acquire the paper ID in this processing, and the database that manages the paper ID and each page of the electronic document and the processing ID is used.

  In the next step S407, the ID encoding unit 125 creates a two-dimensional code from the paper ID. In step S408, the created two-dimensional code is converted into a print image file in the same manner as the electronic document. When the superimposition position is designated, the superposition position is not designated at the designated position in the electronic document. In such a case, the image is superimposed on a predetermined position in a predetermined electronic document. In step S409, an image file for printing an electronic document on which the two-dimensional code is superimposed is printed on paper.

  The fourth embodiment described above enables printing even if an electronic document is created on a PC in which no layout editor is installed. If the print service operates on a predetermined PC and the layout editor is installed only on the PC, the electronic document can be printed using the function.

  In other words, a layout file print command can be issued even on a PC without a layout editor. In addition, since the print service does not edit the electronic document itself but performs an image superimposition operation on the print image file, a viewer having functions such as file output by a print command operates the print service. What is necessary is just to be introduced into PC.

  Further, since the two-dimensional code superimposing operation in the print service is performed on the converted file after being converted into the image file for printing, it can be performed in a unified operation regardless of the format of the original electronic document. Another advantage of the fourth embodiment is that the dimension code data can be superimposed and output to paper.

  Next, a fifth embodiment will be described with reference to FIG. FIG. 8 is a flowchart illustrating processing for printing using the print service. After the user creates and edits the electronic document using the layout editor in step S501, in step S502, a print image or page description language that does not depend on the platform from the document (hereinafter referred to as a print image including the page description language and the like). ). When an existing electronic document is used without being edited, a print image such as a layout viewer is used to create a print image from the electronic document. The print image represents an image of a paper document actually printed on paper.

  In step S503, the print image of the electronic document created in this way is transmitted to the print service using SOAP. At this time, the process ID selected by the user and the document ID indicating the storage destination of the electronic document are transmitted to the print service together. In the PC running the print service, after receiving the print image, the document ID, and the process ID, the paper ID is acquired in step S504. For obtaining the paper ID in this process, the ID management unit 122 is used to associate the paper ID with the electronic document and use a database for managing them.

  In the next step S505, the ID encoding means 125 creates a two-dimensional code from the paper ID. In step S506, the created two-dimensional code is converted according to the format of the print image of the electronic document received earlier, and if the superimposition position is designated, the superposition position is designated at the designated position in the electronic document. If there is no, it is superimposed at a predetermined position in a predetermined electronic document.

  In step S507, an image file for printing an electronic document on which the two-dimensional code is superimposed is printed on paper.

  The fifth embodiment described above enables printing with a two-dimensional code even when the storage destination of the original electronic document is in a place where access from the printing service is not possible. The print service superimposes the two-dimensional code and the electronic document after receiving the print image of the electronic document, but the layout editor does not need to be installed in the PC because the layout editor is not used for this superimposition processing. .

  Further, when printing an existing electronic document that does not need to be edited, the PC that creates the electronic document only needs to be able to issue a print command for the layout file necessary for creating the print image, and the PC has an editing function. There is no need to have a layout editor installed.

  That is, it becomes possible to superimpose a two-dimensional code on an electronic document without using a layout editor for both of the two PCs to exchange. For example, in the case of a PDF file, it is not necessary that an editing application such as Acrobat (registered trademark) of Adobe Corporation be installed on a computer that is a PC for creating an electronic document, and a printing command such as Acrobat (registered trademark) Reader is used. It is sufficient that only applications that can be issued are installed.

ID management means 122
Next, the ID management unit 122 that manages the paper ID will be described. 9 and 10 show examples of management tables used in the ID management means 122 that associates and manages paper IDs and documents.

  The ID management unit 122 receives at least information capable of uniquely specifying an electronic document when a paper ID registration request is made for paper output, and assigns a unique paper ID in the management table to the document information. Is stored in the management table.

  The management table will be described. In FIG. 9 and FIG. 10, each row as a group as shown in the row 145 is a unit of document information corresponding to the registered paper ID, and each column is a registration element of the paper ID.

  The column 141 stores the assigned paper ID. The column 142 stores information (document ID) for uniquely specifying an electronic document. In FIG. 9, a path name is specified as an example of a document ID that uniquely specifies an electronic document. However, when handling up to electronic documents stored in different PCs, as shown in FIG. Or URI (Uniform Resource Identifiers). When a multi-page electronic document is handled, document information exists for each page, and the column 142 includes information on the number of pages. Further, as shown in FIG. 10, when information regarding the number of pages is not stored in the column 142, it is stored in another column 146. In that case, the electronic document is uniquely specified by the column 142 and the column 146.

  Further, when the storage destination of the electronic document is a document management system, the management ID may be used. Furthermore, even if the electronic document storage destination systems are different as shown in FIG. 10, there may be a plurality of storage destination systems as long as the stored electronic documents can be identified. Further, when accepting the registration request, the electronic document itself may be received, stored in a file name that can be distinguished from other documents, and then registered by assigning a paper ID.

  The management table further includes a column 143 to which a processing ID indicating what processing program is to be processed with respect to the paper document or writing on the paper document. A detailed description of the process ID will be given by the process ID management means 128.

  Further, the document information has a column 144 indicating from what application the electronic document was created. Any number of attribute information regarding the electronic document or the paper document may be stored in the column 144 and below.

  Further, when a paper ID is designated and a reference request, which is a request for management information, is made, the ID management unit 122 searches for the corresponding paper ID from the paper ID in the column 141 in FIG. 9, and corresponds to the searched paper ID. Then, information for uniquely specifying the electronic document shown in the column 142 is passed to the request source. The ID management unit 122 may also pass the attribute information from the column 143 onward, but at least the information in the column 142 is passed. In the case of FIG. 10, the information of at least column 142 and column 146 is passed.

  Further, when the ID management unit 122 is a program, the contents of the management table shown in FIGS. 9 and 10 may be held in a memory in which the program operates, or saved as a file system file at a certain timing. You may do it. There is also a form in which the contents of the management table are stored as electronic information in a database. In this case, the paper ID and its attribute information are stored as one record, and the paper ID is associated with the electronic document by storing or retrieving information such as a document by using the paper ID as a key. Good.

  In this way, the ID management unit 122 temporarily stores the management table managed by the ID management unit 122 not only in the memory that performs the program operation but also in a nonvolatile storage such as a file on the hard disk. Even if it stops, it becomes a document processing system which can use the association information managed until then.

  Further, by storing the association information between the paper ID and the electronic document being managed as a network accessible database in the non-volatile storage device, there are a plurality of ID management means 122 that refers to the association information to the database on the system. It becomes a document processing system which can be made to do. Such a nonvolatile storage device corresponds to a nonvolatile storage means.

  Furthermore, the ID management unit 122 may exist in a device independent of other units (devices) and may be connected via a network accessible from other devices. At this time, in particular, the ID management means 122 exists in the form of RPC (Remote Procedure Call), Web service, etc., and accepts registration requests and reference requests from other means via the network.

  As described above, when it is ensured that the ID management unit 122 is connected to other units through a network, and the ID management unit 122 issues only an identifier for a paper document in the system, it is more network-like. The system can receive a registration request and a management information reference request from another discrete device.

  Further, even when the electronic document information is received, even if the same electronic document name exists on the network, the name can be distinguished and managed by including the stored PC name such as the network path name. It becomes a possible system. A system capable of receiving and storing an electronic document to be registered, managing the stored electronic document name in association with the assigned paper ID, and managing the same electronic document name separately for each registration; Become.

-Paper document 123
Next, a paper document assigned with a paper ID will be described. First, an example of a paper document will be described with reference to FIG. FIG. 11 shows an example of a paper document as a member registration / unregistration form 40 such as a circle. The paper document is generated by printing an electronic document managed on a computer by a printer. In addition, this withdrawal / membership registration form 40 is plain paper.

  On the unregistration / admission registration form 40, a content 46 defined by an electronic document, a machine-readable two-dimensional code 45, and four timing marks 41, 42, 43, and 44 are printed. The timing marks 41, 42, 43, and 44 are used for alignment when reading written information, but the shape, number, size, color, and the like are not limited. In addition, there may be no timing mark.

  Incidentally, as shown in the withdrawal / admission registration form 47, the withdrawal / admission registration form 40 is filled in with an appropriate writing instrument.

  There may also be a paper document in which code data is embedded in the content, such as the paper document shown in FIG. FIG. 12 shows a paper document example 59, four timing marks 48, 49, 50, and 51, an enlarged view 53 of a part of the enlarged content 52, an identifier 54, and a code frame and alignment. A dot 55 and a data dot 56 are shown. Thus, in the paper document example 59, data is embedded in the content.

  In this embodiment, a paper document is expressed. However, the paper document only needs to be writable with a writing instrument, and paper or a sheet-like plastic film can be used.

  Next, the information acquisition unit 124 that acquires writing information from a paper document will be described.

Information acquisition means 124 (imaging device 99)
A photographing apparatus 99 using an area CCD such as a digital camera as an image pickup device as the information acquisition means 124 will be described.

  In the case of this photographing apparatus 99, for example, if an A4 size paper document is captured at once with an area CCD of 3 million pixel class (number of pixels 2048 × 1536 (pixels)), the converted effective resolution is about 170 (dpi). . In order to capture an image with a large amount of information such as a two-dimensional code and decode it, a correspondingly high resolution is required, and 170 (dpi) may not be sufficient. In this case, it may be possible to improve the resolution by increasing the integration degree of the area CCD, but there is a limit in the process of the semiconductor manufacturing technology.

  Therefore, in this embodiment, the area CCD is used as an imaging device, and an imaging unit having a zoom lens with a variable imaging magnification is provided, and a partial region of the subject is zoomed up by a driving unit that moves the imaging unit as a divided region. A description will be given of the photographing apparatus 99 that can achieve high resolution by capturing and synthesizing images and can read a two-dimensional code or the like.

  A configuration example of the photographing apparatus 99 is shown in FIG. 13 includes an imaging unit 201, a drive unit 202, a support 203, a control unit 205 corresponding to a control unit, a joining unit, and a two-dimensional code detection unit, an interface 204, and a support base 206. And two operation switches 207.

  The driving unit 202 drives the imaging unit 201 to rotate as indicated by a dotted line. The support column 203 supports the imaging unit 201 and the driving unit 202. The control unit 205 is configured to control the photographing apparatus 99 and to support the support column 203 together with the support base 206. The operation switch 207 is for operating the photographing apparatus 99. The partial areas indicated by the dotted lines A to I of the paper document 208 represent the partial areas photographed by the photographing apparatus 99.

  Next, further detailed configurations of the above-described imaging unit 201, driving unit 202, and control unit 205 are shown in FIG.

  The control unit 205 includes a system controller 211, a CPU (Central Processing Unit) 210, an SDRAM (Synchronous Dynamic Random Access Memory) 212, a PCI (Peripheral Component Interconnect) bus 213, and a PCMCIA (Personal Computer Memory Card International Association) 214. I / O (Input / Output) input / output device 215, IDE 217, PCI / ISA (Industry Standard Architecture) bridge IDE (Integrated Drive Electronics) USB (Universal Serial Bus) conversion interface 218, USB 219, and hard disk 216 And a small board computer unit comprising an ISA bus 220, an I / O controller 221, a serial 222, a parallel 234, and a LAN (Local Area Network) interface 235.

  The control unit 205 performs operation control of the imaging unit 201, image processing, editing, recording, and the like of the image transferred from the imaging device 201, and is connected to an external device via the interface 204 (see FIG. 13). Communication.

  As the interface 204, a general-purpose interface for PC, for example, RS-232C, USB, IEEE1394, a network adapter, or IrDA (Infrared Data Association) is used. In the present embodiment, the configuration using the control unit 205 is shown, but the processing and recording performed by the control unit 205 may be replaced by the MPU 236 in the imaging unit 201.

  Next, the drive unit 202 will be described. The drive unit 202 includes a stepping motor X255, a stepping motor Y256, a rotary encoder X244 for detecting the rotation amount, a rotary encoder Y257, a detection circuit 258, and a drive circuit 243.

  Note that if a rotation position of the stepping motor is calibrated by providing a reference position that stops at a predetermined rotation position, the rotary encoders and the detection circuit may not be provided.

  Next, the imaging unit 201 will be described. The description of the image pickup unit 201 will be described with reference to FIG.

  FIG. 15 shows a CDS (Correlated Double Sampling) 241, an A / D converter 242, an IPP (Image Pre-Processor) 281, a memory 240, a TG (Timing Generator) 280, and an MPU 236. And an I / O controller 237, an I / O device 261, fixed lenses 267 and 268, a zoom lens 266, a diaphragm mechanism 265, a shutter 264, a focus lens 263, and an image sensor 262. The I / O device 261 represents the serial 238 and the USB 239 described with reference to FIG.

  The image of the subject is formed on the image sensor 262 by controlling the exposure time by the shutter 264 through the fixed lenses 267 and 268, the zoom lens 266, the aperture mechanism 265, and the focus lens 263. The image signal from the image sensor 262 is sampled by the CDS 241 and then converted into a digital signal by the A / D converter 242. The timing at this time is generated by TG280. Thereafter, the image signal is subjected to image processing such as aperture correction, compression, and the like by the IPP 281, and is stored in the memory 240.

  The operation of each unit is controlled by the MPU 236. The I / O controller 237 is connected to an external device via the I / O device 261, and is used for image input / output, communication of shooting control signals, and the like.

Next, the movement of the control unit 205 when a single subject is divided and shot will be described with reference to FIG. 14 again.
(1) The control unit 205 applies a pulse voltage from the I / O input / output device 215 to the drive circuit 243 of the drive unit 202, and feeds back the rotation detection value of the detection circuit 258 so that a predetermined angle is obtained.
(2) The control unit 205 transmits a shooting control signal from the USB 219 to the USB 239 of the imaging unit 201.
(3) (1) and (2) are repeated as necessary. When image transfer is instructed, the image is transferred from the imaging apparatus 201 to the control unit 205 via the USB 239, and the control unit 205 transmits the image to the network via the LAN interface 235.
(4) As shown in FIG. 16, the paper document 208 (see FIG. 13) is printed with data identification information such as a two-dimensional code 127 described later. The two-dimensional code, which is a two-dimensional code, is decoded by the ID decoding unit 126. If the decoding is successful and the paper ID is obtained, the information such as the device type, the paper ID, and the image is documented as XML format data. It is transmitted to the ID acquisition means 131.

  Next, processing of the photographing apparatus 99 from photographing of an image on a paper document to associating the result obtained by decoding the two-dimensional code with the image obtained by photographing will be described with reference to the flowchart of FIG.

  In step S1401, the image capturing apparatus 99 adjusts the zoom lens, and captures the entire image so that the entire paper document that is the subject appears in a positional relationship in which the subject and the imaging surface face each other. In step S1402, the photographing apparatus 99 detects a code area where a code such as a two-dimensional code exists from the photographed image. Next, in step S1403, the imaging device 99 calculates the area coordinates and the barycentric position of the code area. In this case, the speed of step S1403 may be increased by prescribing the area where the code exists. Alternatively, the area may be a circumscribed rectangular area of the code area, and the barycentric position of the circumscribed rectangular area may be calculated.

  From the region coordinates obtained in step S1403 and the coordinates of the barycentric position thereof, in step S1404, the imaging apparatus 99 linearly sets the zoom magnification and the driving amount of the driving unit 202 for acquiring information for identifying data as a larger captured image. Calculate by calculation. This drive amount is calculated from two directions of pan (left and right) and tilt (up and down) with the optical axis as the roll axis.

  Based on the calculated result, the imaging device 99 drives the drive unit 202 in step S1405. In the next step S1406, the imaging device 99 captures an image at the driven position. In step S1407, the photographing apparatus 99 encodes the read code by the ID encoding unit 125. In step S1408, the imaging device 99 associates the decoding result with the entire captured image.

  As a result, only the code area can be acquired with high resolution, and a highly reliable paper ID can be assigned to the entire image captured at high speed.

  Next, actual photographing will be described. As described above, the imaging device 99 is configured to divide and shoot a paper document by driving the imaging unit, and to synthesize each of the divided and captured images into one image.

  First, split imaging will be described. As illustrated in FIG. 13 described above, the image capturing unit 201 can capture the areas A, B, and C by driving in the left-right direction indicated by the dotted line.

  Furthermore, as shown in FIG. 18, the imaging unit 201 can drive all the areas from A to I as the imaging area by driving in the vertical direction. FIG. 18 shows a state where the imaging unit 201 captures a paper document 208. The imaging unit 201 captures two areas 301 and 302 of the paper document 208.

  As described above, when shooting a subject with high resolution, the angle of view of the imaging system is made as narrow as possible and shot at a plurality of positions. In this case, shooting is performed so that all parts of the subject are shot in one of the divided images.

  A divided image shot in this way and a synthesized image synthesized by joining the divided images will be described with reference to FIGS. 19 and 20. As shown in FIG. 19, the divided image is obtained by dividing an image on which an alphabet is drawn into six parts. As shown in FIG. 19, it can be seen that the character in the downward direction in the figure is smaller. An image obtained by joining these six divided images is an image shown in FIG.

  Not only when images are joined by such a method, but also when a subject is photographed without being divided, trapezoidal distortion (tilt distortion) as shown in FIG. 20 occurs. Therefore, it is necessary to make the image face up as shown in FIG. The image shown in FIG. 21 is an image obtained by correcting tilt distortion and removing noise from the image of FIG.

  The correction of tilt distortion is based on the directly-facing image at the position facing the subject, and a projection transformation matrix between the facing image and another image is obtained in advance, and the image is rearranged using it. Can be obtained.

  In order to simplify the description of this shooting, a case will be described in which the two areas 301 and 302 shown in FIG. 18 are divided and shot. First, a point on the region 301 and a point on the region 302 are each assumed to be two points represented by Equation 1.

このとき、被写体が平面の場合、両者には、次に示す数２、数３の関係が成り立つ。

At this time, when the subject is a flat surface, the following relationships 2 and 3 are established.

数２、数３の各ｈは、以下の行列で定まるものである。

Each h in Equations 2 and 3 is determined by the following matrix.

数４に示される行列は、射影変換行列であり、画像が撮影される２つの位置が同じ場合、この関係は一定である。従って、予め既知の組(u1,v1)、(u2,v2)からh1〜h8を算出すれば良い。

The matrix shown in Equation 4 is a projective transformation matrix, and this relationship is constant when the two positions where the image is taken are the same. Therefore, h1 to h8 may be calculated from the known sets (u1, v1) and (u2, v2) in advance.

  By using Equation 1, Equation 2, and Equation 3, the position when each point on the region 302 is photographed at the position on the region 301 can be calculated. A pixel on the region 302 can be mapped to the area. Even when there are three or more divided images, for example, a projection transformation matrix between one area and another area is calculated in advance. By doing so, a face-to-face divided image is obtained, and by sequentially joining, the face-to-face image shown in FIG. 21 can be obtained.

  The above is the configuration and processing content of the imaging apparatus 99. Next, six modified examples of the photographing apparatus 99 will be described. In the following description, the description of the already described symbols such as the symbols described in FIG. 13 is omitted.

  The imaging device 99 shown in FIG. 22 as a first modification takes in a paper document into the imaging device 99 shown in FIG. 13 by using the imaging unit 310 for reading a code 127 (paper ID) such as a two-dimensional code. This is provided separately from the imaging device 201 for the purpose.

  Since the photographing apparatus 99 shown in FIG. 22 is provided for the purpose of capturing a small area in which a code exists with high resolution, the photographing apparatus 99 may be configured with a photographing apparatus that is smaller and less expensive than the imaging unit 201. In this case, the imaging apparatus 99 records the decoding result of the code 127 on the image captured by the imaging unit 310 in correspondence with the image captured by the imaging unit 201.

  In the second modification example shown in FIG. 23, a paper ID information reading unit 312 is provided instead of the imaging unit 310. The paper ID information reading unit 312 is assumed to use an imaging unit used in a general-purpose bar code reader or the like.

  Next, a third modification will be described with reference to FIG. The imaging apparatus 99 shown in FIG. 24 has an apparatus configuration in which a code 127 is provided on an underlay 313 of a paper document 208 to be input, and the column 203 is supported by a support base 315. As a result, a code can be given to paper to which no code is given, and a code can also be given by combining it with a printer or the like and outputting it again on paper.

  The fourth modified example shown in FIG. 25 has a device configuration in which a cord 127 is provided on a flat member that can be stored in the support base 315. This planar member corresponds to a two-dimensional code display means.

  In addition, the fifth modification example shown in FIG. 26 has an apparatus configuration in which the projection unit 316 is provided on the imaging unit 201 so that the code 316 can be projected onto the projection region 317 indicated by the dotted line. The code freely projected by the user can be edited as electronic data. The projection unit 316 corresponds to an optical projection unit.

  Although the projection unit 316 is provided on the imaging unit 201 in FIG. 26, the projection unit 316 may be fixed to another part. The projection unit 316 has a configuration similar to a typical liquid crystal projector including a light source, a condenser lens, a mirror, a liquid crystal panel, and a projection lens, or a DLP (Digital Light Processing) using a DMD (Digital Mirror Device). However, it is better to make it small.

  The sixth modification shown in FIG. 27 is a paper document to be captured by providing a portable information terminal 318 having a display device such as a liquid crystal display in the imaging range indicated by a dotted line and displaying a code on the display device. A code corresponding to 208 can be assigned. The portable information terminal 318 corresponds to a display unit.

  The above are six modified examples, but the fact that the drive unit is not illustrated in FIGS. 24 to 27 indicates that the configuration is not limited to the configuration having the drive unit.

・ Information acquisition means (D-PAD)
Next, FIG. 28 shows a functional block diagram of a D-PAD 104 which is another embodiment of the information acquisition means. The D-PAD 104 includes a coordinate input device 74 such as a digitizer for acquiring writing information on paper, a paper ID information reading device 75 for identifying and identifying information printed on paper and electronic information, It has a storage device 71 that holds the acquired information, a communication device 72 that transmits the acquired and held information to the PC, and a control device 73 that controls these devices.

  As the coordinate input device 74, a digitizer that continuously acquires handwritten coordinates can be used. When using a digitizer, there are known methods such as an electromagnetic induction method and a triangulation method using the principle of an ultrasonic distance meter, both of which were performed on paper with a sensor and a dedicated input pen. It is a device that detects a writing action and measures writing information, in this case, writing coordinates which are coordinates of a written locus. A set of handwritten coordinates measured in this way becomes handwritten information.

  It is desirable that the pen tip of the dedicated input pen is provided with a pen tip that can actually be written on paper so that the writing locus can be written on the paper simultaneously with electronic detection of the writing coordinates.

  The paper ID information reading device 75 is a device that reads and decodes a two-dimensional code printed on paper by, for example, a printer, and uses a two-dimensional code reader, a one-dimensional bar code reader, or the like as a known one. Here, when a two-dimensional code reader is used for the paper ID information reading device and, for example, a known QR code (registered trademark) is used for encoding, it is possible to identify information of up to 4296 alphanumeric characters. In general, a sufficient capacity can be obtained for identifying a document printed by a user.

  The storage device 71 is a hard disk or a non-volatile memory, and a removable memory such as a compact flash (registered trademark) disk can also be used. The writing coordinates and printing condition information acquired by the paper ID information reading device 75 are used. Save electronic document information. At this time, data can be exchanged with the PC by directly connecting the memory, and the communication device 72 can be omitted.

  The communication device 72 is a device that transmits stored information, and uses network technologies such as Ethernet (registered trademark) and wireless LAN, USB, Bluetooth, and serial connection technologies.

  The control device 73 is constituted by, for example, a microcomputer, and controls the operation of the above device according to operations described later.

  These devices can be configured integrally, or can be configured separately for each device. Moreover, when it is configured as an integral type, it can be moved to various places and used by being driven by a battery. Since the writing work on the printed paper is not limited to being performed on the office desk, it is desirable that the writing information input device is configured to be integrated and portable.

  FIG. 29 shows an example of the appearance of the D-PAD 104 formed into an integral type. In the illustrated example, the paper ID information reading device 75 (see FIG. 28) is realized as a two-dimensional code reader 62, and a printed document body 65 and a paper ID 127 are printed in advance on the installed paper document. Has been. The coordinate acquisition device 61 is realized by an ultrasonic digitizer, and it is possible to actually add the writing information 64 by the dedicated input pen 66 and acquire the coordinate data.

  Next, processing when a portable digitizer-type writing information input device is used will be described with reference to FIG. First, in step S601, the coordinate input device in the writing information input device detects contact (pen down) of the pen tip with a paper document at the same time as writing is started by the dedicated input pen, and detects writing coordinates in step S602. To do.

  In the next step S603, the writing information input device reads the two-dimensional code with the two-dimensional code reader as appropriate while the dedicated input pen is reading the writing coordinates or when the dedicated input pen is in contact with the writing surface.

  In the next step S604, the writing information input device decodes the read two-dimensional code and reads the paper ID and the like.

  The data consisting of the handwritten coordinates and the paper ID read in this way is temporarily stored in the storage device in step S605, and is appropriately transmitted to the PC by the communication device in the next step S606.

  Here, the stored and transmitted data is configured in a format as shown in FIG. 31, for example. FIG. 31 shows a table having items of “device identification number”, “paper ID number”, “written X coordinate”, “written Y coordinate”, and “pen U / D”.

  The “device identification number” is a number for identifying the writing information input device. The “paper ID number” is the paper ID of the paper read by the writing information input device. “Writing X coordinate” and “Writing Y coordinate” are the X coordinate and the Y coordinate of the writing coordinate information. “Pen U / D” indicates up / down of the dedicated input pen. Written coordinates and paper IDs are transmitted using data in such a format.

・ Information acquisition means (scanner 105)
Next, a scanner 105 which is another embodiment of the information acquisition unit 124 will be described.
In this embodiment, a scanned image of a paper document is acquired from a paper document that has been filled in using the scanner 105 or the like, and the data is transferred to the ID encoding means 125.

  First, the scanner 105 will be described with reference to FIG. The scanner 105 communicates with a control device 82 for controlling each device of the scanner, a storage device 83 for storing programs and images, an externally connected scanner 80 and MFP 86, and a scanner for controlling them. It has a control device 81, an image processing device 84 for processing images, and a network control device 85 for controlling communication with an external network.

  An image can be input using the MFP 86 that can communicate via the network 87 instead of the scanner 105.

  The processing of the scanner 105 will be described with reference to the flowchart of FIG. The flowchart shown in FIG. 33 shows processing for acquiring coordinates using the scanner 105 and transferring data to the document ID acquisition means 131.

  Step S701 is image reading. This is a process of reading an image of a document that the user has completed using the scanner 105 or the MFP 86. The reading condition in this case is, for example, 600 dpi, monochrome binary image. The binarization of an image uses a binarization function that a normal scanner has.

  In step S702, the read image of the paper document is stored as an image file in a predetermined folder of the storage device 83, and enters a queue for next processing. It is the role of the scanner control device 81 that controls to store the read image as an image file in a predetermined folder, and detects that the button of the scanner 105 or the MFP 86 is pressed and the image is transferred from them. The transferred image is stored in a predetermined folder of the storage device 83.

  The image processing device 84 monitors the folder of the storage device 83 in which images input from the scanner 105 and the MFP 86 are stored, and performs image erecting processing in step S703 in order from the image at the head of the queue, and step S704. The region extraction process is performed in step S705, and the decoding process is performed in step S705. In step S706, it is determined whether or not decoding is possible. If decoding is possible, a paper ID is obtained, and the process ends. The process is also terminated when the decoding fails.

  The flowchart shown in FIG. 33 shows the process of the information acquisition step. Further, the paper ID acquired in this way can be converted into a document ID and a processing ID by a management table described later. This process corresponds to the process in the document ID acquisition step.

  Note that the cue method is used in the process of step S702 when a large number of images are input using an ADF (Auto Document Feeder) or the like and a plurality of images are processed at the same time. The reason is that the load becomes very high and the operation may become unstable, and the processing speed becomes slow.

  In the image erecting process in step S703, since the area is extracted from the image in which the area extracting process in the next step 704 is erecting, an image in which the direction read from the scanner is not known is erecting. It is processing to do.

  Details of the image erecting process will be described with reference to the flowchart of FIG. First, in step S801, OCR processing is performed on the read image, and the result is stored. In the next loop of step S802, step S803, and step S801, the image is rotated by 90 degrees to perform OCR processing, and the results are also saved.

  When the OCR process is performed in the four directions rotated by 90 degrees, in step S804, the image direction is determined using the certainty factor which is one of the scales of the OCR process result. The certainty factor is the certainty of the recognized character, and the certainty factor used for the image direction determination is an average of the certainty factor of each character. It is determined that the image in the direction having the largest average certainty factor is upright.

  When the image erecting process is completed in this way, an area extraction process for detecting and decoding a two-dimensional code having a paper ID, which is the process in step S704 of FIG. 33, is performed. In the area extraction process, an area including black pixels surrounded by white pixels in the image is detected. Details of this region extraction will be described with reference to the flowchart of FIG.

  First, in the connected black pixel labeling process in step S901, the image is scanned from the upper left origin. When the upper left, upper, and left pixels are white pixels, and the currently focused pixel is a black pixel, a new label is attached to the black pixel. In the case of other pixels, the pixel is labeled with a black pixel on any of the upper left, upper, or left.

  This will be specifically described with reference to FIG. First, it is assumed that all squares with numbers written in FIG. 36 are black pixels. Based on this, the above processing will be described using the pixels 90, 91, 92, and 93 in FIG. The scanning order at this time is the order of the pixels 90, 91, 92, and 93.

  First, when attention is paid to the pixel 90, the upper left, upper, and left pixels of the pixel 90 are white pixels, and the currently focused pixel 90 is a black pixel. Therefore, the label “1” is attached to the pixel 90.

  Focusing on the pixel 91 to be scanned next, the upper left and upper pixels are white pixels, but since the left is not a white pixel, the pixel 91 is labeled with a black pixel in any of the upper left, upper, or left. . Therefore, the same label “1” as the pixel 90 is attached to the pixel 91.

  Next, focusing on the pixel 92, the upper left, upper, and left pixels of the pixel 92 are white pixels, and the currently focused pixel 92 is a black pixel, so a new label “2” is attached to the pixel 92. .

  Focusing on the pixel 93 to be scanned next, the upper left and upper pixels are white pixels, but the left is not a white pixel, so the black pixel label on either the upper left, upper or left is currently focused. The pixel 93 is attached. Therefore, the same label “2” as the pixel 92 is attached to the pixel 93.

  In this way, the same processing is performed for the following pixels.

  In the circumscribed rectangular coordinate detection process of the connected black pixels performed in the next step S902, circumscribed rectangular coordinates surrounding the black pixel group having the same label are detected. FIG. 37 shows this. As shown in FIG. 37, a circumscribed rectangle 94 of the black pixel group labeled “1” and a circumscribed rectangle 95 of the black pixel group labeled “2” are detected.

  The next step S903 is a process of integrating circumscribed rectangles that overlap and touch, and is a process of integrating circumscribed rectangles that overlap or touch each circumscribed rectangle to form a new circumscribed rectangle. This is the circumscribed rectangle 96 in FIG.

  In step S904, a circumscribed rectangle having a size within a predetermined range is extracted in order to exclude a circumscribed rectangle having a size that is impossible as the size of the two-dimensional code. As described above, since an area including black pixels surrounded by white is detected, the image processing device 84 can perform decoding on all the detected rectangular areas.

  If the position of the two-dimensional code is known in advance, the decoding may be performed only on the rectangular area at the predetermined position. If the position of the two-dimensional code is not known depending on the layout of the paper document, the detected rectangular area Decoding is performed for all, and the decoded one is detected as a paper ID. The details of decoding will be described in the following description of the ID decoding means 126.

  If the decoding is successful and the paper ID can be acquired, the device type, the paper ID, and the writing information are transmitted to the document ID acquisition unit 131. In this case, the information is transmitted to the document ID acquisition unit 131 as XML (eXtensible Markup Language) format data.

  In addition to the flatbed scanner, the image pickup apparatus such as a digital camera or a document camera can be used as the scanner used here.

ID decoding means 126
Next, the ID decoding means 126 for decoding the paper ID will be described. First, as an explanation of the ID decoding means 126, a barcode reading apparatus that reads a two-dimensional code will be described. As shown in FIG. 39, the barcode reading apparatus includes a vertex candidate detection unit 11, a code frame detection unit 12, a projective transformation coefficient calculation unit 13, a data sampling unit 14, an error correction unit 15, and a format conversion. Part 16. Further, the bar code reader reads the two-dimensional code from diagonally upward as shown in the above-described two-dimensional code reader 62 in FIG.

  The vertex candidate detection unit 11 detects a vertex candidate of the two-dimensional code. The code frame detection unit 12 detects a code frame to be described later based on the vertex candidates. By detecting the code frame, the vertex candidate is determined as a true vertex.

  The projective transformation coefficient calculation unit 13 creates the two-dimensional code created from the coordinates of each vertex of the code frame detected by the code frame detection unit 12 and the specified coordinates of each vertex of the code frame when the two-dimensional code is created. A projective transformation coefficient, which is a coefficient for mapping the specified center coordinates of each cell and the center of each cell of the read two-dimensional code, is obtained.

  The data sampling unit 14 samples the data of the two-dimensional code using the projection transformation coefficient obtained by the projection transformation coefficient calculation unit 13. The error correction unit 15 determines whether the data read by the data sampling unit 14 is an error. If there is no error or error correction is possible, the format conversion unit 16 converts the integer type 56-bit data other than the error correction code. Output to. The format converter 16 converts the data into a numeric character string and outputs it.

  Next, details of processing of the vertex candidate detection unit 11 will be described. FIG. 40 is a diagram illustrating processing for detecting vertex candidates of an input image. As shown in FIG. 40, the vertex is detected by scanning the input image in the direction indicated by the arrow. More specifically, oblique scanning is performed from the four corners of the input image, black pixels are detected, and the detected black pixels are set as A, B, C, and D.

  Next, processing for detecting whether A, B, C, and D are vertex candidates will be described with reference to FIG. FIG. 41 is an enlarged view of the two-dimensional code. For this two-dimensional code, the vertex candidate detection unit 11 determines the number of pixels on one side of the cell from A, B, C, D to the direction of the arrow, for example, 45 degrees lower right for A and 45 degrees lower left for B. The pixels are tracked by the number of pixels of 1 / √2 to determine whether they are all black pixels. If all of them are black pixels, the vertex candidate detection unit 11 detects A, B, C, and D as vertex candidates, and moves the processing to the code frame detection unit 12.

  Next, the code frame detection unit 12 will be described. As shown in FIG. 42, the code frame detection unit 12 passes through black frame determination lines 76, 77, 78, and 79 that connect the end points tracked by the number of pixels of 1 / √2 from the vertex candidates A, B, C, and D. If the ratio of black pixels of pixels is 80% or more for every straight line in each straight line, it is determined that it is a code frame, and vertex candidates A, B, C, and D are designated as vertices A, B, and C of the two-dimensional code. , D is confirmed. At this time, the coordinates of the vertices A, B, C, and D are also detected.

  Next, the projective transformation coefficient calculation unit 13 will be described. The projective transformation coefficient calculation unit 13 creates the two-dimensional code created from the coordinates of each vertex of the code frame detected by the code frame detection unit 12 and the specified coordinates of each vertex of the code frame when the two-dimensional code is created. A projective transformation coefficient, which is a coefficient for mapping the specified center coordinates of each cell and the center of each cell of the read two-dimensional code, is obtained. A method for obtaining the projective transformation coefficient will be described later.

  Next, the data sampling unit 14 will be described. The data sampling unit 14 receives the specified center coordinates and projective transformation coefficients of each cell when the two-dimensional code and the two-dimensional code are created. The data sampling unit 14 performs projective transformation of the specified central coordinates of each cell of the created two-dimensional code using the projection transformation coefficient obtained by the projection transformation coefficient calculation unit 13, so that each cell of the read two-dimensional code is read. Find the center coordinates.

  The data sampling unit 14 uses the obtained center coordinates as the sampling center coordinates of the image, and sets the data as “1” if the number of black pixels of 3 × 3 pixels centering on the coordinates exceeds the number of white pixels, and as “0” otherwise. Is read. The read 72-bit data is input and arranged in the error correction unit 15, and determination of error correction is performed. If there is no error or error correction is possible, the error correction unit 15 outputs integer type 56-bit data other than the error correction code to the format conversion unit 16. The format conversion unit 16 restores the numeric character string by converting the data into a numeric character string and outputting it.

  The above-described reading of the two-dimensional code may be performed by software, and FIG. 43 shows a flowchart of the processing. In step S1001, a two-dimensional code obtained by imaging the two-dimensional code is input from obliquely above. In step S1002, a vertex candidate of the two-dimensional code is detected.

  In step S1002, oblique scanning is performed from the four corners of the image as shown in FIG. 40, and black pixels are detected. Let the detected black pixels be A, B, C, and D. Further, in step S1002, as shown in FIG. 41, the number of pixels on one side of the cell is 1 in the direction of arrows from A, B, C, D, for example, 45 degrees on the lower right for A and 45 degrees on the lower left for B. Pixels are tracked by the number of pixels of / √2, and it is determined whether or not they are all black pixels. If they are all black pixels, A, B, C, and D are detected as vertex candidates, and the process proceeds to step S1003.

  In step S1003, as shown in FIG. 42, the ratios of the black pixels passing through the black frame determination lines 52, 53, 54, and 55 connecting the end points tracked from the vertex candidates A, B, C, and D are all If there is 80% or more of each straight line, it is determined as a code frame. Then, the vertex candidates A, B, C, and D are determined as the vertices A, B, C, and D of the two-dimensional code. At this time, the coordinates of the vertices A, B, C, and D are also detected.

  If the code frame cannot be detected in step S1003, the process branches to the end in the branch process of step S1004, and the reading ends. If a code frame is detected, the process proceeds to the next step S1005.

  In step S1005, the specified center coordinates of each cell of the created two-dimensional code from the coordinates of each vertex of the code frame detected in step S1003 and the specified coordinates of each vertex of the code frame when the two-dimensional code is created. Then, a projective transformation coefficient that is a coefficient for mapping the center of each cell of the read two-dimensional code is calculated.

  In the next step S1006, data sampling is performed. Specifically, the two-dimensional code, the projective transformation coefficient, and the specified center coordinates of each cell of the created two-dimensional code are input, and each cell of the created two-dimensional code is created using the projective transformation coefficient obtained in step S1005. By performing projective transformation of the prescribed center coordinates, the center coordinates of each cell of the read two-dimensional code are obtained.

  Then, the obtained center coordinates are set as the sampling center coordinates of the image, and data is read as ‘1’ if the number of black pixels of 3 × 3 pixels centering on the coordinates exceeds the number of white pixels, and ‘0’ otherwise. The read 72-bit data is subjected to error correction determination in step S1007. If there is no error or error correction is possible, the integer type 56-bit data other than the error correction code is converted into a numeric character string in step S1008, and a numeric character string is output in step S1009. The

  Next, how to obtain the projective transformation coefficient will be described. Projective transformation is transformation when a figure / object in a three-dimensional space is displayed on a two-dimensional plane / screen. This is a technique for converting the coordinates of an object in a three-dimensional space into coordinates on a two-dimensional plane, and is widely known as a three-dimensional image processing technique.

  In order to perform such projection conversion accurately, it is necessary to clarify the position of the imaging system, optical characteristics, and the like. However, considering the compatibility with various devices, it is difficult to specify and accurately determine the positions of the imaging systems of all the various devices.

  On the other hand, it is not always necessary to perform an accurate projective transformation in order to exhibit the effect of being easily read by an optical system that captures an image from an oblique direction. For example, a trapezoidal or various density code can be used to facilitate reading with an oblique optical system, instead of a conventional rectangular and two-dimensional code represented by uniform density cells. it can.

  A simple example for realizing such trapezoidal codes and various cell sizes will be described with reference to FIG. In the optical system as shown in FIG. 44, the read image is transformed into a trapezoidal shape by the projective transformation.

  At this time, the ratio (X1 / X3) between the long side and the short side of the trapezoid is equal to the reciprocal (L3 / L1) of the ratio of the distance from the image sensor to each area of the code. In this embodiment, a two-dimensional code having a cell shape and size that can cancel the above-described projective transformation is created instead of a two-dimensional code that is normally rectangular and the size of each cell is uniform.

  The cell size is determined at a constant magnification for each line of the two-dimensional code. The magnification of this deformation is different in the distance from the imaging surface even in one line of the two-dimensional code. For example, the magnification at the middle position of one line is converted at the same magnification from the upper part to the lower part of one line. . By this operation, a two-dimensional code having a stepped cell boundary as shown in FIG. 45 or 46 is obtained. Alternatively, a two-dimensional code as shown in FIG. 47 may be created by strictly performing projective transformation calculation. 45, 46, and 47 will be described in detail in the description of the paper ID.

  Next, the projective transformation will be described with reference to FIG. FIG. 48 shows a two-dimensional code 67 schematically showing the read two-dimensional code and a two-dimensional code 68 schematically showing the electronically generated two-dimensional code. Further, As, Bs, Cs, and Ds of the two-dimensional code 67 and Ar, Br, Cr, and Dr of the two-dimensional code 68 are vertices, and xs1 and yr2 in parentheses represent coordinates. Psk and Prk represent the center coordinates of the cell.

  The As, Bs, Cs, and Ds of the two-dimensional code 67 and the vertices of Ar, Br, Cr, and Dr of the two-dimensional code 68 satisfy the mathematical formula shown in FIG. These mathematical formulas (1) and (2) represent conversion formulas from coordinates for determining the coordinates of the two-dimensional code such as the two-dimensional code 68 to coordinates for determining the coordinates of the two-dimensional code such as the two-dimensional code 67. , Ar, Br, Cr, Dr to As, Bs, Cs, Ds.

  Expression (1) is an expression related to the X coordinate of the vertex, Expression (2) is an expression related to the Y coordinate of the vertex, and the subscript i in Expressions (1) and (2) moves from 1 to 4. In these mathematical formulas, b1 to b8 are conversion parameters, which are unknown numbers. These conversion parameters are obtained by solving an eight-way linear simultaneous equation obtained by substituting the coordinate values of Ar to Dr and As to Ds into the equation. When b1 to b8 are obtained, the center coordinate Prk of each cell of the two-dimensional code generated electronically can be converted to obtain the sampling center coordinate Psk of the two-dimensional code.

ID encoding means 125
Next, the ID encoding unit 125 that encodes the paper ID will be described. A two-dimensional code creation apparatus that creates a two-dimensional code corresponding to the paper ID and corresponds to the ID encoding means 125 will be described with reference to FIG.

  The two-dimensional code creation device includes a format conversion unit 20, an error correction unit 21, and a two-dimensional code creation unit 23.

  The format conversion unit 20 converts the input numeric character string into integer 56-bit data that is normally handled in the computer.

  The error correction unit 21 adds 16 bits of an error correction code to the data converted into the integer type 56-bit data.

  A Reed-Solomon code is used as this error correction code. This Reed-Solomon code is a powerful error correction method capable of correcting an error in byte units, and can correct an error of half or less of the error correction code length. The details of Reed-Solomon error correction codes are described in many books such as Shogodo “Code Theory (Computer Fundamental Course 18)” by Miyagawa, Iwabuchi, and Imai.

  In this embodiment, since the error correction code length is 2 bytes, 1-byte error correction is possible.

  The two-dimensional code creation unit 23 assigns the data and the error correction code data to each cell of the two-dimensional code as shown in FIG. 51, and creates a two-dimensional code. The numbers shown in each cell in FIG. 51 are numbers to which arrangement positions are assigned.

  Data and error correction code data are assigned to cells in which integer 56-bit data is 1 to 56 cells and error correction code data 16 bits is 57 to 72 cells. In creating a two-dimensional code, specified vertex coordinates and cell center coordinates are used. The specified coordinates are also used when reading a two-dimensional code.

  The creation of the two-dimensional code may be performed by software. FIG. 52 is a flowchart showing the processing.

  First, in step S1101, a numeric character string is input. In step S1102, the format of the numeric character string is converted into integer 56-bit data that is normally handled in the computer. In step S1103, 16-bit error correction code is created and added to the data converted to integer type data. As this error correction code, a Reed-Solomon code is used as before. The integer type data and error correction code data created in this way are assigned to each cell of the two-dimensional code as shown in FIGS. 51 and 53 in step S1104, and a two-dimensional code is created. 51 and 53 will be described in detail in the description of the paper ID.

  As in the previous case, data is assigned to cells in which integer type 56-bit data is 1 to 56 cells and error correction code data 16 bits are 57 to 72 cells. The specified vertex coordinates and cell center coordinates are used when creating a two-dimensional code. The specified coordinates are also used when reading a two-dimensional code.

  Next, the paper ID will be described. First, the two-dimensional code shown in FIG. 45 will be described. As shown in FIG. 45, the two-dimensional code is surrounded by a black frame as shown in FIG. 45, and the cell which is the smallest unit and information area representing 1-bit information in white or black is as shown in FIG. 72 are arranged. Therefore, this two-dimensional code can express 72-bit information.

  When this two-dimensional code is read obliquely from above, the two-dimensional code obtained by the barcode reader is reduced to a trapezoidal shape by reducing the lower part where the cells are large. Although the two-dimensional code is distorted in this way, each cell in the two-dimensional code photographed by the barcode reader occupies a plurality of pixels of the image sensor, and the area thereof is approximately equal regardless of the position of the cell.

  The image sensor of the barcode reader provided to read the two-dimensional code obliquely from above with the two-dimensional code in which the size of the upper cell is small and the size of the lower cell is large is Stable shooting of black and white information becomes possible.

  Another example of the two-dimensional code is a trapezoidal code (plan view) shown in FIG. This trapezoidal code is a two-dimensional code in which the size of the cell increases in accordance with the distance between the imaging element and each cell when the barcode reader reads from obliquely above.

  In the case of this trapezoidal code, 12 cells are arranged in each row and there are 6 rows, so the total number of cells is 72. Since the total number of cells is equal to the total number of cells of the two-dimensional code shown in FIG. 45, the number of bits that can be expressed by the trapezoid code is equal to the number of bits that can be expressed by the two-dimensional code of FIG. Incidentally, the 72-bit data is arranged as shown in FIG. 53 showing the arrangement of the data.

  As another example of the two-dimensional code, a two-dimensional code obtained by projective transformation of a rectangular two-dimensional code 57 as shown in FIG. 47 and transformed into a trapezoidal two-dimensional code 58 can be used. In this case, an image of the two-dimensional code obtained when the image is taken obliquely from above is obtained close to the two-dimensional code 57. The amount of information that can be expressed by the two-dimensional code 58 is 72 bits.

  One thing common to the three two-dimensional codes described above is that they are horizontally long. The reason for this is that if the cell is vertically long, the length of the cell increases in length, the overall size of the two-dimensional code becomes very large, and the advantage of the two-dimensional code that a large amount of data can be expressed with a small size is lost. Because.

  Further, when viewed from the bar code reader, the distance from the two-dimensional code is larger in the horizontal direction than in the vertical direction, so that the cell far from the bar code reader has a large aspect ratio. Is appropriate. Therefore, in the example of FIGS. 46 and 47, by making the change in the vertical length larger than the change in the horizontal length of the cell, the two-dimensional code photographed by the barcode reader becomes a shape close to a square. .

Process ID management means 128
Next, the process ID management unit 128 that associates the process ID with the external process program and manages the process ID will be described. FIG. 54 shows an example of a management table used in the process ID management unit 128. This management table corresponds to program processing ID association information.

  The process ID management means 128 that associates and manages the process ID and the external process program requests a process ID from another means to the external process program (registration request). At least the process ID management means 128 Information on which the external processing program can be uniquely defined by the mounted PC is received, an ID unique in the management table is assigned to the information, and the external processing program information is stored in the management table.

  In FIG. 54, each row as a group as shown in a row 155 is a unit of external processing program information corresponding to the processing ID, and columns 151, 152, 153, and 154 are registration elements.

  Among these, the assigned processing ID is stored in the column 151. The column 152 stores information for uniquely specifying an external processing program to be processed. In the first row of column 152, the file path of the external processing program is shown. Thereby, the program to be processed is uniquely determined. In the second row of the column 152, a path name indicating the folder name in which the job is stored is designated. Here, it is assumed that the external processing program processes a file in one job folder, and the correspondence between the processing IDs in the column 151 and the external processing program is related by defining the correspondence one-to-one.

  In the example of the second line in FIG. 54, a program for processing a standard document that receives handwritten information from a paper document on which an electronic document whose process ID 0001 is * .doc is printed as a job in the folder c: \ JobFolder \ WordPrint Is registered. In the third row of column 152, a program on another computer is designated as the URL of the Web service, and is associated with the process ID.

  In addition, in FIG. 54, there is a column 153 which is attribute information indicating what kind of electronic document print information can be handled by the external processing program. In column 154, the description of the external processing program is written in characters. Any number of attribute information regarding external processing programs such as columns 153 and 154 may be provided in addition to columns 153 and 154.

  When a process ID is specified and management information about an external process program is requested (reference request), the process ID management unit 128 searches the corresponding ID from the ID in the column 151 in FIG. 54, and at least the corresponding ID. Information for uniquely specifying the folder path name in the column 152, which is a registration element, is passed to the request source. At this time, the attribute information after column 153 may be passed at the same time.

  Further, when the processing ID management means 128 is a program, the contents of the management table in FIG. 54 may be held in a memory in which the program operates, or may be saved as a file system file at a certain timing. Also good. Some are stored as electronic information in a database system. Alternatively, the process ID and attribute information related to the process ID are stored as one record, the process ID is stored as a key, and the external process program information is stored or retrieved to associate the process ID with the electronic program and manage it. Good.

  In this way, by storing the association information between the managed process ID and the external process program not only on the memory that performs the program operation but also in a non-volatile storage device such as a file on the hard disk, the process ID Even if the management means 128 is stopped once, the system can use the association information that has been managed until then.

  Further, since the process ID management unit 128 stores and manages the process ID and the directory name processed by the corresponding process program, the process ID management up to that time is changed even if the process program name or the program itself is changed. The system can cope with the management information in the means 128 without changing.

  Further, the processing ID management unit 128 may exist in a device independent of other devices, and may be connected to other devices via a network. At this time, the process ID management unit 128 exists in the form of RPC (Remote Procedure Call) or Web service, and accepts registration requests and reference requests from other devices via the network.

In this case, the association information between the managed process ID and the external processing program is stored in a network accessible database as a non-volatile storage device, so that the association information can be registered and referred to by the system in a unified manner. In this system, a plurality of process ID management means 128 can exist.
Furthermore, since it is possible to designate an external processing program in another device on the network, the system can be installed with each external processing program to be registered on the host device meeting the operating conditions of the program.

  In addition, the only processing ID management means 128 on the system is connected to another device via a network, and the processing ID is associated with the external processing program via the network and managed. Thus, the system can register and refer to the association information in a unified manner in the system from the devices of other means that are discrete in the network.

Layout management means 129
Next, the layout management means 129 for editing / managing form layout information and processing methods will be described. The layout management unit 129 is a system that reads a paper document, converts the recognized writing information into an information table, which will be described later, based on the layout and processing information defined in the paper document, and stores the information.

  This will be specifically described with reference to FIGS. 55 and 56. FIG. FIG. 55 shows what is written in the withdrawal / enrollment application form described in FIG. As shown in FIG. 55, the withdrawal / admission application form includes an entry part A170, an entry part B171, an entry part C172, an entry part D173, and an entry part E174 as entry parts. In addition, in the unsubscription / enrollment application form, a name label 175, other member numbers, request items, and comments are written as labels.

  FIG. 56 shows an information table. The information table is a table composed of registration information and processing information. The registration information includes an ID, a name, and a membership number, and the processing information includes a name, a membership number, processing, and a comment.

  In this way, the information table records information written on the withdrawal / enrollment application form.

  The written information written in the entry part A170, entry part B171, entry part E174 of the unsubscription / enrollment application form is recorded in the name, member number, and comment in the information table shown in FIG. In the writing information written in the entry part D173, “delete” or “registration” is recorded in the process according to the checked entry part.

  Next, a form creation program will be described. In the following description, a file defining form layout information and a processing method is called a form definition body, and software for editing the form definition body is called a form creation program.

  A specific apparatus example will be described again with reference to FIG. A form creation program is executed on the form creation PC 101. In the data server 106, a database program operates. In this database program, input / output management of form definition bodies generated by the form creation program and input / output of information tables used in form processing are performed.

  The form creation program is a program that defines the form layout and form processing method as shown in FIG. 55 as a form structure as shown in FIG. 57, and creates and edits the contents. The form structure shown in FIG. 57 divides the entry part A170 into a property group for each semantic unit, the layout information of the form is an element label <Layout>, the recognition information is an element label <Input>, and storage destination information. Are managed by element labels <Registration>, and the contents thereof are described as XML properties.

  The form creation program has a GUI as shown in FIG. This GUI includes a layout area 155 and a tool box 156. The tool box 156 includes a label tool 151, a text box 152, a check box 153, and a barcode 154.

  A form creator can create a form by arranging labels and text boxes in the layout area 155 using the tool box 156.

  The label tool 151 creates a label in the layout area 155. The text box 152 creates a text box in the layout area 155. The check box 153 is for creating a check box in the layout area 155. The barcode 154 creates a barcode in the layout area 155.

  In this way, elements corresponding to the contents to be arranged from the tool box 156 are arranged in the layout area 155, and the attributes (properties) are set on the screen. The elements referred to here correspond to the purpose of use such as the label tool 151, the text box 152, the check box 153, and the barcode 154.

  For example, as shown in FIG. 59, a field for writing a name is created using a text box 152.

  Each element has a property group as shown in FIG. 60, and these properties define the contents actually displayed on the form and the processing method thereof. This property group will be described. The property group shown in FIG. 60 is an example of the property group corresponding to the name label 175 and the entry part A170 of FIG. The property group is roughly divided into layout information (container start to border) 176, recognition information (input to recognition result) 177, and storage destination information (registration server to registration record) 178.

  The layout information 176 manages the position and size of elements, and the state of characters and frame lines displayed there. The recognition information 177 manages the information conversion manner of the content handwritten on the element at the time of form processing. Here, various information used for character recognition is managed. The storage destination information 178 manages the storage destination of the result converted by the recognition information 177 used at the time of form processing.

  The element with ID 0001 shown in FIG. 60 is a name label element because the “type” is “Label”. This name label element has the name “name” displayed without a border because “border” is “none”, and “input” is “impossible”. There is no special processing when written on the screen, and since the “conversion” is “none”, there is no conversion for the input character. Further, since the storage destination information 178 is blank, data is not stored.

  Since the “type” of the entry A170 with ID 0002 is “Textbox”, the text to be displayed is not a “character” blank, and the “border” is “ Since it is “enclosed”, it is displayed with an enclosing (frame). When handwritten, since “input” is “possible”, there is some processing, and character recognition “Japanese”, “handwritten” expressed by “recognition knowledge” 1 to 3, This is done as information conversion of “first and last name”. The obtained recognition result is stored in a location described in the storage destination information 178.

  As described above, a form structure and a processing method are defined by providing and managing such a property group in a form structure.

・ Writing information processing means 130
Next, the writing information processing means 130 that decomposes the writing information into data and stores it from the form layout information and processing method will be described. When the scanner 105 is used as the information acquisition means, using the unsubscribe / enrollment application form shown in FIG. 61, the written information processing means 130 reads the read form image 180 and the unwritten form image 181 that has not been written. And a written image 182 is obtained, and is decomposed into each element such as a name and a membership number and stored.

  When the D-PAD 104 is used as the information acquisition means, the written coordinate sequence, that is, the written information can be obtained as it is, so that it is decomposed into each element such as name and member number and stored. In the case of atypical processing, there is no concept of a form, so it is saved as a whole without being decomposed into each element.

  When the scanner 105 is used as the information acquisition means, the difference between the unfilled paper document image and the filled paper document image is obtained as described above, and only the added portion is taken out.

  When the D-PAD 104 is used as the information acquisition means, the written data can be obtained as it is.

  This process will be described with reference to the flowchart of FIG. In addition, this flowchart has shown the process of the handwriting process program which performs the process which takes the difference mentioned above.

  Step S1201 is form recognition. Step S1202 is generation of an image of a blank form. This process is a process for generating an unfilled form image from the form definition body called in step S1201.

  Step S1203 is the alignment of the blank form image and the filled form image. This process is a process of matching the image of the filled form with the image of the unfilled form using the timing mark. The position / shape information of the timing mark is acquired from the form definition body. If no timing mark exists, this step is not performed.

  Step S1204 is generation of a written image. This process is a process for obtaining the difference between the blank form image and the filled form image.

  Processing from the next step S1205 to step S1208 is performed for each element indicated in the form definition body. First, step S1205 is generation of a partial image corresponding to each element. This process is performed in accordance with element properties (layout information), and is a process for generating partial images such as “Taro Yamada” and “56-381” in FIG. 61, for example.

  Step S1206 is character recognition of the partial image. This processing is performed according to the element property (recognition information). Step S1207 is processing for storing the result of converting information from partial images to characters by character recognition.

  In the next step S1208, it is determined whether or not all elements have been processed. If there is an element that has not yet been processed, the process proceeds to step S1205, and all elements have been processed. ,finish.

Comparison means 132 and writing information composition means 133
Next, the comparison unit 132 that compares information obtained from a plurality of information acquisition units 124 and calculates the match / mismatch of each information will be described. First, an example of writing information obtained from the D-PAD 104 is shown in FIG. The apparatus identification number, paper identification number (paper ID), and X, Y coordinate information already described in FIG. 31 are obtained.

  Next, FIG. 64 shows an example of writing information obtained from the MFP as the information acquisition means. From the MFP, a form, which is a written paper document, is scanned and processed. As a result, paper ID information and a scan image are obtained. The scan image is so-called binary data. Note that image data captured by the image capturing apparatus 99 instead of the MFP may be used.

  The comparison unit 132 compares the paper ID information obtained from the D-PAD 104 and the MFP and, if they match, sends the information obtained from each to the writing information synthesis unit 133. According to the writing information of FIG. 63, 00525, 002001, 008064, and 000111 are obtained as the paper IDs. In the paper ID of FIG. 64, 000525 is obtained as scan image data A, 000111 as data B, and 00200 as data C. Therefore, the comparison unit 132 determines that the writing information of the D-PAD 104 and the MFP writing information is the same for 000525, 000001, and 000111 that have the same paper ID.

  The writing information combining means 133 combines writing information with a paper ID of 00525 as data A, writing information with a paper ID of 000001 as data C, and writing information with a paper ID of 000111 as data B. FIG. 65 shows an example of written information after synthesis. As shown in FIG. 65, the stroke data and the scan image were combined by combining the writing information.

  Further, when combining, it is possible to inquire whether combining is possible. FIG. 66 shows an example of a screen for inquiring whether or not composition is possible and requesting input of whether or not to compose. Further, although not shown in FIG. 66, an acquisition date of each piece of writing information, a scan image, and an image of stroke data may be displayed.

  Since the user can confirm by displaying a screen as shown in FIG. 66 on the computer, it can be handled appropriately so that it is not mistakenly combined by some factor.

  Further, the comparison unit 132 can compare the coordinate information obtained from the plurality of information input units, and determine whether or not both pieces of information match. As a method of comparing writing information, a writing position comparison of writing information and a writing shape comparison are performed. In the comparison of written shapes, a widely known pattern matching method can be used. Here, when the information input device is the D-PAD 104 and the scanner 105, the respective writing information is a coordinate sequence and a scan image, and it is difficult to compare them. Therefore, in this case, the coordinate sequence obtained from the D-PAD 104 is imaged and compared with the image information obtained from the scanner 105.

  67 shows the writing information of the D-PAD 104, and FIG. 68 shows the writing information of the scanner 105. According to FIG. 67, writing information written on three papers, 000525, 000001, and 000111, is acquired. Therefore, if a coordinate sequence is imaged for each paper ID, it can be compared with a scanned image. In FIG. 67, an image of a coordinate sequence is generated handwritten image data. For easy understanding, the generated image data is data AA, data CC, and data BB.

  FIG. 69 shows an example of generated image data and a scanned image scanned. That is, image data is created from coordinate data for each stroke with the same paper ID. The left side of FIG. 69 shows the generated image data, and the right side of FIG. 70 shows the scan image. For example, by setting the minimum circumscribed rectangle of the generated image data and template matching the corresponding coordinates of the scan image, the comparison unit 132 determines whether or not the two pieces of writing information obtained from the plurality of information input units are equal. it can. In addition, the process which produces | generates an image from handwritten coordinates may produce | generate simply with the straight line which connects a coordinate row | line, and may use approximate curves, such as a Bezier curve.

  FIG. 70 shows an example of the combined writing information. Generated image data AA and the like in FIG. 70 are image data generated from handwritten coordinate information. Based on the result of the comparison by the comparison unit 132, the writing information combining unit 133 combines the generated image AA and the scan image data A, combines the generated image CC and the scan image data C, and generates the generated image BB and the scan image data. B was synthesized. 67 and 68, the generated image AA and the scanned image data A, the generated image CC and the scanned image data C, and the generated image BB and the scanned image data B have the same paper ID. It can be seen that the means 132 can image the coordinate sequence obtained from the D-PAD 104 and compare with the image information obtained from the scanner 105 to determine whether or not they are equal.

Next, the case where the writing information combining unit 133 combines additional information other than the paper ID and writing information based on the paper ID or the written image will be described.
As described above, as information obtained from the D-PAD 104, there is additional information in addition to the device identification number, paper identification number (paper ID), and coordinate information already described. An example of the additional information is a paper ID detection time, for example. When the D-PAD 104 is configured, as shown in FIG. 28, a control device 73 is provided to control the operation of the D-PAD 104. In general, however, it is efficient to use a microcomputer for the control device 73. The device 73 has some kind of clock. At this time, it is easy to detect and store the time indicated by the clock at each time point when the paper ID is detected.
71 shows pre-combination writing information acquired by the D-PAD 104, and FIG. 72 shows pre-combination writing information acquired by the scanner 105, respectively. Since the writing information acquired by the D-PAD 104 and the scanner 105 has a paper ID, the writing information having the same paper ID is synthesized. Alternatively, the writing information of the D-PAD 104 may be converted into image data, and the writing information of the D-PAD 104 may be combined with the scanned image determined to be the same paper document by pattern matching.
FIG. 73 shows the combined writing information. By combining as shown in FIG. 73, the paper ID detection time at which the paper ID was detected in addition to the coordinate information and the scan image was obtained as the writing information.
Moreover, you may synthesize the writing time measured as additional information. As described above, the coordinate input device generally includes a clock, and it is possible to easily measure and store the time for each handwritten coordinate. 74 shows the pre-combination writing information acquired by the D-PAD 104, and FIG. 75 shows the pre-combination writing information acquired by the scanner 105.
74, the writing time is acquired together with the writing coordinates acquired by the digitizer of the D-PAD 104. When the same writing information is combined based on the paper ID or the generated image data, the image data shown in FIG. 76 combined by the writing information combining unit 133 is obtained. As shown in FIG. 76, the writing time of each writing coordinate in addition to the paper ID, the coordinate information, and the scan image was obtained by combining the writing information of the plurality of information acquisition means.
Further, the detection position of the paper ID may be synthesized as additional information. As is widely known, GPS (Global Positioning System) can be mounted on a light and small device, but can accurately measure the position on the earth. Therefore, if a GPS receiver is installed in the D-PAD 104, for example, it is easy to detect and store the position indicated by the GPS at the time when the paper ID is detected. FIG. 77 shows an example of handwritten information having position information by GPS acquired by the D-PAD 104. As shown in FIG. 77, when the acquired paper ID information is newly detected, the position information detected by the GPS is stored for each paper ID. Note that the location information may be acquired by the MFP.
The writing information synthesizing unit 133 synthesizes writing information having the same paper ID, for example. When the writing information of FIG. 77 is combined with the writing information by the MFP as shown in FIG. 75, the writing information is combined as shown in FIG.

By combining the writing information in this way, the writing information that can be obtained only by the D-PAT 104 and the writing information that can be obtained only by the scanner (MFP) can be complemented each other. In addition to the writing information, the paper ID detection time, writing time, or position information can be synthesized, and the acquired writing information can be used in more detail.
Document ID acquisition unit 131
Next, the document ID acquisition unit 131 that converts a paper ID into a document ID and a processing method will be described. FIG. 79 shows a schematic diagram of the processing procedure of the document ID acquisition unit 131 for converting the paper ID into the document ID and the processing ID. In FIG. 79, with the document ID acquisition means 131 as the center, the rectangular figure indicates each means (device), the balloon indicates the contents of the data or request, the arrow indicates the data or request direction, and the steps on the arrow indicate the order. Is shown.
First, in step S1301, the document ID acquisition unit 131 acquires a paper ID and writing information from the D-PAD. Alternatively, the document ID acquisition unit 131 reads a paper document written by the scanner or the scanner unit of the MFP, and acquires a paper ID and a scan image.

In the next step S1302, the document ID acquisition unit 131 sends the paper ID to the ID management unit 122 and requests management information regarding the paper document. As a result, in step S1303, the document ID acquisition unit 131 acquires information for uniquely specifying an electronic document that is an ID registration target corresponding to a paper document, a processing ID, and the like.
Next, the document ID acquisition unit 131 sends the processing ID to the processing ID management unit 128 in step S1304, and requests management information of the processing program related to the paper document. As a result, in step S1305, the document ID acquisition unit 131 acquires information for uniquely specifying the folder path name registered with the corresponding identifier from the processing ID management unit 128.
In step S1306, the document ID acquisition unit 131 stores all the information acquired via the D-PAD 104, the image reading device such as the scanner 105 or the MFP, the ID management unit 122, and the processing ID management unit 128 as a file. Store and save as a file in the folder path name obtained in the above process.

  Thus, in step S1307, the document ID acquisition unit 131 changes the writing information from the form layout display and processing method to the writing information processing unit 130 or the atypical processing program that decomposes and stores the data into data. Deliver the job.

  As described above, according to the writing information processing system of the present embodiment, by providing means for appropriately combining a plurality of writing information, each other's information is complemented by using writing information from different information input devices. This makes it possible to manage documents more effectively as a whole writing information processing system.

It is a figure which shows the whole block diagram of a writing information processing system. It is a figure which shows the hardware constitutions of a computer. It is a figure which shows the relationship of each means of a writing information processing system implement | achieved by PC running a program, a paper document, and paper ID. It is a flowchart which shows the 1st Example of an ID provision means. It is a flowchart which shows the 2nd Example of an ID provision means. It is a flowchart which shows the 3rd Example of an ID provision means. It is a flowchart which shows the 4th Example of an ID provision means. It is a flowchart which shows the 5th Example of ID provision means. It is a figure which shows a management table. It is a figure which shows a management table. It is a figure which shows the example of a paper document. It is a figure which shows the example of a paper document. It is a figure which shows an imaging device. It is a figure which shows the detailed structural example of an imaging part, a drive part, and a control part. It is a figure which shows the structural example of an imaging part. It is a figure which shows the example of a paper document. It is a flowchart which shows the process of an imaging device. It is a figure which shows the drive to an up-down direction of an imaging part. It is a figure which shows a divided image. It is a figure which shows the joined image. It is a figure which shows the image which performed correction of tilt distortion. It is a figure which shows the structural example of an imaging device. It is a figure which shows the structural example of an imaging device. It is a figure which shows the structural example of an imaging device. It is a figure which shows the structural example of an imaging device. It is a figure which shows the structural example of an imaging device. It is a figure which shows the structural example of an imaging device. It is a figure which shows the functional block diagram of information acquisition apparatus D-PAD. It is a figure which shows the example of an external appearance of information acquisition apparatus D-PAD. It is a flowchart which shows the process of a writing information input device. It is a figure which shows the format of the data transmitted from a writing information input device. It is a figure which shows a scanner. It is a flowchart which shows the process of a scanner. It is a flowchart which shows an image erecting process. It is a flowchart which shows an area | region extraction process. It is a figure which shows a mode that a pixel is labeled. It is a figure which shows a circumscribed rectangular coordinate detection process. It is a figure which shows the circumscribed rectangle which integrated the circumscribed rectangles. It is a figure which shows each part which comprises a barcode reader. It is a figure which shows a vertex pixel detection. It is a figure which shows vertex candidate detection. It is a figure which shows code frame detection. It is a flowchart which shows a two-dimensional code reading process. It is a figure which shows a mode that it reads from the diagonal direction. It is a figure which shows a two-dimensional code. It is a figure which shows a two-dimensional code. It is a figure which shows projective transformation. It is a figure which shows the two-dimensional code read with the two-dimensional code. It is a figure which shows the numerical formula which calculates | requires a conversion parameter. It is a figure which shows each part which comprises a two-dimensional code production apparatus. It is a figure which shows the arrangement position of data. It is a flowchart which shows a two-dimensional code creation process. It is a figure which shows the arrangement position of data. It is a figure which shows a management table. It is a figure which shows a form. It is a figure which shows an information table. It is a figure which shows a form structure. It is a figure which shows the user interface of a form creation program. It is a figure which shows a mode that a text box is created. It is a figure which shows a property group. It is a figure which shows a mode that writing information is decomposed | disassembled into data. It is a flowchart which shows the process which decomposes | disassembles writing information into data and preserve | saves it. It is an example of the writing information obtained from D-PAD. It is an example of writing information obtained from the MFP. It is an example of the writing information which synthesize | combined the writing information acquired by D-PAD and MFP. It is an example of the screen which inquires whether the composition is possible. It is an example of the writing information obtained from D-PAD. It is an example of writing information obtained from the MFP. It is a figure which shows an example of the generated image data and the scanned image scanned. It is an example of the writing information which synthesize | combined the writing information acquired by D-PAD and MFP. It is an example of the writing information before the synthesis | combination acquired by D-PAD. 4 is an example of pre-combination writing information acquired by an MFP. It is an example of the writing information which synthesize | combined the writing information acquired by D-PAD and MFP. It is an example of the writing information before the synthesis | combination acquired by D-PAD. 4 is an example of pre-combination writing information acquired by an MFP. It is an example of the writing information which synthesize | combined the writing information acquired by D-PAD and MFP. It is an example of the writing information which has the positional information acquired by D-PAD. It is an example of the writing information which synthesize | combined the writing information acquired by D-PAD and MFP. It is a schematic diagram of the process sequence of a document ID acquisition means.

Explanation of symbols

99 Imaging device 101 PC for creating forms
102 Printing apparatus 103 Form processing PC
104 D-PAD
105 scanner 106 data server 107 network 108 form creation device 109 form processing device 111 external processing program 134 storage 121 ID assigning means 122 ID management means 123 paper (paper)
124 Information acquisition means 125 ID encoding means 126 ID decoding means 127 Paper ID
128 processing ID management means 129 layout management means 130 writing information processing means 131 document ID acquisition means 132 comparison means 133 writing information composition means

Claims (15)

ID encoding means for encoding a paper ID for identifying the paper;
ID giving means for associating a document ID for identifying an electronic document with the paper ID and giving the paper to the paper;
Printing means for printing on the paper the encoded paper ID created by the ID encoding means;
ID management means for managing the document ID associated with the paper ID;
An information acquisition means for acquiring the paper ID and writing information encoded from the paper to which the encoded paper ID is given and the handwriting is handwritten;
ID decoding means for decoding the encoded paper ID acquired by the information acquisition means;
A process ID management means for associating the paper ID with a process ID indicating a process performed on the writing information acquired by the information acquisition means;
A writing information processing system comprising:
Comparison means for comparing the writing information acquired by the first information acquisition means with the writing information acquired by the second information acquisition means;
Writing information combining means for combining the writing information acquired by the first information acquiring means and the writing information acquired by the second information acquiring means when the writing information compared by the comparing means is equal. When,
A writing information processing system characterized by comprising: ID encoding means for encoding a paper ID for identifying the paper;
ID giving means for associating a document ID for identifying an electronic document with the paper ID and giving the paper to the paper;
Printing means for printing on the paper the encoded paper ID created by the ID encoding means;
ID management means for managing the document ID associated with the paper ID;
Information acquisition means for acquiring the paper ID and writing information encoded from the paper on which the encoded paper ID is printed and the handwriting is handwritten;
ID decoding means for decoding the encoded paper ID acquired by the information acquisition means;
A process ID management means for associating the paper ID with a process ID indicating a process performed on the writing information acquired by the information acquisition means;
A writing information processing system comprising:
Comparison means for comparing the paper ID acquired by the first information acquisition means with the paper ID acquired by the second information acquisition means;
Written information composition for synthesizing the writing information acquired by the first information acquisition unit and the writing information acquired by the second information acquisition unit when the paper IDs compared by the comparison unit match Means,
A writing information processing system characterized by comprising: The first or second information acquisition means includes additional information acquisition means for acquiring additional information when acquiring the writing information or the paper ID,
When the writing information combining means combines the writing information, the additional information is combined with the writing information.
The writing information processing system according to claim 1 or 2, characterized by the above-mentioned.   4. The writing information processing system according to claim 3, wherein the additional information is a time when the encoded paper ID is acquired.   4. The writing information processing system according to claim 3, wherein the additional information is a time when the writing is handwritten.   4. The writing information processing system according to claim 3, wherein the additional information is position information indicating a position where the encoded paper ID is acquired.   3. The writing information processing system according to claim 1, wherein when the writing information combining means combines the writing information, an input as to whether or not to combine the writing information is requested. An ID encoding step in which an ID encoding means encodes a paper ID for identifying the paper;
An ID providing unit, and ID assignment step to be applied to the paper in association with the paper ID and the document ID identifying the electronic document,
A printing step in which the printing means prints the encoded paper ID created by the ID encoding step on the paper;
An ID management step in which an ID management means manages the document ID associated with the paper ID;
The information acquiring unit, the encoded paper ID is assigned, and information obtaining step of writing to obtain the paper ID and handwritten information encoded from the paper that is hand-written,
An ID decoding step in which an ID decoding means decodes the encoded paper ID;
A process ID management step for associating the paper ID with a process ID indicating a process performed on the writing information acquired by the process ID management unit ;
A writing information processing method characterized by comprising:
A comparison step for comparing the writing information acquired by the first information acquisition step with the writing information acquired by the second information acquisition step;
If the writing information compared by the comparing step is equal, the writing information combining means acquires the writing information acquired by the first information acquiring step and the writing information acquired by the second information acquiring step. Written information synthesis step to synthesize,
A writing information processing method characterized by comprising: An ID encoding step in which an ID encoding means encodes a paper ID for identifying the paper;
An ID assigning step in which an ID assigning unit associates a document ID for identifying an electronic document with the paper ID and assigns the paper to the paper;
A printing step in which the printing means prints the encoded paper ID created by the ID encoding step on the paper;
An ID management step in which an ID management means manages the document ID associated with the paper ID;
The information acquiring unit, the encoded paper ID is assigned, and information obtaining step you get the paper ID and handwritten information encoded from the paper writing is handwriting,
An ID decoding step in which an ID decoding means decodes the encoded paper ID;
A process ID management step for associating the paper ID with a process ID indicating a process performed on the writing information acquired by the process ID management unit ;
A writing information processing method characterized by comprising:
A comparison step for comparing the paper ID acquired by the first information acquisition step with the paper ID acquired by the second information acquisition step;
The writing information obtained by the first information acquisition step and the writing information acquired by the second information acquisition step when the paper ID compared by the comparison step matches the writing ID. Writing information synthesis step to synthesize,
A writing information processing method characterized by comprising: The first or second information acquisition step includes an additional information acquisition step of acquiring additional information when acquiring the writing information or the paper ID,
When the writing information is synthesized by the writing information synthesis step, the writing information synthesis means synthesizes the additional information with the writing information.
The writing information processing method according to claim 8 or 9, characterized in that.   The writing information processing method according to claim 10, wherein the additional information is a time when the encoded paper ID is acquired.   The writing information processing method according to claim 10, wherein the additional information is a time at which the writing is handwritten.   The handwritten information processing method according to claim 10, wherein the additional information is position information indicating a position where the encoded paper ID is acquired. In the case where the writing information is synthesized by the writing information synthesis step, the writing information synthesis means includes a step of requesting an input as to whether or not to synthesize.
The writing information processing method according to claim 8 or 9, characterized in that.   The program which makes a computer perform the writing information processing method of any one of Claims 8-14.

Images