JP2008131381A - Form generating device, form generating method, program and record medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically stick data read from one form to the other form to print without any complicated computer operation between a plurality of different forms. <P>SOLUTION: An area marked on a read form image is detected and stored as form mark information, and the form image is also stored. Further, the area marked on a read field image is detected and stored as field mark information. Further, this device is configured to be controlled by a CPU 101 of an MFP 100 so that a data image is read from a data paper, data of the area corresponding to the form mark information is obtained from the read data image, the obtained data is stored as a rectangular image orOCR result, the data stored as the rectangular image orOCR result is composited in the area corresponding to a mark stored as the field mark information of the form image. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a form generation device, a form generation method, a program, and a recording medium that read data from a data sheet and perform overlay printing on a pre-registered form.

  Conventionally, a technique for capturing an image in a designated rectangular area or a technique for erasing only the image of the portion has been proposed.

  In Patent Document 1, an automatic scanning area in which an area of a document to be detected by a scanner is enclosed in a rectangular area by a user using a general fluorescent color marker or the like, and only the enclosed rectangular area is scanned. A selection device has been proposed.

In Patent Document 2, an image of an area surrounded by a marker or the like is removed from an original image, an original image excluding the image of the enclosed area is copied on the surface of a sheet, and the area of the enclosed area is Copiers that create images on the back of paper have been proposed.
JP 2000-123181 A Japanese Patent Laid-Open No. 06-178021

  Conventionally, there has been a demand for using different forms to print data read from one form by pasting it on the other form.

  However, in order to perform such printing, in the conventional technology, it is necessary for the user to sequentially specify the position information of each item in each form and the connection between items between forms by computer operation. It was a very cumbersome task.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to associate each item between a plurality of different forms without complicated computer operation. It is to provide a mechanism for automatically pasting the data read from the other form onto the other form (pasting without any individual pasting operation by the user) and printing.

  The present invention provides a form generation device for combining form data and field data, wherein a first detection unit that reads a form image from form paper and detects a marked area on the read form image; A first storage means for storing the position of the marked area detected by the first detection means; a second storage means for storing the form image; and a field image read from a field sheet. Second detection means for detecting a marked area on the field image, third storage means for storing the position of the marked area detected by the second detection means, and the third Acquisition means for acquiring the data of the area corresponding to the position of the marked area stored in the storage means, and the data acquired by the acquisition means In the area corresponding to the position of the area corresponding to the mark stored in the first storage means of the form image stored in the second storage means. Synthesizing means for synthesizing data stored in the storage means.

  According to the present invention, simple preparations such as designating the same item between a plurality of different forms with the same marker are not required, registration of a complicated form as in the prior art is not required, and there is no computer knowledge. The user can easily paste the data read from one form between different forms to the other form automatically (without any individual pasting operation by the user) There is an effect.

[First Embodiment]
FIG. 1 is a block diagram illustrating the configuration of a multi-function peripheral (MFP) to which a form generation device showing an embodiment of the present invention can be applied. In this embodiment, a form sheet and a data sheet are scanned by an MFP (color MFP), and overlay (compositing process) is performed in the MFP to perform printing. The form generation device of the present invention may be configured by a personal computer, a scanner, and a printer.

  Reference numeral 100 denotes an MFP as a form generation device of the present invention. In this MFP 100, 101 is a CPU, and a program stored in a ROM 103 or a hard disk (HDD) 105 is executed on the RAM 102 or the like, and the operation of each unit connected via the bus 114 is controlled, whereby the entire MFP 100 is controlled. Oversee and control.

  A hard disk interface (HDD I / F) 104 controls access to the HDD 105.

  A scanning unit 106 reads an image of a document and outputs image data corresponding to the document image. A printer unit 107 records an image corresponding to the image data from the image processing unit 108 on a recording material.

  The image processing unit 108 executes image processing such as synthesis of image data (synthesizes character data with form data). Reference numeral 109 denotes an OCR processing unit that recognizes character information from image data. A character size change processing unit 113 changes the character size of the character data combined with the form data by the image processing unit 108.

  A network interface (LAN I / F) 110 controls communication with a network (not shown).

  Reference numeral 111 denotes an I / O that controls input from the operation unit 112 and output to the operation unit 112. The operation unit 112 includes a touch panel display (operation panel) and hard keys, and is used to perform operation instructions and operation settings for the MFP 100.

  The outline of the form generation process in the form generation apparatus of the present invention will be described below with reference to FIGS.

<Preparation>
Replace a paper document for forms by marking it with an underline marker ((translucent) ink such as a fluorescent pen) (by applying (translucent) ink such as a fluorescent pen) A part is designated (for example, 201a to 201e in FIG. 2A).

  An underline marker or the like is marked on the paper document for data, and the data portion is designated (for example, 301a to 301e in FIG. 3A).

  It is assumed that the form and data are associated with each other by a mark such as an underline marker. In addition, it is assumed that a character or a mark described in the same color as the underline marker or the like in the rectangular area is also associated.

<Realization method>
<Operation (Form registration)>
FIG. 2A is a schematic diagram for explaining a form registration process in the form generation apparatus of the present invention.

  In FIG. 2A, reference numeral 210 denotes an operation panel according to the present embodiment, which is provided on the operation unit 112 of the MFP 100. On the operation panel 210, a “form registration” button 211, a “field registration” button 212, an “execute overlay” button 213, and a “cancel” button 214 are displayed.

  The user sets a paper document for form (form paper 200) on a document table (not shown) of the scanning unit 106 of the MFP 100, and selects (touches) a “register form” button 211 from the operation panel 210.

  Accordingly, MFP 100 scans the form paper document (form paper 200) set on the document table of scan unit 106. Then, the MFP 100 stores the form image data output from the scan unit 106 in the RAM 102.

  Next, the MFP 100 recognizes the mark position (rectangular region) from the stored form image data (for example, 201a to 201e). The MFP 100 also detects characters and marks (for example, a star 1 in 201a) described in the same color as the underline marker in the rectangle.

  After detecting the mark, when the MFP 100 has the OCR processing unit 109, the MFP 100 executes OCR recognition (character, font type, font size recognition) in the detected rectangular area. Then, item numbers are issued (in the order of 1, 2, 3,...), And the item numbers, the mark detection, and the OCR recognition result are stored in the HDD 105 of the MFP 100 as form mark information 202 (FIG. 2B). save.

  FIG. 2B is a schematic diagram illustrating form mark information according to the present embodiment.

  As shown in FIG. 2B (a), information to be saved includes item number, rectangular position information (upper left X coordinate, upper left Y coordinate, rectangular vertical size, rectangular horizontal size), color information (R, G, B). Line type information (dot pattern), font information (font type, font size, character color (R / G / B)), association information, and the like. An example of the form mark information is shown in FIG. 2B (b).

  Hereinafter, the description returns to the form registration process.

  Next, the MFP 100 erases the detected mark (characters or marks described in the same color, such as an underline marker) from the rectangular area of the form image data held in the RAM 102.

  Then, the MFP 100 performs the above process on all the marks in the form image data, and stores the form image data in the HDD 105 when the process is completed for all the marks.

  FIG. 2C is a schematic diagram illustrating a saved image of the form image according to the present embodiment.

  As shown in FIG. 2C, the image data in which the mark is deleted from the form image data (corresponding to the form paper 200) is stored as the form image 203. Then, the form registration process ends.

<Operation (Register Field)>
FIG. 3A is a schematic diagram for explaining field registration processing in the form generation device of the present invention.

  The user sets a field paper document (field papers 300 a and 300 b) on a document table (not shown) of the scanning unit 106 of the MFP 100, and selects (touches) a “register field” button 212 from the operation panel 210.

  As a result, the MFP 100 scans one field sheet (300a, 300b, etc.) set on the document table of the scanning unit 106. Then, the MFP 100 stores the field image data output from the scan unit 106 in the RAM 102. Here, the MFP 100 issues a field sheet number and stores it in the RAM 102. The field paper numbers are issued in the order of 1, 2, 3,.

  Next, the MFP 100 recognizes the mark position (rectangular region) from the stored field image data (for example, 301a to 301c for the field paper 300a and 301d to 301e for the field paper 300b). The MFP 100 also detects characters and marks (for example, a star 1 in 301a) described in the same color as the underline marker in the rectangle. Hereinafter, these pieces of recognition information are referred to as field marks.

  Next, the MFP 100 acquires the form mark information 202 stored in the HDD 105, and detects that the color information and line type information of the recognized field mark match. If there is a match, the MFP 100 stores the matched field mark in the HDD 105 of the MFP 100 as field mark information 302 (FIG. 3B).

  FIG. 3B is a schematic diagram illustrating field mark information according to the present embodiment.

  As shown in FIG. 3B (a), the information to be saved includes the number of the field sheet number issued, the item number of the matched form mark information (FIG. 2B), the detected rectangular position information (upper left X coordinate, upper left) Y coordinate, rectangular vertical size, rectangular horizontal size), color information (R, G, B), line type information (dot pattern), association information, and the like. An example of field mark information is shown in FIG. 3B (b).

  Hereinafter, the description returns to the field registration process.

  Then, the MFP 100 performs the above process for all the marks in the form image data, and when the process is completed for all the marks, performs the process for the next field sheet. When the processing for all field sheets is completed, the field registration process is terminated.

<Operation (overlay implementation)>
FIG. 4A is a schematic diagram for explaining overlay execution processing in the form generation device of the present invention.

  The overlay is executed in the order of data reading processing, overlay processing, and printing processing.

  First, the data reading process will be described.

  The user sets a paper document (data sheet 400) of data on a document table (not shown) of the scanning unit 106 of the MFP 100, and selects (touches) an “execute overlay” button 213 from the operation panel 210.

  As a result, the MFP 100 scans one data sheet 400 set on the document table of the scanning unit 106. Then, the MFP 100 stores the data image output from the scanning unit 106 in the RAM 102. Here, the MFP 100 issues a field sheet number and stores it in the RAM 102. The field paper numbers are issued in the order of 1, 2, 3,.

  Next, the MFP 100 acquires position information corresponding to any item in the field mark information 302 associated with the issued field sheet number, and cuts out a rectangular area of the data image based on the position information. .

  Further, when the MFP 100 includes the OCR processing unit 109, the MFP 100 performs OCR recognition (characters) in the cut out rectangular area. Then, the MFP 100 stores the item number corresponding to the position information used for the cutout, the OCR recognition result, and the cutout rectangular area image data in the HDD 105 of the MFP 100 as a rectangular image or OCR result 401 (FIG. 4B).

  FIG. 4B is a schematic diagram illustrating a rectangular image or OCR result of the present embodiment.

  As shown in FIG. 4B (a), the information to be stored is the item number of the corresponding field mark information, character data (only when an OCR processing unit is provided), and rectangular area image data. An example of the rectangular image or OCR result 401 is shown in FIG. 4B (b).

  Hereinafter, the description returns to the data reading process.

  Then, the MFP 100 performs the above-described clipping process through storage process for all items corresponding to the field sheet number. When the processing for all the items corresponding to the field sheet number is completed, the MFP 100 further determines whether the association of the read data to all the items in the field mark information 302 has been completed, and has ended. If not, the next data sheet is processed.

  When the association of the read data with respect to all items in the field mark information 302 is completed, the processing is shifted to overlay processing.

  In overlay processing, first, the MFP 100 obtains saved form mark information 202, a form image 203, and a rectangular image or OCR result 401.

  If the MFP 100 includes the OCR processing unit 109, the MFP 100 sets each character data in the rectangular image or OCR result 401 to a position corresponding to the rectangular area position information of the form mark information 202 with the matching item number. It is pasted with the font information (font type, font size, color, etc.) of the form mark information 202.

  On the other hand, when the MFP 100 includes the OCR processing unit 109, the MFP 100 converts each image data in the rectangular image or OCR result 401 to the form image corresponding to the rectangular area position information in the form mark information 202 with the matching item number. Paste it at a position in 203.

  Then, all the pasting is completed, and the printing process is executed on the form image 203.

  The above reading process, overlay process, and printing process are repeated until the data sheet 400 on the document table is exhausted.

  Hereinafter, the form generation processing in the form generation apparatus of the present invention will be described in detail with reference to the flowcharts of FIGS.

  FIG. 5 is a flowchart showing an example of a first control processing procedure according to the present invention, and corresponds to the form generation processing in the MFP 100 shown in FIG. Note that the processing in this flowchart is realized by the CPU 101 illustrated in FIG. 1 executing a program stored in the ROM 103 or the HDD 105 on the RAM 102. In the figure, S501 to S511 denote steps.

  First, when the “form registration” button 211 on the operation panel 210 is pressed (touched), in step S501, the CPU 101 causes the scanning unit 106 to scan a paper document for form (form paper 200) set on the document table. The form image data output from the scan unit 106 is stored in the RAM 102.

  Next, in step S <b> 502, the CPU 101 performs form registration processing and stores the form mark information 202 and the form image 203 in the HDD 105. Details of the form registration process are shown in FIG.

  Next, when the “register field” button 212 on the operation panel 210 is pressed (touched), in step S503, the CPU 101 determines the presence or absence of the field sheet 300 set on the document table, and the field sheet 300 is present. In step S504, the field sheet 300 is scanned by the scanning unit 106, and the field sheet data output from the scanning unit 106 is stored in the RAM 102. Although not shown, the CPU 101 issues a field paper number and stores it in the RAM 102. The field paper numbers are issued in the order of 1, 2, 3,.

  In step S <b> 505, the CPU 101 performs field registration processing and saves the field mark information 302 in the HDD 105. Details of the field registration process are shown in FIG.

  Then, the CPU 101 returns the process to step S503.

  If it is determined in step S503 that the field sheet 300 on the document table has been completed, the CPU 101 waits until the “execute overlay” button 213 on the operation panel 210 is pressed (touched).

  When the “execute overlay” button 213 on the operation panel 210 is pressed (touched), in step S506, the CPU 101 determines whether or not the data sheet 400 is set on the document table. If it is determined, the data sheet 400 is scanned by the scanning unit 106 in step S507, and the data image output from the scanning unit 106 is stored in the RAM 102. Although not shown, the CPU 101 issues a field paper number and stores it in the RAM 102. The field paper numbers are issued in the order of 1, 2, 3,.

  Next, in step S <b> 508, the CPU 101 performs data reading processing, and stores in the HDD 105 a rectangular image or OCR result 401 in which items in the form mark information and reading information (rectangular information or OCR information) are linked. Details of the data reading process are shown in FIG.

  Next, in step S509, the CPU 101 determines whether or not the association of all items in the form mark information has been completed in the data reading process. If it is determined that it has not been completed, the process proceeds to step S506. And the next data sheet is scanned.

  On the other hand, if it is determined in step S509 that all items in the form mark information have been linked in the data reading process, the process proceeds to step S510.

  In step S510, the CPU 101 executes overlay processing, causes the printer unit 107 to print the overlaid form image, and outputs a print result 402. Then, the process returns to step S506 to shift the process to the next data sheet.

  If it is determined in step S506 that the data sheet 400 on the document table has been completed, the CPU 101 ends the form generation process.

  Hereinafter, the form registration process shown in step S502 of FIG. 5 will be described in detail with reference to FIG.

  FIG. 6 is a flowchart showing an example of the second control processing procedure in the present invention, and corresponds to the form registration processing shown in step S502 of FIG. Note that the processing in this flowchart is realized by the CPU 101 illustrated in FIG. 1 executing a program stored in the ROM 103 or the HDD 105 on the RAM 102. In the figure, S601 to S608 indicate each step.

  First, in step S601, the CPU 101 acquires form image data stored in the RAM 102. In step S602, the CPU 101 executes mark position detection processing from the acquired form image data to recognize the mark position (rectangular region). To detect characters and marks described in the same color as the underline marker in the rectangle. Details of this mark position detection process are shown in FIG.

  Next, in step S603, the CPU 101 determines whether or not the processing of S604 to S607 has been completed for all the marks detected in step S602. Among the marks detected in S602, any unprocessed mark is selected (hereinafter, this mark is referred to as the current mark), and the process proceeds to step S604.

  In step S604, the CPU 101 determines whether or not the MFP 100 is provided with the OCR processing unit 109. If it is determined that the OCR processing unit 109 is provided, the process proceeds to step S605.

  In step S605, the CPU 101 executes OCR recognition (character, font type, font size recognition) in the rectangular area corresponding to the current mark. In step S606, the CPU 101 issues an item number together with the item number. The mark detection and OCR recognition results are stored in the HDD 105 as form mark information 202 (FIG. 2B).

  On the other hand, if it is determined in step S604 that the OCR processing unit 109 is not provided in the MFP 100, the CPU 101 proceeds to step S606 as it is, issues an item number, and detects the mark together with the item number. The result is stored in the HDD 105 as form mark information 202 (FIG. 2B).

  Next, in step S607, the CPU 101 creates a rectangular area corresponding to the current mark (characters or marks described in the same color, such as underline markers) from the form image data held in the RAM 102. Erase (see FIG. 2C). Then, the CPU 101 returns the process to step S602.

  If it is determined in step S603 that the processing in steps S604 to S607 has been completed for all the marks detected in step S602, the CPU 101 retains the mark area in the RAM 102 in step S608 and deletes the mark area. The formed form image 203 (FIG. 2C) is stored in the HDD 105, and the process is terminated.

  Hereinafter, the field registration process shown in step S505 of FIG. 5 will be described in detail with reference to FIG.

  FIG. 7 is a flowchart showing an example of the third control processing procedure in the present invention, and corresponds to the field registration processing shown in step S503 of FIG. Note that the processing in this flowchart is realized by the CPU 101 illustrated in FIG. 1 executing a program stored in the ROM 103 or the HDD 105 on the RAM 102. In the figure, S701 to S707 indicate steps.

  First, in step S <b> 701, the CPU 101 acquires field image data and field sheet number stored in the RAM 102.

  In step S702, the CPU 101 executes mark position detection processing from the acquired form image data, recognizes the mark position (rectangular area), and uses the same color as the underline marker in the rectangle. Detects written characters and marks. Details of this mark position detection process are shown in FIG.

  Next, in step S703, the CPU 101 determines whether or not the processing of S704 to S707 has been completed for all the marks detected in step S702. Of the marks detected in S602, any unprocessed mark is selected (hereinafter, this mark is referred to as the current mark), and the process proceeds to step S704.

  In step S704, the CPU 101 performs processing for acquiring one form information from the form mark information 202 stored in the HDD 105, and proceeds to step S705.

  In step S705, the CPU 101 finishes reading all the form mark information, and determines whether the form mark information could not be acquired in step S704.

  In step S705, if the CPU 101 determines that all the form mark information has not been read yet and has acquired the form mark information in step S704, the process proceeds to step S706.

  In step S706, the CPU 101 determines whether the form mark information acquired in step S704 matches the current mark color information, line type, and the like. If it is determined that they do not match, the process proceeds to step S704. Return and get the next form mark information.

  If it is determined in step S706 that the form mark information acquired in step S704 matches the color information, line type, etc. of the current mark, the process proceeds to step S707.

  In step S707, the CPU 101 saves the current mark detection result in the HDD 105 as field mark information 302 (FIG. 3B) together with the field sheet number and item head. Then, the process returns to step S703.

  If it is determined in step S705 that reading of all form mark information has already been completed and form mark information has not been acquired in step S704, the process returns to step S703.

  If it is determined in step S703 that the processing in steps S704 to S707 has been completed for all the marks detected in step S702, the CPU 101 ends the processing.

  Hereinafter, the data reading process shown in step S508 of FIG. 5 will be described in detail with reference to FIG.

  FIG. 8 is a flowchart showing an example of the fourth control processing procedure in the present invention, and corresponds to the data reading processing shown in step S508 of FIG. Note that the processing in this flowchart is realized by the CPU 101 illustrated in FIG. 1 executing a program stored in the ROM 103 or the HDD 105 on the RAM 102. In the figure, S801 to S808 indicate steps.

  First, in step S801, the CPU 101 acquires a data image and a field paper number stored in the RAM 102. In step S802, the CPU 101 acquires field mark information 302 corresponding to the field paper number acquired in step S802 from the HDD 105. get.

  Next, in step S803, the CPU 101 determines whether or not the processing in steps S804 to S808 has been completed for all the field mark information acquired in step S802. Of the field mark information acquired in step S802, the field mark information having the smallest item number for which no data is stored in the rectangular image or OCR result 401 is selected (hereinafter, this field mark information is referred to as current field mark information). The process proceeds to step S804.

  In step S804, the CPU 101 cuts out a rectangular area of the image data based on the position information corresponding to the current field mark information, and deletes the mark from the cut out rectangular area.

  In step S805, the CPU 101 determines whether the MFP 100 is provided with the OCR processing unit 109. If the CPU 101 determines that the OCR processing unit 109 is provided, the process proceeds to step S806.

  In step S806, the CPU 101 executes OCR recognition (characters) in the rectangular area cut out in step S804 using the OCR processing unit 109, and in step S807, the OCR recognition result of the item corresponding to the current field mark information. Are stored in the HDD 105 as character data of the rectangular image or OCR result 401 (FIG. 4B). Then, the process proceeds to step S808.

  On the other hand, if it is determined in step S805 that the OCR processing unit 109 is not provided in the MFP 100, the CPU 101 advances the process to step S808 as it is.

  In step S808, the CPU 101 stores the OCR recognition result of the item corresponding to the current field mark information in the HDD 105 as the image data of the rectangular image or OCR result 401 (FIG. 4B) for the rectangular area image cut out in step S804. Then, the process returns to step S803.

  If it is determined in step S803 that the processes in steps S804 to S808 have been completed for all field mark information acquired in step S802, the CPU 101 ends the data reading process.

  Hereinafter, with reference to FIG. 9, the overlay process (synthesis process) shown in step S510 of FIG. 5 will be described in detail.

  FIG. 9 is a flowchart showing an example of the fifth control processing procedure according to the present invention, and corresponds to the overlay processing (synthesis processing) shown in step S510 of FIG. Note that the processing in this flowchart is realized by the CPU 101 illustrated in FIG. 1 executing a program stored in the ROM 103 or the HDD 105 on the RAM 102. In the figure, S901 to S907 indicate each step.

  First, in step S <b> 901, the CPU 101 acquires the form image 203 stored in the HDD 105.

  In step S <b> 902, the CPU 101 acquires a rectangular image or OCR result 401 from the HDD 105.

  Next, in step S903, it is determined whether or not the processing of S904 to S907 has been completed for all the rectangular images or OCR results acquired in step S902, and S904 is still performed for all the rectangular images or OCR results. If the CPU 101 determines that the processing in S907 has not been completed, the CPU 101 selects one of the unprocessed rectangular images orOCR results from the rectangular image orOCR results detected in step S902 (hereinafter, this rectangular image orOCR). The result is called a current rectangular image or OCR result), and the process proceeds to step S904.

  In step S904, the CPU 101 acquires the form image 203 from the HDD 105, and advances the process to step S905.

  Next, in step S905, the CPU 101 determines whether or not the MFP 100 is provided with the OCR processing unit 109. If the CPU 101 determines that the OCR processing unit 109 is provided, the process proceeds to step S906.

  In step S906, the CPU 101 adds font information (font type, font size, color, etc.) of the form mark information to a rectangular area corresponding to the rectangular area position information of the form mark information whose item number matches the current rectangular image or OCR result. ), The character data in the current rectangular image or OCR result is pasted. If the area sizes are different, the CPU 101 uses the character size change processing unit 113 to paste the fonts in accordance with the area size. Further, the CPU 101 determines that the aspect ratio is determined, and automatically controls the vertical writing or the horizontal writing to be pasted. Then, the process returns to step S903.

  On the other hand, if it is determined in step S905 that the OCR processing unit 109 is not provided in the MFP 100, the process proceeds to step S907.

  In step S907, the CPU 101 pastes the image data in the current rectangular image or OCR result into the rectangular area corresponding to the rectangular area position information of the form mark information whose item number matches the current rectangular image or OCR result. If the area sizes are different, the CPU 101 enlarges / reduces the image data according to the area size and pastes the image data. Then, the process returns to step S903.

  If it is determined in step S903 that the processing in steps S904 to S907 has been completed for all the rectangular images or OCR results acquired in step S902, the CPU 101 ends the overlay processing.

  Hereinafter, with reference to FIG. 10, the mark detection process shown in step S602 in FIG. 6 and step S702 in FIG. 7 will be described in detail.

  FIG. 10 is a flowchart showing an example of the sixth control processing procedure in the present invention, and corresponds to the mark detection processing shown in step S602 in FIG. 6 and step S702 in FIG. Note that the processing in this flowchart is realized by the CPU 101 illustrated in FIG. 1 executing a program stored in the ROM 103 or the HDD 105 on the RAM 102. In the figure, S1001 to S1005 indicate each step.

  First, in step S1001, the CPU 101 detects a pixel having a color from target image data (feature extraction (color)).

  Next, in step S1002, the CPU 101 extracts a line from the pixel having the color extracted in step S1001, and specifies a line type (dot pattern) from the extracted line (feature extraction (line type)).

  Next, in step S1003, the CPU 101 determines the shape based on the line / line type extracted in step S1002 (feature extraction (shape)). For example, if line segments of the same color / line type overlap at four points and the intersecting line segments form a rectangle, it is determined as “rectangular”. Also, if the line segments of the same color / line type do not overlap, it is determined as “underline”.

  Next, in step S1004, the CPU 101 determines whether or not the feature extraction (shape) in step S1003 has been determined to be a rectangle. If it is determined to be a rectangle, the process proceeds to step S1005.

  In step S1005, if the tangents of the line segments determined to be rectangular in step S1003 are not connected, the CPU 101 corrects the line segments so that they extend and intersect (rectangular correction). Then, the mark detection process ends.

  On the other hand, if it is determined in step S1004 that the feature extraction (shape) in step S1003 has not determined to be a rectangle, the CPU 101 ends the mark detection process as it is.

  Although not shown in FIG. 10, for the detection of characters / markers described in the same color as the underline / marker in the rectangle at the same time, the CPU 101 performs feature extraction (color, shape, etc.) as described above. Etc.), the character / mark is identified from the characteristic distribution of the target identification mark by a statistical approach.

  The characters and marks are identified in advance because a statistical approach is performed. The statistical approach described above specifies characters / marks by registering information such as color, line type, number of corners, number of line segments, etc. in advance for the characters / marks used in the system. Show how to go.

  As described above, it is possible to associate each item between multiple different forms by simply preparing the same item with the same marker between different forms. The read data can be automatically pasted on the other form (pasted without any individual pasting operation by the user) and printed.

  Therefore, it is not necessary to register a complicated form as in the conventional case, and even a user without computer knowledge can easily use it.

  For example, when the present invention is used for New Year's card printing, the user registers the form by specifying the postal code, address, and name rectangle of the New Year's card with a marker or the like, and the mail of the sender of the New Year's card received last year Easily print New Year's cards even if you don't have a New Year's card printing application by simply registering fields by specifying the number, address, and name rectangles with markers, etc., and then instructing the implementation of the overlay. It can be carried out.

  In addition, in the application form for securities or gifts, an individual slip from the application slip or the next application slip from the individual slip can be easily created by the same method as described above.

[Other embodiment 1]
A mark defining a calculation as shown in FIG. 11 may be written on the form sheet 200 so that the CPU 101 performs the defined calculation and pastes the calculation result on the field image.

  FIG. 11 is a schematic diagram showing an example of a mark that defines a rectangular area to which a calculation result that can be written on the form paper 200 is pasted.

  In FIG. 11, 1101 indicates the calculation result of (“value of item of mark 1111” + “value of item of mark 1112” − “value of item of mark 1113”) × “value of item of mark 1114”). A mark that defines a rectangular area to be pasted.

  Reference numeral 1102 denotes a mark that defines a rectangular area to which a calculation result of “(value of item of mark 1111” ÷ “value of item of mark 1112”) is pasted.

  Further, reference numeral 1103 denotes a mark that defines a rectangular area to which a calculation result of ((“item value of mark 1111” + “item value of mark 1112”) × 1.05) is pasted.

  Reference numeral 1104 denotes a mark that defines a rectangular area to which the calculation result (total of all “values of items of the mark 1111”) is pasted. In this case, it is assumed that a plurality of marks 1111 are designated in the field paper 300.

  Further, reference numeral 1105 denotes a mark that defines a rectangular area to which the operation result of (multiplication of all “values of items of the mark 1112”) is pasted. In this case, it is assumed that a plurality of marks 1112 are designated in the field paper 300.

  It should be noted that a mark defining such an operation is distinguishable from other marks by, for example, “math” or the like being written in the right corner of the mark.

  When registering the form, the CPU 101 registers the arithmetic expression defined in this way in the form mark information 202 together with the item number, rectangular position information, color information, font information, and association information. To do. For example, in the case of 1101, “(item 1 + item 2−item 3) × item 4” or the like is registered as an arithmetic expression.

  Note that the definition of the calculation shown in FIG. 11 is an example, and the pasting of the calculation result of any mathematical expression can be defined.

  As described above, simply writing the mark that defines the calculation on the form paper, not only pasting the data read from one form into another form, but also the calculation result of the data read from one form to another It can be easily pasted and printed on a form.

  Also, 1106 pastes a pie chart created using “item value of mark 1111”, “value of item of mark 1112”, “value of item of mark 1113”, and “value of item of mark 1114”. A mark that defines a rectangular area. As described above, the graph that defines the graph name and the data used for the graph is described on the form sheet 200, so that the CPU 101 may create the defined graph and paste it on the field image.

  Note that a mark defining such a graph can be distinguished from other marks by, for example, “graph” or the like being written in the right corner of the mark.

  As described above, it is possible to easily create a graph using data read from a certain form, paste it on another form, and print it by simply describing the mark defining the graph on the form sheet.

[Other embodiment 2]
When “field registration” is performed, each time a field sheet is scanned, the user specifies the number of field sheets (for example, “1”, “2”, “variable amount”, etc.) You may comprise so that registration may be performed.

  For example, it is assumed that the field sheet 300a shown in FIG. 3A is designated as “1”, and then the field sheet 300b is designated as “variable amount” and field registration is performed. As a result, the number of sheets is registered in the field mark information 302 together with the item number, rectangular position information, color information, line type information, and association information.

  In the above case, a data sheet corresponding to one field sheet 300a and a plurality of field sheets 300b are set as a set of data sheets, and a plurality of sets are set in the MFP to instruct the execution of overlay. Thus, the data read from the set of data sheets can be pasted and printed on the form image.

  Note that when “variable amount” is designated as the number of field sheets as described above, the CPU 101 displays the characteristics of each field sheet (for example, the image “order sheet” is located at the position (X1, Y1)). It shall be registered. Then, when the data sheet is read, it is determined which field sheet the data sheet corresponds to by a method such as matching, and the reading process is performed.

  It should be noted that the configuration and contents of the various data shown in the above drawings are not limited to this, and needless to say, they are configured with various configurations and contents depending on applications and purposes.

  Although one embodiment has been described above, the present invention can take an embodiment as, for example, a system, apparatus, method, program, or recording medium, and specifically includes a plurality of devices. The present invention may be applied to a system including a single device.

  The configuration of the data processing program that can be read by the form generation device according to the present invention will be described below with reference to the memory map shown in FIG.

  FIG. 12 is a diagram for explaining a memory map of a recording medium (storage medium) that stores various data processing programs that can be read by the form generation device according to the present invention.

  Although not specifically shown, information for managing a program group stored in the recording medium, for example, version information, creator, etc. is also stored, and information depending on the OS on the program reading side, for example, a program is identified and displayed. Icons may also be stored.

  Further, data depending on various programs is also managed in the directory. In addition, when a program or data to be installed is compressed, a program to be decompressed may be stored.

  The functions shown in FIGS. 5, 6, 7, 8, 9, and 10 in this embodiment may be performed by a host computer by a program installed from the outside. In this case, the present invention is applied even when an information group including a program is supplied to the output device from a recording medium such as a CD-ROM, a flash memory, or an FD, or from an external recording medium via a network. Is.

  As described above, a recording medium in which a program code of software for realizing the functions of the above-described embodiments is recorded is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus is stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing the program code.

  In this case, the program code itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program code constitutes the present invention.

  As a recording medium for supplying the program code, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, A silicon disk or the like can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) or the like running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Furthermore, after the program code read from the recording medium is written in a memory provided in a function expansion board inserted in the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the case where the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program represented by software for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading out a program represented by software for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention. It becomes.

  In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

  As described above, it is possible to provide a mechanism that allows data read from one form to be automatically pasted and printed between different forms without complicated computer operation. .

  It can be used for printing New Year's cards. First, the user instructs registration of a form by designating a postal code, address, and name rectangle of the New Year's card with a marker or the like. Next, the user designates the postal code, address, and name rectangle of the sender of the New Year's card received last year with a marker or the like, and instructs field registration. Finally, the user instructs the implementation of the overlay. As a result, even if you do not have a New Year's card printing application, you can easily print this year's New Year's card from last year's New Year's card.

  In addition, in the application form for securities or gifts, an individual slip from the application slip or the next application slip from the individual slip can be easily created by the same method as described above.

1 is a block diagram illustrating a configuration of a multi-function peripheral (MFP) to which a form generation device showing an embodiment of the present invention can be applied. It is a schematic diagram explaining the form registration process in the form production | generation apparatus of this invention. It is a schematic diagram explaining the form mark information of this embodiment. It is a schematic diagram explaining the preservation | save image of the form image of this embodiment. It is a schematic diagram explaining the field registration process in the form production | generation apparatus of this invention. It is a schematic diagram explaining the field mark information of this embodiment. It is a schematic diagram explaining the implementation process of the overlay in the form production | generation apparatus of this invention. It is a schematic diagram explaining the rectangular image orOCR result of this embodiment. It is a flowchart which shows an example of the 1st control processing procedure in this invention. It is a flowchart which shows an example of the 2nd control processing procedure in this invention. It is a flowchart which shows an example of the 3rd control processing procedure in this invention. It is a flowchart which shows an example of the 4th control processing procedure in this invention. It is a flowchart which shows an example of the 5th control processing procedure in this invention. It is a flowchart which shows an example of the 6th control processing procedure in this invention. FIG. 5 is a schematic diagram showing an example of a mark that defines a rectangular area to which a calculation result that can be written on form paper 200 is pasted. It is a figure explaining the memory map of the recording medium (storage medium) which stores the various data processing program which can be read with the form production | generation apparatus which concerns on this invention concerning this invention.

Explanation of symbols

100 MFP
101 CPU
102 RAM
103 ROM
105 HDD
106 Scan unit 107 Printer unit 108 Image processing unit 109 OCR processing unit 112 Operation unit 113 Character size change processing unit 200 Form paper 202 Form mark information 203 Form image 210 Operation panel 300 Field paper 302 Field mark information 400 Data paper 401 Rectangular image or OCR Result 402 Print result

Claims (14)

In the form generation device that combines form data and field data,
First detection means for reading a form image from form paper and detecting a marked area on the read form image;
First storage means for storing the position of the marked area detected by the first detection means;
Second storage means for storing the form image;
Second detection means for reading a field image from field paper and detecting a marked area on the read field image;
Third storage means for storing the position of the marked area detected by the second detection means;
Obtaining means for obtaining data of an area corresponding to the position of the marked area stored in the third storage means;
Fourth storage means for storing data acquired by the acquisition means;
The data stored in the fourth storage means is combined with the area corresponding to the position of the area corresponding to the mark stored in the first storage means of the form image stored in the second storage means. Combining means;
A form generation device characterized by comprising:   The form generation apparatus according to claim 1, wherein the first detection unit and the second detection unit detect a region marked by a mark having the same characteristic.   The said 1st detection means and the said 2nd detection means identify and detect the said marked area | region with the characteristic containing the color and line | wire type of a mark, The detection method of Claim 2 characterized by the above-mentioned. Form generation device.   The form generation apparatus according to claim 3, wherein the mark detected by the first detection unit and the second detection unit is a mark characterized by a marker line.   The second storage means stores, as a form image, image data obtained by deleting the marked area detected by the first detection means from the form image read from the form paper. The form production | generation apparatus in any one of Claims 1 thru | or 4. The first storage means stores the position and size of the marked area detected by the first detection means,
The synthesizing means is stored in the fourth storage means in an area corresponding to the position of the area corresponding to the mark stored in the first storage means of the form image stored in the second storage means. The form generation according to any one of claims 1 to 5, characterized in that the data is combined by being enlarged or reduced in accordance with the size of the area corresponding to the mark stored in the first storage means. apparatus. A character recognition unit for performing character recognition of the acquired data in the acquisition unit;
The fourth storage means stores data acquired by the acquisition means and a character recognition result by the character recognition means,
The synthesizing means is stored in the fourth storage means in an area corresponding to the position of the area corresponding to the mark stored in the first storage means of the form image stored in the second storage means. The form generation apparatus according to claim 1, wherein the character recognition results are combined. Font information recognition means for recognizing font information of characters existing in the marked area detected by the first detection means;
The first storage means stores the position of the marked area detected by the first detection means and the font information recognition result by the font information recognition means,
The synthesizing unit is stored in the first storage unit in an area corresponding to a position of an area corresponding to the mark stored in the first storage unit of the form image stored in the second storage unit. 8. The form generation apparatus according to claim 7, wherein the character recognition result stored in the fourth storage unit is synthesized with a font corresponding to the font information. The first storage means stores the position and size of the marked area detected by the first detection means,
The synthesizing unit enlarges or reduces the font size in accordance with the size of the area corresponding to the mark stored in the first storage unit, the character recognition result recognized by the character recognition unit. The form generation device according to claim 7 to 8. The mark detected by the first detection means can define an arithmetic expression using a mark having the same characteristics as the mark detected by the second detection means,
When a calculation is defined for the mark detected by the first detection means, the first storage means stores the position of the marked area and the defined calculation expression. Is,
The synthesizing means is stored in the fourth storage means in an area corresponding to the position of the area corresponding to the mark stored in the first storage means of the form image stored in the second storage means. The form generation device according to claim 7, wherein the calculation result by the arithmetic expression defined by the mark stored in the first storage means of the character recognition result is synthesized.   The form generation apparatus according to claim 1, wherein the acquisition unit acquires data of an area stored in the third storage unit of a data image in which data is described. In the form generation method that overlays form data and field data,
A first detection step of reading a form image from form paper and detecting a marked area on the read form image;
A first registration step of registering the position of the marked area detected by the first detection step in a first storage unit and registering the form image in a second storage unit;
A second detection step of reading a field image from field paper and detecting a marked area on the read field image;
A second registration step for registering the position of the marked area detected by the second detection step in a third storage means;
An acquisition step of acquiring data of an area corresponding to the position of the marked area registered in the third storage unit;
A third registration step of registering the data acquired in the acquisition step in a fourth storage means;
The data registered in the fourth storage means is combined with the area corresponding to the position of the area corresponding to the mark registered in the first storage means of the form image registered in the second storage means. A synthesis step;
A form generation method characterized by comprising:   The program for making a computer implement | achieve the form production | generation apparatus described in Claim 1 thru | or 11 or the program for making a computer perform the form production | generation method described in Claim 12.   A program for causing a computer to implement the form generation device according to claim 1 or a program for causing a computer to execute the form generation method according to claim 12 in a computer-readable storage Medium.

Images