JP2002207955A - Information input support system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically set an input box for print data in a desired area for input by automatically recognizing a character string, a ruled line, or a frame on a document. SOLUTION: This system has MFP 1 and PC 2 connected through a network N and the PC 2 has a ruled-line recognition part 252 which recognizes a ruled line or a frame included in image data, a character recognition part 253 which recognizes characters included in the image data, a data storage part 21 which stores the image data and area separation result data separated by an image processing part 12, and an input box setting part 254 which determines the positions of the ruled line or frame recognized by the ruled-line recognition part 252 according to the image data stored in the data storage part 252 and sets an input box of size corresponding to an area at the positions.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an information input support system capable of minimizing a user's operation when inputting print data to a document of a specific format.

[0002]

2. Description of the Related Art When combining print data with a document of a specific format, a printing system has been proposed in which an image of the document already set in a printer as an image forming apparatus is displayed on a personal computer. See JP-A-2000-112699).

[0003] In this way, the user checks the synthesis result displayed on the personal computer while adding the original to the document.
Print data to be combined can be input.

[0004]

However, according to the above-described conventional printing system, no special means for inputting print data is provided. for that reason,
In the case of inputting print data, it is necessary for the user to specify the area to be input and then input the print data, which has a problem that the input operation is troublesome.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and has as its object to automatically recognize a character string, a ruled line, or a frame on a document and automatically set a print data input box in an area to be input. The present invention provides an information input support system that simplifies a user's operation of inputting print data by setting the information input support system.

[0006]

In order to solve the above problems, an information input support system according to the present invention is an information input support system in which an image forming apparatus and an external device are connected via a communication line. The image forming apparatus includes: an image reading unit that reads image data of a document printed in a format; an image processing unit that separates a character area and a line drawing area from an image area of the read image data; Image forming means for forming an image, wherein the external device comprises: an image display means for capturing and displaying the image data read by the image reading means; and a ruled line for recognizing a ruled line or a frame included in the image data. Frame recognition means,
Character recognition means for recognizing characters included in the image data, storage means for storing the image data and the area separation result data separated by the image processing means, and image data stored in the storage means Input box setting means for determining a position of a ruled line or a frame recognized by the ruled line / frame recognizing means and setting an input box having a size corresponding to an area at the position.

According to the present invention having such features,
The position of the ruled line or the frame is determined by the input box setting means, and the input box of a size corresponding to the area at that position is automatically set, so that it is not necessary for the user to specify the area to input the print data by himself. It is possible to omit it and to input the print data desired by the user immediately.

[0008] The information input support system of the present invention comprises:
Image reading means for reading image data of a document printed in a format, image processing means for separating a character area and a line drawing area from an image area of the read image data, and an image for forming an image on a recording sheet Forming means;
Image display means for displaying image data read by the image reading means, ruled line / frame recognition means for recognizing ruled lines and frames included in the image data, and character recognition means for recognizing characters included in the image data Storage means for storing the image data and the area separation result data separated by the image processing means; and a ruled line recognized by the ruled line / frame recognition means based on the image data stored in the storage means. Input box setting means for determining the position of the frame or the frame, and setting an input box having a size corresponding to the area at the position, wherein each of these means is provided inside the image forming apparatus.

According to the present invention having such features,
The position of the ruled line or the frame is determined by the input box setting means, and the input box of a size corresponding to the area at that position is automatically set, so that it is not necessary for the user to specify the area to input the print data by himself. It is possible to omit it and to input the print data desired by the user immediately.

Further, the information input support system of the present invention comprises:
In each of the above configurations, the positions of characters, ruled lines, and frames are specified from the character and diagram areas of the image data separated by the image processing means, and whether or not the input box is necessary based on each position is determined. Is further provided.

According to the present invention having such features,
An input box can be set for an area where print data is to be input. That is, it is possible to prevent a problem that an input box is set in an area other than the area where the print data is desired to be input.

Further, the information input support system of the present invention comprises:
In each of the above configurations, the position of the blank area of the document and the position of the character are specified from the character and diagram areas of the image data separated by the image processing unit, and the position data and the character recognition unit recognize the position. A determination unit configured to determine whether an input box is necessary in the blank area based on the character recognition result data; and the input box setting unit sets the input box in the blank area by the determination unit. When it is determined that it is necessary, an input box is set in the blank area.

According to the present invention having such features,
This eliminates the need for the user to draw an image or to set or change an input support tool for an area to be input, and allows the user to immediately input image data desired by the user.

Further, the information input support system of the present invention comprises:
In each of the above configurations, the apparatus further comprises means for associating an input box to be set with a character to be input to the input box based on the ruled line and the character string recognized from the image data by the ruled line / frame recognition means and the character recognition means. It is characterized by having.

According to the present invention having such features,
This eliminates the need for the user to set and change the input support tool, and allows the user to immediately input desired data.

Further, the information input support system of the present invention comprises:
In each of the above configurations, based on a character string recognized from the image data by the character recognizing means, a data storage unit that stores data corresponding to an arbitrary character string, and stores data corresponding to the content of the character string in the data. Data input means for extracting the data from the storage means and inputting the data into an input box associated with a character string.

According to the present invention having such features,
The trouble of inputting data by the user himself can be saved.

Further, the information input support system of the present invention comprises:
In each of the above configurations, a means for adjusting a print format based on the contents of a character string recognized from the image data by the character recognition means and the size of an input box corresponding to the character string (data correction processing unit) Is further provided.

According to the present invention having such features,
This eliminates the need for the user to change the print data format.

Further, the information input support system of the present invention comprises:
In each of the above-described configurations, the image processing apparatus further includes a difference analysis unit that extracts the image data of the filled-in portion by calculating a difference between the image data of the blank document read by the image reading unit and the image data of the filled document. The input box setting means sets an input box corresponding to the image data of the entry portion extracted by the difference analysis means in the document data.

According to the present invention having such features,
An input box can be set accurately for an area where print data is to be input.

[0022]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a functional block diagram showing one embodiment of the information input support system of the present invention.

In this information input support system, a multifunction device (hereinafter abbreviated as MFP) 1 as an image forming apparatus and a personal computer (hereinafter abbreviated as PC) 2 as an external device are connected via a network N. It is connected.
Further, a file server 3 storing personal information and the like is connected to the network N. Further, a display device 4 such as a CRT and an input device 5 such as a mouse and a keyboard are connected to the PC 2.

The MFP 1 includes an image reading unit 11, an image processing unit 12, an image forming unit 13, and a network interface (I / F) 14. Image reading unit 11
Is a block for scanning a document (not shown) set by the user. The image processing unit 12 is a block that separates a scanned document from a character and line drawing area and an image area. The image forming unit 13 is a block that accurately matches the position of the additional data input on the PC 2 with the position of the document (recording paper) and forms an image on the document (recording paper).

The PC 2 comprises a data storage unit 21, a data storage unit 22, a data input unit 23, a data display unit 24, an application unit 25, and a network interface (I / F) 26.

The application section 25 includes a form recognition section 251, a ruled line recognition section (ruled line / frame recognition means) 252, a character recognition section 253, an input box setting section 254, a data automatic input section 255, a data correction processing section 256, and a data editing section. It comprises a processing unit 257 and a difference analysis unit 258. The data storage unit 21 includes a document data storage unit 211 and an additional data storage unit 212.

The ruled line recognizing unit 252 is provided in the document data storing unit 2
11 (results separated into character and line drawing areas and image areas by the image processing unit 12)
This is a block for recognizing ruled lines and frames.

The character recognizing section 253 includes dictionary data (not shown) for recognizing characters related to the input contents, for example, characters such as "name", "contact", "Heisei", "description", and "figure". This is a block for recognizing those characters from the character area as a result of the area separation. As a result, only necessary parts can be quickly recognized. Further, since the amount of character information of the character recognition unit 253 can be minimized, there is an advantage that the storage capacity can be reduced.

The rule recognition unit 252 and the character recognition unit 253
Has the recognized ruled lines and frames, and the position information of the character strings. The form recognition unit 251 associates the specified character strings with the ruled lines based on the position information, and performs information relating to the character input. This is a block for determining ruled lines and frames of missing words.

The input box setting section 254 is a block for setting an input box having an optimal size in an area where an input is required, which is determined by the form recognizing section 251.

The data automatic input unit 255 is provided with the character recognition unit 2
53 is a block for extracting data corresponding to the recognized character string from the data storage unit 22 and inputting the data to an input box associated with the character string.

The data correction processing unit 256 is a block that determines and adjusts a font size and a line feed suitable for the size of the input box and the number of characters of the input data.

The data editing unit 257 is a block for editing and changing data according to a command from the data input unit 23.

The original data storage unit 211 is a block for storing the image of the image data of the original transmitted from the MFP 1 and the data of the area separation result.

The additional data storage unit 212 is a block for storing the additional data input by the user from the input device 5 and the additional data by the data automatic input unit 255 of the application unit 25.

The data storage unit 22 stores user information (name,
This is a block for storing data such as department name, contact information, email address, etc.) and date. Data storage unit 2
2 stores a data table 221 as shown in FIG. The data table 221 includes items such as a keyword, an input support tool, the number of characters, and a data storage location.

The data input unit 23 issues an instruction to input and edit data to the application unit 25 and issues an image reading command to the MFP 1. Also, I
This block performs control such as control of a character input tool such as an ME, insertion of an image into an input box, or association of input of a character or a number with an input box.

The data display unit 24 stores the original data storage unit 2
11 is a block for performing control for displaying the image of the image data of the original document stored in 11 and the additional data stored in the additional data storage unit 212 on the display device 4.

Next, an information input support procedure in the information input support system having the above-described configuration will be described with reference to a flowchart shown in FIG. 3 and explanatory diagrams of input box settings shown in FIGS. 4 and 5.

An original to be read, for example, an original 61 shown in FIG. 4A is set on a tray (not shown) in the image reading section 11 of the MFP 1. Then, in response to a document reading command from the data input unit 23 of the PC 2, the image reading unit 11 scans the set document 61 and reads image data (step S1). The image processing section 12 separates the image area from the character area and the line drawing area of the read image data (step S2).

The image data and the area separation result data of the original 61 are stored in the network I / F 14, the network N,
And transmitted to the PC 2 via the network I / F 26 and stored in the document data storage unit 211 (step S
3). Then, based on the data stored in the document data storage unit 211, the ruled line recognition unit 252 recognizes ruled lines and frames in the document as shown in FIG.
4), the character recognition unit 253, as shown in FIG.
A character string related to the input of the manuscript, that is, “creation date”,
"Author", "Department", "Contact", "Email",
Is recognized (step S5).

On the other hand, the form recognizing unit 251 associates the ruled line and the frame with the character string based on the positional relationship between the ruled line and the frame obtained in step S4 and step S5, and makes the ruled line irrelevant to the character input. The frame and the frame are determined (step S6). Also, an input box setting unit 254
Determines the size and arrangement position of the input box from the recognition result of the form recognition unit 251 and sets the input box 62 as shown in FIG. 4D, for example (step S).
7). Here, in the present embodiment, the input box setting unit 2
Before setting the input box at 54, the form recognition unit 2
One of the features is that a rule line or a frame irrelevant to the character input is determined in advance at 51. That is, if the form recognition unit 251 is not provided, as shown in FIG. 5A, the input box 63 is set for an unnecessary frame. If the frame and the frame are determined in advance, such a problem does not occur.

The data input section 23 reads information from the data table 231 shown in FIG. 2 and associates an input box with an input support tool so that a user can easily input characters and images. For example, when "Email" is recognized, the input box corresponding to "Email" is an alphanumeric input.

Next, the data automatic input unit 255 checks whether or not an item to be automatically input exists on the document (step S8), and if it exists (Yes in step S8).
If it is determined to be s), data corresponding to the character recognized by the character recognition unit 253 is obtained from the data storage unit 22 or the file server 3 on the network N, and data is input to the input box ( Step S9). For example, when the character string “creator” is recognized, data “Taishi Nishio” corresponding to the keyword “creator” is read from the data table 221 shown in FIG. Obtain and automatically enter that data. FIG. 5B shows an example of the input result. Similarly, "department", "contact", "Emai
The data corresponding to each keyword is automatically entered in each input box of "1".

Next, the user selects an input box of an item to be input by operating a mouse or a TAB key (not shown), and inputs data from the keyboard (step S).
10). At this time, since the input box and the input support tool are associated with each other as described above, the user can easily input data.

Next, the data correction processing unit 256 calculates the standard of the number of characters of the input data by using the data table 221 shown in FIG.
The appropriate font size, line feed, etc. are determined and adjusted based on the estimated number of characters and the size of the input box. As a result, it is possible to approach an input result desired by the user.

When the user edits the contents in the input box (when judged Yes in step S11), the user selects the target input box and changes the contents, the font, or the size, The number of rows is changed (step S12). These additional data are stored in the additional data storage unit 212.

Thereafter, when the user operates a print button (not shown) of the input device 5 to execute a print command, these additional data are transferred to the MFP 1, and the image forming unit 13 determines the position of the additional data and the original (recording). An image is formed by accurately matching the position of the sheet (paper) (step S1).
3) By printing and outputting (step S14), it is possible to obtain a printing result as displayed on the display device 4. FIG. 5C shows an example of the printing result at this time.

Next, another embodiment of the information input support procedure in the information input support system having the configuration shown in FIG. 1 will be described with reference to the flowchart shown in FIG. 6 and the illustration of the input box setting shown in FIGS. I will explain.

In this embodiment, for example, a blank document 65 shown in FIG. 7A and a filled document 66 shown in FIG. 7B are prepared as the documents to be read, and these are read by the image reading unit 11. Set on a tray (not shown). Then, in response to a document reading command from the data input unit 23 of the PC 2, the image reading unit 11 scans the set documents 65 and 66 to read image data (Step S).
21). The image processing unit 12 separates the image area from the character area and the line drawing area of the read image data for each of the originals 65 and 66 (step S2).
2).

The image data and region separation result data of the document 65 and the image data and region separation result data of the document 66 are stored in the network I / F 14, the network N,
And transmitted to the PC 2 via the network I / F 26 and stored in the document data storage unit 211 (step S
23).

When the two image data are stored in the document data storage unit 211 in this manner (Y in step S24).
Then, the difference analysis unit 258, based on the two image data stored in the document data storage unit 211, based on the image data of the blank document 65 and the image data of the filled document 66. The analysis is performed on the difference between the two (step S25). Since the unfilled manuscript 65 and the filled-in manuscript 66 generally differ only in the entry fields, the difference analysis unit 258 determines the difference between the two based on the ruled lines and frames that are the characteristic parts of the two. Is extracted. The result is as shown in FIG.

FIG. 8A shows the input box setting section 254.
An input box 62 as shown in FIG. 7B is set for the difference area shown in FIG. Then, the input box 62 set as described above and FIG.
When the image data of the unfilled original 65 shown in (a) is superimposed, the original 67 in which the input box 62 is set in the area where the print data is to be input is displayed on the display device 4 as shown in FIG. Is displayed. This allows the user to easily input print data for a document of a specific format.

In the above embodiment, MFP 1 and P
C2 is connected via a network N,
The PC 2 is described as having a data storage unit 21, a data storage unit 22, a data input unit 23, a data display unit 24, and an application unit 25.
The MFP 1 may be configured such that all functions on the 22 side, that is, all of the data storage unit 21, the data storage unit 22, the data input unit 23, the data display unit 24, and the application unit 25 are provided on the MFP 1 side. FIG. 9 shows an example of the MFP 1 having such a configuration. Note that the information input support procedure in the MFP 1 having such a configuration is the same as described above, and a description thereof will be omitted.

[0056]

According to the information input support system of the present invention, the position of the ruled line or the frame is determined by the input box setting means, and the input box of a size corresponding to the area at that position is automatically set. This eliminates the need for the user to specify the area in which the user wants to input print data, and allows the user to immediately input the print data desired by the user.

Further, according to the information input support system of the present invention, the positions of characters, ruled lines and frames are specified from the character and diagram areas of the image data separated by the image processing means, and based on the respective positions. Since the configuration further includes means for determining whether an input box is required, an input box can be set for an area where print data is to be input. That is, it is possible to prevent a problem that an input box is set in an area other than an area where print data is to be input. Further, according to the information input support system of the present invention, from the character and diagram area of the image data separated by the image processing means,
Judgment means for specifying the position of a blank area and the position of a character in a document, and judging whether or not an input box is required in the blank area based on the position data and the character recognition result data recognized by the character recognition means. The input box setting means is configured to set the input box in the blank area when it is determined by the determining means that the input box needs to be set in the blank area. The trouble of drawing or setting or changing an input support tool for an area to be input can be omitted, and image data desired by the user can be input immediately.

According to the information input support system of the present invention, based on the ruled lines and character strings recognized from the image data by the ruled line / frame recognizing means and the character recognizing means, an input box to be set and input to the input box are input. Since the configuration further includes means for associating with a character, it is possible to save the user the trouble of setting and changing the input support tool, and to input data desired by the user immediately.

Further, according to the information input support system of the present invention, the data storage means for storing data corresponding to an arbitrary character string and the character string based on the character string recognized from the image data by the character recognition means And data input means for extracting data corresponding to the contents of the data from the data storage means and inputting the data into the input box associated with the character string. Can be omitted.

According to the information input support system of the present invention, the print format is determined based on the contents of the character string recognized from the image data by the character recognition means and the size of the input box corresponding to the character string. (Data correction processing unit), so that the user does not need to change the format of the print data by himself.

Further, according to the information input support system of the present invention, the difference between the image data of the blank document read by the image reading means and the image data of the filled document is obtained, whereby the image of the filled portion is obtained. Since difference analysis means for extracting data is provided, the input box setting means is configured to set the input box corresponding to the image data of the entry portion extracted by the difference analysis means in the original data. An input box can be set accurately for an area in which the user wants to input.

[Brief description of the drawings]

FIG. 1 is a functional block diagram illustrating an information input support system according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram showing a configuration example of a data table.

FIG. 3 is a flowchart showing one embodiment of an information input support procedure in the information input support system of the present invention.

FIG. 4 is an explanatory diagram of input box settings.

FIG. 5 is an explanatory diagram of input box setting.

FIG. 6 is a flowchart showing another embodiment of the information input support procedure in the information input support system of the present invention.

FIG. 7 is an explanatory diagram of an input box setting.

FIG. 8 is an explanatory diagram of input box settings.

FIG. 9 is a functional block diagram showing an embodiment in which the entire information input support system of the present invention is provided in a copying machine.

[Explanation of symbols]

 Reference Signs List 1 MFP (image forming apparatus) 2 PC (external device) 3 file server 4 display device 5 input device 11 image reading unit 12 image processing unit 13 image forming unit 21 data storage unit 22 data storage unit 23 data input unit 24 data display unit 25 application section 211 original data storage section 212 additional data storage section 251 form recognition section 252 ruled line recognition section (ruled line / frame recognition means) 253 character recognition section 254 input box setting section 255 data automatic input section 256 data correction processing section 257 data editing Processing unit 258 Difference analysis unit

Claims (8)

[Claims] 1. An information input support system in which an image forming apparatus and an external apparatus are connected via a communication line, the image forming apparatus comprising: an image reading unit for reading image data of a document printed in a format; An image processing unit configured to separate a character area and a line drawing area of the read image data from the image area; and an image forming unit configured to form an image on a recording sheet. Image display means for capturing and displaying the image data read by, ruled line / frame recognition means for recognizing ruled lines and frames included in the image data, and character recognition means for recognizing characters included in the image data, Storage means for storing the image data and the area separation result data separated by the image processing means; and image data stored in the storage means. On the basis of,
An input box setting means for determining a position of a ruled line or a frame recognized by the ruled line / frame recognizing means and setting an input box having a size corresponding to an area at the position; . 2. An image reading means for reading image data of a document printed in a format, an image processing means for separating a character area, a line drawing area, and an image area of the read image data, and Image forming means for performing image formation; image display means for displaying image data read by the image reading means; ruled line / frame recognition means for recognizing ruled lines and frames included in the image data; Character recognition means for recognizing included characters, storage means for storing the image data and the area separation result data separated by the image processing means, and based on the image data stored in the storage means,
Input box setting means for determining a position of a ruled line or a frame recognized by the ruled line / frame recognizing means, and setting an input box having a size corresponding to an area at the position; An information input support system provided in a computer. 3. The position of a character, a ruled line, and a frame is specified from a region of a character and a diagram of image data separated by the image processing means, and whether or not the input box is necessary is determined based on the position. 3. The information input support system according to claim 1, further comprising: means for judging. 4. A position of a blank area of a document and a position of a character are specified from the character and diagram areas of the image data separated by the image processing means, and the position data and the position of the character are recognized by the character recognition means. A determination unit configured to determine whether or not an input box is required in the blank area based on the character recognition result data; and the input box setting unit needs to set an input box in the blank area by the means. 4. The information input support system according to claim 1, wherein when it is determined that there is an input box, an input box is set in the blank area. 5. 5. An image forming apparatus further comprising: a unit for associating an input box to be set with a character to be input to the input box based on a ruled line and a character string recognized from the image data by the ruled line / frame recognition unit and the character recognition unit. The information input support system according to claim 1, 2, 3, or 4, wherein: 6. A data storage means for storing data corresponding to an arbitrary character string, and, based on a character string recognized from the image data by the character recognition means, data corresponding to the contents of the character string, 4. A data input means for extracting data from an input box associated with a character string extracted from a storage means.
4. The information input support system according to 4 or 5. 7. A means for adjusting a print format based on the contents of a character string recognized from the image data by the character recognition means and the size of an input box corresponding to the character string (data correction processing unit) The information input support system according to claim 1, further comprising: 8. A difference analysis means for extracting a difference between image data of an unfilled document read by the image reading device and image data of a filled document, thereby extracting image data of an entry portion. The input box setting means sets an input box corresponding to the image data of the entry portion extracted by the difference analysis means in the document data.
Or the information input support system according to 7.