JP2014038504A - Item entering device, item entering system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an item entering device, an item entering system, and a program, capable of entering an item value for each item in an entry column provided for entering the item value.SOLUTION: An item entering device includes: a ruled line extraction part 82 for extracting a ruled line out of an image; an area classification part 84 for classifying a plurality of areas defined by the ruled lines extracted by the ruled line extraction part 82 into item columns and entering columns; an association part 86 for associating the item column classified by the area classification part 84 with an entry column for entering an item value corresponding to an item shown in the item column; and an entering part 94 for reading a previously stored item value corresponding to an item shown in the item column so as to enter it in an entry column associated with the item column by the association part 86.

Description

  The present invention relates to an item entry device, an item entry system, and a program.

  In Patent Document 1, digital image data from an image scanner that has read a print format printed on a form is displayed on an LCD, and in this image display, a horizontal ruled line is sequentially detected by repeating a search to the right and a line feed. Then, sequentially determine whether the detected margin area immediately above the horizontal ruled line is a printable area, and when it is determined as a printable area, the printable area is indicated by the area cursor, and the printable area is Standard area information is calculated and displayed, and the area information is determined by pressing the + key. All the area information sequentially determined by pressing the + key is stored in the floppy (registered) format as a print format by pressing the SAVE key. Trademark) what is stored on the disc is disclosed.

  Japanese Patent Laid-Open No. 2004-26883 reads and stores information such as characters displayed on an input sheet by optical means, cuts out only a specified area of the stored contents, and specifies an output position of the cut out area. A method for producing output paper having a format different from that of the input paper by performing output printing, wherein a position of a correction mark provided in advance on the input paper is detected, and an area to be cut out based on the detected position A format conversion processing method between input and output sheets is disclosed.

Japanese Patent Laid-Open No. 06-222895 JP-A-62-099888

  An object of the present invention is to provide an item entry device, an item entry system, and a program capable of entering an item value for each item in an entry column provided for entering the item value.

  The present invention according to claim 1 is a ruled line extracting unit that extracts a ruled line from an image, a region classifying unit that classifies a plurality of regions determined by the ruled line extracted by the ruled line extracting unit into an item column and an entry column, Corresponding means for associating an entry field for entering an item value for the item indicated by the item field with the item field classified by the region classification means, and an entry field associated with the item field by the associating means , An item entry device having entry means for reading out and entering previously stored item values for the items indicated by the item column.

  According to a second aspect of the present invention, the correlating means is based on a line segment constituting the item column to be associated and an extension of the line segment and a degree of overlap between the line segment constituting the entry column. The item entry device according to claim 1 to be associated.

  The present invention according to claim 3 is the item entry device according to claim 1 or 2, wherein the region classification means classifies based on a ratio of pixels having a predetermined pixel value in the region.

  The present invention according to claim 4 further includes correction means for correcting a pixel having a pixel value other than a predetermined pixel value out of the pixels included in the image to a predetermined pixel value, 4. The item entry device according to claim 3, wherein the classifying means classifies using the pixel values corrected by the correcting means.

  The present invention according to claim 5 is the item entry device according to any one of claims 1 to 4, wherein the ruled line extracting means extracts a plurality of ruled lines within a predetermined interval as one ruled line.

  According to a sixth aspect of the present invention, the associating means determines whether the line segment that constitutes the item column to be matched and the degree of overlap between the extension line of the line segment and the line segment that constitutes the entry column. 6. The item entry device according to any one of claims 2 to 5, wherein the entry field to be associated is determined by weighting determined by the adjacent direction of the field and the entry field.

  According to a seventh aspect of the present invention, the associating means includes, in the item field classified by the area classification means, a line segment constituting the item field, an extension line of the line segment, and a line segment constituting the entry field. The item entry device according to any one of claims 2 to 5, wherein a plurality of entry fields are associated with each other on the basis of the degree of overlap.

  The present invention according to claim 8 is configured such that the image includes a frame line surrounding a region where a character string is represented, and a ruled line surrounding at least one side surrounding a region adjacent to the region where the character string is represented. 8. The item entry device according to claim 1, further comprising a frame line creating unit configured to create a frame line, wherein the ruled line extracting unit extracts the frame line created by the frame line creating unit. .

  The present invention according to claim 9 further includes storage means for storing the image and information about the association by the association means, and the entry means includes the image and the association information stored in the storage means. The item entry device according to any one of claims 1 to 8, wherein an item value is entered in an entry field based on information.

  According to the tenth aspect of the present invention, there is provided a user management device that manages user information, a ruled line extracting unit that extracts a ruled line from an image, and a plurality of areas determined by the ruled line extracted by the ruled line extracting unit. An area classification means for classifying the field into an entry field, an association means for associating an item field classified by the area classification means with an entry field for entering an item value for the item indicated by the item field, and a user Identification information accepting means for accepting information for identifying, and use determined by the identification information accepted by the identification information accepting means for the item indicated by the item field in the entry field associated with the item field by the associating means An item entry system comprising an item entry device having entry means for reading out and entering previously stored item values for the user from the user management device.

  The present invention according to claim 11 is a ruled line extracting step for extracting ruled lines from an image, a region classifying step for classifying a plurality of areas determined by the extracted ruled lines into item fields and entry fields, and classified item fields An association step for associating an entry field for entering an item value for the item indicated by the item field, and reading and entering the pre-stored item value for the item indicated by the item field in the associated entry field This is a program that causes a computer to execute an entry step.

  According to the first aspect of the present invention, it is possible to provide an item entry device capable of entering the item value for each item in the entry column provided for entering the item value.

  According to the present invention according to claim 2, in addition to the effect of the present invention according to claim 1, it is possible to prevent entry of an item value in an incorrect entry column as compared with the case without this configuration. A possible item entry device can be provided.

  According to the third aspect of the present invention, in addition to the effect of the first aspect of the present invention according to the first or second aspect, compared to the case where the present configuration is not provided, the classification of the item column and the entry column is incorrect. It is possible to provide an item entry device that can reduce the amount of work done.

  According to the fourth aspect of the present invention, in addition to the effect of the present invention according to the third aspect, even if the pixel value in the region is other than the predetermined pixel value, compared with the case where the present configuration is not provided. In the classification of the item column and the entry column, it is possible to provide an item entry device that can reduce erroneous classification.

  According to the fifth aspect of the present invention, in addition to the effect of the present invention according to any one of the first to fourth aspects, the ruled line of the item column and the ruled line of the entry column represented in the image are not in contact with each other. In addition, it is possible to provide an item entry device capable of entering the item value for each item in the entry column provided for entering the item value.

  According to the present invention according to claim 6, in addition to the effects of the present invention according to any one of claims 2 to 5, an incorrect entry column is associated with the item column as compared to the case without this configuration. An item entry device can be provided.

  According to the present invention according to claim 7, in addition to the effect of the present invention according to any one of claims 2 to 5, even when there are provided a plurality of entry columns for entering item values for the items indicated by the item column, It is possible to provide an item entry device capable of entering an item value for each item in an entry column provided for entering the item value.

  According to the present invention according to claim 8, in addition to the effects of the present invention according to any one of claims 1 to 7, the item value for each item even when the item field and the entry field are not surrounded by ruled lines in the image It is possible to provide an item entry device that can be entered in an entry field provided for entering the item value.

  According to the ninth aspect of the present invention, in addition to the effect of the present invention according to any one of the first to eighth aspects, the item column and the entry column are already associated with each other as compared with the case where the present configuration is not provided. It is possible to provide an item entry device that can reduce the processing load when entering item values for an image.

  According to the tenth aspect of the present invention, it is possible to provide an item entry system capable of entering item values for each item in an entry column provided for entering the item values.

  According to the present invention according to claim 11, it is possible to provide a program capable of entering an item value for each item in an entry column provided for entering the item value.

It is a mimetic diagram showing item entry system 2 concerning an embodiment of the present invention. 1 is a cross-sectional view showing an image forming apparatus 4 according to an embodiment of the present invention. 2 is a block diagram illustrating a hardware configuration of an image forming apparatus 4 according to an embodiment of the present invention. FIG. It is a schematic diagram which shows the hardware constitutions of the user management apparatus 6 which concerns on embodiment of this invention. It is a block diagram which shows the function structure of the image forming apparatus 4 implement | achieved by running a program. It is a schematic diagram explaining extraction of the area | region divided by the ruled line and the ruled line by the ruled line extraction part 82, (a) shows an example of the item column and entry column contained in an image, (b) is extracted. A ruled line is shown, and (c) shows the numbering of each extracted area. It is a schematic diagram explaining extraction of a ruled line when there are two ruled lines that divide an area, (a) shows a ruled line included in the image, and (b) shows a ruled line extracted by the ruled line extracting unit 82. ing. It is a schematic diagram which illustrates the other aspect of an item column and an entry column, (a) shows the aspect in which an entry column is provided in the lower stage of an item column, (b) has shown the aspect of vertical writing. It is a schematic diagram explaining the correlation by the correlation part 86, (a) shows the example which matches an entry column with the area | region classified with the item column, (b) fills in not the column which shows an item. In the case where there is a blank field that is not a column for the purpose, an example in which an entry field is associated is shown, and (c) shows an example in which a plurality of entry fields are associated with one item field. It is a flowchart which illustrates operation | movement of the item entry system which concerns on embodiment of this invention. It is a block diagram which shows the function structure of the image forming apparatus 4 in the 1st modification of embodiment of this invention. It is a schematic diagram explaining the correction | amendment by the correction | amendment part 130 in the 1st modification of embodiment of this invention, (a) illustrates the case where both an item column and an entry column are gray images, (b) is The case where only the item column is a gray image is illustrated, and (c) shows the result of the correction performed by the correction unit 130 on the item column and entry column shown in (a) and (b). It is a block diagram which shows the function structure of the image forming apparatus 4 in the 2nd modification of embodiment of this invention. It is a mimetic diagram explaining creation of a frame line by frame line creation part 132 in the 2nd modification of an embodiment of the present invention, and (a) and (b) are frame lines by frame line creation part 132, respectively. An example of an image before being created is shown, and (c) shows an image after a frame line is created by the frame line creation unit 132.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a schematic diagram showing an item entry system 2 according to an embodiment of the present invention. As shown in FIG. 1, the item entry system 2 includes an image forming apparatus 4 that functions as an item entry apparatus and a user management apparatus 6. The image formation apparatus 4 and the user management apparatus 6 are Are connected by a network 8 constituted by a LAN, a WAN, the Internet, or the like.

  FIG. 2 is a cross-sectional view showing the image forming apparatus 4. The image forming apparatus 4 includes a UI device 10, a printing device 12, a reading device 14, and a communication device 16.

  The UI device 10 is configured as a touch panel, for example, and includes a function as a display device that displays information and a function as an input reception device that receives an input made by an operator.

  The printing device 12 is a device that performs printing. The printing apparatus 12 includes, for example, three stages of recording medium supply cassettes 18, and each of the recording medium supply cassettes 18 is provided with a supply head 20.

  When one of the recording medium supply cassettes 18 is selected, the supply head 20 is actuated and supplied from the selected recording medium supply cassette 18 to the image forming mechanism 24 via the recording medium supply path 22.

  The image forming mechanism 24 is provided with yellow, magenta, cyan, and black photoconductors 26 and an intermediate transfer belt 28.

  Around each photoconductor 26, a charging device, an exposure device, a developing device, a primary transfer device, a cleaning device, and the like (not shown) are arranged, and a toner image formed on each photoconductor 26 is transferred to the intermediate transfer belt 28. Transcribed. When black and white is set, only black is enabled.

  The toner image on the intermediate transfer belt 28 is transferred to the sent recording medium by the secondary transfer roll 30 and fixed by the fixing device 32, and the recording medium on which the toner image is fixed passes through the recording medium discharge path 34. And discharged to the discharge unit 36.

  However, when duplex printing is set, the recording medium whose surface is fixed by the fixing device 32 is sent from the recording medium discharge path 34 to the reversing device 38, reversed by the reversing device 38, and recorded on the recording medium reversing path 40. To the recording medium supply path 22 again and sent to the image forming mechanism 24 to print the back side.

  The reading device 14 has an automatic document feeder 42 capable of reading a double-sided document. The automatic document feeder 42 feeds the document to a platen 44, and the document is scanned on the platen 44 by a reading unit 46 composed of a CCD or the like. Images are read.

  A document set detector 48 for detecting whether or not a document is set on the automatic document feeder 42 is provided. The automatic document feeder 42 also serves as a platen cover, and the document can be placed on the platen 44 by opening the platen cover. The opening / closing of the platen cover can be detected by a platen cover opening / closing detector 50.

  The communication device 16 is a device that communicates with an external device such as the user management device 6 via the network 8, and corresponds to, for example, a data line termination device. For example, the image forming apparatus 4 uses the communication device 16 to acquire information about the user stored in the user management device 6.

  FIG. 3 is a block diagram illustrating a hardware configuration of the image forming apparatus 4.

  As shown in FIG. 3, the image forming apparatus 4 has a configuration in which a CPU 60, a memory 62, and a storage device 64 are connected by a bus in addition to the above-described printing device 12, reading device 14, UI device 10, and communication device 16. ing.

  As described above, the image forming apparatus 4 includes a component as a computer that can communicate with the user management apparatus 6 and other apparatuses.

  The CPU 60 controls the operation of the image forming apparatus 4 by executing a program written in the memory 62 or the storage device 64. In addition, an input received via the UI device 10 is transmitted to the CPU 60, and display information from the CPU 60 is transmitted to the UI device 10.

  The CPU 60 may execute a program stored in a portable storage medium such as a CD-ROM (not shown), or may execute a program provided through the communication device 16.

  The storage device 64 stores data in a hard disk or the like so as to be able to write and read data. In the present embodiment, the storage device 64 stores an image received by an image receiving unit 80 (to be described later), information about association by an association unit 86 (to be described later) with respect to the image, items specified by an item specifying unit 88 (to be described later), and the like. Is stored.

Next, the user management device 6 will be described.
The user management device is a device that manages user information by executing a control program, and includes, for example, a Lightweight Directory Access Protocol (LDAP) server, an Active Directory of Windows (registered trademark), and the like.

  FIG. 4 is a schematic diagram illustrating a hardware configuration of the user management device 6. As shown in FIG. 4, the user management device 6 transmits and receives data to and from an external device or the like via the CPU 70, a memory 72, a storage device 74 such as a hard disk drive (HDD), and the network 8. It has a communication device 76 such as a data line terminating device, a user interface (UI) device 78 including a touch panel or a liquid crystal display and a keyboard. These components are bus-connected.

  The CPU 70 executes processing based on a control program stored in the memory 72 or the storage device 74 and controls the operation of the user management device 6. In the present embodiment, the CPU 70 has been described as reading and executing a control program stored in the memory 72 or the storage device 74, but the program is stored in a storage medium such as a CD-ROM and stored in the CPU 70. The program can be provided, or the program can be provided to the CPU 70 via the communication device 76.

Next, a functional configuration of the image forming apparatus 4 as an item entry device will be described.
FIG. 5 is a block diagram showing a functional configuration of the image forming apparatus 4 realized by executing the program.

  As shown in FIG. 5, the image forming apparatus 4 of the present embodiment includes an image receiving unit 80, a ruled line extraction unit 82, a region classification unit 84, an association unit 86, an item specifying unit 88, and identification information. A receiving unit 90, an item value reading unit 92, an entry unit 94, and a storage unit 96 are provided.

  The image receiving unit 80 receives an image. In the present embodiment, the image receiving unit 80 receives an image of a document including an item field and an entry field for the item field. An example of a document including an item column and an entry column for the item column is an application form. The image receiving unit 80 may receive an image of a document original read by the reading device 14 or may receive an image transmitted via the network 8 via the communication device 16. Further, the image receiving unit 80 may receive a document obtained by converting electronic data of a document into image data using a printer driver or the like.

  The ruled line extraction unit 82 extracts ruled lines included in the image received by the image receiving unit 80. Further, the ruled line extraction unit 82 specifies an area determined by the extracted ruled line. Specifically, the ruled line extraction unit extracts an area delimited by the ruled line. For example, the ruled line extraction unit 82 extracts ruled lines and areas using coordinate information in the image.

  FIG. 6 is a schematic diagram for explaining extraction of a ruled line and a region delimited by the ruled line by the ruled line extraction unit 82. Here, an image of an application form in which entry fields are provided for three items of name, employee number, and affiliation will be described as an example. FIG. 6A shows an example of item fields and entry fields included in the image. The ruled line extraction unit 82 extracts a ruled line from the portion shown in FIG. 6A from the image received by the image receiving unit 80, for example, as shown in FIG. 6B, and is divided into ruled lines. Regions 100, 102, 104, 106, 108 and 110 are identified.

  Also, as shown in FIG. 6C, the ruled line extraction unit 82 numbers the extracted areas in a predetermined order, and creates area information representing information about the areas. If the format is horizontal writing, the ruled line extraction unit 82 numbers the extracted areas, for example, in order from left to right and from top to bottom, and creates and manages area information. In the example shown in FIG. 6C, the ruled line extraction unit 82 performs region “1” (region 100), region “2” (region 102),..., Region “6” (region 110), respectively. Generate and manage information. Further, in the case of the vertical writing format, the ruled line extraction unit 82 numbers the extracted areas, for example, in the order from top to bottom and from right to left, and manages the area information. Note that the region information includes, for example, coordinate information for specifying the region.

  Whether the format is vertical writing or horizontal writing may be acquired by the image receiving unit 80 as additional information when the image is received, or may be determined by analyzing the image.

  In the example illustrated in FIG. 6, the case where there is one ruled line that divides the region has been described. However, the ruled line extraction unit 82 may extract a plurality of ruled lines within a predetermined interval as one ruled line. Good.

  FIG. 7 is a schematic diagram for explaining the extraction of ruled lines when there are two ruled lines that divide the region. FIG. 7A shows the ruled lines included in the image, and FIG. 7B shows the ruled line extracting unit. A ruled line extracted by 82 is shown. As shown in FIG. 7, when the interval between the plurality of ruled lines is within a predetermined interval, the ruled line extracting unit 82 treats the plurality of ruled lines as one ruled line and extracts the ruled lines. .

In addition to the example shown in FIG. 6, the ruled line extraction unit 82 extracts ruled lines for various items of item fields and entry fields as shown in FIG. 8.
FIG. 8 is a schematic diagram illustrating another aspect of the item field and the entry field. FIG. 8A shows an aspect in which the entry field is provided in the lower part of the item field, and FIG. The mode of writing is shown.

  The area classification unit 84 classifies the area determined by the ruled line extracted by the ruled line extraction unit 82 into an item column and an entry column. In the present embodiment, the region classification unit 84 performs classification based on the ratio of pixels having a predetermined pixel value in the region.

  Specifically, for example, the area of the area and the area of the margin are calculated, the ratio of the area of the margin to the area of the area is calculated, and the ratio of the area of the margin to the area of the area is less than a predetermined threshold. If the ratio of the area of the blank area to the area of the area is equal to or greater than a predetermined threshold, the field is classified as an entry field. Whether or not the pixel constitutes a margin is determined based on whether or not the pixel has a predetermined pixel value (for example, a pixel value indicating white). The predetermined pixel value is not limited to one pixel value (for example, pixel value x), but may be a pixel value having a range (for example, pixel value x or more and less than y).

  For example, the region classification unit 84 classifies the region 100 as follows. As shown in FIG. 6, a character string “name” is shown in the region 100. Here, it is assumed that the area of the region is 200, the area of the margin is 190, and the threshold is 0.99. Suppose that In this case, the ratio of the area of the blank area to the area of the region is 0.95, which is less than the threshold value 0.99, and thus is classified as an item column. As described above, according to the region classification unit 84, the regions 100, 104, and 108 are classified as item columns and the regions 102, 106, and 110 are classified as entry columns in the region shown in FIG.

  By classifying according to the threshold value in this way, it is expected that the item field and the entry field are properly classified even when characters are previously written in the entry field. For example, if “Birth date” is entered in the item column, and the entry column for this item column is blanked in the entry field and “Year / Month / Date” is entered in advance (in the entry column, the date of birth) In the case where it is only necessary to fill in the numbers in (), the blank space occupies most even if letters are written, so it is expected to be classified as an entry field without being classified as an item field.

  In the present embodiment, the area classification unit 84 classifies the pixels based on the ratio of pixels having a predetermined pixel value in the area as described above, but may be classified by other methods. For example, if a predetermined character string such as “name”, “employee number”, “affiliation” is represented in the area, the area classification unit 84 classifies the area as an item column and sets the predetermined character string. When the character string is represented in the area, it may be classified as an entry field.

  The associating unit 86 associates an entry field for entering an item value for the item indicated by the item field with the item field classified by the region classifying unit 84. In the present embodiment, the associating unit 86 includes the degree of overlap between the line segment that configures the item column to be associated with the line segment that configures the entry column, and the extension line of the line segment that configures the item column to be correlated. Correspondence is performed based on the degree of overlap with the line segment constituting the entry field. Note that the association unit 86 performs association in order for each of the regions classified as item fields. In the example illustrated in FIG. 6, the association is performed in the order of the areas 100, 104, and 108.

  FIG. 9 is a schematic diagram for explaining association by the association unit 86. In FIG. 9, hatched regions indicate regions classified as item columns by the region classification unit 84, and unhatched regions indicate regions classified as entry columns by the region classification unit 84.

  FIG. 9A shows an example in which an entry field is associated with an area classified as an item field by the area classification unit 84. In the example illustrated in FIG. 9A, an entry column is associated with the item column represented by the area 104 illustrated in FIG. The associating unit 86 associates the line segment constituting the item field represented by the area 104 and the extension line of the line segment with the line segment constituting the entry field. In FIG. 9, the line segment constituting the item column and the extension line of this line segment are both represented by bold lines.

  The associating unit 86 determines, for example, the degree of overlap for the entry field adjacent to the item field to be correlated based on the region information created by the ruled line extracting unit 82. The associating unit 86 is determined by the region classifying unit 84. The degree of overlap may be determined for all entry fields classified as entry fields, or entry fields that have already been associated may be excluded from the determination targets.

  In the example shown in FIG. 9A, in the areas 102, 106 and 110 adjacent to the area 104, only the lower line segment of the area 102 overlaps the thick line (for example, the degree of overlap is 1). For the region 106, the upper, lower, and left line segments overlap with the thick line (for example, the overlap degree is 3), and for the region 110, only the upper line segment overlaps with the thick line (for example, The overlapping degree is 1.) In this case, the associating unit 86 associates the entry field represented by the area 106 having an overlap degree of 3 with the item field represented by the area 104.

  FIG. 9B shows an example in which an entry column is associated with an area classified as an item column when there is a blank column that is neither a column indicating an item nor a column for entry. The areas 112 and 114 in the blank column that are neither the column indicating the item nor the column for filling in are classified as the entry column by the region classifying unit 84. Originally, the regions 112 and 114 are included in any item column. This is a field that should not be associated.

  In FIG. 9B, when the entry field is associated with the item field represented by the area 108, the overlapping degrees of the areas 110 and 112 are both 3. In such a case, the associating unit 86 determines the entry field to be associated by weighting the degree of overlap according to the direction in which the item field and the entry field are adjacent to each other.

  For example, as shown in FIG. 9B, for the horizontal writing format, the entry column on the upper side, the entry column on the left side, the entry column on the right side, and the entry column on the lower side with respect to the item column. Is multiplied by values such as 0, 0, 5, and 3, respectively, and weighting is performed, and an entry field having the maximum weighting result is associated with this item field. In this example, since the overlapping degree after weighting is 15 in the area 110 and 9 in the area 112, the entry field represented by the area 110 is associated with the item field represented by the area 108.

  Further, FIG. 9C shows a plurality of entries for one item column based on the degree of overlap between the line segment constituting this item column and the extension line of this line segment and the line segment constituting the entry column. An example of associating columns is shown.

  For example, for the region classified as the item field by the region classification unit 84, the associating unit 86 is based on the degree of overlap between the line segment constituting the item field and the extension line of this line segment and the line segment constituting the entry field. Then, one entry column is associated with each other. Then, after the entry fields are associated with all the item fields, next, again based on the degree of overlap between the line segment constituting the item field and the extension line of the line segment and the line segment constituting the entry field. The second entry field is sequentially associated with each item field. Note that, even if the second entry field is associated, if an entry field that is not associated remains, association is performed again.

  In the example shown in FIG. 9C, the area 118 as the first entry field is associated with the area 116 as the item field by the associating unit 86. The second entry field is associated with the line segment constituting the item field 116 and the degree of overlap between the line segment constituting the item field and the line segment constituting the entry field. In this example, the overlapping degree of the region 120 and the region 122 is 2, 1, respectively, and the region 110 having the overlapping degree of 2 is associated with the item column as the second entry column.

  The item specifying unit 88 specifies an item shown in the region classified as the item column by the region classifying unit 84. The item specifying unit 88 specifies an item by recognizing a character string shown in the item column of the image received by the image receiving unit 80 by, for example, OCR (Optical Character Recognition) technology. Further, the character string shown in the item column may be specified from the character information included in the electronic data of the document corresponding to the image received by the image receiving unit 80. For example, in the example shown in FIG. 6, “name”, “employee number”, and “affiliation” are specified as items.

  The identification information receiving unit 90 receives identification information for identifying a user. For example, the identification information receiving unit 90 receives identification information acquired via a storage medium reading device (not shown) provided in the image forming apparatus 4. In the storage medium reading device, for example, identification information is acquired by reading a storage medium such as an IC card or a magnetic card presented by the user. Note that the identification information receiving unit 90 may receive the identification information input via the UI device 10.

  The item value reading unit 92 reads the item value stored in advance for the item specified by the item specifying unit 88 based on the identification information received by the identification information receiving unit 90. In the present embodiment, the item value reading unit 92 inquires of the item value in the database of the user management device 6 based on the identification information received by the identification information receiving unit 90 and the item specified by the item specifying unit 88, and uses it. The item value stored in advance in the database of the person management device 6 is acquired. For example, the item value reading unit 92 reads the values of the items “name”, “employee number”, and “affiliation” from the database based on the user ID that is the identification information of the user A.

  The entry unit 94 reads and fills in an item value stored in advance in the entry field associated with the item field by the association unit 86 for the item indicated by the item field. Specifically, the item value read by the item value reading unit 92 is entered in the entry field associated with the item field by the associating unit 86 for the image received by the image receiving unit 80.

  The storage unit 96 stores the image received by the image receiving unit 80 in association with the information about the association by the association unit 86 for this image. The storage unit 96 stores, for example, an image and information about association with the image in association with each other for each of a plurality of application forms. In the present embodiment, the storage unit 96 also stores the items specified by the item specifying unit 88 in association with each image.

  If the image receiving process, the process for associating the item field with the entry field for the image, and the item specifying process have already been performed, the storage unit 96 stores the process without performing these processes again. By using the information to be entered, the item value can be entered. In this case, the item value reading unit 92 reads the item value based on the identification information received by the identification information receiving unit 90 and the items stored in the storage unit 96, and the entry unit 94 is stored in the storage unit 96. The item value is entered in the image based on the associated image and the association information of the item column and entry column in this image.

  FIG. 10 is a flowchart illustrating the operation of the item entry system.

  In step 100 (S100), the image receiving unit 80 receives, for example, an image of an application form as an image.

  In step 102 (S102), the ruled line extraction unit 82 applies a ruled line included in the image received by the image receiving unit 80, and specifies an area determined by the extracted ruled line.

  In step 104 (S104), the region classification unit 84 classifies the region determined by the ruled line extracted by the ruled line extraction unit 82 into an item column and an entry column.

  In step 106 (S106), the associating unit 86 associates the entry field for entering the item value for the item indicated by the item field with the item field classified by the area classification unit 84.

  In step 108 (S108), the item specifying unit 88 specifies the item shown in the area classified as the item column.

  In step 110 (S110), the item value reading unit 92 inquires of the item value in the database of the user management device 6 based on the identification information received by the identification information receiving unit 90 and the item specified by the item specifying unit 88. Then, the item value stored in advance in the database of the user management device 6 is acquired.

  In step 112 (S112), the entry unit 94 enters the item value acquired in step 110 for the item indicated by the item field in the entry field associated with the item field by the associating unit 86.

  In step 114 (S114), the printing apparatus 12 prints out the image in which the item value is entered by the entry unit 94.

  In the present embodiment, the item value reading unit 92 exemplifies a configuration for acquiring an item value from the user management device 6, but for example, an item value stored in a storage medium such as an IC card or a magnetic card. May be read by a storage medium reading device (not shown) provided in the image forming apparatus 4 to read the item value. In this case, the storage medium such as the IC card or the magnetic card may be the same as the storage medium storing the identification information for identifying the user.

  Further, the image in which the item value is entered by the entry unit 94 may be printed out by the printing device 12 or transmitted to another device by the communication device 16.

Next, a first modification of the present embodiment will be described.
FIG. 11 is a block diagram illustrating a functional configuration of the image forming apparatus 4 according to the first modification. The first modification is different from the above embodiment in that a correction unit 130 is added.

  The correction unit 130 corrects a pixel having a pixel value other than a predetermined pixel value to a predetermined pixel value among the pixels included in the image received by the image receiving unit 80. For example, for an image including pixels having multi-value pixel values, the correction unit 130 binarizes the image and corrects it to either a pixel value indicating white or a pixel value indicating black. The region classification unit 84 calculates the ratio of the area of the margin (pixel value indicating white) in the area of the region based on the result corrected by the correction unit 130, and sets the region in the item column or entry column. Classify.

  FIG. 12 is a schematic diagram for explaining correction by the correction unit 130 in the first modification. In FIG. 12A, both the item column and the entry column are gray images, and in FIG. 12B, only the item column is a gray image. FIG. 12C shows the result of correction by the correction unit 130 with respect to FIGS. 12A and 12B.

Next, a second modification of the present embodiment will be described.
FIG. 13 is a block diagram illustrating a functional configuration of the image forming apparatus 4 according to the second modification. The second modification is different from the above embodiment in that a frame line creation unit 132 is added.

  The frame line creation unit 132 creates a frame line that encloses the area where the character string is represented in the image received by the image receiving unit 80, and encloses an area adjacent to the area where the character string is represented, Creation of a frame line whose one side is constituted by ruled lines.

  FIG. 14 is a schematic diagram illustrating the creation of a frame line by the frame line creation unit 132 in the second modification. FIG. 14A and FIG. 14B show an image before a frame line is created by the frame line creation unit 132, and FIG. 14C shows a frame line created by the frame line creation unit 132. The later image is shown.

  As can be seen from the images shown in FIGS. 14A and 14B, unlike the item fields and entry fields shown in FIG. 6, the item fields and entry fields are not surrounded by ruled lines. The frame line creation unit 132 extracts a character string in the image and a ruled line adjacent to the character string, surrounds a frame line surrounding the area where the character string is represented, and an area adjacent to the area where the character string is represented, A frame line having at least one side constituted by ruled lines is created.

  A frame line as shown in FIG. 14C is created by the frame line creation unit 132, and the ruled line extraction unit 82 extracts a ruled line and an area for the image to which the frame line is added. Furthermore, the above-mentioned area classification unit 84 classifies the item field and the entry field.

  The example in which the image forming apparatus 4 functions as an item entry device has been described above. However, the item entry device is not limited to the image forming device 4 and may be realized by another device having a function as a computer.

2: Item entry system 4: Image forming device 6: User management device 80: Image receiving unit 82: Ruled line extraction unit 84: Area classification unit 86: Association unit 88: Item specifying unit 90: Identification information receiving unit 92: Item Value reading unit 94: entry unit 96: storage unit 130: correction unit 132: frame line creation unit

Claims (11)

Ruled line extraction means for extracting ruled lines from the image;
A plurality of areas determined by the ruled lines extracted by the ruled line extracting means, an area classification means for classifying the areas into item fields and entry fields;
Corresponding means for associating an entry field for entering an item value for the item indicated by the item field with the item field classified by the area classification unit;
Item entry device comprising: entry means for reading out and entering previously stored item values for the item indicated by the item field in the entry field associated with the item field by the association means. The item entry device according to claim 1, wherein the association unit associates the line segment that constitutes the item column to be associated and an extension line of the line segment and a degree of overlap between the line segment that constitutes the entry column. . The item entry device according to claim 1, wherein the area classification unit classifies the pixels based on a ratio of pixels having a predetermined pixel value in the area. A correction unit that corrects a pixel having a pixel value other than a predetermined pixel value out of the pixels included in the image to a predetermined pixel value,
The item entry device according to claim 3, wherein the area classification unit classifies using the pixel value corrected by the correction unit. The item entry device according to any one of claims 1 to 4, wherein the ruled line extraction unit extracts a plurality of ruled lines within a predetermined interval as one ruled line. The associating means adjoins the entry field and the entry field in accordance with the degree of overlap between the line segment constituting the item field to be matched and the extension line of the line segment and the line segment constituting the entry field. The item entry device according to any one of claims 2 to 5, wherein weighting determined by a direction is used to determine an entry field to be associated. The associating means includes a plurality of items in the item column classified by the region classifying unit based on a degree of overlap between a line segment constituting the item column and an extension line of the line segment and a line segment constituting the entry column. The item entry device according to any one of claims 2 to 5, wherein the entry field is associated. A frame line for creating a frame line surrounding an area where a character string is represented and a frame line surrounding a region adjacent to the area where the character string is represented and having at least one ruled line for the image A creation means,
The item entry device according to any one of claims 1 to 7, wherein the ruled line extraction unit extracts a frame line created by the frame line creation unit. Storage means for storing the image and information about association by the association means;
The item entry device according to any one of claims 1 to 8, wherein the entry means enters an item value in an entry field based on the image and the association information stored in the storage means. A user management device for managing user information;
Ruled line extraction means for extracting ruled lines from the image;
A plurality of areas determined by the ruled lines extracted by the ruled line extracting means, an area classification means for classifying the areas into item fields and entry fields;
Corresponding means for associating an entry field for entering an item value for the item indicated by the item field with the item field classified by the area classification unit;
An identification information receiving means for receiving information for identifying the user;
In the entry field associated with the item field by the association unit, the item value stored in advance for the user determined by the identification information received by the identification information receiving unit for the item indicated by the item field is used. An item entry system comprising: an item entry device having entry means for reading out and filling out from a person management device. A ruled line extraction step for extracting a ruled line from the image;
An area classification step for classifying a plurality of areas determined by the extracted ruled lines into an item field and an entry field;
An associating step for associating an entry field for entering an item value for the item indicated by the item field with the classified item field;
A program for causing a computer to execute an entry step of reading out and filling in an item value stored in advance in an associated entry field for the item indicated by the item field.

Images