JP2006331180A - Method for recognizing document - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a document recognition method capable of recognizing not only a table existing in a scanned paper document but also a state that the table is a variable table or a fixed table and capable of easily performing succeeding form editing operation by reflecting the set contents to a table object in an electronic form. <P>SOLUTION: The document recognizing method is provided with: a document image reading step for reading image data in the paper document; a table recognition step for recognizing a table from the image read out in the document image reading step; a fixed/variable judgment step for judging whether the table recognized by the table recognition step is a variable table or a fixed table; and a table object preparation step for preparing a table object from the results recognized and judged by the table recognition step and the fixed/variable judgment step. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a reading method for recognizing a form.

  Conventionally, in a form, a method of receiving data in a separate file and displaying it as shown in FIG. 4 may be used. Hereinafter, a graphic that receives data and displays the data is called a field graphic. Also, overlay printing is a process in which data in a data file is dynamically embedded in a field figure on a form for display / printing.

  In addition, a table can be created by concatenating field graphics, and various attributes such as the number of rows, the number of columns, and designation of heading rows can be set for the table. A set of field figures set with a table is called a table sheet figure. Furthermore, it is possible to perform a setting for dynamically deforming the outer shape of the table according to the amount of data that is flowed into the table during overlay printing. Hereinafter, a table set to dynamically change the outer shape is called a variable table, and a table not set is called a fixed table.

  On the other hand, a paper form already used in an office or the like can be recognized using a reading device such as a scanner and digitized into a format that can be read by form editing software or the like. The digitized form describes information such as figures, character strings, and tables in a predetermined format. Based on this information, drawing on a display and printing on a printer are performed. Hereinafter, each part such as a graphic described in the form is called an object. For example, a ruled line included in a paper form is recognized as a ruled line object in the form, and a table that is a set of ruled lines is recognized as a table object.

As a conventional example, for example, Patent Document 1 can be cited.
JP-A-8-320914

  However, when recognizing a table from a paper form, conventionally, it has not recognized whether the table is a fixed table or a variable table. Therefore, after recognizing a table in a paper form as a table object, it is necessary to set again a fixed table or a variable table using form editing software or the like.

  Therefore, in the present invention, not only the table existing in the scanned paper form is recognized, but also the table is recognized as a variable table or a fixed table, and the setting is reflected in the table object in the digitized form. The purpose is to make the form editing work easier.

  In order to solve the above problem, in the present invention, a form image reading step for reading image data of a paper form, a table recognition step for recognizing a table from an image read in the form image reading step, and the table recognition step Determining whether the table recognized in step 1 is a variable table or a fixed table, and a table object creation step for creating a table object from the result of recognition and determination in the table recognition step and the fixed / variable determination step And are provided.

  As explained above, it becomes possible to recognize whether the table is fixed or variable when scanning a paper form. By creating an electronic form based on the recognition result, subsequent editing operations can be performed efficiently. .

Example 1
Embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing the hardware configuration of a form recognition creation / editing system according to this embodiment. This system includes a central processing unit composed of a CPU 10 and the like, a main storage unit composed of a ROM 11 / RAM 12 and the like, an external storage unit composed of an FD drive 13 and an HD drive 15, a pointing device such as a mouse 18 ( A computer system comprising a coordinate input means), an instruction input device including a keyboard 16, a display device including a CRT display 17, a printing device 19 including a printer and a plotter, and a system bus 20 connecting them. Shall. This system is assumed to be connected to another computer system via a communication line such as a network.

  This system operates when the CPU executes a basic I / O program, an OS, and a form recognition creation / editing program. It is assumed that the basic I / O program is written in the ROM 11 and the OS is written in the HD 15. When the system power is turned on, the OS is read from the HD 15 into the RAM 12 by the IPL (Initial Program Loading) function in the basic I / O program, and the operation of the OS is started.

  Further, a control program (form recognition creation / editing program) and related data for realizing the present embodiment are recorded in the FD 14, and the configuration of the recorded contents is shown in FIG. The control program and related data recorded in the FD 14 can be loaded into the computer system through the FD drive 13 as shown in FIG. When the FD is set in the FD drive 13, the control program and related data are read from the FD 14 under the control of the OS and the basic I / O program, and loaded into the RAM 12 to be operable. FIG. 3 shows a memory map in a state where the control program is loaded into the RAM and becomes executable.

  In this embodiment, the control program and related data are directly loaded from the FD 14 to the RAM 12 and executed. However, the control program and related data are stored (installed) in the HD 15 in advance, and this program is stored. It is also possible to load from the HD 15 to the RAM 12 when operating. In addition to the FD, other removable storage media such as a CD-ROM and an IC memory card can be used as a medium for recording the control program. Furthermore, this program can be recorded in the ROM 11, configured so as to form a part of the memory map, and directly executed by the CPU 10. Further, the present control program may be read from another device via a network and executed.

  FIG. 4 is an example showing a form of generating an output form by inserting field data into a field of a form file. In the present embodiment, it is assumed that a table can be created by connecting a plurality of field graphics, and the connected table portion is called a table sheet graphic. The field data to be flowed into the table sheet graphic is described in a field data file in a predetermined format, and the data of each row is flowed into the table record sequentially at the time of overlay.

  In this embodiment, it is assumed that a form including a variable table can be created as shown in FIG. The number of table rows changes variably according to the amount of field data. If the table does not settle on one page, the table is created across multiple pages. Further, it is assumed that calculation results such as the sum of a certain column can be displayed by editing the table.

  Furthermore, in this embodiment, it is assumed that a form including a fixed table can be created as shown in FIG. Regardless of the amount of field data, the number of rows in the table is fixed, the outer shape does not change, and rows that do not contain data are output as blank rows. Even when the table is not cured on one page, the shape of the table does not change between the first page and the nth page. It is assumed that calculation results such as totals can be displayed in the same manner as a variable table.

  The operation of this embodiment will be described below.

  FIG. 7 is a flowchart showing the flow of operation in this embodiment.

  FIG. 8 shows an example of a paper form to be read in this embodiment. A table sheet figure of 2 rows and 3 columns is printed at a position of X coordinate: 15 and Y coordinate: 70 of the paper form. The size of each cell constituting the table sheet figure is as shown in the figure. Moreover, the character written in each cell is a cell identification number.

  First, in step 1, a paper form is scanned using a reading device such as a scanner.

  Next, in step 2, all ruled lines included in the scanned image are extracted. As an extraction method, an existing technique such as a method using a histogram can be used. In this embodiment, after all the ruled lines are read once, the analysis process described later is performed. However, the analysis process described later may be performed while extracting the ruled lines from the top to the bottom of the form.

  Next, in step 3, a cell is recognized from the extracted ruled line information. Scan from left to right, top to bottom, and if an area surrounded by four ruled lines is found, that part is recognized as a cell, and the cell is identified in the cell information management table as shown in FIG. Information such as the number, the X / Y coordinates of the upper left corner of the cell, the height, and the width is written.

  Next, in step 4, a record is detected based on the cell information. Each cell information in the cell information management table is compared, and if cells having the same Y coordinate and height are found, it is determined that they constitute a record, and the record is stored in the record information management table as shown in FIG. Information such as the number of cells constituting each cell, the cell number of each cell, the X / Y coordinates of the upper left corner of the record, the height and width of the record, etc. are written. In this embodiment, table information is managed using the cell information management table and the record information management table. However, the table configuration method and the cell / record data management method do not need to be as described above, It only has to be able to manage the data. Further, the recognition method does not change even in the case of a table having a complicated shape as shown in FIG. In this case, c1 to c6 constitute one record.

  Next, in step 5, it is determined whether the table is finished.

  If it is determined in step 5 that the table has not ended, the process returns to step 2 to detect cell record information and write to the table, and this operation is repeated until the table ends.

  If it is determined in step 5 that the table has been completed, in step 6, the record information management table and the cell information management table are used to compare the shape of each record and the shape of all cells constituting the record. And determine whether all records are equal. Two records are equal when the shape of the record and the shape of all the cells constituting it are the same or within a certain error range.

  If step 6 determines that all records are equal, then step 7 determines that the table is variable.

  On the other hand, if at least one record has a different shape in step 6, it is determined in step 8 that the table is fixed.

  In step 9, a form file including a variable or fixed table is created as electronic data based on the determination in step 7 or step 8.

  Through the above steps, not only can the table be recognized from the scanned image, but it can also be determined whether the table is variable or fixed. Further, by using the determination result for form creation, the table object in the form can be appropriately initialized.

(Example 2)
In the variable table, the shape of the table changes in accordance with the amount of data to be flowed, so that a line where no data exists is not printed. On the other hand, in the fixed table, since the shape of the table to be printed is fixed regardless of the data amount, there may be a record in which only the frame line is printed without the data. Therefore, in this embodiment, whether a variable table or a fixed table is determined based on whether any data exists in the last record of the table.

  Hereinafter, details of the present embodiment will be described.

  First, in order to determine whether data exists in a cell, the cell information management table shown in FIG. 9 is changed to have a “data” item for storing data without a cell.

  FIG. 12 shows the flow of determining a table in a paper form as a variable table using this embodiment.

  First, information is stored in the record information management table and the cell information management table in the same procedure as in the first embodiment. The data in the cell is also stored in the “data” item of the cell information management table. If there is no data in the cell, nothing is stored.

  Next, with reference to the record information management table, cell identification numbers c4, c5 and c6 of the cells constituting the last row r2 of the table are acquired.

  Next, referring to the cell information management table, it is determined whether or not the cells c4, c5, and c6 constituting the final record hold data.

  In FIG. 12, since the cells c4, c5, and c6 have data, it can be determined that the table is variable.

  On the other hand, FIG. 13 shows the flow of determining a table in a paper form as a fixed table using this embodiment.

  First, information is stored in the record information management table and the cell information management table in the same procedure as in the first embodiment. The data in the cell is also stored in the “data” item of the cell information management table. If there is no data in the cell, nothing is stored.

  Next, with reference to the record information management table, cell identification numbers c7, c8, c9 of the cells constituting the last row r3 of the table are acquired.

  Next, with reference to the cell information management table, it is determined whether or not the cells c7, c8, c9 constituting the final record hold data.

  In FIG. 13, since the cells c7, c8, and c9 do not have data, it can be determined that the table is fixed.

(Example 3)
By editing the table, it is possible to display calculation results such as the sum of a certain column. Tables that are set to display the calculation result such as the total value have the same record shape and are highly likely to be variable tables. Therefore, in this embodiment, a mode is shown in which fixed / variable is determined by detecting a character string such as “total”.

  FIG. 14 is an example showing the present embodiment. The last record r3 in the table is composed of only the cell c7, and the cell c7 holds character string data “total ¥ 1500”. In this embodiment, character string data in all cells constituting the final record of the table is extracted, and fixed / variable is determined by comparing these character strings with character strings registered in the database. In FIG. 14, the character string “total ¥ 1500” detected from the cell c7 in the final record is compared with character strings such as “total” and “total” registered in the database. As a result, since the database registered character string “total” is found in the character strings detected from the image, it is determined as a variable table. If not found, it is determined as a fixed table.

Example 4
Depending on the amount of data to be flowed, the table may be printed across multiple pages. In the present embodiment, a mode of determining whether a table is fixed or variable across a plurality of pages is shown.

  FIG. 15 shows an example of printing a table that spans a plurality of pages. The upper example is a printing example of a form including a variable table, and the lower is an example of printing a form including a fixed table.

  In the case of a table created as a fixed table at the time of form creation, a table having the same shape is printed on all pages. On the other hand, in the case of a variable table, for example, when a header graphic is displayed only on the first page, it is possible to change the upper limit setting for the second and subsequent pages. In this case, the outer shapes of the first page and the second and subsequent tables are different. Therefore, in this embodiment, it is determined whether the table is a fixed table or a variable table by comparing the outer shapes of the first and second pages.

(Example 5)
The first to fourth embodiments may be used singly, but the accuracy of the table fixing / variable determination can be improved by combining a plurality. In the present embodiment, an embodiment in which a plurality of determination methods are combined to increase determination accuracy will be described.

  FIG. 16 is a flowchart showing the flow of operation in this embodiment.

  First, in step 1, it is determined whether or not all record shapes in the table are equal.

If all the record shapes are not equal, it is determined in step 7 that the table is fixed, and an electronic form in which the information is set is created. (Step 8)
If all the record shapes are equal, it is determined in step 2 whether the last row of the table is blank.

If the last line of the table is blank, it is determined in step 7 that the table is fixed, and an electronic form in which the information is set is created. (Step 8)
If the last line of the table is not blank, it is determined in step 3 whether the data registered in the database is included in the data in the cell of the last line.

If the registered character is not included, it is determined in step 7 that the table is fixed, and an electronic form in which the information is set is created. (Step 8)
If registered characters are included, it is determined in step 4 whether or not the table covers a plurality of pages.

In the case of a table that fits on one page, it is determined in step 6 that the table is variable, and an electronic form in which the information is set is created. (Step 8)
In the case of a table that cannot be completely settled on one page, it is determined in step 5 whether or not the outline of the table on each page is different.

If the outer shape of the table is not different for each page, it is determined in step 7 that the table is fixed, and an electronic form in which the information is set is created. (Step 8)
If the outer shape of the table is different for each page, it is determined in step 6 that the table is variable, and an electronic form in which the information is set is created. (Step 8)

Hardware configuration block diagram of the present invention Example of configuration of contents recorded on medium in the present invention Example of storage area configuration in an executable state in the present invention Generation example of output form including table Example of generating an output form with a variable table Example of generating an output form with a fixed table Flowchart of operation in the embodiment of the present invention Example of a form with a table Configuration example for managing cell information Configuration example for managing record information Example of complex record shape table Example of variable table recognition Recognition example of fixed table Recognition example of fixed / variable table Recognition example of fixed / variable table Examples of recognition of fixed / variable tables by combining multiple methods

Claims (1)

  A form recognition method for determining whether a table included in a paper form is a fixed table or a variable table, a form image reading step for reading the image data of the paper form, and a table from the image read in the form image reading step. Recognizing, determining whether the table recognized in the table recognition step is a variable table or a fixed table, recognizing and determining in the fixed / variable determination step, the table recognition step, and the fixed / variable determination step A form recognition method characterized by comprising a table object creation step for creating a table object from the result obtained.

Images