JP2014048851A - Layout holding device of spread sheet software - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a layout holding device of a spread sheet software which does not damage an arrangement relation of a layout even when a copy is made on another sheet in which a column width is fixed, and realizes easy handling.SOLUTION: A layout holding device executes character recognition with respect to an input image acquired by reading a document image. When forming a spread sheet file by inserting a result into corresponding cells in spread sheet software, in a case where the result of the character recognition R1 (R2) positions over a plurality of cells C1 and C2, or in a case where a first character recognition result R1 and a second character recognition result R2 are contained within one cell of the spread sheet software, the layout holding device joins both the character recognition results R1 and R2 together or separates them from each other in accordance with the relation between text box widths D of the character recognition results R1 and R2 and a cell width d of the spread sheet software.

Description

  The present invention relates to a layout holding device for spreadsheet software applied to an MFP (Multi Function Peripherals) having a file creation function using spreadsheet software.

  2. Description of the Related Art Conventionally, an MFP or the like uses an image data of a document image read by a scanner unit as an input image, and uses an optical character recognition device (also referred to as OCR) for a desired text area in the input image. Some of them have a function of recognizing and creating a file format using spreadsheet software such as excel provided by Microsoft.

  When a file format sheet created using such Excel is copied to another sheet, it is important that the layout is properly maintained.

  Conventionally, when the conversion result (OCR result) of character recognition for a text area in a document is poured into each text area (cell area), the arrangement of the text areas is avoided while avoiding character reduction as much as possible. A technique that does not break the relationship has been proposed.

  Specifically, when the layout analysis unit obtains each region in the input image, performs OCR, and translates, the sequence structure analysis unit sets a boundary line on the outer periphery of the page and the margin between each region, and performs layout. In the processing unit, the OCR result and translation result in each region are described for each region, and in the arrangement structure adjusting unit, the boundary line on the outer periphery of the page is outside the page, and the boundary line adjacent to the blank region is a blank region. In this technique, the area is moved or enlarged according to the movement, and the boundary line is moved and the area is moved or enlarged until all the areas are within the page (for example, , See Patent Document 1).

JP 2009-230605 A

  However, in general, when a sheet of spreadsheet software such as Excel is copied to another sheet, the layout is often corrupted due to the difference in the column width of another sheet. It becomes difficult to do.

  Also, in the prior art, the height and width of the text area are made variable so as not to break the arrangement relation between the text areas. In this file format, the arrangement relation is maintained, but another sheet is used. When copying to, the layout arrangement relationship is broken. This is because the column width is fixed to the default value in the copy destination sheet when copying the spreadsheet sheet. Therefore, in the prior art, when the column width of the text area is changed, the arrangement is shifted in the column direction (width direction), and the arrangement relationship cannot be maintained.

  The present invention has been made in view of the above circumstances, and even when copying to another sheet with a fixed column width of the sheet, spreadsheet software that can perform good handling without destroying the layout arrangement relationship. It is an object to provide a layout holding device.

The above problem is solved by the following means.
(1) Reading means for reading a document image, converting it into image data, and outputting it; character recognition means for using the image data from the reading means as an input image and performing character recognition on a character area of the input image; A file creation means for creating a spreadsheet file by inserting a plurality of character recognition results obtained by the recognition means into corresponding cells in the spreadsheet software, and when the character recognition results straddle a plurality of cells, or When the first character recognition result and the second character recognition result are included in one cell of the spreadsheet software, the character recognition result depends on the relationship between the text box width and the spreadsheet software cell width. And a control means for controlling to combine or separate the character recognition results.
(2) When the first character recognition result and the second character recognition result result in one word, the control means adds a space between the first character recognition result and the second character recognition result. 2. The layout holding device for spreadsheet software according to item 1, wherein the character recognition results are combined in a state where the layout is held.
(3) When the first character recognition result and the second character recognition result do not result in one word / phrase, the control means displays the first character recognition result and the second character recognition result respectively in the spreadsheet software. 2. The layout holding device for spreadsheet software according to item 1, which is inserted into separate cells.
(4) The control means has a function of performing syntax analysis on the character recognition result when the text box width of the character recognition result is larger than the cell width of the spreadsheet software. 2. The layout holding device for spreadsheet software according to item 1, wherein if the character recognition result cannot be separated as a word / phrase as a result of the syntax analysis, the character recognition result is directly inserted into a cell of the spreadsheet software.
(5) The control means is configured such that the text box width of the character recognition result is larger than the cell width of the spreadsheet software, and the character recognition result is subjected to syntax analysis. The layout holding device for spreadsheet software according to item 4 above, in which, if the phrase can be separated, the plurality of separable character recognition results are inserted into separate cells.
(6) When the first character recognition result is deviated from the second character recognition result by a certain distance in the row direction, the control means calculates the first character recognition result and the second character recognition result using spreadsheet software. The layout holding device for spreadsheet software according to any one of the preceding items 1 to 5, wherein the position of the first character recognition result or the second character recognition result is adjusted so that it can be inserted into different cells in the same row.

  According to the invention described in item (1) above, character recognition is performed on the input image obtained by reading the document image by the reading means, and a plurality of obtained character recognition results are spreadsheeted by the file creating means. A spreadsheet file is created by inserting into the corresponding cell in the software.

  In that case, when the character recognition result extends over a plurality of cells of the spreadsheet software, or the first character recognition result and the second character recognition result are included in one cell of the spreadsheet software. If so, the control means controls to combine or separate the character recognition results according to the relationship between the text recognition result text box width and the spreadsheet software cell width. Even if the sheet row width in the software is fixed by default, it is possible to create a spreadsheet of spreadsheet software with good handling without destroying the layout when copied to another sheet.

  According to the invention described in the preceding item (2), when the first character recognition result and the second character recognition result become one word, a space is provided between the first character recognition result and the second character recognition result. Since both character recognition results are combined in a state in which the layout is maintained by joining, the handling when copying to a text file becomes easy.

  According to the invention described in the preceding item (3), when the first character recognition result and the second character recognition result do not become one word / phrase, the first character recognition result and the second character recognition result are spreadsheeted. Since it is inserted into a separate cell of the software, it is possible to create a file that is easy to handle and search when copied to another sheet of spreadsheet software.

  According to the invention described in item (4) above, when the text box width of the character recognition result is larger than the cell width of the spreadsheet software, the third character recognition result is parsed. If the recognition result cannot be separated into words / phrases, the character recognition result is inserted into the spreadsheet software cell as it is, making it easier to handle when copying files to other spreadsheet software sheets. It is possible to create a file that is easy to perform.

  According to the invention described in item (5), the text box width of the character recognition result is larger than the cell width of the spreadsheet software, and the result of parsing the character recognition result is that the cell boundary of the spreadsheet software is If the line can be separated as a word / sentence, it can be handled when the file is copied to another sheet by inserting the separated character recognition results into separate cells of the spreadsheet software. It is easy to create a file that is easy to search.

  According to the invention described in (6) above, when the first character recognition result is deviated from the second character recognition result by a certain distance in the row direction, the first character recognition result and the second character recognition result. The position of the first character recognition result or the second character recognition result is adjusted so that the file can be inserted into different cells in the same row of the spreadsheet software, making it easier to handle when copying files to other sheets This makes it possible to create a file that is easy to search.

1 is a block diagram showing an electrical configuration of an image forming apparatus to which a spreadsheet software layout holding device according to an embodiment of the present invention is applied. FIG. It is explanatory drawing at the time of inserting the some OCR result at the time of OCR recognition about an input image into each cell of Excel, and creating a spreadsheet file. It is a flowchart which shows the flow of a process in case a some OCR result is inserted in one cell of spreadsheet software from a some OCR result. It is a flowchart which shows the flow of a process in case an OCR result is inserted in the several cell of spreadsheet software from a several OCR result. It is a flowchart which shows the flow of a process when paying attention to the cell in which a certain OCR result is inserted from several OCR results, and inserting an OCR result in the cell adjacent to this cell. It is explanatory drawing of the example of a file produced with spreadsheet software. It is explanatory drawing of the example of another file produced with spreadsheet software. It is explanatory drawing of another example of a file produced with spreadsheet software. It is explanatory drawing of another example of a file produced with spreadsheet software.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing an electrical configuration of a multi-function digital multi-function peripheral (hereinafter also referred to as MFP) to which a layout holding device for spreadsheet software according to an embodiment of the present invention is applied.

  In FIG. 1, the MFP includes, for example, a CPU 1, a ROM 2, a RAM 3, a scanner unit 4, an operation panel unit 5, a storage unit 6, a printer unit 7, and an external interface unit 8.

  In addition to the overall control of the overall operation of the MFP, the CPU 1 has functions such as a spreadsheet file format creation unit 11 and a syntax analysis unit 12 that analyzes the syntax of the OCR result.

  The ROM 2 is a memory in which an operation program of the CPU 1 is stored, and the RAM 3 is a memory that provides a work area when the CPU 1 operates based on the operation program.

  The scanner unit 4 constitutes a reading unit that reads a document image, converts it into image data that is electronic data, and outputs the image data. The scanner unit 4 also has a function of an OCR (optical character recognition device) 41 that performs character recognition on a plurality of necessary partial areas using the obtained image data as an input image.

  The operation panel unit 5 includes a key unit 51 including hard keys such as a start key, a stop key, and a numeric keypad, and a display unit 52 including a liquid crystal display (LCD).

  The storage unit 6 is a storage unit that stores various data and application software, and includes, for example, a hard disk device (HDD). Here, Excel as spreadsheet software, OCR software, and the like are stored.

  The printer unit 7 constitutes an engine unit that prints image data on paper.

  The external interface unit 8 controls communication with a user terminal or the like connected via a network.

  2A to 2C, image data obtained by reading a document by the scanner unit 4 is used as an input image, OCR recognition is performed on a plurality of necessary partial areas of the input image, and a plurality of OCR results are obtained. It is explanatory drawing at the time of inserting in each cell of Excel and creating a spreadsheet file.

  In this example, when OCR recognition is performed on a necessary partial region in the input image, and a plurality of obtained OCR results R1 and R2 extend over a plurality of (two adjacent to each other) cells C1 and C2, Alternatively, when the OCR result R1 and the OCR result R2 are included in one cell C1 of Excel, the OCR result R1 and the OCR result R2 depend on the relationship between the text box width D of the character recognition result and the cell width d of Excel. And the case where these are combined or separated.

  In FIG. 2A, as shown in the left part of FIG. 2, the OCR result R2 extends over the two cells C1 and C2. As a result of the syntax analysis, one OCR result R1 and one OCR result R2 exist. It shows the case where it does not become a word or phrase. In this case, the OCR result R1 and the OCR result R2 are inserted into separate cells C1 and C2 (the circled number 1 at the right end of the figure).

  In this case, when copying to another sheet of Excel, it becomes possible to create a file that is easy to handle and easy to search.

  In addition, when the OCR result R1 and the OCR result R2 become one word / phrase, a blank (indicated by hatching) G is added between the OCR result R1 and the OCR result R2, and both R1 and R2 are combined. In the state, it is inserted in each of the cells C1 and C2 (circle number 2 at the right end of the figure).

  Thus, since both OCRR1 and R2 are joined in a state in which a blank G is added between OCR1 and OCR2 and the layout is maintained, handling when copying to a text file is facilitated.

  FIG. 2B shows a case where OCR recognition is performed on a necessary partial region in the input image, and as a result, the width D of the text box is larger than the cell width d.

  In FIG. 2B, as shown in the left part of FIG. 2, since the width D of the text box of the result R3 recognized by OCR is larger than the cell width d, the OCR result R3 is parsed. If the word / phrase can be separated at the cell boundary L of Excel and the OCR result R3 can be separated into the OCR result R3A and the OCR result R3B, the OCR results R3A and R3B are separated into separate cells C1 and C2. Insert (circle number 3 at the right end of the figure).

  As described above, since the OCR results R3A and R3B obtained by separating the OCR result R3 are inserted into the separate cells C1 and C2, the file is easy to handle and search when the file is copied to another sheet of Excel. Can be created.

  On the other hand, if the OCR result R3 is parsed and cannot be separated as a word / phrase, the OCR result R3 is inserted into the Excel cell C1 as it is (circle number 4 at the right end of the figure).

  As described above, since the OCR result R3 is inserted into the Excel cell C1 as it is, it is possible to create a file that can be easily handled and searched when the file is copied to another sheet of Excel.

  FIG. 2C focuses on a certain cell C1 (C2) in Excel. When the OCR result R1 (R2) is deviated from the OCR result R2 (R1) by a certain distance in the row direction, the OCR result The position of the OCR result R1 (R2) or the OCR result R2 (R1) is adjusted so that the R1 (R2) and the OCR result R2 (R1) are applied to different cells C1 and C2 in the same row.

  In FIG. 2C, as shown in the left part of FIG. 2, since the OCR result R1 is shifted by a certain distance in the row direction with respect to the OCR result R2, the position of the OCR result R1 is adjusted, and these OCR results R1 , R2 are inserted into separate cells C1, C2 (circle number 5 at the right end of the figure).

  As described above, by adjusting the position in the row direction of the OCR result R1 (R2) or the OCR result R2 (R1), the file is easy to handle and search when the file is copied to another sheet of Excel. Can be created.

  FIG. 3 shows the flow of processing when a plurality of OCR results R1 and R2 enter one cell C1 (C2) of Excel as shown in FIG. 2A from a plurality of OCR results R1 and R2. It is a flowchart.

  In FIG. 3, in step S1, a document image is read by the scanner unit 4, and the image data is set as an input image (image input).

  In step S2, OCR recognition is performed on the entire input image. Note that OCR recognition may be performed only on necessary portions.

  In step S3, the character or character string in the input image is output as the OCR result R1 by OCR processing for a certain partial region. In step S4, a character or character string in the input image is output as an OCR result R2 by OCR processing for another partial region.

  In step S5, when a plurality of (for example, two) OCR results R1 and R2 are included in one cell C1 of Excel, the OCR result R1 and the OCR result R2, that is, (R1 + R2) is one word or phrase. Is determined.

  If the OCR result R1 and the OCR result R2 constitute one word or phrase (the determination in step S5 is YES), in step S6, the OCR result R1 and the OCR result R2 are combined, and FIG. As shown by the circled number 2 in FIG. In this case, a blank G (shaded display) G is added between the OCR result R1 and the OCR result R2 in order to maintain the layout.

  If the OCR result R1 and the OCR result R2 do not constitute one word or phrase (the determination in step S5 is NO), the OCR result R1 and the OCR result R2 are not combined in step S7 (FIG. 2). As indicated by the circled number 1 in A), the OCR result R1 is inserted into the cell C1, and the OCR result R2 is inserted into the cell C2 adjacent to the right.

  As described above, when the OCR results R1 and R2 are included in one cell C1 (C2) of Excel with respect to the sheet having a fixed column width in Excel, the cells C1 (C2) are separated. ), And the OCR results R1 and R2 straddle the two cells C1 and C2, the OCR result R1 and the OCR result R2 are combined and inserted into the cell C1. On the other hand, the layout is maintained and the handling (handling) is improved.

  In particular, when the OCR results R1 and R2 result in one word / phrase, a blank G is added between the OCR result R1 and the layout is maintained well.

  FIG. 4 shows a case where OCR recognition is performed on a necessary partial region in the input image from a plurality of OCR results, and as a result, the width D of the text box is larger than the cell width d. It is a flowchart which shows the flow of a process.

  4, in step S11, a document image is read by the scanner unit 4, and the image data is set as an input image (image input).

  In step S12, OCR recognition is performed on the entire input image.

  In step S13, the character or character string in the input image is output as an OCR result (R1) by OCR processing for a certain partial region. In step S14, the character or character string in the input image is output as an OCR result (R2) by OCR processing for another partial region.

  In step S15, the OCR result R3 is entered into a plurality of Excel cells C1 (C2), and as a result of the syntax analysis, it is determined whether the OCR result R3A and the OCR result R3B, which are different words / phrases, can be separated. To do.

  As a result of the syntax analysis, when the OCR result R3A and the OCR result R3B can be separated (the determination in step S15 is YES), in step S16, the OCR result R3 is divided into the OCR result R3A and the OCR result R3B, and FIG. As indicated by the circled numbers in B), the OCR result R3A and the OCR result R3B are inserted into the cells C1 and C2 corresponding to the upper left coordinates of the OCR result R3B, and then the process ends.

  As a result of the syntax analysis, when separation into the OCR result R3A and the OCR result R3B cannot be made (determination in step S15 is NO), the upper left of the OCR result R3 is shown in step S17 as indicated by the circled number 4 in FIG. The OCR result R3 is inserted into the cell corresponding to the coordinates without separation.

  FIG. 5 focuses on a cell C1 (C2) into which an OCR result is inserted as shown by a circled number 5 in FIG. 2C from a plurality of OCR results, and a cell C2 adjacent to the cell C1 (C2). It is a flowchart which shows the flow of a process when the OCR result R2 (R1) is inserted in (C1).

  In FIG. 5, in step S21, a document image is read by the scanner unit 4, and the image data is set as an input image (image input).

  In step S22, OCR recognition is performed on the entire input image.

  In step S23, the character or character string in the input image is output as the OCR result R1 by OCR processing for a certain partial region. In step S24, the character or character string in the input image is output as the OCR result R2 by OCR processing for another partial region.

  In step S25, paying attention to the cell C1 in which a certain OCR result is inserted, and when the OCR result R2 is inserted in the cell C2 adjacent to the cell C1, "OCR result R1 of the cell C1 and OCR result R2 of the cell C2" "Is parsed to determine whether it can be determined as a single word or phrase.

  If it can be determined as one word or phrase (YES in step S25), the OCR result R1 and the OCR result R2 are put in one cell in step S26.

  When “the OCR result R1 of the cell C1 and the OCR result R2 of the cell C2” are parsed and cannot be determined as one word or phrase (the determination in step S25 is NO), the OCR result R1 and the OCR result are determined in step S27. Insert R2 into the original corresponding cells C1 and C2.

  FIG. 6 is an explanatory diagram of an example of a file created by Excel.

  In FIG. 6, the left side is a form of an input image V obtained by scanning a document image, and the right side is a form in which the document image is OCR-recognized and the OCR result R1 is inserted into a cell of an Excel sheet. ing.

  Note that, in the form of the left input image V, it is used for printing according to a predetermined job, and the form in the right Excel sheet is reused for text.

  FIG. 7 is an explanatory diagram of another example of a file that is also created in Excel.

  In FIG. 7, when the document image is scanned, if the document covers a plurality of pages, it is difficult to understand at a glance how many pages have been scanned in the standard display with only one sheet. To do. For example, by default, a separate file is recommended for every 255 pages (sheets).

  FIG. 8 is an explanatory diagram of still another example of a file created in the same Excel, which is configured only by an Excel sheet and is enabled only when the OCR recognition function is ON.

  FIG. 9 is an explanatory diagram of another file example that is also created in Excel.

  FIG. 9 shows a form in which a CSV (Comma separated Value) format file created by Excel is opened, and is enabled only when the OCR recognition function is ON. In this case, the font size is not saved.

1 CPU
4 Scanner part 41 Character recognition part (OCR)
11 File creation unit 12 Parsing unit C1, C2 Spreadsheet cell d Cell width D Text box width G Blank R1, R2, R3 OCR result R3A, R3B Separated OCR result V Read image (input image)

Claims (6)

Reading means for reading a document image, converting it into image data, and outputting it;
Character recognition means for performing image recognition on a character area of the input image, using the image data obtained by the reading means as an input image;
A file creation means for creating a spreadsheet file by inserting a plurality of character recognition results obtained by the character recognition means into corresponding cells in the spreadsheet software;
Character recognition is performed when the character recognition result extends over a plurality of cells, or when the first character recognition result and the second character recognition result are included in one cell of the spreadsheet software. Control means for controlling to combine or separate the character recognition results according to the relationship between the result text box width and the cell width of the spreadsheet software;
A layout holding device for spreadsheet software, comprising:   When the first character recognition result and the second character recognition result result in one word, the control means adds a space between the first character recognition result and the second character recognition result to hold the layout. The layout holding device for spreadsheet software according to claim 1, wherein both character recognition results are combined in a state of being processed.   When the first character recognition result and the second character recognition result do not result in one word / phrase, the control means displays the first character recognition result and the second character recognition result in separate cells of the spreadsheet software. The layout holding device for spreadsheet software according to claim 1, which is inserted into the spreadsheet. The control means has a function of parsing the character recognition result when the text box width of the character recognition result is larger than the cell width of the spreadsheet software,
The layout of the spreadsheet software according to claim 1, wherein if the character recognition result cannot be separated into words and phrases as a result of the parsing, the control means inserts the character recognition result into a cell of the spreadsheet software as it is. Holding device.   The control means is such that the text box width of the character recognition result is larger than the cell width of the spreadsheet software, and as a result of parsing the character recognition result, as a word / phrase at the cell boundary line of the spreadsheet software 5. The layout holding device for spreadsheet software according to claim 4, wherein, if separation is possible, the plurality of separable character recognition results are inserted into separate cells.   When the first character recognition result is deviated from the second character recognition result by a certain distance in the row direction, the control means displays the first character recognition result and the second character recognition result on the same line of the spreadsheet software. The layout holding device for spreadsheet software according to any one of claims 1 to 5, wherein the position of the first character recognition result or the second character recognition result is adjusted so that it can be inserted into a separate cell.

Images