JP2013179399A - Image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To edit a table of printed matters without using an image editing software of a personal computer or a tablet PC.SOLUTION: The image processing apparatus: specifies rows or columns to be edited in a table by writing handwriting checks by a writing tool in a printed matter having the table printed as a print image by a toner or an ink; reads the printed matter; distinguishes and separates all handwriting check images from the print image; specifies all frames including the separated handwriting check images as a frame to be edited; determines whether print image data is edited in a row direction or a column direction in consideration of variation in positions in the row direction and the column direction of the frame to be edited; and restructures the print image data in the determined edit direction by editing rows or columns including the frame to be edited and orthogonal to the edit direction in a record unit.

Description

  The present invention relates to image processing for editing print image data obtained by reading a mixed original in which a handwritten image by a writing instrument is written on a printed matter in which a table is printed as a printed image using toner or ink based on the written handwritten image. Relates to the device.

  Patent Document 1 describes a document information correction apparatus that reads a document that has been corrected by handwriting directly on a printed matter and reflects the correction in the original electronic data. In this document information correction apparatus, the difference between the image of the corrected document and the original text image is extracted as correction information, and the electronic file of the original text is corrected according to the handwritten form of the extracted correction information. In addition, there is a method of detecting handwriting correction by pattern matching with a character information database of type characters in which handwritten images are stored in advance.

  In Patent Document 2 and Patent Document 3, it is not necessary to store original image data or character image data in advance, and a printed image (an image printed with toner or ink) is considered in consideration of the degree of shading of multi-value image data. ) And a technique for distinguishing a handwritten image by a writing instrument.

JP 2010-244466 A JP 2011-061473 A JP 2011-070327 A

  A problem to be solved by the present invention is to write a handwritten check with a writing tool on a printed material on which a table is printed as a printed image with toner or ink, specify a row or column to be edited in the table, and read the printed material. It is an object of the present invention to provide an image processing apparatus capable of obtaining print image data edited in units of rows or columns.

  In the present invention, a table including a row or column for handwriting check entry is printed as a printed image using toner or ink, and a handwriting check by a writing instrument is entered in a frame constituting the row or column for handwriting check entry. An image reading unit that can read the mixed original and create multi-value image data, an image storage unit that stores the multi-value image data read by the image reading unit, and the multi-value image data stored in the image storage unit And an image processing unit that edits print image data.

  In a preferred aspect, the image processing unit includes a separation processing unit, a target frame specifying unit, an editing direction determining unit, and an editing processing unit. The separation processing unit separates all the handwritten check images from the printed image from the multi-valued image data, using the degree of shade difference of the plurality of pixels constituting the handwritten check as a consideration element. The target frame specifying unit specifies all the frames including the separated handwritten check image as the target frames for editing. The editing direction determination unit determines whether to edit the print image data in the row direction or the column direction in consideration of variations in the position of the target frame in the row direction and the column direction. The edit processing unit reconstructs the print image data by editing, in record units, a row or a column including the target frame and orthogonal to the edit direction in the determined edit direction.

  In a further preferred aspect, the target frame detection unit includes a process for obtaining center coordinates of all separated handwritten check images, a process for extracting all connected white pixel regions in the print image data, and all handwriting checks. A process of determining which of the connected white pixel areas extracted with respect to the center coordinates of the image is included, and a process of setting a connected white pixel area including the center coordinates of the handwritten check image as the target frame are executed.

  In a further preferred aspect, the editing direction determination unit obtains average coordinates that are average values of the center coordinates of all target frames for each of the row and column directions. , Calculating the distance difference between the center coordinate and the average coordinate for all target frames, and subsequently calculating the sum of the absolute values of all the distance differences, and the sum of the absolute values of the distance differences in the row direction and the column direction A process of comparing the sum of absolute values of the distance differences and determining one as the editing direction is performed.

  In a further preferred aspect, the editing processing unit deletes, from the print image data in the image storage unit, a row or a column including the target frame and orthogonal to the editing direction in the determined editing direction in units of records. To reconstruct the print image data.

  In a further preferred aspect, the edit processing unit extracts, from the print image data of the image storage unit, a row or a column including the target frame and orthogonal to the edit direction in the determined edit direction in units of records. To reconstruct the print image data.

  In a further preferred aspect, the editing processing unit determines the larger one of the sum of absolute values of distance differences in the row direction and the sum of absolute values of distance differences in the column direction as the editing direction.

  In a further preferred aspect, the editing processing unit emphasizes, in record units, rows or columns that include the target frame and are orthogonal to the editing direction in the determined editing direction from the print image data of the image storage unit. Then, the print image data is reconstructed.

  In a further preferred aspect, the enhancement process is a hatching process.

  In a more preferred aspect, the edit processing unit determines the smaller of the sum of absolute values of distance differences in the row direction and the sum of absolute values of distance differences in the column direction as the edit direction.

  In a further preferred aspect, the image processing apparatus further includes an image recording unit that records the reconstructed print image data on a recording sheet.

  According to each preferred aspect of the present invention described above, a handwritten check by a writing tool is entered on a printed matter on which a table is printed as a toner or ink printed image, and a row or column to be edited in the table is specified, and this printed matter is read. Therefore, it is possible to reconstruct the print image data that has been subjected to emphasis processing such as deletion, extraction or shading of the table in units of rows or columns, and it is possible to print the reconstructed print image data on a recording sheet. it can.

1 is a block diagram showing a hardware configuration in a digital multi-function peripheral as an image processing apparatus according to an embodiment of the present invention. It is a figure which shows the specific example of the process which deletes the column of deletion object from a table per record, and rebuilds a table only by the remaining column. It is a figure which shows the main flowchart of a deletion copy function. It is a figure which shows the process which distinguishes and isolate | separates a handwritten image and a printed image. It is a figure which shows the flowchart of the process which specifies an object frame. It is a figure which shows the specific example of an object frame specific process. 10 is a flowchart of an editing direction determination process for determining whether to edit print image data in a row direction or a column direction. It is a figure which shows the specific example of an edit direction determination process. It is a figure for demonstrating the read-out process of the column data from the image memory in a deletion process. It is a specific example which shows the process which extracts the row | line | column of extraction object from a table | surface per record, and rebuilds the print image data containing the table | surface which consists only of the extracted column | column. It is a figure which shows the main flowchart of an extraction copy process. It is a flowchart of the process which specifies the outer frame of a table | surface. It is a figure which shows the specific example of the outer frame specific process which specifies the outer frame of a table | surface. It is a figure for demonstrating the read-out process of the column data from the image memory in an extraction process. It is a specific example which shows the process which extracts the row | line | column to be shaded from a table | surface by a record unit, and rebuilds the table | surface which performed the shading emphasis process. It is a figure which shows the main flowchart of a shading emphasis process.

  The present invention will be described as a plurality of preferred embodiments with reference to FIGS. 1 to 16, but the technical scope of the present invention should be determined by the description of the scope of claims. The description should not be construed as limiting.

  FIG. 1 is a diagram showing a configuration of a digital multi-function peripheral 1 as an image processing apparatus according to an embodiment of the present invention. The digital multi-function peripheral 1 is configured as a multi-function peripheral (MFP apparatus) having a plurality of functions such as a FAX function, a copy function, a scan function, and a print function.

  The digital multifunction peripheral 1 includes a control unit 11, a ROM 12, a data memory 13, an image memory 14, an operation panel 15, an image processing unit 16, an image reading unit 17, an image recording unit 18, and a large-capacity storage. The unit 19 and the communication processing units 31 to 34 are electrically connected via the bus line 10.

  The control unit 11 is composed of a CPU. The control unit 11 controls each of the above hardware units based on the program P stored in the ROM 12 and realizes the function of the digital multi-function peripheral 1.

  The ROM 12 is a read-only storage device that stores in advance programs P, data, and the like necessary for controlling the digital multi-function peripheral 1.

  The data memory 13 is a storage device that can be read and written. The data memory 13 temporarily stores various data such as image data, FAX numbers, and mail addresses, data generated during arithmetic processing by the control unit 11, and the like. Memorize temporarily. The data memory 13 is composed of SRAM, flash memory or the like.

  The image memory 14 is a memory for temporarily storing image data received from an external device through the LAN I / F 34 or the NCU 33, image data acquired by the image reading unit 17, image data processed by the image processing unit 16, and the like. Device. The image memory 14 is configured by a memory such as a DRAM capable of reading and writing. The image memory 14 can function as an image storage unit and stores multi-value image data read by the image reading unit 17.

  The operation panel 15 is a processing unit that functions as a user interface. The operation panel 15 includes a display unit 151 and an operation key group 152.

  The display unit 151 displays various types of information and accepts user operations. The display unit 151 includes a display panel and a touch panel attached to the display panel. The display panel is a device that displays the operating state of the digital multi-function peripheral 1, and is configured by a liquid crystal display, for example. The touch panel senses that a finger or the like has touched the display screen area of the display panel, and acquires the contact information.

  The operation key group 152 includes various keys such as character keys, numeric keys, and function keys, and accepts user operations such as input of commands, text data, and the like. User operation of the operation key group 152 is input to the control unit 11 as a signal. The control unit 11 controls the operation of each unit based on a user operation.

  The image processing unit 16 is a processing unit that performs various processes such as A / D conversion, color system conversion, color adjustment, and image synthesis on received image data, image data acquired from the image reading unit 17, and the like. is there.

  The image reading unit 17 is a scanner that reads an image on a document with a reading element such as a CCD line sensor. The image reading unit 17 may be a scanner of a type in which a reading element scans the surface of a document placed on a glass table and reads an image, and the document placed on a document placement table (not shown). May be a scanner that reads an image by conveying the document by an ADF (Auto Document Feeder) and scanning the surface of the conveyed document by a stationary reading element. The image reading unit 17 includes a table including a handwriting check entry row or column on a printed matter on which a print image is formed with toner or ink, and a handwriting check with a writing tool is used as a frame constituting a row or column for handwriting check entry. Multi-valued image data can be created by reading a mixed original document.

  The image recording unit 18 is a printer that records image data stored in the image memory 14, the large-capacity storage unit 19, and the like on recording paper. As the image recording unit 18, for example, an electrophotographic printer can be employed.

  The large capacity storage unit 19 is configured by a hard disk or the like. The large capacity storage unit 19 can store the image data processed by the image reading unit 17.

  Further, the digital multi-function peripheral 1 includes a codec (CODEC) 31 that encodes / decodes image data and the like corresponding to a plurality of protocols, and a modem 32 that modulates and demodulates transmission / reception data as communication-related processing units. The NCU 33 that controls opening / closing of the telephone line and the LAN I / F 34 corresponding to the interface with the LAN 41 are electrically connected via the bus line 10.

  Here, the communication environment of the digital multi-function peripheral 1 will be described. The digital multifunction device 1 is connected to the LAN 41. The LAN 41 is connected to the Internet 43 via a router 42 and the like. Accordingly, the digital multi-function peripheral 1 can perform e-mail communication with the information processing apparatus 44 connected via the LAN 41 or the information processing apparatus 45 connected via the Internet 43. Note that the information processing devices 44 and 45 are, for example, a personal computer, a device similar to the digital multifunction peripheral 1, a mobile phone, or the like.

  Further, the digital multi-function peripheral 1 is a line that is a data communication network for analog lines (for example, PSTN (Public Switched Telephone Network) 46 (or ISDN (Integrated Services Digital Network)). ). As a result, the digital multi-function peripheral 1 can perform FAX communication with the communication terminal device 47 connected via the line 46. The communication terminal device 47 is, for example, a personal computer connected to a modem, a device similar to the digital multi-function peripheral 1, a fixed phone, a mobile phone, a FAX dedicated device, or the like.

  The digital multi-function peripheral 1 specifies a row or a column to be edited such as deletion, extraction, or emphasis such as shading by entering a handwritten check with a writing tool on a printed matter on which a table is printed as a print image with toner or ink. By reading this printed matter, it is possible to reconstruct the table image data that has been subjected to emphasis processing such as deletion, extraction or shading of the table in units of rows or columns, and the reconstructed table image data is recorded on the recording paper. Can be printed (hereinafter referred to as a delete copy function, an extract copy function, and an emphasized copy function, respectively). These functions are mainly executed by the image processing unit 16. Hereinafter, each of these functions will be described.

  FIG. 2 shows a specific example of the delete copy function. FIG. 2A is an example of a mixed document read by the image reading unit 17. A table is printed as a print image using toner or ink on the mixed document, and this table includes a handwriting check entry row or column (the rightmost row in this embodiment) as a check column. A handwriting check is written in a check column with a writing instrument such as a magic, oily / water-based ballpoint pen, or pencil, and a row or column (column in this embodiment) to be deleted is designated by the user.

  The image reading device 17 is caused to read the mixed original document in a state in which the deletion copy function is valid, and the multivalued image data read by the image reading unit 17 is stored in the image memory 14. As shown in FIG. 2B, the image processing unit 16 edits the image data. That is, the image processing unit 16 distinguishes and separates all handwritten check images from the print image from the image data, and specifies all frames including the separated handwritten checks as target frames for editing. Then, it is determined whether to edit the print image data in the row direction or the column direction in consideration of variations in the position of the target frame in the row direction and the column direction. Stuff on top). Subsequently, as shown in FIG. 2 (C), the print image data is deleted in record units in the determined editing direction, the rows or columns including the target frame and orthogonal to the editing direction, and the remaining rows or columns. Rebuild the table. The image recording unit 18 prints this reconstructed table on a recording sheet.

  FIG. 3 shows a main flowchart of the deletion copy function. Step S301 is a process for separating the handwriting check and the print image. From the multi-valued image data stored in the image memory 14, a handwriting check (a check written in handwriting on a manuscript with a pencil, oil-based or water-based ink is used, taking into account the degree of shading difference of a plurality of pixels constituting the handwriting check. And symbols such as asterisks, alphanumeric characters, hiragana, katakana, kanji, or graphics) are distinguished from other printed images.

  Specifically, as shown in FIG. 4, in the separation process, the image data is divided into several coherent object images, and the image data is separated using the difference in density of each object image. That is, the handwriting check with a writing instrument tends to have more portions with lower density than the printed portion. Therefore, the average density of the object unit (for example, connected pixel unit) in the image data is calculated, and the part where the average density is a predetermined value or less is determined as the handwriting check, and the handwritten check is separated from the image data by separating it. To separate. In addition, for example, the separation process is performed using a change in shading of each object included in the image data. That is, the handwritten check tends to have a gentler density change than the printed portion. Therefore, the average density change rate (average value of density difference between adjacent pixels) in the object unit (for example, connected pixel unit) in the image data is calculated, and a portion where the average density change rate is equal to or less than a predetermined value is determined as a handwriting check. Then, by separating this, the handwriting check is separated from the image data. The separation process can be performed using density information of each pixel in the image data as exemplified above, and can also be performed using various known techniques.

  In step S302, all the frames of the table in which the handwriting check is entered are specified as the frames to be deleted and edited. The details are shown in the flowchart of FIG. In step S501, numbers 1 to N (N is a positive integer) are assigned to all separated handwriting checks. In step S502, the first handwriting check is designated with variable N = 1. In step S503, the center coordinates of the handwriting check are obtained, and the center coordinates are set to A (N). In step S504, it is determined whether the variable N matches the total number of separated handwritten checks. If YES, the process proceeds to step S506. If NO, 1 is incremented to the variable N in step S505, and step S503 is performed. Repeat ~ S505. In this way, the center coordinates A (1) to A (N) of all separated handwriting checks are obtained.

  In step S506, all connected white pixel areas of the print image are extracted. In step S507, numbers 1 to M (M is a positive integer) are assigned to all the extracted connected white pixel areas, and each connected white pixel area is assigned. Is B (M). In step S508, the center coordinate A (1) of the first handwriting check is designated with the variable N = 1. In step S509, the first connected white pixel region B (1) is designated with the variable M = 1. In step S510, it is determined whether or not the designated handwritten check center coordinate A (N) exists in the designated connected white pixel area B (M). If NO, the variable M is incremented by 1 in step S511. Steps S510 and S511 are then repeated. If “YES” in the step S510, the connected white pixel area B (M) is specified as a table frame in which a handwriting check exists, and this is extracted as an area C (N) of an editing target frame. Then, the process proceeds to step S513 to determine whether or not the variable N matches the total number of separated handwritten checks. If NO, the variable N is incremented by 1 in step S514, and steps S509 to S514 are repeated. If there are, the deletion edit target frames C (1) to C (N) are specified for all handwriting checks, and the process proceeds to step S303 of the main flow. FIG. 6 is a diagram showing a specific example of the processing for specifying the target frame in FIG. 5, and the center coordinates A of the handwriting check from all the connected white pixel regions B (1) to B (19) of the print image data. The connected white pixel area B (4) where (1) exists is specified.

  In step S303, in consideration of variations in the row direction and the column direction of the target frames C (1) to C (N) obtained in step S302, it is determined whether the deletion editing is performed in the row direction or the column direction. To do. The details are shown in the flowchart of FIG. FIG. 8 shows a specific example. In step S701, center coordinates of all the target frames C (1) to C (N) are obtained, and the center coordinates are set to D (1) to D (N), respectively.

  In step S702, an average value of the X coordinates (column direction) of the center coordinates D (1) to D (N) of all the target frames is obtained, and the value is set to X (0). In step S703, an average value of the Y coordinates (row direction) of all the center coordinates D (1) to D (N) is obtained, and the value is set to Y (0). In step S704, the center coordinate D (1) of the first target frame C (1) is designated with the variable N = 1. In step S705, a distance difference between X (N) (position in the column direction) that is the X coordinate of the center coordinate D (N) and the average value X (0) is obtained, and an absolute value E (N) is obtained. In step S706, a distance difference between Y (N) (position in the row direction) that is the Y coordinate of the center coordinate D (N) and the average value Y (0) is obtained, and an absolute value F (N) is obtained. In step S707, it is determined whether or not the variable N matches the total number of separated handwritten checks (total number of target frames). If YES, the process proceeds to step S709, and if NO, the variable N is set in step S708. Increment 1 and repeat steps S705 to S708. Thus, with respect to the center coordinates D (1) to D (N) of all target frames, the absolute value E (N) of the distance difference of the X coordinate (column direction) and the absolute value of the distance difference of the Y coordinate (row direction). F (N) is obtained.

  In step S709, by calculating the sum E (sum) of the absolute values E (N) of the distance differences of all X coordinates (column direction), the degree of variation of the X coordinates (column direction) of all target frames is numerically calculated. Turn into. In step S710, the sum F (sum) of the distance differences F (N) of all the Y coordinates (row direction) is obtained, and the degree of variation of all the Y coordinates (row direction) is quantified. Since the check columns are always arranged in a line or column, one of the sum X (sum) of the X coordinate and the F (sum) of the Y coordinate is always almost zero, and this sum is almost equal to zero. The coordinate direction can be recognized as the recording direction of one record in the table. In addition, the other of the total E (sum) of the X coordinates and the F (sum) of the Y coordinates is always a value larger than 0, so that this coordinate direction can be recognized as the direction of deletion editing.

  In the specific example shown in FIG. 8, the sum E (sum) of the X coordinate (column direction) is almost 0, and the sum F (sum) of the Y coordinate (row direction) has a value larger than 0. The recording direction of one record is the X coordinate (column direction), and the deletion editing direction is the Y coordinate (row direction). After determining the deletion editing direction and the recording direction of the table record as described above, the process proceeds to step S304.

  Returning to FIG. 3, in step S304, an area to be deleted and edited is determined. That is, when the direction of deletion editing is the X coordinate (column direction), the coordinates of the left end and the right end are obtained for each of the target frames specified in step S302, and the area between them is set as the target area for deletion editing. Further, when the direction of deletion editing is the Y coordinate (row direction), the coordinates of the upper end and the lower end are obtained for each of the target frames identified in step S302, and the area between them is set as the target area for deletion editing. In the specific example shown in FIG. 8, the coordinates of the upper and lower ends of the column including the handwriting check are obtained, and all the image data in the meantime is set as a target area for deletion editing. In this way, after the deletion edit target area is determined, the process proceeds to step S305.

  In step S305, the print image data from which the deletion edit target area is removed is reconstructed. Specifically, as shown in FIG. 9, when image data stored in a storage area of the image memory 14 is transferred to another storage area of the image memory 14, by skipping the target area for deletion editing, Reconstruct the print image data after deletion and editing. That is, when the direction of deletion editing is the X coordinate (column direction), the print image data to be left undeleted is packed left-justified, and when the print image data is packed, the right end of the column is whitened. If it is filled with image data, and the direction of deletion editing is the Y coordinate (line direction), the print image data that is not deleted is padded with top padding, and when the print image data is packed, that line By embedding white image data up to the lower end of the image, the print image data including the table after the deletion edit is reconstructed. The reconstructed print image data is transferred to the image recording unit 18 and is recorded on the recording paper by the image recording unit 18 with toner or ink, and the user obtains a copy on which the table after deletion and editing is printed.

  The user simply instructs the digital multi-function peripheral 1 to read a document with a handwritten check on the printed matter, and the image processing unit 16 executes the above-described processing. Therefore, the user can use the image editing software of a personal computer or tablet PC. There is no need for editing work, and it is possible to easily obtain a copy in which the table after deletion and editing is printed.

  FIG. 10 shows a specific example of the extraction copy function. FIG. 10A is an example of a mixed document read by the image reading unit 17. A table is printed as a print image using toner or ink on the mixed document, and this table includes a handwriting check entry row or column (the rightmost row in this embodiment) as a check column. A handwriting check is written in a check column with a writing instrument such as a magic, oily / water-based ballpoint pen, or pencil, and a row or column (column in this embodiment) to be extracted is designated by the user.

  The image reading device 17 is caused to read a mixed original in a state where the extraction and copying function is valid, and multi-valued image data read by the image reading unit 17 is stored in an image memory 14 serving as an image storage unit. As shown in FIG. 10B, the image processing unit 16 edits this image data. That is, the image processing unit 16 distinguishes and separates all handwritten check images from the print image from the image data, and specifies all frames including the separated handwritten checks as target frames for editing. Then, in consideration of variations in the position of the target frame in the row direction and the column direction, it is determined whether the print image data is edited in the row direction or the column direction (in this embodiment, extraction editing is performed in the row direction). ). Subsequently, as shown in FIG. 10C, the print image data is extracted in the determined editing direction, the row or column including the target frame and orthogonal to the editing direction in record units, and the extracted row or column is extracted. Reconstruct the print image data including the table. The image recording unit 18 prints the reconstructed print image data on a recording sheet.

  FIG. 11 shows a main flowchart of the extraction copy function. Step S1101 is a separation process between the handwriting check and the print image including the table, and the handwriting check and the print image are distinguished and separated in the same procedure as in step S301 of FIG. Next, in step S1102, all the table frames in which the handwriting check is entered are specified as the extraction edit target frames in the same procedure as in the flowchart of FIG.

  In step S1103, it is determined in the same procedure as the flowchart of FIG. 7 whether the extraction editing is performed in the row direction or the column direction. Also in the extraction and editing function, the coordinate direction in which the sum is almost equal to 0 out of the X coordinate total E (sum) and the Y coordinate F (sum) can be recognized as the recording direction of one record in the table. A coordinate direction larger than 0 can be recognized as the direction of extraction editing.

  In step S1104, the coordinates of the outer frame (the circumscribed rectangle) of the table are obtained. The details are shown in the flowchart of FIG. 12 and the specific example of FIG. In step S1201, all the connected black pixel areas of the print image data including the table are extracted, and numbers 1 to L (L is a positive integer) are assigned to all the connected black pixel areas extracted in step S1202, and each connected black pixel area is assigned. Let the pixel region be D (L). In step S1203, the first connected black pixel region D (1) is designated with the variable L = 1. In step S1204, it is determined whether all the handwriting check center coordinates A (1) to A (N) exist in the designated connected black pixel region D (L). If NO, the variable L is determined in step S1205. 1 is incremented by 1 and steps S1204 and S1205 are repeated. If “YES” in the step S1204, the process proceeds to a step S1206, and since all the handwritten checks are included in the connected black pixel region D (L), it can be determined that it is an outer frame (circumscribed rectangle) of the table, This is extracted as the outer frame of the table, and the coordinates of this outer frame are obtained. In the specific example of FIG. 13, the connected black pixel region D (1) where the center coordinates A (1) of all handwriting checks are present is selected from all the connected black pixel regions D (1) to D (22). It is specified as the outer frame (circumscribed rectangle) of the front image.

  Next, the process proceeds to step S1105 to determine the print image data extraction area. If it is determined in step S1103 that the extraction editing direction is the Y coordinate (row direction), (1) from the upper end of the print image data to the Y coordinate of the upper end of the outer frame of the table image obtained in step S1104 ( 2) From the top Y coordinate to the bottom Y coordinate of all the target frames obtained in step S1102, (3) From the bottom Y coordinate of the outer frame of the table image obtained in step S1104 to the bottom edge of the print image data, The above (1) to (3) are extracted and specified as target areas for extraction editing. If it is determined in step S1103 that the extraction editing direction is the X coordinate (column direction), (4) from the left end of the print image data to the X coordinate of the left end of the outer frame of the table image obtained in step S1104. (5) From the left end X coordinate to the right end X coordinate of all the target frames obtained in step S1102, and (6) the right end of the print image data from the right end X coordinate of the outer frame of the table image obtained in step S1104. Up to the above, (4) to (6) are extracted and specified as the control region for extraction editing.

  Next, the process proceeds to step S1106, and print image data is reconstructed using only the extraction edit target area. Specifically, as shown in FIG. 14, when print image data stored in a storage area of the image memory 14 is transferred to another storage area of the image memory 14, the extraction edit target area specified in step S <b> 1105. The print image data after extraction editing is reconstructed by transferring only the image data. At this time, the extracted edit areas (1), (2), (4), and (5) are transferred with the top or left justification, and the areas (3) and (6) have the same coordinate position after the transfer. By transferring to, you can lay out the reconstructed table with a natural feeling. The print image data including the table thus reconstructed is transferred to the image recording unit 18 and is recorded as a print image by toner or ink on the recording paper by the image recording unit 18, and the user prints the table after extraction and editing. Get a copy.

  The user simply instructs the digital multi-function peripheral 1 to read a document with a handwritten check on the printed matter, and the image processing unit 16 executes the above-described processing. Therefore, the user can use the image editing software of a personal computer or tablet PC. There is no need for editing work, and it is possible to easily obtain a copy in which the table after extraction and editing is printed.

  FIG. 15 shows a specific example of the emphasized copy function. FIG. 15A is an example of a mixed document read by the image reading unit 17. A table is printed as a print image using toner or ink on the mixed document, and this table includes a handwriting check entry row or column (the rightmost row in this embodiment) as a check column. A handwritten check is written in a check column with a writing instrument such as a magic, oily / water-based ballpoint pen, or pencil, and a row or column (column in this embodiment) to be emphasized (shaded in this embodiment) is designated by the user.

  The image reading device 17 is caused to read a mixed original in a state where the enhanced copying function is valid, and multi-valued image data read by the image reading unit 17 is stored in an image memory 14 serving as an image storage unit. As shown in FIG. 15B, the image processing unit 16 edits this image data. That is, the image processing unit 16 distinguishes and separates all handwritten check images from the print image from the image data, and specifies all frames including the separated handwritten checks as target frames for editing. Then, in consideration of variations in the position of the target frame in the row direction and the column direction, it is determined whether the print image data is to be edited in the row direction or the column direction (in this embodiment, the editing is emphasized in the column direction). ). Subsequently, as shown in FIG. 15C, the print image data is extracted in the determined editing direction, the row or column including the target frame and orthogonal to the editing direction in record units, and the extracted row or column in the table is extracted. The column is subjected to emphasis (shading) processing, and print image data including the emphasized table is reconstructed. The image recording unit 18 prints the reconstructed print image data on a recording sheet.

  FIG. 16 shows a main flowchart of this emphasis (shaded) copying function. Step S1601 is a separation process between the handwriting check and the print image including the table, and the handwriting check and the print image are distinguished and separated in the same procedure as in step S301 in FIG. Next, in step S1602, all the frame of the table in which the handwriting check is entered is specified as the extraction edit target frame in the same procedure as the flowchart of FIG.

  In step S1603, it is determined whether the emphasis (shading) editing is performed in the row direction or the column direction in the same procedure as the flowchart of FIG. In the emphasis (shaded) editing function, the coordinate direction in which the sum is substantially equal to 0 among the sum E (sum) of the X coordinates and the F (sum) of the Y coordinates is emphasized as the recording direction of one record in the table ( This is recognized as the editing direction of shading. Step S1604 is processing for obtaining the coordinates of the outer frame (circumscribed rectangle) of the table, and specifies the outer frame (circumscribed rectangle) of the table image in the same procedure as the flowchart of FIG.

  Next, the process advances to step S1605 to determine an emphasis (shaded) region of the front image in the print image data. If it is determined in step S1603 that the emphasis (shaded) editing direction is the X coordinate (column direction), (1) for the column including all the handwriting target frames, (1) the outer frame is placed at the X coordinate (column direction). The print image area surrounded by the left end to the right end and (2) the upper end to the lower end of the target frame in the Y coordinate (row direction) is determined as an emphasis (shaded) editing area. If it is determined in step S1603 that the emphasis (shaded) editing direction is the Y coordinate (row direction), (3) for the column including all handwriting target frames, (3) the outer frame at the Y coordinate (row direction). The print image area surrounded by the upper end to the lower end and (4) the X coordinate (column direction) from the left end to the right end of the target frame is determined as an emphasis (shaded) editing area.

  Next, the process proceeds to step S1606, and print image data obtained by shading (or coloring) the white pixel data area (area excluding black pixel data) with respect to the emphasized (shaded) area determined in step S1605. To rebuild. The print image data including the enhanced table reconstructed in this way is transferred to the image recording unit 18 and recorded as a print image with toner or ink on the recording paper by the image recording unit 18. Get a printed copy.

  The user simply instructs the digital multi-function peripheral 1 to read a document with a handwritten check on the printed matter, and the image processing unit 16 executes the above-described processing. Therefore, the user can use the image editing software of a personal computer or tablet PC. There is no need for editing work, and it is possible to easily obtain a copy in which the highlight-edited table is printed.

  Although the embodiments of the present invention have been described above, any of the embodiments is illustrative and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

11 Control Unit 14 Image Memory 16 Image Processing Unit 17 Image Reading Unit 18 Image Recording Unit

Claims (10)

A mixed manuscript in which a table including a row or column for handwriting check entry is printed as a printed image using toner or ink, and a handwritten check by a writing instrument is entered in a frame constituting the row or column for handwriting check entry. An image reading unit that can read and generate multi-value image data, an image storage unit that stores the multi-value image data read by the image reading unit, and print image data in the multi-value image data stored in the image storage unit In an image processing apparatus comprising an image processing unit for editing
The image processing unit
From the multi-valued image data, a separation processing unit for separating and separating all handwritten check images from the printed image, taking into account the degree of shade difference of a plurality of pixels constituting the handwritten check,
A target frame specifying unit for specifying all frames including the separated handwritten check image as a target frame for editing;
In consideration of variations in the position of the target frame in the row direction and the column direction, an edit direction determining unit that determines whether to edit the data of the print image in the row direction or the column direction;
An editing processing unit that edits and reconstructs the data of the print image in the determined editing direction by editing a row or a column including the target frame and orthogonal to the editing direction. An image processing apparatus.   The target frame detection unit extracts processing for obtaining center coordinates of all separated handwritten check images, processing for extracting all connected white pixel regions in the print image data, and extraction for center coordinates of all handwritten check images. The process of determining which of the connected white pixel areas is included and the process of setting the connected white pixel area including the center coordinates of the handwritten check image as the target frame are performed. Item 8. The image processing apparatus according to Item 1. The editing direction determination unit
Processing for determining the center coordinates of all target frames;
For each row and column direction, find the average coordinate that is the average value of the center coordinates of all target frames, find the distance difference between the center coordinates and the average coordinates for all target frames, and then all the distance differences Processing to obtain the sum of absolute values of
3. A process of comparing the sum of absolute values of distance differences in the row direction and the sum of absolute values of distance differences in the column direction to determine one as an editing direction. An image processing apparatus according to 1.   The editing processing unit deletes the print image data from the print image data of the image storage unit by deleting a row or a column including the target frame and orthogonal to the editing direction in the determined editing direction. The image processing apparatus according to claim 1, wherein the image processing apparatus is reconstructed.   The edit processing unit extracts, from the print image data of the image storage unit, a row or a column including the target frame and orthogonal to the edit direction in the determined edit direction in units of records, and print image data The image processing apparatus according to claim 1, wherein the image processing apparatus is reconstructed.   6. The edit processing unit according to claim 4 or 5, wherein the edit processing unit determines the larger of the sum of absolute values of distance differences in the row direction and the sum of absolute values of distance differences in the column direction as the edit direction. The image processing apparatus described.   The edit processing unit emphasizes a row or a column including the target frame and orthogonal to the edit direction in the determined edit direction from the print image data of the image storage unit in units of records, and print image data The image processing apparatus according to claim 1, wherein the image processing apparatus is reconstructed.   The image processing apparatus according to claim 7, wherein the enhancement process is a shading process.   9. The edit processing unit according to claim 7, wherein the edit processing unit determines the smaller of the sum of absolute values of distance differences in the row direction and the sum of absolute values of distance differences in the column direction as the edit direction. The image processing apparatus described. The image processing apparatus according to claim 1, further comprising an image recording unit that records the reconstructed print image data on a recording sheet.