JP2021180456A - Image processing apparatus - Google Patents

Abstract

To automatically delete a strikethrough in read image data and prevent the generation of a blank in a deleted portion.SOLUTION: An image processing apparatus includes a document reading unit and a processing circuit. The processing circuit recognizes lines included in read image data and symbol areas including symbols. The processing circuit creates a markup language file that describes the symbol area and the lines by using a markup language. The processing circuit removes the description of strikethroughs superimposed on characters in the markup language file. The processing circuit removes one or more symbols superimposed on the strikethroughs in the description of the symbol areas in the markup language file, and shifts the position of a symbol following the removed symbols.SELECTED DRAWING: Figure 2

Description

The present invention relates to an image processing apparatus that processes image data obtained by reading a document.

There is an image processing device that edits (processes) image data obtained by reading a handwritten document. For example, the user writes in the manuscript by handwriting. This document is scanned. The image processing device analyzes the image data obtained by reading the original, and modifies the image data according to the written contents. Patent Document 1 describes an example of an image processing apparatus that processes image data of a handwritten manuscript.

Specifically, in Patent Document 1, the manuscript is read, image data is output, a cancellation portion including a predetermined cancellation symbol is extracted from the image data, a related portion related to the cancellation portion is extracted, and the image data is obtained. The related part is erased from, the replacement image data in which the canceled part is replaced with the related part is generated, and the blowout image data in which the mark indicating that the image is canceled and the canceled part are combined is generated, and the position of the canceled part is As can be seen, an image processing device that synthesizes blown-out image data and replacement image data is described (see Patent Document 1: Claim 1, Claim 2, Paragraph [0040], FIG. 6 and the like). By this method, the image data is automatically corrected, and the image of the balloon indicating the corrected part and the corrected image data are combined.

Japanese Unexamined Patent Publication No. 2007-280266

Clerical errors may be included in the document. Also, extra expressions may be included in the document. Unnecessary parts of these documents may be manually modified. For example, a strikethrough may be drawn by hand on an unnecessary part of a document. Also, depending on the person, unnecessary parts may be erased with correction fluid. However, the modified document may not look very good.

A manually modified document may be scanned and the image data obtained by scanning may be processed. For example, image data editing software may be used to process the image data obtained by reading. When the strikethrough portion is erased (the process of filling with the color of the paper), there is a problem that a blank is created in the erased portion.

Here, in the technique described in Patent Document 1, the portion with the cancellation symbol (cancellation line) is erased. However, there is no description about the processing when there is no related part corresponding to the cancellation symbol. It is unclear whether or not the strikethrough part is erased when there is no related part. It is not a technology that can deal with the above problems.

In view of the above-mentioned problems of the prior art, the present invention automatically erases the strikethrough portion of the scanned image data and prevents blanks from being formed in the erased portion.

The image processing apparatus according to the present invention includes a document reading unit and a processing circuit. The document reading unit reads a document. The processing circuit analyzes the scanned image data obtained by scanning the document, and recognizes the line included in the scanned image data and the symbol region including the symbol. The processing circuit recognizes the symbol included in the symbol area. The processing circuit uses a markup language to describe the symbol area, the line, and each of the symbol area and other than the line, thereby producing a markup language file describing the structure of the read image data. Generate. The processing circuit removes the description of the strikethrough line, which is the line overlapping the characters, from the description of the line in the markup language file. The processing circuit removes one or more of the symbols overlapping the strikethrough in the description of the symbol area of the markup language file, and shifts the position of the symbol following the removed symbol to indicate the symbol. Fill in the blanks created by the removal of.

According to the present invention, the strike-through portion in the scanned image data can be automatically erased. In addition, it is possible to prevent a meaningless blank from being created in the erased part.

It is a figure which shows an example of the multifunction device which concerns on embodiment. It is a figure which shows an example of the flow of the process when the strike-through removal function of the multifunction device which concerns on embodiment is used. It is a figure which shows an example of the scanned image data which concerns on embodiment. It is a figure which shows an example of the analysis processing result which concerns on embodiment. It is a figure which shows an example of the symbol recognition process which concerns on embodiment. It is a figure which shows an example of the generation process of the markup language file which concerns on embodiment. It is a figure which shows an example of the markup language file which concerns on embodiment. It is a figure which shows an example of the removal editing process which concerns on embodiment. It is a figure which shows an example of the file after the removal editing process which concerns on embodiment. An example of the output file generation process according to the embodiment is shown.

Hereinafter, embodiments of the present invention will be described with reference to FIGS. 1 to 10. In the following description, the multifunction device 100 will be described as an example of the image processing device. The multifunction device 100 is also an image forming apparatus. However, each element such as the configuration and the arrangement described in the present embodiment does not limit the scope of the invention and is merely an explanatory example.

(Multifunction device 100)
Next, an example of the multifunction device 100 according to the embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of the multifunction device 100 according to the embodiment.

The multifunction device 100 includes a control unit 1, a storage unit 2, a document reading unit 3, an operation panel 4, a printer unit 5, and a communication circuit unit 6.

The control unit 1 controls the operation of the multifunction device 100. For example, the control unit 1 is a substrate. The control unit 1 includes a control circuit 10, an image processing circuit 11, and an image data generation circuit 12. For example, the control circuit 10 is a CPU. The control circuit 10 controls and calculates the multifunction device 100. The image processing circuit 11 is an integrated circuit (ASIC) designed for image processing. The storage unit 2 stores a control program and data. The multifunction device 100 includes a ROM, a RAM, and a storage as a storage unit 2. For example, the storage is an HDD or an SSD. The control circuit 10 controls and calculates the multifunction device 100 based on the program and data of the storage unit 2.

At the time of a job of reading a document, the control unit 1 causes the document reading unit 3 to read (scan) the document. For example, the document reading unit 3 includes a document stand (contact glass), a lamp, and an image sensor. When reading a document, the control unit 1 causes the lamp to irradiate the document set on the platen with light. The light reflected by the document is incident on the image sensor. The image sensor includes a plurality of light receiving elements. Each light receiving element outputs an analog image signal according to the amount of light received. The analog image signal is input to the control unit 1.

The image data generation circuit 12 processes an analog image signal that the document reading unit 3 reads the document and outputs, and generates image data. Hereinafter, the image data (image data generated by the image data generation circuit 12) obtained by scanning the original is referred to as scanned image data 7. The image data generation circuit 12 includes a circuit that processes an analog image signal. For example, the image data generation circuit 12 is an amplifier circuit, an offset circuit, and an A / D conversion circuit. The A / D conversion circuit converts the analog image signal adjusted by the amplifier circuit and the offset circuit into digital data (read image data 7). For example, the image data generation circuit 12 generates image data of 8 to 10 bits per pixel and color. By repeating reading in units of one line and digitizing analog image signals, one page of read image data 7 can be obtained. The control unit 1 stores the generated scanned image data 7 in the storage unit 2 (for example, HDD).

Jobs for reading a document include, for example, a copy job, a scan transmission job, and a scan save job. The image processing circuit 11 performs image processing on the scanned image data 7 and generates image data for a job. The control unit 1 executes a job using the image data for the job.

The operation panel 4 includes a display panel 41 and a touch panel 42. The control unit 1 displays various setting screens and operation images on the display panel 41. Operational images are, for example, buttons, keys, and tabs. The touch panel 42 is attached to the display panel 41. The touch panel 42 detects the touch position. Based on the output of the touch panel 42, the control unit 1 recognizes the operated operation image. By operating the operation panel 4, settings related to the job can be made.

The printer unit 5 includes a paper feeding unit 5a, a paper transport unit 5b, an image forming unit 5c, and a fixing unit 5d. The control unit 1 controls printing-related processes such as paper feeding, paper transport, toner image formation, transfer, and fixing. The paper feed unit 5a includes a paper feed roller and a paper feed motor. The paper feed motor rotates the paper feed roller. At the time of a print job, the control unit 1 rotates a paper feed motor (paper feed roller). As a result, the paper is supplied from the paper feed unit 5a. The paper transport unit 5b includes a transport roller pair and a transport motor. The transport roller pair transports the paper. The transfer motor rotates a pair of transfer rollers. At the time of the print job, the control unit 1 rotates the transfer motor to transfer the paper to the paper transfer unit 5b.

For example, the image forming unit 5c includes a photoconductor drum, a charging device, an exposure device, a developing device, and a transfer roller. The control unit 1 causes the image forming unit 5c to form a toner image based on the image data for print output. The fixing portion 5d includes a heater, a heating rotating body, a pressurized rotating body, and a fixing motor. The heater heats the heating rotating body. The paper passes through the nip of the heated rotating body and the pressurized rotating body. As a result, the toner image is fixed on the paper. At the time of the print job, the control unit 1 causes the fixing unit 5d to fix the toner image. The paper transport unit 5b ejects the printed paper to the outside of the machine.

The communication circuit unit 6 includes various sockets for communication, a communication circuit, and communication software. The communication circuit unit 6 communicates with the computer 200 via the network. The computer 200 is, for example, a PC or a server. The communication circuit unit 6 receives the print data transmitted from the computer 200. The communication circuit unit 6 acquires the print job data. The data of the print job includes the data described in the page description language. The image processing circuit 11 generates image data from the data described in the page description language. The control unit 1 causes the printer unit 5 to perform printing based on the generated image data.

(Overview of strikethrough removal function)
Next, an example of the strikethrough removing function of the multifunction device 100 according to the embodiment will be described with reference to FIG. FIG. 2 is a diagram showing an example of a processing flow when the strike-through removing function of the multifunction device 100 according to the embodiment is used.

For jobs involving document scanning, the strikethrough removal function can be used. Jobs that involve scanning documents include, for example, copying, scanning transmission, or scanning and saving. First, the user selects one of these as the type of job to be executed on the operation panel 4. When the user wants to use the strike-through removal function, the user sets to use the strike-through remover function in the selected job. For example, the user operates a button that enables the strikethrough removal function. In this way, the operation panel 4 accepts the setting for using the strikethrough removal function.

After the setting is completed, the user inputs the start instruction of the selected job to the operation panel 4. For example, the user operates the start button. The operation panel 4 receives a job start instruction using the strikethrough removal function. The start of FIG. 2 is the time when the start instruction of the job using the strikethrough removal function is given.

When the job using the strikethrough removal function is started, the control unit 1 causes the document reading unit 3 to perform the scanning process (step # 11). The scanning process is a process of causing the document scanning unit 3 to scan the set document.

The control unit 1 performs analysis processing (step # 12), symbol recognition processing (step # 13), markup language file 9 generation processing (step # 14), and removal editing of the scanned image data 7 obtained by the reading process. Perform processing (step # 15) and output file generation processing (step # 16). If the setting is made not to use the strikethrough removal function, the control unit 1 does not perform the processes of steps # 12 to 16.

In the following description, an example in which the control circuit 10 performs the processes of steps # 12 to # 16 will be described. For example, the control circuit 10 performs processing based on the software stored in the storage unit 2 (storage). In this case, the control circuit 10 writes the image data, the file, and the program used for the processing to the RAM.

The image processing circuit 11 may perform the processing of steps # 12 to # 16. The image processing circuit 11 may include a hardware circuit for performing the processing of steps # 12 to # 16. Further, the control circuit 10 may execute a part of the processing of steps # 12 to # 16, and the image processing circuit 11 may execute the other part. That is, the control circuit 10 and the image processing circuit 11 may share the processing.

In the analysis process, the control circuit 10 analyzes the read image data 7. For example, the control circuit 10 recognizes the symbol region R1 and the line. The symbol area R1 is an area including a symbol (symbol string). The control circuit 10 also recognizes the line included in the scanned image data 7. In the symbol recognition process, the control circuit 10 recognizes each symbol included in the symbol area R1. In the markup language file 9 generation process, the control circuit 10 converts the scanned image data 7 based on the result of the analysis process to generate a file (markup language file 9) described in the markup language. The markup language file 9 is a file in which the content and structure of the scanned image data 7 are described in the markup language.

In summary, the control circuit 10 analyzes the scanned image data 7 obtained by scanning the original, and recognizes the line included in the scanned image data 7 and the symbol region R1 in which the symbols are arranged. Further, the control circuit 10 recognizes the symbol string included in the symbol region R1. The control circuit 10 generates a markup language file 9 in which the structure of the read image data 7 is described in the markup language for the symbol area R1, the line, and the area other than the symbol area R1 and the line (non-symbol area). ..

Further, in the removal editing process, the control circuit 10 is a process of removing the description of the line overlapping the character (cancellation line 8) and the description of the character overlapping the cancellation line 8 in the markup language file 9. Further, the control circuit 10 edits the description of the markup language file 9 in order to eliminate the blank created by the removal. In the output file generation process, the control circuit 10 converts the markup language file 9 after the removal edit process to generate an output file.

The control unit 1 executes a job based on the generated output file. For example, in the case of a copy job (print job), the control unit 1 generates image data based on the edited markup language file 9. The control unit 1 causes the printer unit 5 to perform printing based on the generated image data. In the case of a scan transmission job, the control unit 1 causes the communication circuit unit 6 to transmit the generated output file to the set destination. In the case of a scan save job, the control unit 1 stores the generated output file in a set save destination (see FIG. 10).

(Analysis processing)
Next, an example of the analysis process according to the embodiment will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram showing an example of the scanned image data 7 according to the embodiment. FIG. 4 is a diagram showing an example of the analysis processing result according to the embodiment.

For example, the storage unit 2 stores the analysis software 21 in a non-volatile manner (see FIG. 1). In the control circuit 10, the analysis software 21 is used, and the control circuit 10 performs analysis processing. When the strikethrough removal function is used, the control circuit 10 starts the analysis process when the scanned image data 7 is generated by the scanning process.

In the analysis process, the control circuit 10 recognizes at least the line included in the scanned image data 7. Further, the control circuit 10 recognizes at least the symbol region R1 included in the read image data 7.

The control circuit 10 recognizes a line in the scanned image data 7. For example, the control circuit 10 performs a Hough transform process to recognize a line drawn in the scanned image data 7, which is longer than the reference length. The reference length is predetermined.

Further, for example, in the analysis process, the control circuit 10 performs a region extraction process. For example, the control circuit 10 extracts a symbolic region R1 and a non-symbolic region as regions.

The symbol area R1 is an area including letters, numbers, and symbols in a narrow sense. The characters are, for example, alphabets, hiragana, katakana, and kanji. Symbols in the narrow sense are symbols used in descriptions, along with letters and numbers such as parentheses, question marks, exclamation marks, and at signs. For example, the control circuit 10 recognizes the row portion (symbol string) included in the scanned image data 7 as the symbol region R1. The non-symbol area is an area that is not the symbol area R1. The non-symbol area is, for example, an area of a photograph or a figure.

An example of extraction in the area extraction process will be described. For example, in the area extraction process, the control circuit 10 performs a labeling process, a connected figure analysis process, and an integrated process. First, the control circuit 10 copies the scanned image data 7 and performs threshold processing on the copied scanned image data 7 to generate binarized image data (image data for region extraction). In addition, in order to accurately recognize the symbol string, the control circuit 10 may perform a process of removing (converting to white pixels) the recognized line from the image data for region extraction.

In the labeling process, the control circuit 10 sets the high-density pixel (black pixel) as the pixel of interest in the image data for region extraction, and has the same label (black pixel) on the high-density pixel (black pixel) connected (connected) in any of the eight directions. Number) is attached. The control circuit 10 constitutes a part or all of the symbols, and affixes the same label to a plurality of connected black pixels. Further, the control circuit 10 constitutes a figure and a photograph, and attaches the same label to a plurality of connected black pixels. A group of pixels with the same label is referred to as a connected figure for convenience.

In the connected figure analysis process, the control circuit 10 performs a process of enclosing each connected figure with an circumscribed rectangle. In addition, the area (number of pixels) of each circumscribed rectangle is obtained. Here, the control circuit 10 defines an circumscribed rectangle whose area is equal to or larger than the first reference value as a non-symbol region. The control circuit 10 defines a large area that is not recognized as a symbol as a non-symbol area. For example, the first reference value may be predetermined, or any value within the range of 1.5 to 2 times the average value of the area of the inscribed figure may be set as the first reference value. As a result, the control circuit 10 recognizes the position (coordinates) and range of the non-symbol region in the scanned image data 7.

In the integrated process, the control circuit 10 is an circumscribed rectangle that is not defined as a non-symbol area, and the circumscribed rectangles whose distance is less than the second reference value are grouped together and surrounded by one circumscribed rectangle. For example, the control circuit 10 groups circumscribed rectangles that are close to each other in the symbol description direction (row direction, left-right direction). As a result, the control circuit 10 recognizes each row portion (symbol string) included in the scanned image data 7 as the symbol region R1. As a result, in the scanned image data 7, the control circuit 10 recognizes the position (coordinates) and range of the symbol region R1. The second reference value may be predetermined. The second reference value can be a value considering the character spacing, and can be a value smaller than the line spacing.

In addition, using another image processing method, the control circuit 10 may recognize the symbolic region R1 and the non-symbolic region in the scanned image data 7. For example, the control circuit 10 may recognize the symbolic region R1 and the non-symbolic region in the scanned image data 7 by paying attention to the edge and the blank.

FIG. 4 shows an example of the analysis processing result of the control circuit 10. The broken line in FIG. 4 shows an example of the symbol region R1 recognized by the control circuit 10. In the examples of FIGS. 3 and 4, the scanned image data 7 (manuscript) does not include figures and photographs. Therefore, in the examples of FIGS. 3 and 4, the control circuit 10 does not recognize the non-symbol region. When the manuscript includes a figure and a photograph, the control circuit 10 recognizes the area of the figure and the area of the photograph as a non-symbol area.

Further, as shown in FIG. 4, the control circuit 10 recognizes a line included in the document (scanned image data 7). The control circuit 10 can also recognize the strikethrough 8 written by hand on the manuscript.

(Symbol recognition processing)
Next, an example of the symbol recognition process according to the embodiment will be described with reference to FIG. FIG. 5 is a diagram showing an example of the symbol recognition process according to the embodiment.

For example, the storage unit 2 stores the symbol recognition software 22 in a non-volatile manner (see FIG. 1). The control circuit 10 uses the symbol recognition software 22 to perform the symbol recognition process. Specifically, the control circuit 10 performs OCR processing on each symbol included in the symbol region R1. In order to accurately recognize the symbol string, the control circuit 10 may perform a process of removing (converting to white pixels) the recognized line from the read image data 7.

The start of FIG. 5 is when the analysis process of the scanned image data 7 is completed. First, the control circuit 10 recognizes image data for one symbol for each symbol included in the symbol area R1 (cutting out the symbol, step # 21). For example, the control circuit 10 moves a line in a direction perpendicular to the row direction (the short side direction of the symbol region R1) on the symbol region R1. The control circuit 10 counts the number of lines intersecting with characters (high density pixels). Recognize a bundle of lines with a count value of zero as a character delimiter. Based on the recognized delimiter, the control circuit 10 recognizes image data for one symbol.

The control circuit 10 recognizes each symbol for each symbol's image data (step # 22). For example, the control circuit 10 performs pattern matching processing and recognizes a symbol. Further, the control circuit 10 may obtain the feature amount of the image data for one symbol by calculation instead of the pattern matching process, and recognize each symbol based on the obtained feature amount. When all the symbols are recognized, the control circuit 10 ends the symbol recognition process (end).

(Generation process of markup language file 9)
An example of the markup language file 9 generation process according to the embodiment will be described with reference to FIGS. 6 and 7. FIG. 6 is a diagram showing an example of the generation process of the markup language file 9 according to the embodiment. FIG. 7 is a diagram showing a part of the markup language file 9 according to the embodiment.

Markup language is a language for describing sentence structure. The control circuit 10 generates a markup language file 9 by using the results of the analysis process and the symbol recognition process. In the embodiment, an example in which the control circuit 10 generates a file described in XML (Extensible Markup Language) as the markup language file 9 will be described. That is, in the markup language file 9 generation process, the control circuit 10 generates an XML file. The control circuit 10 may generate a file in a markup language other than XML.

For example, the storage unit 2 non-volatilely stores the file generation software 23 for generating the markup language file 9 (for converting the read image data 7 into the markup language file 9) (see FIG. 1). The control circuit 10 uses the file generation software 23 to generate the markup language file 9 from the scanned image data 7.

The start of FIG. 6 is when the symbol recognition process of the scanned image data 7 is completed. First, the control circuit 10 includes a necessary description in the generated markup language file 9 (step # 31). For example, the control circuit 10 includes a version, a character code, and a namespace declaration to be used in the markup language file 9.

The control circuit 10 includes the description of the recognized line in the markup language file 9 (step # 32). FIG. 7 shows a part of the markup language file 9 (XML file) generated based on the scanned image data 7 of FIGS. 3 and 4. In the description of FIG. 7, from the start tag of <draw: polygon> to the end tag of </ draw: polygon> is a description relating to the line.

As shown in FIG. 7, the control circuit 10 may describe the definition (content) of the line in the SVG format. In the example of FIG. 7, for the drag: polygon tag, the control circuit 10 includes a viewBox and a description of the start position, width, and height of the line. The start position has an X coordinate and a Y coordinate. The starting position indicates the position of the left end of the line. If drawing is performed based on the description of this XML file (creating image data), the control circuit 10 draws a line having a defined width and height from the defined start position.

Further, the control circuit 10 includes the description of the recognized symbol area R1 in the markup language file 9 (step # 33). In the description of FIG. 7, it is a description of the symbol region R1 recognized from the start tag of <draw: frame> to the end tag of </ draw: frame>.

In FIG. 7, the first description from <draw: frame> to </ draw: frame> is a symbol including a sentence of "This env innovation ... characters" in the sixth line of FIGS. 3 and 4. It is a description about the region R1.

In FIG. 7, the second description from <draw: frame> to </ draw: frame> includes a sentence of "in a scanned ... area" in the 7th line of FIGS. 3 and 4. It is a description about a symbol area R1.

As shown in FIG. 7, the control circuit 10 may describe the definition of the symbol string in the SVG format. In the example of FIG. 7, for the drag: frame tag, the control circuit 10 includes a description of the start position, width, and height of the frame (rectangular area including the symbol string). The start position has an X coordinate and a Y coordinate. The X and Y coordinates indicate the coordinates of the upper left corner of the frame. For example, the control circuit 10 uses the coordinates of the upper left corner of the symbol region R1 recognized in the analysis process as the coordinates of the upper left corner of the frame.

If drawing (generating image data) is performed based on the description of this XML file, the control circuit 10 is defined in a rectangle (frame) having a defined width and height from the defined start position. Draw a symbol string.

When the non-symbol area is recognized, the control circuit 10 includes the description of the recognized non-symbol area in the markup language file 9 (step # 34). The scanned image data 7 of FIGS. 3 and 4 does not include a non-symbol region. In this case, the control circuit 10 does not include the description of the non-symbol area in the markup language file 9 (XML file). When the description indicating the structure of the text has been defined, the control circuit 10 ends the process (end).

In some cases, a manuscript with handwritten text (autographed manuscript) is set in the manuscript reading unit 3. In this case, in order to generate the markup language file 9, the control circuit 10 recognizes all the written symbols and replaces them with text data. The control circuit 10 includes the description of the recognized text data in the markup language file 9.

(Removal editing process)
Next, an example of the removal editing process according to the embodiment will be described with reference to FIGS. 8 and 9. FIG. 8 is a diagram showing an example of the removal editing process according to the embodiment. FIG. 9 is a diagram showing an example of a file after the removal editing process according to the embodiment.

For example, the storage unit 2 stores the automatic editing software 24 in a non-volatile manner (see FIG. 1). In the control circuit 10, the automatic editing software 24 is used, and the control circuit 10 performs the removal editing process. Specifically, the control circuit 10 edits the generated markup language file 9.

When the job uses the strikethrough removal function, the control circuit 10 automatically edits the contents of the markup language file 9. The start of FIG. 8 is when the generation process of the markup language file 9 is completed. First, the control circuit 10 identifies a line overlapping the symbol in the description of the line included in the markup language file 9 (step # 41). Further, the control circuit 10 specifies a symbol overlapping the line in the description of the markup language file 9 (step # 42).

Then, the control circuit 10 removes one or a plurality of symbols overlapping the line from the description of the symbol area R1 (row area) (step # 43). That is, the control circuit 10 removes symbols (characters and the like) that overlap the strikethrough 8 written on the document.

In the examples of FIGS. 3, 4, and 7, the three symbols (alphabet) of "env" overlap with the line. In this case, the control circuit 10 identifies the symbol in which "env" overlaps with the line in the description of the markup language file 9. Then, the control circuit 10 removes the description of "env", which is a symbol specified to overlap with the line.

Next, the control circuit 10 shifts the position of the symbol (symbol string) following the removed symbol (step # 44). That is, the control circuit 10 changes the description of the markup language file 9 so that the position of the symbol following the removed symbol is shifted (prepared). The control circuit 10 prevents blanks by removal.

FIG. 9 shows an example of the markup language file 9 after the removal editing process. FIG. 9 shows an example in which the three symbols of “env” overlapping the line are removed from the description of FIG. 7. Then, in FIG. 9, the symbol (symbol string) following the removed symbol, the portion shifted in position (shifted to the left) is surrounded by a two-dot chain line. Since the entire symbol string after the removed symbol is shifted, there can be no blank space.

The control circuit 10 may narrow the width (width in the left-right direction, width in the row direction, width in the description direction) of the frame (symbol region R1) by the amount removed. For example, the ratio is obtained by dividing the number of characters included in the symbol area R1 after removal by the number of characters included in the symbol area R1 before removal. Then, the control circuit 10 may obtain the corrected width by multiplying the width of the frame (symbol region R1) by the ratio. The control circuit 10 may rewrite the description of the width of the frame (symbol region R1) to the obtained corrected width.

Specifically, the number of symbols (number of characters) of "This env invention aim to solve this problem by detecting and deleting strikethrough characters" in FIG. 7 is 83 characters including a space. The "env" to be removed is 3 characters. For example, the control circuit 10 performs an operation of 80/83 to obtain a ratio.

In the markup language file 9 of FIG. 7, the width of the frame (symbol area R1) of the above line is defined as 15.314 cm. Therefore, the width value may be rewritten to 15.314 × (80/83) ≈14.763. FIG. 9 shows an example of rewriting the width. In this way, the control circuit 10 may adjust the width of the frame (symbol region R1) from which the symbol is removed.

Further, the control circuit 10 removes the description of the line overlapping the symbol (the line specified to overlap) in the markup language file 9 (step # 45). That is, the control circuit 10 erases the cancel line 8. Of the descriptions of the markup language file 9 in FIG. 7, the description from the start tag of <draw: polygon> to the end tag of </ draw: polygon> is the description of the strikethrough 8. FIG. 9 shows an example of the description of the markup language file 9 after the strikethrough 8 is removed. All the statements about the strikethrough 8 have been removed.

By removing the description of the strikethrough 8, the removal editing process (automatic editing process) of the markup language file 9 ends (end).

(File generation process for output)
Next, an example of the output file generation process according to the embodiment will be described with reference to FIG. FIG. 10 shows an example of the output file generation process according to the embodiment.

When the automatic editing of the markup language file 9 is completed, the control circuit 10 starts generating an output file for the output of the job. The start of FIG. 10 is when the removal editing process is completed.

The control circuit 10 confirms whether or not the job to be executed is a copy job (step # 51). When the job to be executed is a copy job (Yes in step # 51), the control circuit 10 generates an image file (image data) as an output file based on the markup language file 9 after the removal editing process (step #). 52). The control circuit 10 performs drawing processing according to the description of the markup language file 9 and generates an image file. For example, the control circuit 10 generates an image file in bitmap format. Then, the control circuit 10 (control unit 1) causes the printer unit 5 to print based on the generated image file (step # 53). This completes the copy job (end).

When the job to be executed is not a copy job (No in step # 51), the control circuit 10 confirms whether or not the job to be executed is a scan transmission job (step # 54). When the job to be executed is a scan transmission job (Yes in step # 54), the control circuit 10 generates a file in the format for transmission as an output file (step # 55). Before starting the job (before scanning the original), the operation panel 4 accepts the selection of the format of the file to be transmitted. There are multiple file formats to choose from. For example, PDF, JPEG, Tiff can be selected.

When generating a PDF file, the control circuit 10 changes the description of the markup language file 9 and generates a file described in PDF format. When generating a JPEG file or a Tiff file, the control circuit 10 draws image data according to the description of the markup language file 9. For example, the control circuit 10 first generates image data in bitmap format. Then, the control circuit 10 (control unit 1) generates a JPEG file or a Tiff file from the image data in the bitmap format according to the algorithm of the selected image format.

Then, the control circuit 10 (control unit 1) transmits based on the generated file (step # 56). In the case of a transmission job, the control circuit 10 (control unit 1) causes the communication unit to transmit the generated file to the set destination. This completes the send job (end).

When the job to be executed is not a scan transmission job but a scan save job (No in step # 54), the control circuit 10 generates a file in a save format as an output file (step # 57). Before starting the job (before scanning the original), the operation panel 4 accepts the selection of the format of the file to be saved. There are multiple file formats to choose from. For example, PDF, JPEG, Tiff can be selected.

The control circuit 10 (control unit 1) stores the generated file in the storage unit 2 (step # 58). In the case of a save job, the control circuit 10 (control unit 1) causes the storage unit 2 to save the file in the set save location. This completes the save job (end).

In this way, the image processing device (multifunction device 100) according to the embodiment includes the document reading unit 3 and the processing circuit (control circuit 10). The document reading unit 3 reads the document. The processing circuit analyzes the scanned image data 7 obtained by scanning the document, and recognizes the line included in the scanned image data 7 and the symbol region R1 including the symbol. The processing circuit recognizes the symbol included in the symbol area R1. The processing circuit generates a markup language file 9 that describes the structure of the scanned image data 7 by describing each of the symbol area R1, the line, and the symbol area R1 and other than the line using the markup language. .. The processing circuit removes the description of the strikethrough line 8, which is a line overlapping the characters, from the description of the line in the markup language file 9. The processing circuit removes one or more symbols that overlap the strikethrough 8 from the description of the symbol area R1 of the markup language file 9, shifts the position of the symbol following the removed symbol, and removes the blank. Fill in.

The scanned image data 7 can be automatically converted into the markup language file 9. When the manuscript is handwritten, the contents of the manuscript can be automatically converted into text data. In the markup language file 9, the description of the line overlapping the symbol (cancellation line 8) can be automatically deleted. Symbols are, for example, letters, numbers, and symbols in the narrow sense. In the markup language file 9, the description of the symbol overlapping the strikethrough 8 can be automatically removed. Further, the position of the symbol following the removed symbol can be automatically shifted to prevent a conspicuous blank from being created after the symbol is removed.

The processing circuit converts the strikethrough 8 and the markup language file 9 after removing the symbol overlapping the strikeoff line 8 to generate an output file having a format different from that of the markup language file 9. An output file can be generated based on the modified markup language file 9. A file in another format can be generated from the modified markup language file 9.

The image processing device includes an operation panel 4 that accepts the specification of the format of the output file to be generated. The processing circuit converts the markup language file 9 and generates an output file in the format specified by the operation panel 4. You can specify the format of the output file to be generated. You can get an output file in the desired format.

The processing circuit generates a markup language file 9 described using tags. The processing circuit recognizes the position and size of the symbol region R1 in the scanned image data 7. The processing circuit describes the position and size of the frame corresponding to the recognized symbol region R1 in the markup language file 9. The processing circuit describes the symbol string to be stored in the frame in the markup language file 9. The processing circuit removes the symbol overlapping the strikethrough 8 from the description of the symbol string to be stored in the frame, and shifts the symbol following the removed symbol to the head side of the line. The description in the markup language file 9 can be automatically modified so that only the symbol that overlaps the strikethrough 8 is properly removed. The position of characters, etc. following the removed symbol can be automatically shifted so that there is no large space between words.

The processing circuit generates an XML format file as a markup language file 9. An XML format file can be obtained as the markup language file 9.

Although the embodiment of the present invention has been described, the scope of the present invention is not limited to this, and various modifications can be made without departing from the gist of the invention.

The present invention can be used in an image processing device that reads a document and handles image data.

100 Multifunction device (image processing device) 10 Control circuit (processing circuit)
3 Document reader 4 Operation panel 7 Scanned image data 8 Strikes 9 Markup language file R1 Symbol area

Claims (5)

A document reader that reads documents and
The scanned image data obtained by scanning the document is analyzed to recognize the line included in the scanned image data and the symbol area including the symbol.
Recognize the symbol contained in the symbol area and
By using the markup language to describe the symbol area, the line, and each of the symbol area and other than the line, a markup language file describing the structure of the read image data is generated.
From the description of the line in the markup language file, the description of the strikethrough line that overlaps with the characters is removed.
In the description of the symbol area of the markup language file, one or a plurality of the symbols overlapping the strikethrough are removed, the position of the symbol following the removed symbol is shifted, and a blank created by removing the symbol. An image processing apparatus characterized by including a processing circuit that fills the space. The processing circuit is characterized in that the strikethrough and the markup language file after removal of the symbol overlapping the strikeoff line are converted to generate an output file having a format different from that of the markup language file. The image processing apparatus according to claim 1. Includes an operation panel that accepts the format specification of the output file to be generated.
The image processing apparatus according to claim 2, wherein the processing circuit converts the markup language file to generate the output file in the format specified by the operation panel. The processing circuit is
Generate the markup language file described using tags,
Recognize the position and size of the symbol area in the scanned image data,
Describe the position and size of the frame corresponding to the recognized symbol area in the markup language file.
The symbol string to be contained in the frame is described in the markup language file, and the symbol string is described in the markup language file.
The first to third aspects of the description of the symbol string to be accommodated in the frame, wherein the symbol overlapping the strike-through line is removed, and the symbol following the removed symbol is shifted to the head side of the line. The image processing apparatus according to any one of the following items. The image processing apparatus according to any one of claims 1 to 4, wherein the processing circuit generates an XML format file as the markup language file.

Images