JPH10829A - Image processor and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To read out the rule information contained in the image information of a document with small memory capacity by registering an underline in a character data constituting a character line in units of that character data based on the positions of the character line and the underline. SOLUTION: A first line is formed (S51) and the head of an ascending order table is pointed (S52). A decision is then made whether or not the pointed position exceeds the end of the ascending order table (S53). When the end is exceeded, the remaining line is formed between the last line already formed and the lower blank (S69). Subsequently, an underline data region between the upper and lower blanks is checked for the underline and when no underline is present, an underline is registered in a character data in units of that character data based on the positions of the character line and the underline before setting an underline in a sentence (S70). According to the method, rule information contained in the document can be read out accurately with small memory capacity.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention reads an original,
The present invention relates to an image processing apparatus for performing image processing and a processing method thereof, and more particularly to an image processing apparatus for extracting a ruled line from read image data and a processing method thereof.

[0002]

2. Description of the Related Art In a conventional image processing apparatus, as a method of reading a ruled line, a method of converting a ruled line into a graphic and reading the figure is described.
There is a method of taking a ruled line into a document as a vector ruled line or a character ruled line.

[0003]

However, in the above-mentioned conventional image processing apparatus, it is necessary to provide a memory capable of storing image information of the entire original to be read, for example, one page, in the apparatus itself. When reading large-sized paper such as paper or B4 paper, a large memory capacity is required, which is a problem in reducing costs. As a countermeasure against this problem, it is conceivable to reduce the required memory capacity by lowering the resolution when reading the document. However, in this method, if the resolution is lowered to a certain degree or more, there arises a problem that reading accuracy is lowered and ruled line information is missing from the read image information depending on the state of the document.

Further, the above-mentioned method of converting a ruled line into a graphic has the disadvantage that characters and underlines do not interlock because they are converted into graphic data without being read as a document. Also, the method of taking ruled lines into a document as vector ruled lines or character ruled lines is that a horizontal ruled line as an underline is also read as a ruled line, so that the underlined data must be re-edited and the editing efficiency deteriorates. was there.

Accordingly, the present invention provides an image processing apparatus and an image processing apparatus for accurately reading ruled line information included in image information of a document with a small memory capacity and generating a character line in an underline portion of a character included in the ruled line information. The purpose is to provide a method.

[0006]

In order to achieve the above object, an image processing apparatus and a processing method according to the present invention have the following arrangement.

That is, a ruled line extracting means (or step) for extracting a ruled line shown in the document from image data obtained by reading the document, and a ruled line in a digit direction which does not intersect a ruled line in the line direction of the ruled line. Underline extracting means (or step) for extracting a character line as an underline on the document, a character line creating means (or step) for creating a character line between the ruled lines in the line direction of the ruled line, and a character line creating means (or step) Or step), based on the position of the character line created by the underline extraction means (or step), the underline in the character data constituting the character line,
Registration means (or process) for registering in character data units
For example, the character line creating means (or step) generates line data representing the position of the created character line and the structure of the line, and the registration means creates the character line creating The line pitch of each character line obtained by the means is adjusted to a predetermined value and registered in the line data, and the line data includes character data constituting the character line. And As a result, a character line is created in the underlined portion on the document, and subsequent editing and character input of the read document image are facilitated.

Further, the ruled line extracting means (or step)
A division reading unit (or step) for reading the original document by dividing the original into a plurality of areas; a storage unit (or step) for storing divided image data obtained by the division reading unit (or step); Means (or process)
A ruled line extracting means (or step) for extracting a ruled line from the divided image data stored in the storage unit, and a ruled line connected in a row direction among the divided ruled lines obtained by the divided ruled line extracting means (or step). Divided ruled line synthesizing means (or step). Thus, when reading a large-sized document, the document is accurately read even when only a storage unit having a limited storage capacity is provided, and ruled lines on the document are represented.

[0009]

Embodiments of the present invention will be described below in detail with reference to the drawings.

First, an outline of the present embodiment will be described.
When reading a one-page document as image information, the document is read by dividing it into a plurality of regions in a predetermined range, extracting ruled lines from each region, and combining them as ruled lines for one page. Then, a ruled line (horizontal direction for a horizontally written original) that does not intersect a line direction (vertical direction for a horizontally written original) among the ruled lines is extracted as an underline (underline) of a character on the original. , A character line is generated at that position.

FIG. 1 is a block diagram of an image processing apparatus according to an embodiment of the present invention.

In the figure, 1 is a central processing unit (CPU),
Reference numeral 2 denotes a read-only memory (ROM) which stores a program for a processing procedure described later. 3 is a readable / writable memory (RAM), 4 is a read-only memory externally added (external ROM), 5 is a keyboard controller (KBC),
Reference numeral 6 denotes a keyboard (K) connected to the keyboard control device 5.
B) and 7 are a display control device (CRTC), 8 is a display device (CRT) connected to the display control device 7, and 9 is a peripheral device control device (PKC). Reference numeral 10 denotes an external storage device FDD (floppy disk drive) connected to the peripheral device control device 9, reference numeral 11 denotes an external storage device HDD (hard disk drive) connected to the peripheral device control device 9, and F
The DD 10 and the HDD 11 may store a program for a processing procedure described later. 12 is a printing device (PR
T), 13 is a pointing device (PD), and 14 is an image scanner (SC) as reading means of a document or the like.
N). CPU1, ROM2, RAM3, external ROM4, KBC5, CRTC7, PKC9, PRT
The PD 12, the PD 13 and the SCN 14 are connected to each other via a system bus 15 for transmitting and receiving data between the devices.

The programs used in the image processing apparatus according to the present embodiment include ROM 2, FDD 10, HDD 11
Alternatively, the program is stored in the RAM 3 and the CPU 1 sequentially reads the program via the system bus 15 into the ROM 2, the FDD 10,
A predetermined process is performed by reading from the HDD 11 or the RAM 3.

Next, the overall flow of the character processing of the image processing apparatus according to the present embodiment will be described.

FIG. 2 is a flowchart showing an outline of character processing according to an embodiment of the present invention.

When the image processing apparatus is powered on and started up, an initialization program stored in advance in the ROM 2 is started, a work menu screen (not shown) is displayed on the CRT 8, and the following processing starts.

In the figure, in a step S21, the processing shifts to a function selection processing. In this embodiment, a ruled line is read by selecting an item corresponding to “ruled line reading” in a work menu screen (not shown) displayed on the CRT 8 by a predetermined operation. Select Here, when an item corresponding to “ruled line reading” is designated, the process proceeds to step S23. On the other hand, when an item of a function other than the “ruled line reading” is designated, the process proceeds to step S22 to perform other function processing (the description is omitted in the present embodiment).

In step S23, a document reading process for reading a document on which ruled lines are printed is performed (the details of the document reading process will be described later). In brief, the operator sets a document on the SCN 14 and
A start of reading is input via B6. Then, R
In accordance with the control program stored in the OM 2, binary data for each predetermined range width (for example, 512 dot lines) is stored in an image buffer secured in the RAM 3. Further, a vertical line or a horizontal line in the ruled line information is extracted from the image buffer in which the binary data is stored as a set of start point coordinates and end point coordinates, and is stored in the ruled line data area secured in the RAM 3. In this embodiment, the binary data of the read original in the image buffer is SC data.
The dot coordinate data corresponding to the resolution of N14 is stored such that the upper left of the document is the coordinate origin, the right direction is the X coordinate, and the lower direction is the Y coordinate.

Then, the process shifts to step S24 to perform a document conversion process for converting the ruled line data extracted in step S23 into a document (the details of the document conversion process will be described later).

In step S25, a document editing program stored in advance in the ROM 2 is started, and step S25 is executed.
The contents of the document memory 100 created in step 24 are displayed on the CRT 8 so that the operator can edit the contents.

<Original reading process> Hereinafter, step S2
3 will be described with reference to FIG.

FIG. 3 is a flowchart of a document reading process according to an embodiment of the present invention.

In the figure, in step S31, an initial value setting process for initializing control information and the like in the RAM 3 when performing a reading process is performed. That is, the ruled line data area and the ruled line data work area are secured in the RAM 3, and the ruled line data area is initialized to an unused state. Next, the content of the sheet reading position for recording the reading range on the sheet of the original is set to 0 and stored in the RAM 3. Note that the paper reading position is handled by dot coordinate values. Next, R
The image buffer for storing the read image in the AM3 is RA
Secure in M3. Further, a reading start position and a reading end position for storing the read image in the image buffer are secured in the RAM 3, and the contents are set to 0 respectively.
Note that the reading start position and the reading end position are handled by dot coordinate values. Here, the reading start position is the upper end position of the area in which the reading range is specified in the above-mentioned original paper, and when this value is 0, it corresponds to the head position in the Y direction in the image buffer. The reading end position is the maximum reading width in the vertical direction of the paper (Y in the image buffer).
The maximum dot width in the direction). Then, the extraction end position, which is the dot coordinate value, is secured in the RAM 3, and the content is set to the maximum dot width in the Y direction. Here, the extraction end position is position information for designating a portion from the head position in the Y direction in the image buffer to be extracted as a ruled line in the image data in the image buffer.

Steps S32 to S37 are routines for reading an original of one page having a ruled line into a plurality of predetermined ranges (ruled line recognition areas) and reading the data as binary data into the image buffer. That is, the original is scanned by the scanner (S
CN) 14 and inputting a reading start key via the KB 6 divides the document into a plurality of areas from a reading start position to a reading end position, and individually reads those areas to form binary image data. Fill the buffer.

In step S32, the current ruled line recognition area is read into the image buffer as binary data.

Next, in step S33, a horizontal line (including a digit direction ruled line in a ruled line to be described later), a skewed line, a reading error, etc. (hereinafter, referred to as a near line) near the reading end position (the lower end position in the current ruled line recognition area) in the image buffer. The line may extend diagonally to the next reading range due to a horizontal line, etc., and such a portion is excluded from the current ruled line recognition area and included in the next reading range (ruled line recognition area). Perform buffer boundary processing. That is, it is determined whether a horizontal line or the like exists near the lower end position in the current ruled line recognition area based on the state of the dot line or the like. The end position is changed in the −Y direction until a horizontal line or the like does not exist. Note that the process of adjusting the next reading range by the amount by which the current ruled line recognition area is narrowed in step S33 will be described in step S37.

Next, in step S34, a ruled line extraction process for extracting ruled line data in the binary image data in the image buffer is performed. That is, binary data from the head position in the direction of the image buffer corresponding to the current ruled line recognition area to the extraction end position is scanned, and a vertical line (vertical line) or a horizontal line (horizontal line) is set to a start point coordinate and an end point coordinate by a known method. And stores it in the ruled line data work area.

Next, in step S35, of the extracted ruled line data, a boundary ruled line synthesizing process for synthesizing a vertical line with a ruled line already read is performed. That is, if the ruled line data area is unused, the ruled line data work area is copied to the ruled line data area to be used. On the other hand, if the ruled line data area is in use, the vertical line that is not in contact with the upper end position of the current ruled line recognition area among the horizontal and vertical lines stored in the ruled line data work area is subjected to coordinate conversion into the ruled line data area. Move. Next, with respect to the vertical lines in the ruled line data area and the ruled line data work area, the connection state of the vertical line in which the lower end position of the previous ruled line recognition area is in contact with the upper end position of the current ruled line recognition area is determined. For the connected vertical line, the size of the Y component of the vertical line in the ruled line data work area is added to the Y component of the corresponding vertical line in the ruled line data area. On the other hand, if there are unconnected vertical lines in the ruled line data work area, they are moved to the ruled line data area by coordinate conversion.

Next, in step S36, the original paper is
It is determined whether pages have been read. That is, the value of the reading end position is added to the sheet reading position, and the result is added to the SCN1.
The dot value of the vertical size of the paper corresponding to the resolution of 4 is compared, and if the vertical size of the paper is larger, it means that one page has not been read yet, so that the next ruled line recognition area is read in step S37. Move to On the other hand, if the paper size is smaller or equal, it indicates that one page has been read, and the process ends assuming that the document reading process of FIG. 3 has been normally performed, and proceeds to step S23 of FIG.

In step S37, before reading the next ruled line recognition area, an in-buffer moving process for moving the binary image data of the current ruled line recognition area present in the image buffer as necessary is performed. That is, the extraction end position is compared with the reading end position, and if the extraction end position is smaller, the data content in the image buffer from the extraction end position to the reading end position is moved to the reading start position, and from the reading end position. The value of the difference between the extraction end positions is set as the reading start position. If the extraction end position is equal to the reading end position, 0, that is, the upper end position of the image buffer is set as the reading start position. Next, in order to obtain the next reading width, the result of subtracting the sheet reading position from the vertical dot size of the sheet is compared with the maximum dot width in the Y direction. If the result of the subtraction is larger or equal, Y is set to the reading end position. The maximum dot width in the direction is set, and if the subtraction result is smaller, the value of the subtraction result is set at the reading end position. Then, the value of the reading end position is set to the extraction end position, and step S
Return to 32.

(Modification of Original Reading Process) In the above-described original reading process, although the case where the original is skewed (skewed) is not particularly described, depending on how the paper is set when reading the original, In this case as well, for example, skew correction is performed in units of reading a document in a divided manner, and the next read image is first shifted in the Y-axis direction in the image buffer based on the correction amount, and skew correction is performed. It may be configured to perform skew correction on the whole.

Further, in the present embodiment, each time the original is divided and read in units of the ruled line recognition area, the ruled line data extracted up to the previous time and the boundary ruled line synthesizing process are performed, but the capacity of the memory used allows. If it is within the range, the extracted ruled line data may be divided and stored for each read region, and finally, the boundary ruled line synthesizing process may be performed for the entire page. As a result, more accurate ruled line reading becomes possible.

<Document Conversion Processing> The document conversion processing in step S24 will be described in detail below.

FIG. 7 is a view showing an example of a document to be read according to an embodiment of the present invention. P51 indicates the size of the document, and P52 and P53 indicate ruled lines.

FIG. 8 is a diagram showing an example of a document after ruled line data is converted into a document according to an embodiment of the present invention.
Each dot of P61 is a blank mark or space indicating the position of a half-width digit where characters can be written.

In step S24, for example, the document shown in FIG. 7 is converted into a document shown in FIG. 8 by performing a document conversion process.

First, a document memory secured in the RAM 3 used for converting the read ruled line image into a document will be described with reference to FIGS.

FIG. 9 is a diagram showing the relationship between page information and line data according to one embodiment of the present invention.

In the figure, a document memory 100 includes a text information area 110, a page information area 120, a format information area 130,
It has a form overlay figure area 140. Each of these will be described below.

The text information area 110 stores line format information 111 and in-line character data 112 in units of one line. FIG. 10 shows the configuration of the line format information 111, and FIG. 11 shows the in-line character data 112.

FIG. 10 is a diagram showing an example of line format information according to an embodiment of the present invention. The line pitch designation value (for example, width in units of 0.1 mm) and the print line pitch value (for example, a width of 0.1 mm) for each line are shown. (A value converted into a print pitch value when the line pitch designation value is printed) is stored.

FIG. 11 is a diagram showing an example of in-line character data according to an embodiment of the present invention, in which a modification flag (for example, underline modification) and a character code are stored for each character.

In the document memory 100, every time an editing operation for changing the line position (for example, document initialization, document call, line deletion, line insertion, line pitch change, line movement, etc.) is required, a change is required. The line pitch designation value or the print line pitch value in the line format information 111 from the first line to the last line of the part is changed, and in this process, the line crossing the page boundary is used by using the document format information in the format information area 130. Is determined, the line number of the line is updated in the corresponding page information area 120, so that the document memory 10
In 0, position information at the time of printing in page units and line units is stored.

The format information area 130 has a form overlay presence / absence flag for managing the existence of data (form overlay) for displaying / printing a fixed figure on a document over a document on each page. When an overlay is present (indicating that the form overlay presence / absence flag is present), the form overlay graphic area 140 exists in a different area from the text information area 110.

Next, the document conversion processing will be described with reference to the flowchart of FIG.

FIG. 4 is a flowchart showing a document conversion process according to an embodiment of the present invention.

In the figure, in step S41, the dot coordinates of the ruled line information (vertical / horizontal lines) in the area (hereinafter, ruled line data area) storing the ruled line data extracted in step S23 of FIG. Then, a dot / mm conversion process for converting into a mm coordinate representing a length is performed.
In the present embodiment, when converting from dots to mm, 0.1 is used.
It is rounded to the nearest millimeter.

Next, the flow shifts to step S42, in which a document memory securing / initializing process for securing each area of the document memory 100 shown in FIG.
At the stage of initialization, the text information area 110, the page information area 120, the format information area 130, and the empty area (FIG. 9)
And a control area (not shown in FIG. 9) for managing these areas are arranged in the document memory 100.

Next, the process shifts to step S43 to perform an underline extraction process of extracting only horizontal ruled lines that do not intersect with vertical ruled lines among the extracted ruled lines. That is, the inside of the ruled line data area is examined, and a horizontal line that does not intersect the vertical line at any one position is extracted from the horizontal lines, and RA is set as a set of start point coordinates and end point coordinates.
It is stored in the underlined data area secured in M3. And
The extracted horizontal line is deleted from the ruled line data area.

Next, the flow shifts to step S44, where a ruled line / form overlay conversion process for converting the extracted ruled line into a form overlay figure is performed. That is, the form overlay presence / absence flag in the format information area 130 shown in FIG. 9 is set to “Yes”, the form overlay graphic area 140 is secured in an empty area in the document memory 100, and the ruled line information existing in the ruled line data area is deleted. The conversion into graphic data is performed by, for example, setting the format to a horizontal line or a vertical line, setting the attribute to a solid line, and setting the position information to mm coordinates of the start point and the end point.

Next, the process proceeds to step S45, in which ascending order table creation processing is performed on the horizontal line row direction in which horizontal lines in the ruled line data area are extracted in ascending order in the row direction (vertical direction for a horizontally written original). That is, the horizontal lines existing in the ruled line data are stored in the ascending order table area secured in the RAM 3 in ascending order from Y = 0 based on the Y coordinate component of the horizontal line. Note that only the first one of the horizontal lines having the same Y component is stored.

Then, the flow shifts to step S46, in which a character size determination process for determining the character size of the entire document based on the line spacing of the ruled lines, that is, the vertical spacing of the ruled lines, is performed. That is, the interval between each horizontal line is obtained based on the Y component of the horizontal line of the ascending table area secured in step S35, and this interval is compared with, for example, the size of 6 points which is the minimum print size in this embodiment. The minimum interval among the sizes equal to or larger than 6 points is obtained and stored in the character size value secured in the RAM 3.

Next, the process proceeds to step S47, where the number of lines / line pitch calculation / line creation is calculated based on the ascending table area created in step S45 and the character size value found in step S46. The process is performed (details will be described later), and the process proceeds to step S25 in FIG.

(Number of Lines / Line Pitch Calculation / Line Creation Process) Here, the number of lines / line pitch calculation / line creation process in step S47 will be described with reference to the flowcharts shown in FIGS.
This will be described with reference to FIG.

FIG. 12 is a diagram showing a conversion relationship between ruled lines and lines to be created according to an embodiment of the present invention.

In the figure, P91 is a horizontal line, P92 is a character, P
93 and P94 are the line pitch, K is the distance between horizontal lines, S is the character size, G is the distance between the character and the horizontal line located above the character, and A is the distance between the character and the horizontal line located below the character. is there.

FIGS. 5 and 6 are flowcharts showing the flow of the number of rows / row pitch calculation / row creation process according to one embodiment of the present invention.

First, a first row is created in step S51. That is, for example, the first line is set at the position of the upper margin value in the entire document, the line format information is created as a predetermined value, and the accumulated value secured in the RAM 3 is set to -1.

Next, the process shifts to step S52 to point to the head of the ascending order table. In other words, the first horizontal line in the ascending order table area is pointed by the pointer.

Next, the flow shifts to step S53, where it is determined whether or not the point position has exceeded the end of the ascending order table. That is,
It is determined whether or not the pointer pointed in step S52 and step S55 has exceeded the ascending order table. If not, the process proceeds to step S54.
It moves to 69.

In step S69, a remaining line is created between the last line of the already created line and the lower margin position to fill, for example, the line with the line pitch value specified by the format information.

Next, the flow shifts to step S70, using the upper margin position and the lower margin position, checking the underline in the underline data area existing between them, and adjusting the line pitch of the already created line if necessary. Perform the underlined line setting process in the text to be performed.

That is, the underline existing in the range between the upper margin position and the lower margin position is searched in the underline data area, and if there is no line, the number of lines / line pitch calculation / line creation processing is performed normally. And terminates the process, and proceeds to step S25 in FIG.
Move to On the other hand, if at least one underline exists, it is determined whether or not the existing underline satisfies the underline position of the already created line. If satisfied, the line is underlined. On the other hand, if not satisfied, it is determined whether an existing line can be shifted up and down within a range where no line is out of the range of the current horizontal line and within a range not exceeding the previous and next lines, If you do not want to process,
Underline setting processing is performed by adjusting the line pitch with the previous line.
When an underline is set, the X component of the underline data area is converted into a digit position component, and characters within the corresponding character digit range are converted to those shown in FIG.
Set the underline flag as shown in. Here, the underline position is (upper end position of target line + S + character gap position). The character gap is a gap existing between a character and an underline. This value may be set to a value that looks good when printed. Upon completion of the underline setting process, the flow shifts to step S25 in FIG.

In step S54, the magnitude relationship between the Y component and the upper margin position is determined. That is, the Y component position of the pointed horizontal line is compared with the upper margin position. If (Y component position ≧ upper margin position), the process proceeds to step S56, and if (Y component position <upper margin position), step S55. Move to

In step S55, the next line in the ascending order table is updated to point to a horizontal line that satisfies (Y component position ≧ upper margin position), and the process returns to step S53.

On the other hand, in step S56, the R component is calculated based on the Y component value of the horizontal line that satisfies (Y component position ≧ upper margin position).
(Y component position−upper margin position) is set to the accumulated value secured in AM3.

Then, the flow shifts to step S57, where the upper margin position and the Y of the horizontal line satisfying (Y component position ≧ upper margin position) are satisfied.
The underline existing between them is checked in the underline data area using the component position, and if necessary, an underline line setting process for adding an underline is performed. That is, the underline existing within the range of the pointed horizontal line and the upper margin is searched in the underline data area, and if there is no such line, the process proceeds to step S58. On the other hand, if the underline exists, the Y component position of the already created first line and the underline is compared, and the underline that is on the upper margin side from the underline position of the first line is not processed, and the underline of the first line is not processed. Underlines that satisfy the position are processed in the first line. In this case, the X component of the underlined data area is converted into a digit position component,
An underline flag is set for the character data within the corresponding character digit range as shown in FIG. If the line is located on the lower margin side from the underline position of the first line, a new line is added to the position of (underline Y component position-character gap-S) and the same processing is performed. When a new row is added, the cumulative value is updated.
That is, the difference between the upper end position of the last line and the upper end position of the new last line is subtracted from the accumulated value.

In step S58, it is determined whether the interval K can be obtained. That is, as shown in FIG. 12, in order to obtain the interval K between these horizontal lines based on the horizontal line that is pointed and the Y component of the next horizontal line, it is determined whether or not the next horizontal line exists in the ascending order table. Is determined. If the next point does not exceed the end of the ascending order table, it indicates that the next horizontal line exists, and the flow shifts to step S59. On the other hand, if the next point is beyond the end of the ascending order table, it means that the next horizontal line does not exist, and the process shifts to step S71.

In step S71, a remaining line is created between the last line of the already created line and the lower margin position to fill, for example, a line with a line pitch value specified by format information.

Next, the flow shifts to step S72, using the Y component position of the current point and the lower margin position, to check the underline existing between them in the underline data area, and if necessary, the line of the already created line An underline line setting process is performed for the lower margin position for adjusting the pitch.

That is, if the current point is located at a position within the lower margin, it is determined that the line number / line pitch calculation / line creation processing has been normally performed, and the processing is terminated.
Move to 5. On the other hand, if the current point does not exist at the position within the lower margin, an underline existing within a range of the lower margin from the current pointed horizontal line is searched for in the underline data area. As a result, if there is no underline, it is determined that the number of rows / row pitch calculation / row creation processing has been normally performed, the processing is terminated, and the routine proceeds to step S25 in FIG. On the other hand, if at least one underline exists, it is determined whether or not the existing underline satisfies the underline position of the already created line. If satisfied, the line is underlined. On the other hand, if not satisfied, it is determined whether an existing line can be shifted up and down within a range where no line is out of the range of the current horizontal line and within a range not exceeding the previous and next lines, In the case of shifting, the line pitch is adjusted between the previous line and the underline, and the underline setting process is performed. When setting an underline, the X component of the underline data area is converted into a digit position component, and the character data within the corresponding character digit range is converted to the character data shown in FIG.
Set the underline flag as shown in FIG. Here, the underline position is (upper end position of target line + S + character gap position). The character gap is a gap existing between a character and an underline. This value may be set to a value that looks good when printed. Upon completion of the underline setting process, the flow shifts to step S25 in FIG.

In step S59, an interval K is obtained. That is, the result of subtracting the Y component of the current point from the Y component of the next point is set as the interval K secured in the RAM 3.

Then, the flow shifts to step S60, where a magnitude relationship between the interval K and the character size S obtained in step S46 in FIG. 4 is determined. That is, if (interval K ≧ character size S), at least one line can be created, so that step S6
Move to 1. If (interval K <character size S), even if a line of character size S is created at this interval K, it goes beyond the interval K, so that no line is created and the process proceeds to step S68.

In step S68, the cumulative value is added. That is, the interval K is added to the accumulated value for calculating the row pitch value of the last row already created.

In step S61, the number of rows that can be created at the interval K is calculated to create a row. That is, for example, the number of lines is calculated by the number of lines = 1 + [K / 3S] (where [n] is rounded down to the decimal point of n). For example, the line format information or the like is obtained as a predetermined number of lines. Create a row.

Then, the flow shifts to step S62, where the line pitch between the first line and the line preceding the line within the interval K is calculated, and the line pitch for the previous line is set. That is, according to the number of rows determined in step S61, for example, G = (K−number of rows × S) / (2 × number of rows) Row pitch value = cumulative value + G The row pitch of the row preceding the first row in the interval K Calculate the value,
Set to the line pitch specification value in the line format information of the previous line.

Next, the flow shifts to step S63, where it is determined whether the number of rows is two or more. That is, if the number of rows is greater than 1, step S
Move to 64. If the number of rows is equal to or less than 1, the step S6
Move to 5.

In step S64, the line pitch up to the line before the last line in the interval K is calculated and set. That is, the interval K
Is calculated by the line pitch value = S + 2G, and is set to the line pitch designation value in the line format information of the previous line.

Next, the flow shifts to step S65, using the Y component position of the current point and the Y component position of the next point, to check the underline in the underline data area existing between them,
If necessary, an underlined line setting process between the ruled lines in the text for adjusting the line pitch of the already created line is performed.

That is, the underline existing in the range between the currently pointed horizontal line and the next pointed horizontal line is searched in the underline data area. If no underline exists, the process proceeds to step S66. On the other hand, if at least one underline exists, it is determined whether or not the existing underline satisfies the underline position of the already created line. If satisfied, the line is underlined. On the other hand, if not satisfied, it is determined whether an existing line can be shifted up and down within a range where no line is out of the range of the current horizontal line and within a range not exceeding the previous and next lines, In the case of shifting, the line pitch is adjusted between the previous line and the underline, and the underline setting process is performed. When setting an underline, the X component of the underline data area is converted into a digit position component, and an underline flag is set for character data within the corresponding character digit range as shown in FIG.

In step S66, the cumulative value is updated. That is, the interval A between the upper end position of the last line in the interval K and the next horizontal line is obtained and set by overwriting the accumulated value.

Next, the flow shifts to step S67, where the pointer pointing to the ascending order table is updated to the position of the next horizontal line, and the flow returns to step S58.

When the processing in step S47 in FIG. 4 is normally performed and completed, the process proceeds to step S25 in FIG.

(Modification of Document Conversion Process) In the above-described document conversion process, a method has been described in which a line is created between horizontal lines when an underline is set, and then the underline position is adjusted with respect to the line. First, a line may be created corresponding to the underline position between the horizontal lines, and then, if necessary, a line may be created between the horizontal line and the underline line.

In this embodiment, an example in which a document in a horizontal writing format is converted has been described. However, when a document in a vertical writing format is read, except that the underline position is located on the right side of the line. Since the control method is the same as that in the horizontal writing format, it goes without saying that the present invention can be applied to a manuscript in a vertical writing format.

The present invention can be applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), and can be applied to a single device (for example, a copier, a facsimile). Equipment)
May be applied.

An object of the present invention is to provide a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and to provide a computer (or CPU) of the system or apparatus.
And MPU) read and execute the program code stored in the storage medium.

In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, magnetic tape, non-volatile memory card, ROM, etc. can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) And the like perform part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that a CPU or the like provided in the function expansion board or the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the above-described flowcharts. Each module shown will be stored in a storage medium.

FIG. 13 is a diagram showing an example of a memory map of the image processing apparatus as one embodiment of the present invention. That is, a "ruled line extraction module" for extracting at least the ruled line shown in the document, a "underline extraction module" for extracting as an underline applied to characters on the document, and a "character for forming a character line between ruled lines in the line direction" What is necessary is just to store the program code of each module of the "line creation module" and the "registration module" for registering the extracted underline in the in-line character data for each character data in the storage medium.

[0094]

As described above, according to the present invention,
It is possible to provide an image processing apparatus and an image processing method for accurately reading ruled line information included in image information of a document with a small memory capacity and generating a character line in an underline portion of a character included in the ruled line information.

That is, when a one-page document is read as image information, the document is read by dividing it into a plurality of regions within a predetermined range, extracting ruled lines from each region, and combining them as one-page ruled lines. Regardless of the size, processing can be performed with a resolution at the time of reading even with a relatively small memory capacity. Further, among the read ruled lines, digit-directional ruled lines that do not intersect with the line-directional ruled lines are extracted as underlines, and character lines for document creation can be created at those positions, so that the time required for editing work can be reduced.

[0096]

[Brief description of the drawings]

FIG. 1 is a block diagram of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a flowchart illustrating an outline of character processing according to an embodiment of the present invention.

FIG. 3 is a flowchart of a document reading process as one embodiment of the present invention.

FIG. 4 is a flowchart showing a document conversion process as one embodiment of the present invention.

FIG. 5 is a flowchart showing a flow of a row number / row pitch calculation / row creation process as one embodiment of the present invention.

FIG. 6 is a flowchart illustrating a flow of a row number / row pitch calculation / row creation process as one embodiment of the present invention.

FIG. 7 is a diagram illustrating an example of a document to be read according to an embodiment of the present invention.

FIG. 8 is a diagram illustrating an example of a document after converting ruled line data into a document according to an embodiment of the present invention.

FIG. 9 is a diagram illustrating a relationship between page information and line data according to an embodiment of the present invention.

FIG. 10 is a diagram illustrating an example of line format information according to an embodiment of the present invention.

FIG. 11 is a diagram illustrating an example of in-line character data according to an embodiment of the present invention.

FIG. 12 is a diagram illustrating a conversion relationship between ruled lines and lines to be created according to an embodiment of the present invention.

FIG. 13 is a diagram illustrating an example of a memory map of the image processing apparatus as one embodiment of the present invention.

[Explanation of symbols]

 1 CPU 2 ROM 3 RAM 4 External ROM 5 Keyboard control device (KBC) 6 Keyboard (KB) 7 Display control device (CRTC) 8 Display device (CRT) 9 Peripheral device control device (DKC) 10 Floppy disk drive (FDD) 11 Hard disk drive (HDD) 12 Printing device (PRT) 13 Pointing device (PD) 14 Image scanner (SCN) 15 System bus

Claims (8)

[Claims] 1. A ruled line extracting means for extracting a ruled line shown in the document from image data obtained by reading the document, Underline extraction means for extracting as an upper underline; character line creation means for determining the size of a character based on the interval between the ruled lines in the line direction in the ruled line and creating a character line composed of the character; Registration means for registering the underline in character data constituting the character line based on the position of the character line created by the creation means and the position of the underline obtained by the underline extraction means, in units of the character data; An image processing apparatus comprising: 2. The character line creating means generates line data representing the position of the created character line and the structure of the line, and the registration means stores each character line obtained by the character line creating means for each line. 2. The image processing apparatus according to claim 1, wherein the line pitch of the image data is adjusted to a predetermined value and registered in the line data. 3. The apparatus according to claim 2, wherein the line data includes character data constituting the character line. 4. A ruled line extracting means for dividing and reading the document into a plurality of areas, reading means for storing divided image data obtained by the divided reading means, and storing in the storage means Divided ruled line extracting means for extracting ruled lines from the divided image data, and divided ruled line synthesizing means for connecting ruled lines connected in the row direction among the divided ruled lines obtained by the divided ruled line extracting means. The image processing apparatus according to claim 1, wherein: 5. When reading a certain area of the plurality of areas, if there is a diagonal line near the lower end of the area, the divided reading unit excludes the diagonal line part and reads the next reading area. The image processing apparatus according to claim 4, wherein the image processing apparatus includes: 6. A ruled line extracting step of extracting a ruled line shown in the document from image data obtained by reading the document, and forming a ruled line in the digit direction which does not intersect with a linewise ruled line in the ruled line. An underline extraction step of extracting as an upper underline, a character line creation step of determining the size of a character based on the interval between the ruled lines in the line direction in the ruled line, and creating a character line composed of the character, A registration step of registering the underline in character data constituting the character line based on the position of the character line created in the creation step and the position of the underline obtained in the underline extraction step, in units of the character data; An image processing method comprising: 7. The ruled line extraction step includes: a division reading step of dividing the original into a plurality of regions to read the document; a storage step of storing divided image data obtained by the division reading step; and a storage step of storing the divided image data. A dividing ruled line extracting step of extracting a ruled line from the divided image data, and a dividing ruled line combining step of connecting ruled lines connected in a row direction among the divided ruled lines obtained in the divided ruled line extracting step. 7. The image processing method according to claim 6, wherein: 8. A computer-readable memory containing a program code for controlling an image processing apparatus, wherein a code for a ruled line extracting step for extracting a ruled line indicated on the document from image data obtained by reading the document. A code for an underline extraction step of extracting a ruled line in the digit direction that does not intersect with a linewise ruled line in the ruled line as an underline on the document; and a character size based on the interval between the linewise ruled lines in the ruled line. Is determined, based on the code of the character line creation step of creating a character line consisting of the character, the position of the character line created in the character line creation step, and the position of the underline obtained in the underline extraction step A code for a registration step of registering the underline in character data constituting the character line in units of the character data.