JP3670571B2 - Image reading device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image reading apparatus that reads a conveyed document or a placed document, and more particularly to an image reading apparatus that realizes high-precision and high-speed document reading.
[0002]
[Prior art]
In consideration of the demand for high-speed document reading, an image reading apparatus that reads a document that is being transported or placed on the document is designed so that the document can be read without performing complex image processing. A method of restricting the posture to a certain one is used.
[0003]
That is, when a plurality of read originals are set on the automatic paper feed mechanism and read continuously, in the conventional technique, the paper guide of the automatic paper feed mechanism is matched to the size of the read original. A method is used in which the position of the original is restricted to a predetermined position and is read by setting the position.
[0004]
Further, in the case where a read document is placed on a document table and read, in the related art, the user can place the read document in a specified posture on the document table, thereby changing the posture of the document. It uses a method of restricting and reading certain things.
[0005]
[Problems to be solved by the invention]
However, according to such a conventional technique, there is a problem that the original cannot be read accurately if the attitude of the original does not become a specified one.
[0006]
In other words, if the original is set to be tilted, the image data of the tilted original is input to the image reading apparatus, so that the original cannot be read accurately.
[0007]
Certainly, due to recent advances in image processing technology, it has been widely performed to perform editing processing such as rotation processing on image data using tilted image data as a processing target on a personal computer or the like.
[0008]
However, the rotation processing realized by such an image processing technique takes a long processing time, and therefore cannot be applied to an image reading apparatus that requires real-time document reading.
[0009]
For this reason, according to the conventional technology, for example, an A4 size read original and a B5 size read original are mixedly read using an image reading apparatus having an automatic paper feeding mechanism. Then, the orientation of the smaller B5 size read original is not tilted because it is not restricted by the automatic paper feed mechanism, and this makes it impossible to read the B5 size read original accurately. In addition, there is a problem that high-precision image reading cannot be realized because there is a problem that a B5-size read original becomes an A4-size image having a blank.
[0010]
The present invention has been made in view of such circumstances, and provides a new image reading apparatus that realizes high-precision and high-speed document reading when reading a conveyed document or a placed document. Objective.
[0011]
[Means for Solving the Problems]
In order to achieve this object, in the image reading apparatus of the present invention, the image data read by the line image sensor is extracted from the image data read by the line image sensor. The memory means for storing and binarizing the image data read by the line image sensor detect the edge portion, and for each line, specify the leftmost edge portion and the rightmost edge portion. Thus, using the extraction means for extracting the edge portions located on the four sides of the document, and the edge portions extracted by the extraction means, the inclination and size of the document to be read, and the document stored in the memory means Detecting means for detecting the reading start position of the image data, and correcting the inclination of the document according to the detection result of the detecting means; Determining a read order of the image data to be present, it reading means for the memory means reads the image data of the document in accordance with the determination of the reading means did Read by reading order Water Causes flat and / or vertical misalignment Drawing Raw pixel data Select an image filter according to the form of the deviation, and Located near the pixel of Painting A smoothing unit for performing a smoothing process using the raw pixel data, and an enlarging unit for enlarging the original image data read in a reduced form according to the reading order determined by the reading unit to an original size. To do.
[0012]
In the image reading apparatus of the present invention configured as described above, the image data read by the line image sensor is stored in the memory means as multi-value data and is also input to the extracting means.
[0013]
Upon receiving this input, the extracting means detects the edge portion by binarizing the image data read by the line image sensor, and for each line, the edge portion located at the leftmost edge and the edge located at the rightmost edge. By specifying the part, the edge part located on the four sides of the document is extracted.
[0014]
In response to this extraction result, the detection means uses the extracted edge portion to identify a straight line expression indicating the coordinate positions of the four sides of the original, and finds the vertex of the original by obtaining the intersection of these linear expressions. Accordingly, the inclination and size of the document to be read and the reading start position of the image data of the document stored in the memory means are detected accordingly.
[0015]
The reading means receives the detection result, determines the reading order of the image data that realizes correcting the inclination of the document, and reads the image data of the document from the memory means accordingly.
[0016]
Then, upon receiving the reading of the image data of the original, the smoothing means follows this reading order. Read by water Causes flat and / or vertical misalignment Drawing Raw pixel data Select an image filter according to the form of the deviation, and Located near the pixel of Painting Smoothing processing is performed using raw pixel data.
[0017]
The enlargement unit enlarges the image data of the original read in a reduced form according to the reading order to the original size, using the image data of the original subjected to the smoothing process as a processing target.
[0018]
Thus, in the image reading apparatus of the present invention, the image data read by the line image sensor is stored in the memory means as multi-value data, and in parallel therewith, the inclination and size of the document to be read, and the memory The reading start position of the image data of the original stored in the means is detected, and the reading order of the image data realizing correction of the inclination of the original is determined according to the detection result, and from the memory means accordingly By reading out the image data of the document, processing is performed so that the image data of the document is cut out while correcting the inclination with the multi-value data.
[0019]
Thus, according to the image reading apparatus of the present invention, it is possible to correct the inclination of the image data of the document while reading the image data of the document and maintaining the multi-value data. Highly accurate and high speed document reading can be realized.
[0027]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, the present invention will be described in detail according to embodiments.
[0028]
FIG. 1 shows an embodiment of an original reading apparatus 1 having the present invention.
[0029]
As shown in this figure, a document reading apparatus 1 according to the present invention includes a line image sensor 10 that reads a document conveyed by an automatic paper feeding mechanism, and an A / D converter that performs A / D conversion on image data read by the line image sensor 10. The D controller 11 and the image data output from the A / D converter 11 are input to the memory control unit 12 that reads a document by performing prescribed image processing, and the image data output from the A / D converter 11 As an input, an edge detection unit 13 that detects an edge portion of the image data and, for example, firmware, the edge information detected by the edge detection unit 13 is input, and an inclination / size that detects the inclination and size of the document. The detection unit 14 is configured by firmware, for example, and instructs the memory control unit 12 to start the scanner reading process. It receives the detection result of the feeder / size detection section 14, and a scanner control unit 15 for instructing the start of the deskew process to the memory control unit 12.
[0030]
The memory control unit 12 stores a first image memory 20 that stores document image data read by the line image sensor 10 in the reading order, and a document image data stored in the first image memory 20. The inclination correction reading unit 21 that reads out while correcting the inclination, the smoothing processing unit 22 that smoothes the jagged portion of the image data generated by the reading by the inclination correction reading unit 21, and the image data processed by the smoothing processing unit 22 A smoothing processing unit 23 for smoothing the image, a horizontal enlargement processing unit 24 for enlarging the image data processed by the smoothing processing unit 23 in the horizontal direction, and an image data processed by the smoothing processing unit 23 in the vertical direction. A vertical enlargement processing unit 25, a binarization unit 26 for binarizing image data enlarged in the horizontal / vertical direction, and a frame portion of the document A masking unit 27 for removing existing shadows and noises, and a second image memory 28 for storing the image data read from the first image memory 20 subjected to these processes and delivering it to a host device (not shown). With.
[0031]
In this way, the memory control unit 12 does not correct the inclination after binarizing the image data of the document, but adopts a configuration in which the inclination is corrected in the state of the multi-value data before binarization. After that, a configuration is adopted in which smoothing processing is performed. Thus, the smoothing process becomes effective.
[0032]
As the smoothing processing unit 23, the horizontal enlargement processing unit 24, the vertical enlargement processing unit 25, the binarization unit 26, and the masking unit 27, those used in the conventional image processing technology can be used.
[0033]
First, the outline of each component constituting the document reading apparatus 1 of the present invention will be described.
[0034]
(1) When the edge detection unit 13 is activated in response to the activation of the scanner reading process issued by the scanner control unit 15, the image data read by the line image sensor 10 for each line as shown in FIG. Are detected in order from the left edge of the scan start, detecting the pixel position that changes sharply from “white to black” or “black to white” without being affected by noise or shadow, and detects it first. The pixel position is set to “left edge”, and the pixel position to be detected last is set to “right edge”.
[0035]
(2) Upon receiving the “left edge coordinates” / “right edge coordinates” reported for each line from the edge detection unit 13, the inclination / size detection unit 14, as shown in FIG. While detecting the coordinates of the two vertices, a process of detecting the coordinates of the vertex which is the lowest end of the document is performed.
[0036]
Then, the inclination / size detection unit 14 calculates the “width” and “horizontal inclination (θ)” of the document shown in the drawing at the stage where the coordinates of the two vertices on the upper end side can be detected, and further, The horizontal magnification correction value is calculated according to “1 / cos θ”, and when the document conveyance speed is a prescribed standard, the same value as the horizontal magnification correction value is calculated as the vertical magnification correction value, and the document conveyance When the speed is not the specified standard, the vertical magnification correction value is calculated according to the ratio value of “1 / cos θ” and the conveyance speed, and their “width” / “slope (expressed in tan θ) ] / “Magnification correction value” and “cutout start address” defined as a storage destination address (storage address of the first image memory 20) of pixel data associated with the top leftmost vertex of the document Processing to be reported to the unit 15 is performed.
[0037]
Then, when the inclination / size detection unit 14 detects that the reading to the lowest vertex of the detected original has been completed (a state in which the “length” of the original shown in the figure can be calculated), the reading of the original is completed. A process of reporting the fact to the scanner control unit 15 is performed.
[0038]
(3) The scanner control unit 15 instructs the memory control unit 12 to execute the scanner reading process, and as shown in FIG. 4, the image data (multi-value data) of the original read by the line image sensor 10 Are written into the first image memory 20 of the memory control unit 12 in the order of reading.
[0039]
When the scanner control unit 15 receives the report of “cutting start address” / “width” / “tilt” / “magnification correction value” from the tilt / size detection unit 14, the “image processing mode” / The “masking range” is set, and the received value and the set value are notified, and the memory controller 12 is instructed to execute the deskew process.
[0040]
When the tilt / size detection unit 14 fails to detect the tilt / size, the scanner control unit 15 instructs the memory control unit 12 to execute a deskew process with the tilt “0”.
[0041]
When the scanner control unit 15 receives a notification from the inclination / size detection unit 14 that the reading of the document has been completed, the scanner control unit 15 responds to the process and instructs the memory control unit 12 to end the deskew process. Do.
[0042]
(4) When the scanner control process 15 is activated from the scanner control unit 15, the memory control unit 12 has the image data of the original read by the line image sensor 10 in the memory control unit 12, as shown in FIG. The first image memory 20 is written in the reading order.
[0043]
When the deskew processing is activated from the scanner control unit 15, the memory control unit 12 follows the “cutting start address” / “width” / “tilt” / “magnification correction value” notified from the scanner control unit 15. As shown in FIG. 5, the image data of the document stored in the first image memory 20 is read while correcting the inclination, and the jagged portion of the image data generated by the reading is smoothed. Further, the “image processing mode” notified from the scanner control unit 15 using the smoothing processing unit 23, the horizontal enlargement processing unit 24, the vertical enlargement processing unit 25, the binarization unit 26, and the masking unit 27 is performed. / Enter processing to perform image processing according to “masking range”, and complete deskew processing from scanner control unit 15 in conjunction with the end of document reading When instructed, it performs a process of ending the process.
[0044]
When the memory control unit 12 is instructed by the scanner control unit 15 to execute the deskew process with the inclination “0”, the image data of the original stored in the first image memory 20 is read as it is, so The correction or smoothing process is not performed.
[0045]
Next, a detailed configuration of each component constituting the document reading apparatus 1 of the present invention will be described.
[0046]
First, the detailed configuration of the edge detection unit 13 will be described.
[0047]
As shown in FIG. 6, the edge detection unit 13 includes a dot counter 130, a left end edge coordinate detection unit 131, a right end edge coordinate detection unit 132, an edge coordinate report unit 133, and an edge filter unit 134. Yes.
[0048]
The dot counter 130 resets the counter value to “0” if the horizontal synchronization signal (shown in FIG. 2) is ON, and (2) if the horizontal valid signal (shown in FIG. 2) is ON. The image clock is counted up. (3) If the horizontal effective signal is OFF, the number of dots of image data sequentially input from the left end is counted by operating so as to hold the counter value.
[0049]
If the horizontal synchronization signal is ON, the left end edge coordinate detection unit 131 sets “0000” in the first edge register, and (2) the horizontal valid signal is ON, and “0000” in the first edge register. ”Is set and the edge filter unit 134 detects an edge, the counter value of the dot counter 130 is set in the register of the first edge, and (3) whether the horizontal valid signal is OFF or“ If a value other than 0000 "is set or the edge filter unit 134 does not detect an edge, the value of the register of the first edge is held, so that the dot of the pixel detected as the first edge portion for each line. Holds the counter value.
[0050]
The right edge coordinate detection unit 132 sets “FFFF” in the register of the last edge when the horizontal synchronization signal is ON, and (2) the horizontal valid signal is ON, and the edge filter unit 134 detects the edge. If it is detected, the counter value of the dot counter 130 is set in the register of the last edge. (3) If the horizontal valid signal is OFF or the edge filter unit 134 does not detect the edge, the value of the register of the last edge is held. Thus, the dot counter value of the pixel detected as the final edge portion is held for each line.
[0051]
When the horizontal synchronization signal is ON, the edge coordinate reporting unit 133 sets the dot counter value held in the first edge register to the register holding the left edge edge coordinate and the last edge register described above. Set the dot counter value to be held in the register that holds the right edge coordinates, and (2) if the horizontal sync signal is OFF, hold the value of the register that holds the left edge coordinates and the register that holds the right edge coordinates By holding the value, the coordinates of the left end edge and the coordinates of the right end edge are reported to the inclination / size detection unit 14.
[0052]
The edge filter unit 134 uses a middle block centered on the pixel of interest, a right block located on the right side of the middle block, and a left block located on the left side of the middle block. In the case of (1), in order to detect the boundary between the document and the document pressing plate and the edge portion of the document while removing noise and shadow, (1) as shown in FIG. When the pixel data of all the belonging pixels is smaller than the Low slice and the pixel data of all the pixels belonging to the right block is larger than the High slice, the target pixel position is detected as an edge, and (2) The pixel data of all the pixels belonging to the left block whose pattern is reversed is larger than the High slice, and the pixel data of all the pixels belonging to the right block is smaller than the Low slice. The target pixel position is detected as an edge when. Here, “Low slice <High slice” is set.
[0053]
Then, in the case of “the original press plate is white”, in order to detect the shadow of the end of the original and the edge part of the original while removing noise and shadow, (1) in FIG. As shown, when the pixel data of all the pixels belonging to the left block and the right block are larger than the high slice and smaller than the low slice of the pixel data of all the pixels belonging to the middle block, the target pixel position is edged (2) The pixel data of all the pixels belonging to the left block and the right block, whose pattern is reversed, are smaller than the Low slice and the pixel data of all the pixels belonging to the middle block are reversed. When the pixel is larger than the high slice, the target pixel position is detected as an edge. Here, “Low slice> High slice” is set.
[0054]
FIG. 8 shows the edge filter unit 134. One case Is illustrated.
[0055]
As shown in this figure, the edge filter unit 134 compares the pixel data (8-bit multi-value data) input from the A / D converter 11 with the Low slice / High slice described above, and the comparator 200. The shift register 201 that shifts and holds the high slice comparison output that is output from the shift register 202 that shifts and holds the low slice comparison output that is output from the comparator 200, and the pixels belonging to the left block held by the shift register 201 The AND circuit 203 that calculates the logical product of the comparison output values, the AND circuit 204 that calculates the logical product of the comparison output values of the pixels belonging to the left block held by the shift register 202, and the middle block held by the shift register 201 AND circuit 2 for calculating the logical product of the comparison output values of the pixels 5 and an AND circuit 206 that calculates the logical product of the comparison output values of the pixels belonging to the middle block held by the shift register 202, and the logical product of the comparison output values of the pixels that belong to the right block held by the shift register 201. The AND pixel 207, the AND circuit 208 that calculates the logical product of the comparison output values of the pixels belonging to the right block held by the shift register 202, and the calculation results of the AND circuits 203 to 208 are input, and the target pixel position is an edge. An edge determination circuit 209 for determining whether or not.
[0056]
When the edge determination circuit 209 receives the data input according to this configuration and determines that “the presser plate of the document is black” according to the filter type instructed from the outside, the filter type 1 shown in FIG. To determine whether or not the target pixel position is an edge portion, and according to the filter type instructed from the outside, it is determined that “the original press plate is white” Performs a filter type 2 logical operation shown in FIG. 9 to determine whether or not the target pixel position is an edge portion.
[0057]
Although not shown in FIG. 8, a circuit for generating a low slice / high slice is prepared, and this slice generation circuit is adapted to an appropriate low slice / high slice according to the filter type designated from the outside. Is generated and supplied to the comparator 200.
[0058]
The edge filter unit 134 allows the size of the middle block to be selected from 1 pixel / 3 pixels / 5 pixels / 9 pixels in order to cope with the unique characteristics of the scanner device, and the left block. The right block size can be selected from 2 pixels / 4 pixels / 8 pixels / 16 pixels.
[0059]
For example, as shown in FIG. 10, the selection configuration is such that the size of the left and right blocks is 2 pixels / 4 pixels / 8 pixels / 16 pixels by selecting an AND circuit by the selector with 1 pixel as the size of the middle block. The edge filter circuit that enables selection from among the three, the size of the middle block as 3 pixels, and the AND circuit is selected by the selector, so that the size of the left and right blocks is 2 pixels / 4 pixels / 8 pixels / 16 pixels Select edge filter circuit and 5 pixels as the size of the middle block and select the AND circuit by the selector to select the size of the left and right blocks from 2 pixels / 4 pixels / 8 pixels / 16 pixels Edge filter circuit to be able to do and left and right by selecting AND circuit by selector with 9 pixels as middle block size Edge filter circuit that makes it possible to select a lock size from 2 pixels / 4 pixels / 8 pixels / 16 pixels, and an edge by selecting a specified one from the output values of these four edge filter circuits This is realized by a selector input to the determination circuit 209.
[0060]
According to this configuration, when the edge detection unit 13 is activated in response to the activation of the scanner reading process issued by the scanner control unit 15, the image read by the line image sensor 10 for each line as shown in FIG. By checking the data in order from the left edge of the scan start, the pixel position that changes sharply from “white to black” or “black to white” is detected first without being affected by noise or shadow. The pixel position to be detected is the “left edge”, the pixel position to be detected last is the “right edge”, and the process of reporting it to the inclination / size detection unit 14 is performed.
[0061]
Next, detailed processing executed by the tilt / size detection unit 14 will be described.
[0062]
The inclination / size detection unit 14 performs processing for detecting the inclination and size of the document conveyed in an inclined posture as shown in FIG. At this time, as shown in FIG. 11B, even if the four corners of the document are bent or marks or the like are written at the four corners of the document, the document has a function of accurately detecting the inclination and size of the document. ing.
[0063]
Specifically, as shown in FIG. 12, the inclination / size detection unit 14 has an expression “Y = A * X + B” indicating the coordinate position of the left side of the document and an expression “Y = A * X + C ”, an expression“ Y = − (1 / A) * X + D ”indicating the coordinate position of the upper side of the document, and an expression“ Y = − (1 / A) * X + E ”indicating the coordinate position of the lower side of the document. This detection function is realized by calculating the coordinates of the two vertices on the upper end side of the document and the coordinates of the vertex that is the lowest end of the document according to these four equations.
[0064]
FIGS. 13 to 15 show an embodiment of a processing flow executed by the inclination / size detection unit 14. Next, according to this processing flow, processing executed by the inclination / size detection unit 14 that realizes this detection function will be described in detail.
[0065]
When the tilt / size detection unit 14 is started by entering the document reading process, first, as shown in the processing flow of FIGS. 13 to 15, first, in step 1, the X coordinate of the edge is detected from the edge detection unit 13. After receiving the report of the “left edge coordinate” / “right edge coordinate” as a value and receiving the report, the process proceeds to step 2 to receive the reported “left edge coordinate” / “right edge coordinate”.
[0066]
Subsequently, in step 3, the Y coordinate value of the received “left edge coordinate” / “right edge coordinate” is calculated by adding the number of read lines, and in step 4, the received “left edge coordinate” is received. "/" Right edge edge coordinates "are stored in correspondence with the number of read lines.
[0067]
Subsequently, in step 5, it is determined whether or not two vertices at the upper end of the document have been detected. If it is determined that they have not been detected, the process proceeds to step 6 to receive the received "right edge coordinate". The document width is calculated by calculating a difference value between the “left edge coordinate” and the “left edge coordinate”.
[0068]
Subsequently, in step 7, it is determined whether or not the calculated document width is wider than the previous one, and when it is determined that the document is widened, the process returns to step 1 as it is. When making a determination, the process proceeds to step 8 where it is determined whether or not the state continues for a specified number of lines. If the specified number of lines is not continued, the process returns to step 1 as it is.
[0069]
On the other hand, when it is determined in step 8 that the document width is not widened for a predetermined number of lines, that is, when it is determined that the position of the document width W shown in FIG. The left edge coordinate (X1, Y1) that is the starting point of the number of continuous lines and the left edge coordinate (X2, Y2) that is the arrival point of the number of continuous lines indicate the coordinate position of the left side of the document. formula
Y = A * X + B
And the right edge coordinate (X3, Y3) that is the starting point of the number of continuous lines and the right edge coordinate (X4, Y4) that is the arrival point of the number of continuous lines Expression indicating position
Y = A * X + C
Is calculated.
[0070]
Subsequently, in step 10, the inclinations of the top and bottom sides of the document are “corresponding to the fact that the top side, the left side, and the right side of the document are orthogonal to each other and the bottom side, the left side, and the right side of the document are orthogonal to each other. -(1 / A) ".
[0071]
Subsequently, at step 11, edge coordinates located on the upper side of the document are extracted from the stored edge coordinates. The processing for extracting the edge coordinates located on the upper side of the document is, for example, a document smaller than the document width W determined to be reached in step 8 from the stored edge coordinates (left edge coordinate / right edge coordinate). Edge coordinates having a width are extracted, and among them, an expression “Y = A * X + B” indicating the coordinate position of the left side of the document and an expression “Y = A * X + C” indicating the coordinate position of the right side of the document are obtained. This is done by identifying things that are not on board.
[0072]
Subsequently, in step 12, the extracted edge coordinates (for example, (X5, Y5) shown in FIG. 12) are used to express the coordinate position of the upper side of the document.
Y =-(1 / A) * X + D
By substituting into, the value of D is calculated for each of the extracted edge coordinates, and the average value of the calculated values of D is calculated while excluding the values deviating from the others. Expression indicating the coordinate position of the upper side of the document
Y =-(1 / A) * X + D
Is calculated.
[0073]
Subsequently, in step 13, an expression “Y = A * X + B” indicating the coordinate position of the left side of the document calculated in step 9 and an expression “Y = − (1 / A / A) indicating the calculated coordinate position of the upper side of the document. ) * X + D ”is calculated to obtain the coordinates of the upper left vertex of the document, and the equation“ Y = A * X + C ”indicating the coordinate position of the right side of the document calculated in step 9 is calculated. The coordinates of the upper right vertex of the document are obtained by calculating the position of the intersection with the expression “Y = − (1 / A) * X + D” indicating the coordinate position of the upper side of the document.
[0074]
Subsequently, in step 14, it is detected from the calculated coordinates of the upper left vertex of the original and the coordinates of the upper right vertex whether the original is inclined upward or upward. That is, when the coordinates of the upper left vertex are closer to the reading start side than the coordinates of the upper right vertex, it is determined that the document is tilted in a left-up manner, and the coordinates of the upper right vertex are the coordinates of the upper left vertex. When the position is closer to the reading start side than the original, it is determined that the document is inclined in a right-up manner.
[0075]
Subsequently, in step 15, “the extraction start address (the storage address on the first image memory 20 of the pixel data associated with the edge coordinates of the upper left edge of the document)” defined by the one shown in FIG. , “Width”, “tilt (tan θ)”, and “magnification correction value (1 / cos θ)” are calculated and notified to the scanner controller 15, and the process returns to step 1.
[0076]
On the other hand, if it is determined in step 5 that the two top vertices of the document have been detected, the process proceeds to step 16 to determine whether or not the bottommost vertex of the document has been detected. When it is determined that the bottom vertex is not detected, the process proceeds to step 17 to calculate the document width by calculating the difference value between the received “right end edge coordinates” and “left end edge coordinates”.
[0077]
Subsequently, in step 18, when it is determined whether or not the calculated document width is approximately 0, and it is determined that the document width is not approximately 0, the process returns to step 1, and the document width is approximately When it is determined that the value is 0, the process proceeds to step 18 to extract the edge coordinates located on the lower side of the document from the stored edge coordinates.
[0078]
The processing for extracting the edge coordinates located on the lower side of the document is, for example, more than the document width W after the document width W is detected from the stored edge coordinates (left edge coordinate / right edge coordinate). Edge coordinates that have a small document width are extracted, and among them, an expression “Y = A * X + B” indicating the coordinate position of the left side of the document and an expression “Y” indicating the coordinate position of the right side of the document are extracted. = A * X + C ”is specified.
[0079]
Subsequently, in step 19, the extracted edge coordinates (for example, (X6, Y6) shown in FIG. 12) are used to express the coordinate position of the lower side of the document.
Y =-(1 / A) * X + E
By substituting into, the value of E is calculated for each of the extracted edge coordinates, and the average value of the calculated values of E is calculated while excluding values that are out of the others. Formula indicating the coordinate position of the lower side of the document
Y =-(1 / A) * X + E
Is calculated.
[0080]
Subsequently, in step 20, the equation “Y = A * X + B” indicating the coordinate position of the left side of the document or the equation “Y = One of the formulas “A * X + C” is selected, and the intersection position of the selected formula and the formula “Y = − (1 / A) * X + E” indicating the coordinate position of the detected lower side of the original is determined. By calculating, the lowest vertex of the document is obtained.
[0081]
That is, if it is detected in step 14 that the document is tilted upward as shown in FIG. 12, the equation “Y = A * X + C” indicating the coordinate position of the right side of the document and the calculated document By calculating the position of the intersection with the expression “Y = − (1 / A) * X + E” indicating the coordinate position of the lower side of the document, the lowest vertex of the document is obtained, while the document is tilted upward to the right Is detected, the equation “Y = A * X + B” indicating the coordinate position of the left side of the document, and the equation “Y = − (1 / A) * X + E” indicating the calculated coordinate position of the lower side of the document, By calculating the position of the intersection, the lowermost vertex of the document is obtained.
[0082]
Subsequently, in step 21, it is determined whether or not the reading line coincides with the position of the lowermost vertex of the document. When it is determined that the reading line does not match, the process returns to step 1, and when it is determined that the reading line matches, Proceeding to step 22, the scanner control unit 15 is notified of the end of reading of the document, and the process ends.
[0083]
When it is determined in step 16 that the lowermost vertex of the document has been detected, the processing in steps 17 to 20 is omitted, and the process proceeds immediately to step 21 where the reading line is at the lowermost edge of the document. When it is determined whether or not the positions of the vertices coincide with each other, and when it is determined that they do not match, the process returns to step 1, and when it is determined that they match, the process proceeds to step 22 to end the reading of the document. 15 and the process is terminated.
[0084]
At the end of reading the original, the scanner control section 15 is notified of the “length” of the original shown in FIG. This is based on how much memory capacity (= [length / cos θ] * [width] for storing document image data for a host device (not shown) that receives document image data from the second image memory 28. This is to inform whether it is necessary to prepare / cos θ]).
[0085]
In this way, upon receiving the “left edge coordinates” / “right edge coordinates” reported for each line from the edge detection unit 13, the inclination / size detection unit 14 receives the upper edge of the document as shown in FIG. In addition to detecting the coordinates of the two vertices on the side, processing is performed to detect the coordinates of the vertex that is the lowermost end of the document.
[0086]
The inclination / size detection unit 14 detects the coordinates of the two vertices on the upper end side and the original “width” and the original “inclination (tan θ: preferably numerator 1, denominator is a natural number”. ”And the“ magnification correction value (1 / cos θ: when the document transport speed is not a standard one), the horizontal magnification correction value and the vertical magnification correction value are separately set. And “the extraction start address (the storage address on the first image memory 20 of the pixel data associated with the edge coordinates of the upper left edge of the document)” is specified. Processing to report to the scanner control unit 15 is performed.
[0087]
When the inclination / size detection unit 14 detects that the reading of the detected original to the lowest vertex is completed, the inclination / size detection unit 14 performs processing to report to the scanner control unit 15 that the reading of the original has been completed.
[0088]
As described above, the scanner control unit 15 instructs the memory control unit 12 to execute the scanner reading process, and as shown in FIG. 4, the image data (multivalued) of the document read by the line image sensor 10 is read. Data) is written into the first image memory 20 of the memory control unit 12 in the order of reading.
[0089]
When the scanner control unit 15 receives the report of “cutting start address” / “width” / “tilt” / “magnification correction value” from the tilt / size detection unit 14 according to the above-described processing, the “image processing mode” "/ Masking range" is set, and the received value and the set value are notified, and processing for instructing the memory control unit 12 to execute deskew processing is performed.
[0090]
When the scanner control unit 15 receives a notification from the inclination / size detection unit 14 that the reading of the document has been completed, the scanner control unit 15 performs a process for instructing the memory control unit 12 to end the deskew process.
[0091]
Next, details of processing executed by the memory control unit 12 will be described.
[0092]
When the scanner reading process is activated from the scanner control unit 15, the memory control unit 12, as shown in FIG. 4, stores the first image data of the document read by the line image sensor 10 in the memory control unit 12. A process of writing to the image memory 20 in the order of reading is performed.
[0093]
As will be described below, the memory control unit 12 sequentially reads the image data written in the first image memory 20 and processes it in parallel, so that the document read by the line image sensor 10 can be processed. The image data can be overwritten in the first image memory 20 in an overwritten manner. Thus, the first image memory 20 does not need to have a capacity for storing image data for one original.
[0094]
In response to this writing, the inclination / size detection unit 14 enters the above-described processing, and in response to this, the scanner control unit 15 instructs the memory control unit 12 to “cut out start address” / While performing notification of “width” / “tilt (tan θ)” / “magnification correction value” / “image processing mode” / “masking range”, execution of deskew processing is instructed.
[0095]
Upon receiving this deskew processing execution instruction, the inclination correction reading unit 21 constituting the memory control unit 12 notifies the notified “tilt (tan θ)” from the notified “cutout start address”. While the storage address is sequentially set in accordance with the “width”, the image data of the document stored in the first image memory 20 is read while correcting the inclination.
[0096]
For example, when a slope of “tan θ = 1/5”, which rises right by 5 pixels in the horizontal direction and shifts by 1 pixel in the vertical direction, is notified, as shown in FIG. Starting from the above, when 4 pixels are read in the horizontal direction, reading the previous reading line and reading 4 pixels in the horizontal direction are repeated for the length of the notified “width”. The first line is read out while correcting its inclination, and subsequently, the same horizontal position as the “cutting start address” is set for the second line, the third line, and the fourth line. Reading in the same way as the starting point, and entering the fifth line, repeatedly reading up to the last line of the document starting from the same position starting from the position shifted by one pixel to the right from the “cutting start address” Have It is, is performed a process of reading the image data of the document while correcting its tilt.
[0097]
On the other hand, when an inclination of “tan θ = 1/5” rising to the left is notified, reading out the next reading line after reading out four pixels in the horizontal direction from the “cutting start address”. The first line of the document is read while correcting the inclination by repeating the notified “width” length to read out four pixels in the horizontal direction, and then the second line is read. For the 3rd line, the 3rd line, and the 4th line, the same horizontal position as the “cutting start address” is read out in the same manner, and when entering the 5th line, “cutting start” By repeating the process of reading out in a similar manner starting from a position shifted by one pixel to the left from the “address” to the last line of the document, the document image data is read out while correcting its inclination. Ah .
[0098]
The storage address of the pixel data stored in the first image memory 20 has regularity as shown in FIG. 17, and from this, the inclination correction reading unit 21 reads “cutting start address” / “inclination (tan θ)”. ”/“ Width ”notification, you can know how to change the storage address and read the image data of the document with corrected tilt. The image data of the document stored in the first image memory 20 is read out while correcting the inclination while sequentially setting the storage addresses.
[0099]
FIG. 18 to FIG. 20 illustrate the image data reading process executed by the inclination correction reading unit 21 in the form of a processing flow.
[0100]
Here, in this processing flow, it is assumed that “horizontal inclination (1 / (p + 1))” and “vertical inclination (1 / (q + 1))” are given as different values. The process of determining whether or not it is going up to the right in step 2 is performed with a code added to “horizontal inclination (1 / (p + 1))”. Steps 3 to 14 are processes executed when the document is tilted upward to the right, and steps 15 to 26 are processes performed when the document is tilted upward to the left.
[0101]
If described with reference to FIG. 16, “p = 4” in FIG. The “address one line before the address corresponding to the p-th address following the address X” described in step 5 is, for example, the fourth pixel data e following the address X. This is the storage address of the pixel data f one line before that is associated with the storage address. Further, the “address after one line associated with the address next to the address X” described in step 14 is, for example, the pixel data next to the pixel data {circle around (1)} described with reference to FIG. That is, the storage address of pixel data {circle around (3)} after one line associated with the storage address of 2 ▼.
[0102]
In the processing executed in steps 3 to 14 when the document is tilted upward to the right, the image data is read by tracing back one line before one line starting from the top left corner of the document. Thus, in the processing executed when the original is tilted to the left in steps 15 to 26, the image data is read by tracing one line and one line starting from the top left edge of the original. There is only a difference.
[0103]
When such an oblique reading method is used, an image shift locally occurs due to a quantization error of less than one pixel. A smoothing processing unit 22 constituting the memory control unit 12 is prepared for correcting this image shift.
[0104]
In order to notify the smoothing processing unit 22 to which pixel the smoothing processing should be performed, the inclination correction reading unit 21 shifts the pixel data in a form shifted in the vertical direction as shown in FIG. When reading, pixel data read immediately before the shift (for example, d in the figure) and pixel data read by the shift (for example, f in the figure) are defined as “horizontal misalignment pixels”, and the pixel data Processing is performed to turn on the horizontal shift bit of the 1-bit configuration to be added.
[0105]
Then, in order to inform the smoothing processing unit 22 to which pixel the smoothing processing should be performed, the inclination correction reading unit 21 shifts the pixels in the horizontal direction as shown in FIG. When reading data, the pixel data on the line read immediately before the shift (indicated by the left-upward slanted line in the figure) and the pixel data on the line read out of the shift (in the right-upward slanted line in the figure) Are defined as “vertical misalignment pixels”, and processing is performed to turn on the 1-bit vertical misalignment bits added to the pixel data.
[0106]
When the smoothing processing unit 22 constituting the memory control unit 12 receives the image data of the original whose inclination is corrected and read by the inclination correction reading unit 21, it is generated by the inclination correction using an image filter as shown in FIG. To make the jagged portion of the image data to be smoothed.
[0107]
That is, for a horizontal shift pixel in which the horizontal shift bit is turned on, for example, an image generated by tilt correction using an image filter (smoothing degree K can be selected) as shown in FIG. Performs processing to smooth the jagged portion of the data.
[0108]
Incidentally, in the image filter shown in FIG. 21A, when “K = 1”, the pixel data (X in the drawing) of the horizontal shift pixel is replaced with the average value of the pixel data of the pixels adjacent to the left and right. As a result, the process of smoothing the jagged portion generated by the horizontal shift pixel is performed.
[0109]
In addition, for a vertical shift pixel in which the vertical shift bit is turned ON, for example, an image generated by tilt correction using an image filter (smoothing degree K can be selected) as shown in FIG. Performs processing to smooth the jagged portion of the data.
[0110]
Incidentally, in the image filter shown in FIG. 21B, in the case of “K = 1”, the pixel data (X in the drawing) of the vertically shifted pixels is replaced with the average value of the pixel data of the vertically adjacent pixels. Thus, a process for smoothing the jagged portion generated by the vertical shift pixels is performed.
[0111]
In addition, for a horizontal / vertical shift pixel in which the horizontal shift bit is turned on and the vertical shift bit is turned on, for example, an image filter as shown in FIG. 21C (smoothing degree K can be selected) is used. Then, the process of smoothing the jagged portion of the image data generated by the inclination correction is performed.
[0112]
Incidentally, in the image filter shown in FIG. 21C, in the case of “K = 1”, the pixel data of the horizontal and vertical misalignment pixels (X in the figure) is the average value of the pixel data of the pixels adjacent vertically and horizontally. By replacing with, a process of smoothing the jagged portion generated by the horizontal and vertical misalignment pixels is performed.
[0113]
In order to enable application of this image filter, the smoothing processing unit 22 has a mechanism for holding image data for three lines read by the inclination correction reading unit 21.
[0114]
When the smoothing processing unit 23 constituting the memory control unit 12 receives the image data of the document that has been smoothed by the smoothing processing unit 22, the smoothing processing unit 23 uses the image filter as shown in FIG. A process is performed to smooth the jagged portions of the image data that did not exist.
[0115]
That is, for all pixels, for example, using an image filter as shown in FIG. 22 (the degree of smoothing K can be selected), image data that could not be removed by the smoothing processing by the smoothing processing unit 22 is used. Performs a smoothing process on the jagged parts of the image.
[0116]
Incidentally, in the image filter shown in FIG. 22, in the case of “K = 1”, the pixel data of the pixel to be processed (X in the figure) is the average value of the pixel data of eight pixels adjacent in eight directions. By replacing with, a jagged portion of image data that could not be removed by the smoothing process is smoothed.
[0117]
In order to enable application of this image filter, the smoothing processing unit 23 has a mechanism for holding image data for three lines subjected to the smoothing processing by the smoothing processing unit 22.
[0118]
The horizontal enlargement processing unit 24 constituting the memory control unit 12 reduces the image data of the original whose inclination is corrected read out by the inclination correction reading unit 21 by “cos θ” times in the horizontal direction compared to the original image data. Therefore, a process of enlarging the read image data by “1 / cos θ” times in the horizontal direction is performed.
[0119]
Then, the vertical enlargement processing unit 25 constituting the memory control unit 12 has the image data of the document whose inclination is corrected read by the inclination correction reading unit 21 multiplied by, for example, “cos θ” in the vertical direction compared to the original image data. Considering that the image data has been reduced (changes depending on the document conveyance speed), the read image data is enlarged by, for example, “1 / cos θ” times in the vertical direction.
[0120]
The horizontal enlargement processing by the horizontal enlargement processing unit 24 determines that it is necessary to insert one pixel for every 100 pixels in the horizontal direction when “1 / cos θ = 1.01”, for example. The average value of the pixel data of the left and right pixels at the insertion location is calculated, and the pixel data having the average value is inserted into the insertion location.
[0121]
The vertical enlargement processing by the vertical enlargement processing unit 25 determines that it is necessary to insert one line for every 100 lines in the vertical direction when, for example, “1 / cos θ = 1.01”. For example, the calculation is performed by calculating the average value of the pixel data of the pixels on the upper and lower lines of the insertion location, and inserting the pixel data having the average value into the insertion location.
[0122]
The binarization unit 26 constituting the memory control unit 12 compares the image data enlarged by the horizontal enlargement processing unit 24 and the vertical enlargement processing unit 25 with a prescribed threshold value, thereby converting the multivalued image data into 2 Performs the process of converting to a value
[0123]
In this way, the memory control unit 12 does not correct the inclination after binarizing the image data of the document, but adopts a configuration in which the inclination is corrected in the state of the multi-value data before binarization. After that, a configuration is adopted in which smoothing processing is performed. Thus, the smoothing process becomes effective.
[0124]
The masking unit 27 constituting the memory control unit 12 performs a process of erasing shadows existing in the frame portion (edge portion) of the image data of the document binarized by the binarization unit 26, thereby performing the second processing. Processing to be stored in the image memory 28 is performed.
[0125]
In this way, when the scanner reading process is activated from the scanner control unit 15, the memory control unit 12 converts the image data of the original read by the line image sensor 10 into the memory control unit 12 as shown in FIG. Is written in the first image memory 20 in the reading order.
[0126]
When the deskew processing is activated from the scanner control unit 15, the memory control unit 12 follows the “cutting start address” / “width” / “tilt” / “magnification correction value” notified from the scanner control unit 15. As shown in FIG. 5, the original image data stored in the first image memory 20 is read while correcting its inclination, and the jagged portion of the image data generated by the inclination correction is made smooth. Further, smoothing processing is performed, and the “image processing mode” notified from the scanner control unit 15 using the smoothing processing unit 23, horizontal enlargement processing unit 24, vertical enlargement processing unit 25, binarization unit 26, and masking unit 27. ”/“ Masking range ”is entered, and the deskew processing is completed from the scanner control unit 15 in conjunction with the end of reading of the document. When instructed, it performs a process of ending the process.
[0127]
Although not described in the embodiment shown in FIG. 1, the memory control unit 12 is an image processing unit, in addition to a processing unit that performs enhancement processing, a processing unit that performs error diffusion, and a floating slice. A processing unit that performs conversion is prepared.
[0128]
【The invention's effect】
As described above, in the image reading apparatus of the present invention, the image data read by the line image sensor is stored in the memory means as multi-value data, and in parallel therewith, the inclination and size of the document to be read, A configuration for detecting a reading start position of image data of a document stored in the memory means is determined, and a reading order of image data for realizing correction of the inclination of the document is determined according to the detection result, and the memory means is determined accordingly By reading out the image data of the document from the document, processing is performed so that the image data of the document is cut out while correcting the inclination with the multi-value data.
[0129]
Thus, according to the image reading apparatus of the present invention, it is possible to correct the inclination of the image data of the document while reading the image data of the document and maintaining the multi-value data. Highly accurate and high speed document reading can be realized.
[0130]
Therefore, when multiple scanned originals are set in the automatic paper feed mechanism and read continuously, originals of different sizes can be read at the same time, and the originals are placed on the platen and read. In addition, the original can be read accurately even if the orientation of the original is not set correctly.
[Brief description of the drawings]
FIG. 1 is an example of an embodiment of the present invention.
FIG. 2 is an explanatory diagram of processing of an edge detection unit.
FIG. 3 is an explanatory diagram of processing of an inclination / size detection unit.
FIG. 4 is an explanatory diagram of a process for storing image data in a first image memory.
FIG. 5 is an explanatory diagram of processing of a memory control unit.
FIG. 6 shows the circuit configuration of the edge detection unit. One case It is.
FIG. 7 is an explanatory diagram of binarization processing of the edge filter unit.
[Fig. 8] Edge filter section One case It is.
FIG. 9 is an explanatory diagram of determination processing of an edge determination circuit.
FIG. 10 shows the edge filter section. One case It is.
FIG. 11 is an explanatory diagram of a document being conveyed.
FIG. 12 is an explanatory diagram of detection processing of an inclination / size detection unit.
FIG. 13 is an example of a processing flow executed by an inclination / size detection unit.
FIG. 14 is an example of a processing flow executed by an inclination / size detection unit.
FIG. 15 is an example of a processing flow executed by an inclination / size detection unit;
FIG. 16 is an explanatory diagram of a reading process of an inclination correction reading unit.
FIG. 17 is an explanatory diagram of image data stored in the first image memory.
FIG. 18 is an explanatory diagram of processing executed by an inclination correction reading unit.
FIG. 19 is an explanatory diagram of processing executed by an inclination correction reading unit.
FIG. 20 is an explanatory diagram of processing executed by an inclination correction reading unit.
FIG. 21 is an explanatory diagram of an image filter on which smoothing processing is performed.
FIG. 22 is an explanatory diagram of an image filter to which smoothing processing is performed.
[Explanation of symbols]
1 Document reader
10 Line image sensor
11 A / D converter
12 Memory controller
13 Edge detector
14 Tilt / size detector
15 Scanner control unit
20 First image memory
21 Tilt correction readout section
22 Smoothing processing unit
23 Smoothing processor
24 Horizontal enlargement processing section
25 Vertical enlargement processing unit
26 Binarization part
27 Masking part
28 Second image memory

Claims (8)

In an image reading apparatus that extracts image data of a document to be read from image data read by a line image sensor,
Memory means for storing image data read by the line image sensor;
Detecting means for detecting the inclination and size of the document to be read and the reading start position of the image data of the document stored in the memory means according to the image data read by the line image sensor;
A reading unit for determining a reading order of image data for realizing correction of the inclination of the document according to a detection result of the detecting unit, and reading the image data of the document from the memory unit according to the reading order ;
For pixel data of a pixel that causes a horizontal shift and / or a vertical shift by reading in the reading order, an image filter corresponding to the form of the shift is selected, and pixel data of a pixel located in the vicinity of the pixel is accordingly selected. And providing a smoothing means for performing a smoothing process using,
A characteristic image reading apparatus. The image reading apparatus according to claim 1 ,
Said smoothing means is attached to the pixel data of the pixel to cause horizontal displacement, in accordance with the selected image filter performs smoothing processing with the pixel data of pixels adjacent in the horizontal direction, the pixel data of the pixel to cause vertical deviation for, according to the selected image filter performs smoothing processing with the pixel data vertically adjacent pixels, the information on the pixel data of the pixel that causes the horizontal displacement and vertical displacement, in accordance with the selected image filter, horizontal using the pixel of pixels adjacent to the pixel data and vertical pixels adjacent in a square direction data is subjected to smoothing processing,
A characteristic image reading apparatus. The image reading apparatus according to claim 1 or 2 ,
The detecting means and the reading means execute the processing when the memory means stores image data.
A characteristic image reading apparatus. The image reading apparatus according to any one of claims 1 to 3 ,
The detecting means, when detecting the end of storage of the document image data in the memory means, instructing the reading means to end reading of the image data of the document from the memory means;
A characteristic image reading apparatus. The image reading apparatus according to any one of claims 1 to 4 ,
The edge portion is detected by binarizing the image data read by the line image sensor, and the edge portion located at the leftmost end and the edge portion located at the rightmost end are specified for each line, thereby allowing the document to be read. An extraction means for extracting edge portions located on four sides;
The detecting means uses the edge portion extracted by the extracting means to identify a straight line expression indicating the coordinate positions of the four sides of the original, detects the vertex of the original by obtaining the intersection of these linear expressions, To detect the inclination and size of the document to be read and the reading start position of the image data of the document stored in the memory means,
A characteristic image reading apparatus. The image reading apparatus according to claim 5 .
The detection means specifies a linear expression indicating the coordinate positions of the two left and right sides of the document, calculates an inclination orthogonal to the inclination of the linear expression, and uses it to use the coordinates of the upper and lower two sides of the document. To identify a linear expression that indicates the position,
A characteristic image reading apparatus. The image reading apparatus according to any one of claims 1 to 6 ,
Comprising an enlarging means for enlarging the original image data read in a reduced form by the reading order to the original size;
A characteristic image reading apparatus. The image reading apparatus according to any one of claims 1 to 7 ,
The readout means reads out the number of pixels specified by the slope in the horizontal direction starting from the readout start address, and then moves to the previous or next line according to the slope and continues the readout. Is repeated for the length of the width to read one line of the document, and the reading for the one line is repeated in the vertical direction for the number of lines specified by the inclination, and the next line is Determining the readout order of repeating shifting the start address as a starting point to the left or right by one pixel according to the inclination,
A characteristic image reading apparatus.

Images