JP3582988B2 - Non-contact image reader - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image reading apparatus for reading, recognizing, and collating information such as characters, figures, images, or imprints imprinted or imprinted on a medium such as paper without contact. In particular, the present invention relates to a control method for an image input device capable of freely changing a reading position and a control system using the same.
[0002]
[Prior art]
Currently, commercialized image input devices include a flatbed scanner, a sheet scanner, and a digital camera. However, the flatbed scanner has a high resolution but has a large installation area and a low reading speed, and the sheet scanner has a small installation area but can only read a sheet-shaped sheet. Digital cameras have advantages and disadvantages, such as the inability to take high-resolution images of documents and the like, and do not satisfy the needs of users who want to read various objects at high speed with high image quality.
[0003]
Further, as examples of the non-contact type including the present invention, those described in, for example, JP-A-8-9102, JP-A-8-274955, and JP-A-8-154153 have been proposed. .
[0004]
[Problems to be solved by the invention]
In the above-mentioned prior art document, the image is fixed at a reading position from substantially above, and the installation area becomes large when reading an image.
[0005]
Therefore, a first object of the present invention is to provide a non-contact type image reading apparatus having a high degree of freedom and good operability.
[0006]
It is a second object of the present invention to provide a non-contact image reading apparatus capable of high-speed reading, inputting and recognizing a document image with high image quality.
[0007]
A third object is to provide a small and inexpensive image reading device.
[0008]
[Means for Solving the Problems]
In order to solve at least one of the above objects, the present invention provides a housing for housing a sensor unit for reading a document, a support for supporting the housing, a document table on which the document is placed, and the housing And a detecting unit for detecting a positional relationship between the document and the original, and an image correcting unit for correcting an image distorted based on the positional relationship.
[0009]
In addition, a housing for accommodating a sensor unit for reading a document, a support for supporting the housing and having a movable part for making the housing movable, and a mark for recognizing the position of the document are added. A document table on which the document is placed, a detection unit for detecting a positional relationship between the case and the document based on the mark, a switch added to the case, and activating the detection unit; An image correction unit is provided for correcting an image distorted based on the relationship.
[0010]
In this manner, the presence of the detection unit that detects the positional relationship between the document and the housing enables the housing to accurately read the document at any position (for example, obliquely upward) with respect to the document, and achieve high image quality. Can input and recognize the original.
[0011]
In addition, by providing a movable part on the support, it is possible to move the housing to a different position when reading anything from a free position, as well as when nothing is wrong, and it will not interfere with other work. No. Furthermore, a simple and low-cost image reading apparatus can be provided by using a simple configuration such as a housing, a support table, and a document table.
[0012]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0013]
FIG. 1 is a functional block diagram of an image reading apparatus according to an embodiment of the present invention. The image input device 100 of the present invention reads image data from the movable scanner 101 and outputs binary data to the recognition unit 108. The movable scanner 101 reads a document not only from directly above but also from above. For this reason, the captured image may not be rectangular. If binarization is performed as it is, characters cannot be recognized because the characters are distorted. For this reason, it is necessary to perform a perspective transformation on the distorted image in the perspective transformation unit 105 and convert the distorted image into an image taken from the front. However, since the conversion coefficient differs depending on the reading position, it must be adjusted every time the reading position is moved. Therefore, after moving, the switch 106 is controlled by the coordinate detection switch 102 attached to the movable scanner 101, the output of the movable scanner 101 is binarized as it is, and the vertex of the rectangle is extracted by the coordinate detector 103, and the coefficient is extracted. The determining unit 104 determines coefficients for perspective transformation and outputs the coefficients to the perspective transformation unit 105. After that, the coordinate detection switch 102 is switched. This time, the output of the movable scanner 101 is binarized by the binarization processing unit 107 via the perspective transformation unit 105, and the binarized image data without distortion is sent to the recognition unit 108. Is output.
[0014]
As described above, since the reading can be performed from any position without contact, the efficiency of image input can be improved. Further, even if the reading sensor position is moved, the distortion correction coefficient is automatically calculated, so that there is no need to set again. In addition, since the sensor housing has a reference position reading instruction switch, the operation is simple, there is no need to search for a keyboard, and distortion correction is performed by digital image processing such as PC software. There is an advantage that it can contribute to the development.
[0015]
FIG. 2 is a hardware block diagram of the image reading apparatus according to one embodiment of the present invention. A sensor for reading an image is stored in the movable scanner 101, an analog signal from the sensor is A / D converted, and transmitted to the preprocessing board 120 as a digital multi-value signal. In the pre-processing board 120, a sensor variation correcting unit 125 corrects a variation in odd-numbered and even-numbered bits of a sensor, and the like, and the DMA controller 126 transfers the data to a personal computer 121 which is a processing main body. Here, a PCI bus was used as the connection bus 127. The personal computer 121 temporarily stores the transmitted image signal in the memory 128, receives an instruction via the keyboard 123, performs image correction, processing, and recognition by the CPU 124, and displays the result on the display 122 or stores the result in the file 129. I do.
[0016]
Here, the read document 112 is placed on the document table 111, and the positioning markers 113 a, b, c, and d previously marked on the document table are changed by the coordinate detection switch 102 mounted on the movable scanner 101. The detection is performed by instructing, and the geometric distortion amount of the image is detected and corrected.
[0017]
Next, FIG. 3 shows a flowchart of the image reading process according to the present invention. First, the coordinate detection switch press detection unit 504 determines whether or not the coordinate detection switch 102 is pressed, and when pressed, the positioning markers 113a, b, c, and d marked on the document table are used for template matching or the like. In the method of comparing and detecting images, the coordinate position is detected by the reference coordinate detecting unit 505. The coordinate position judging unit 506 judges whether or not these coordinate positions are normal. If it is determined that the coordinate positions are inconsistent or the range is out of range, the alarm issuing unit 508 issues an alarm and issues a warning. I do. When the coordinate position is normal, a coordinate conversion parameter for projecting and transforming the distorted image is calculated by the coordinate conversion parameter calculation unit 507, and a perspective conversion process is executed by the perspective conversion unit 509 based on the parameter. Then, the image is converted into an image taken from the front, and the image is recognized in the recognition processing 512 and displayed on a display device such as a display.
[0018]
FIG. 4 shows the configuration of software for image correction, image processing, and recognition processing in the personal computer 121. First, in the reference position detection mode, when the reference position detection switch input unit 403 detects that the coordinate detection switch 102 is pressed, the image signal input from the movable scanner 101 is signal-corrected by the image quality correction unit 401, and passed through the selector 404. Then, the data is converted into binary data by the floating threshold binarizer 405, the coordinate value is detected by the reference coordinate detection unit 408, the coefficient is obtained by the perspective transformation coefficient extraction unit 409, and is output to the perspective transformation unit 402 as a parameter. . Here, broken lines in the figure indicate control signals and parameter signals, thick solid lines indicate multi-valued data, and thin solid lines indicate binary data.
[0019]
By adding such an alarm function, even if the moving position is inappropriate and exceeds the reading range, it is notified by an alarm, so that there is no setting error.
[0020]
Next, in the reading mode, similarly, the signal from the movable scanner 101 is normalized by the image quality correction unit 401 after signal correction by the perspective transformation unit 402, and converted into an image viewed from the front. The output is passed through the selector 404, binarized by the floating threshold binarizer 405, transferred to the recognition processing unit 407, and recognizes characters and symbols.
Hereinafter, details of each unit will be described.
[0021]
FIG. 5 shows a processing procedure in the image quality correction unit 401. First, the signal from the scanner is subjected to two-dimensional shading correction 601, flicker correction 602 from fluorescent light, noise is reduced by superimposition 603 of the image, and the filter is changed by the filter variable unit 604 according to the distance to correct the image quality. are doing.
[0022]
Hereinafter, these details will be further described.
[0023]
FIG. 6 shows a flowchart of the detailed processing of the two-dimensional shading correction 601. (A) is a reference value creation using blank page input. The blank paper is read by the blank paper reading unit 6011, and the shape model is created by the shape model creating unit 6012 according to how the waveform of the blank paper is distorted. Generally, the central portion has a bright characteristic and the peripheral portion has a dark characteristic. Therefore, if the actual central and peripheral reading levels are matched with the roof-like model, the model is completed. Next, the equation representing the distortion in each read line is extracted by the equation extraction unit 6013 and registered in the table by the registration unit 6014. This can be achieved by creating all the pixels in all the lines, so that a complete correction can be realized. However, in practice, a rough correction is sufficient, and only characteristic lines such as the first line, the center line, and the last line are used. Correction can be realized by making a table, and performing linear complementation processing at the line position or pixel position of interest in other cases.
[0024]
Next, (b) shows the reading mode, in which the coordinates of the pixel of interest are input by the coordinate input unit, the table is interpolated by the table interpolation unit 6016 as described above, and the pixel reference position is calculated by the pseudo-reference value calculation unit 6017. Is calculated, and an interpolation operation is performed by the interpolation operation unit 6018. This is performed by dividing an input pixel value by a shading reference value and multiplying by a maximum value to be normalized. However, since the division by the CPU 124 takes time, this is also calculated using a table.
[0025]
FIG. 7 shows a detailed flow of flicker prevention. In the scanner of the present invention, since the scanner reads at a free position without special illumination, it is affected by flickering of the fluorescent lamp. For this reason, the maximum luminance detection unit 6021 detects the maximum value of the luminance in the line for each line, and if the detected value is equal to or larger than the limit value in the limit value comparison unit 6022, the maximum value is adopted as the normalized reference value here. Otherwise, the limit value is used as a reference value. This is because, when a line having no information, for example, a line out of the paper is read, the maximum value of the line is not used as a reference value. When the reference value is obtained, normalization is performed by the normalization calculation unit 6024 for each pixel. Further, in the scanner of the present invention, when the illumination at the time of reading is dark, there is a lot of noise. Therefore, the same image is photographed a plurality of times, and the images are superimposed and averaged to reduce the noise.
[0026]
FIG. 8 shows a flow of changing the filter according to the distance. First, the distance calculation unit 6041 calculates the distance from the camera to a specific reading position, and uses this to perform blur correction using a lens. If the correction range is within the range that can be corrected by the filter in the correction range determination unit 6042, the amount of deviation from the in-focus position is calculated, and the coefficient of the sharpening filter is controlled by the filter coefficient control unit 6043. If the value falls outside the correction range, the limiter value fixing unit 6045 applies the limiter value of the filter. By applying this to each pixel by the filter operation unit 6044, high image quality can be achieved.
[0027]
FIG. 9 shows a conceptual diagram (a) and a detailed flow (b) of the floating threshold binarizer 405. A total value is calculated for a block of XWIN pixels in the main scanning direction and YWIN pixels in the sub-scanning direction, and an average value is calculated from the total value. Here, the processing time is shortened by using the calculation result. That is, the total value SUM can be described as SUM = SUM + Stick [x] -Stick [x-XWIN] by the total value updating unit 4061 using the sticks Stick [x] and Stick [x-XWIN]. In the stick update unit 4060, Stick [x] = Stick “x” + pImg [x + y_old_adr] −pImg [x + y_old_adr]. Therefore, the total value can be obtained by four memory accesses and four additions / subtractions per window without depending on the window size.
[0028]
FIG. 10 shows a reference coordinate detection flow. First, a positioning mark is detected by a positioning mark detection unit 4081, and a reading range determination unit 4082 creates a coordinate list by a coordinate list creation unit 4083 if the mark position is within the reading range. In step 4084, a normalization correction coefficient is obtained. If the reference mark is out of the range, the alarm issuance unit 4085 issues an alarm. Here, the algorithm for detecting the positioning mark uses a generally known template matching method, and thus will not be described in detail here. An image used as a reference mark is registered as a template, and a matching process is performed on all the images, so that a position having a high degree of similarity is set as a detection position.
[0029]
FIG. 11 shows a form of the read image before the perspective transformation. The multi-value data read from the scanner is stored in the memory as shown in FIG. That is, even if a rectangular image is read, a nearby image such as the side A-D looks large, and an image far away such as the side BC appears small.
[0030]
FIG. 12 shows a detailed flow of the perspective transformation. In the perspective transformation, first, the start position calculation unit 4090 aligns the AB side vertically, the reduction value calculation unit 4091 changes the reduction ratio of each line in the image, and the reduction processing unit 4092 performs all B-B images. Length of C side: realized by unifying Dest_Width.
[0031]
Here, the case where the distortion is trapezoidal is shown, but it is generally deformed into a distorted rectangle.
[0032]
FIG. 13 shows an example in which the support of the movable scanner 101 is a flexible support 1101. When reading is performed by scanning with such a freely movable support, the document table is distorted in the memory as shown in (b) as A, B, C, and D, and the document placed there is read. Are also distorted like E, F, G, H. However, such distortion can be mapped with high image quality by a texture mapping method often used in 3D graphics processing, as long as the reference coordinates are known.
[0033]
FIG. 14 is an example in which the scanner of the present invention is applied to a seal verification machine. The seal image captured from the scanner is corrected by the image processing unit of the present invention, a collation image as a template specified by the keyboard 123 is read from the template file 1203 by the template reading unit 1202, and collation is performed by the collation unit 1204. The output unit 1206 displays the information on the display 122. As a result, the number of types of seal verification documents that have conventionally been limited to the types of paper can be dramatically increased, and there is an advantage that the speed and labor can be reduced.
[0034]
FIG. 15 shows an example in which the scanner of the present invention is integrated with a display. A sensor and a sensor housing are attached to the lower part of the display, and a rotating mirror 1011 is attached to the upper part of the display. The image placed on the document table 111 is reflected by the rotating mirror 1011 and read by the sensor. This makes it possible to easily and quickly input an image without taking up space as in a conventional flatbed scanner.
[0035]
FIG. 16 shows an example in which the scanner of the present invention is applied to a mobile terminal such as a mobile phone, a PHS, and a PDA. Even if the image is read obliquely, the distortion can be corrected, so that it is not necessary to hold the digital camera from the front as in a conventional digital camera, and an image can be easily input.
[0036]
FIG. 17 shows an example in which the scanner of the present invention is applied to a copier 1301. The image read from the scanner is converted into an image taken from the front by the image correction unit 1302 and the normalization unit 1305, and the editing instruction from the operation panel is analyzed by the editing analysis unit 1303, and if necessary, the image file 1304 or the like is referred to. In the meantime, the editing unit 1307 executes synthesis, trimming, enlargement, and reduction, and prints out with the printer 1306.
[0037]
Since it can be read without contact, it can be easily read without opening the lid like a conventional copier and bringing the reading surface into contact with the lower surface. Further, since the reading speed is as high as about 1 second, image input is completed only by flipping a book.
[0038]
【The invention's effect】
According to the present invention, it is possible to provide a non-contact type image reading apparatus having a high degree of freedom and good operability. Further, it is possible to provide a small-sized and low-cost image reading apparatus which can perform high-speed reading, can input and recognize a document image with high quality, and can recognize it.
[Brief description of the drawings]
FIG. 1 is a diagram showing one embodiment of a non-contact type image reading apparatus according to the present invention.
FIG. 2 is a diagram showing a schematic view of an embodiment of a non-contact type image reading apparatus according to the present invention.
FIG. 3 is a flowchart illustrating a processing procedure of the non-contact image reading apparatus of the present invention.
FIG. 4 is a diagram showing image processing inside the personal computer of the present invention.
FIG. 5 is a diagram illustrating a flowchart of the image correction unit of the present invention.
FIG. 6 is a diagram illustrating a flowchart of a two-dimensional shading correction unit according to the present invention.
FIG. 7 is a diagram illustrating a flowchart illustrating a flicker preventing method according to the present invention.
FIG. 8 is a diagram illustrating a flowchart showing a filter variable method according to the present invention.
FIG. 9 is a diagram illustrating a flowchart showing a floating threshold binarization method of the present invention.
FIG. 10 is a diagram illustrating a flowchart illustrating a reference coordinate detection method according to the present invention.
FIG. 11 is a diagram showing one embodiment of a read image of the present invention.
FIG. 12 is a diagram illustrating a flowchart showing a perspective transformation method of the present invention.
FIG. 13 is a view showing another embodiment of the non-contact type image reading apparatus according to the present invention.
FIG. 14 is a diagram showing an embodiment of a seal stamp collating machine provided with the non-contact type image reading device of the present invention.
FIG. 15 is a diagram showing an embodiment in which the non-contact image reading device of the present invention and a display are combined.
FIG. 16 is a diagram showing an embodiment of a mobile phone provided with the non-contact image reading device of the present invention.
FIG. 17 is a diagram showing an embodiment of a copying machine provided with the non-contact image reading device of the present invention.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 100 ... Image input device, 101 ... Movable scanner, 102 ... Coordinate detection switch, 103 ... Coordinate detector, 104 ... Coefficient determination unit, 105 ... Perspective transformation unit, 106 ... Switcher, 107 ... Binarization processing unit, 108 ... Recognition unit, 110: support, 111: document table, 112: read document, 113a, b, c, d: positioning marker, 120: preprocessing board, 121: personal computer, 122: display, 123: keyboard, 124 ... CPU, 125: sensor variation correction unit, 126: DMA controller, 127: connection bus, 128: memory, 129: file, 401: image quality correction unit, 402, 509: perspective conversion unit, 403: reference position detection switch input unit 404: selector, 405: floating threshold binarizer, 407: recognition processing unit, 408, 505: reference coordinate detection unit 409: perspective transformation coefficient extraction unit, 504: coordinate detection switch press detection unit, 506: coordinate position determination unit, 507: coordinate conversion parameter calculation unit, 508: alarm issuing unit, 512: recognition processing, 601: two-dimensional shading correction, 602: Flicker correction, 603: Image superposition, 604: Filter variable unit, 1011: Rotating mirror, 1101: Flexible support, 1201: Seal verification machine, 1202: Template reading unit, 1203: Template file, 1204: Verification unit, 1205 image processing unit, 1206 result output unit, 1225 mobile phone, 1301 copy machine, 1302 image correction unit, 1303 edit editing unit, 1304 image file, 1305 normalization unit, 1306 printer, 1307 ... Editing unit, 4060 ... Stick updating unit, 406 1 ... Total value update unit, 4081 ... Positioning mark detection unit, 4082 ... Read range determination unit, 4083 ... Coordinate list creation unit, 4084 ... Normalization correction coefficient calculation unit, 4085 ... Alarm issuing unit, 4090 ... Start position calculation unit 4091 reduction value calculation unit, 4092 reduction processing unit, 6011 blank sheet reading unit, 6012 shape model creation unit, 6013 expression extraction unit, 6014 registration unit, 6015 coordinate input unit, 6016 table interpolation unit, 6017 ... Shading reference value calculation section, 6018 interpolation calculation section, 6021 maximum brightness value detection section, 6022 limit value comparison section, 6023 limit value determination section, 6024 normalization calculation section, 6025 maximum brightness value determination section, 6041 distance calculation unit, 6042 correction range determination unit, 6043 filter coefficient control unit, 6044 filter Calculation unit, 6045 ... limiter value fixed portion.

Claims (4)

A housing in which a sensor unit for reading a document is stored;
A support having a movable part for supporting the housing and making the housing movable,
And a document holder to put the previous Symbol manuscript,
An image processing unit that processes an image input from the sensor unit,
The document table has a positioning mark for detecting the position of the document,
The image processing unit includes a detection unit that detects a positional relationship between the housing and the document based on the positioning mark, and a normalization correction coefficient calculation unit that calculates a normalization correction coefficient based on a detection result of the detection unit. And a perspective transformation unit for normalizing geometric distortion of the image based on the calculated normalization correction coefficient . A housing in which a sensor unit for reading the original is stored and the reading position is variable;
A document table on which the document is placed;
An image processing unit that processes an image input from the sensor unit,
The document table has a positioning mark for detecting the position of the document,
The image processing unit includes a detection unit that detects a positional relationship between the housing and the document based on the positioning mark, and a normalization correction coefficient calculation unit that calculates a normalization correction coefficient based on a detection result of the detection unit. And a perspective transformation unit for normalizing geometric distortion of the image based on the calculated normalization correction coefficient. The non-contact image reading device according to claim 1 or 2,
A non-contact image reading device having a switch for activating the detection unit. The non-contact image reading device according to claim 1 or 2,
A non-contact image reading apparatus comprising: a coordinate position determining unit that determines whether coordinate position information detected by the detection unit is normal or abnormal; and an alarm issuing unit that issues an alarm when the determination result is abnormal.

Images