JP2010219704A - Image processor, image processing method, image processing program and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide: an image processor for easily and highly-accurately detecting the direction and inclination of inputted read image data; an image processing method; an image processing program; and a recording medium. <P>SOLUTION: The image processor 1 acquires the image data read from a paper original in an image data acquisition part, a symbol specifying function part 12 extracts a symbol image included in the acquired gradient detection object image data and acquires a prescribed corner part of the symbol image as a specified corner part, a detection function part 14 detects the coordinates of the plurality of corner parts of the symbol image specified by the corner part acquired by the symbol specifying function part 12, and a gradient calculating function part 16 calculates the gradient of the symbol image based on the coordinates of the plurality of corner parts detected by the detection function part 14. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing device, an image processing method, an image processing program, and a recording medium, and more specifically, an image processing device, an image processing method, and a method for easily and accurately correcting the orientation and inclination of input read image data. The present invention relates to an image processing program and a recording medium.

  In recent years, with the widespread use of image processing apparatuses such as scanners, copiers, multifunction devices, printers, computers, etc., various paper documents such as images and documents are read and digitized by main scanning and sub scanning. In addition, with the spread of networking, image data obtained by reading a paper document in the same manner, or electronic data subjected to data conversion processing for converting it into a predetermined data format, Data distribution processing for distribution via a network has been performed. In this data distribution process, the image processing apparatus itself that reads a paper document is provided, and the data of the read paper document is processed, or the distribution server is connected to the network to which the image processing apparatus that reads the paper document is connected. Then, the image data of the paper document read by the image processing apparatus or the electronic data after the data conversion is transmitted to the distribution server together with the distribution request designating the distribution destination, and the distribution server performs the distribution processing of the electronic data. It has become to. Further, in the image processing apparatus, scan data storage processing is performed in which electronic data obtained by reading a paper document by an image reading unit and digitizing the data is stored in a storage device such as a hard disk.

  Such a paper document is read by main scanning and sub-scanning with an image reading unit to acquire image data, or image data is acquired by receiving image data that has already been read and stored in a storage device. In some cases, the image data may be in a different orientation from the normal orientation, such as tilted or upside down.

  For example, when a paper original (paper document) is read by the image reading unit, the original is set on the contact glass of the image reading unit, and the paper original on the contact glass is main-scanned and sub-scanned to read the image of the paper original. . In addition, when using ADF (Auto Document Feeder), a plurality of paper documents are set on the ADF document tray, and an image of a paper document conveyed while the paper document is conveyed by the ADF is read. A paper original is conveyed onto the contact glass by the ADF, and an image of the paper original is read by scanning the paper original set on the contact glass.

  In reading such a paper document, when the paper document is set on the contact glass or ADF, or when the paper document is transported by the ADF, the read image data is caused by an error in the setting direction of the paper document or a tilted set. It may be in a state of being rotated 90 degrees or 180 degrees, or may be slightly inclined obliquely.

  Therefore, conventionally, there is software that corrects the orientation and inclination of image data with respect to image data. As this software, fully automatic correction software that automatically performs all correction processing of the orientation and inclination of image data, There is semi-automatic correction software in which a user specifies information necessary for correction and automatically corrects the orientation and inclination of image data based on the specified content.

  Then, the fully automatic correction software performs correction processing by determining the vertical and horizontal directions and inclination using a recognition technique such as an OCR (optical character recognition) technique (see Patent Document 1).

  The semi-automatic correction software corrects the orientation and inclination of image data in accordance with designation of information necessary for correction such as reference point setting input (see Patent Document 2).

  However, in the above prior art, it is necessary to improve the operability and accuracy in correcting the orientation and inclination of image data at a low cost.

  In other words, since the fully automatic correction software determines the orientation and inclination of image data using a recognition technology such as OCR, the recognition accuracy of the image data is affected by the accuracy of the recognition technology. In order to improve the accuracy, there is a problem that the price is high, or the processing speed is slowed down due to an increase in the amount of data to be processed.

  In addition, since the semi-automatic correction software designates information necessary for correction for each page of image data, the more the user-specified information used for correcting the direction and inclination of the image data, the more the direction and inclination of the image data. Although the accuracy of correction can be improved, the number of user operations increases and the number of image data to be corrected increases, the number of user operations increases accordingly, the burden on the user increases, and the operability is improved. In order to improve, there was a need for improvement.

  Therefore, the present invention provides an image processing apparatus, an image processing method, an image processing program, and a recording medium that detect the orientation and inclination of acquired image data with high accuracy and low cost while improving operability. It is aimed.

  In order to achieve the above object, the present invention acquires image data read from a paper document by an image data acquisition unit, and a specific information acquisition unit is included in the image data acquired by the image data acquisition unit. Extracting an angle detection image including a plurality of feature image portions that provide position information capable of detecting an inclination angle of image data, and acquiring position information of a predetermined feature image portion in the angle detection image as specific information Then, the feature detection means detects the position information of the plurality of feature image portions in the angle detection image specified by the specification information acquired by the specification information acquisition means, and the inclination angle detection means The tilt angle of the angle detection image is detected based on the position information of the plurality of feature image portions detected by the feature detection means.

  In the present invention, the specific information acquisition unit may select one angle detection image from the plurality of angle detection images when the image data includes a plurality of the angle detection images. An image selection unit that acquires the specific information of the angle detection image selected by the angle detection image selection unit, and the feature detection unit includes a plurality of the angle detection images included in the image data; From the position information of all the feature image portions in all the angle detection images detected by the all feature detection means, all the feature detection means for detecting the position information of all the feature image parts each has A feature image portion of position information that matches the position information of the feature image portion selected by the angle detection image selection means and acquired by the specific information acquisition means from the angle detection image; Matching image search means for searching for an angle detection image, wherein the inclination angle detection means is based on the position information of the feature image portion of the angle detection image searched by the match image search means. The tilt angle of the angle detection image may be detected.

  Furthermore, the present invention includes a partial image extraction unit that extracts, as partial image data, image data of a surrounding predetermined region portion at a position indicated by the specific information acquired by the specific information acquisition unit of the image data. The detection means may detect the position information of a predetermined number of the feature image portions in the angle detection image specified by the specification information from the partial image data extracted by the partial image extraction means. .

  According to the present invention, it is possible to detect the orientation and inclination of acquired image data with high accuracy and low cost while improving operability.

FIG. 3 is an explanatory diagram of a main block configuration and a correction processing procedure of the image processing apparatus to which the first embodiment of the present invention is applied. The figure which shows an example of the symbol designation | designated screen in a correction process procedure. The figure which shows an example of a symbol. The figure which shows an example of the symbol in the case of having an inclination. Explanatory drawing of the schematic structure and correction | amendment processing procedure of the image processing apparatus to which 2nd Example of this invention is applied.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In addition, since the Example described below is a suitable Example of this invention, various technically preferable restrictions are attached | subjected, However, The range of this invention is unduly limited by the following description. However, not all the configurations described in the present embodiment are essential constituent elements of the present invention.

  1 to 4 are diagrams showing a first embodiment of an image processing apparatus, an image processing method, an image processing program, and a recording medium of the present invention. FIG. 1 shows an image processing apparatus, an image processing method of the present invention, It is a figure which shows the principal part functional block of the image processing apparatus 1 to which the 1st Example of the image processing program and the recording medium were applied, and the inclination detection processing procedure.

  In FIG. 1, an image processing apparatus 1 includes an image data acquisition unit (image data acquisition unit) that scans a paper document such as a scanner device, a copying apparatus, and a composite device to perform main scanning and sub-scanning and reads an image of the paper document. ) Or an image processing apparatus provided with an image reading unit, or a printer, computer, distribution server, or the like provided with an interface for receiving image data read by the image processing apparatus via a network or the like. An image processing apparatus. Although not shown, the image processing apparatus 1 includes a control unit that controls each unit, an image data acquisition unit, an image processing unit that performs various image processing and data conversion on the image data acquired by the image data acquisition unit, and an image processing unit. A data output unit for outputting the processed electronic data, an operation input unit for inputting various processing commands, a display unit for displaying various operation screens and other information, and the like. The image processing apparatus 1 according to the present embodiment includes a touch panel provided on the display unit, displays function buttons on an operation screen displayed on the display unit, and assigns the function buttons to the function buttons by a touch operation of the function buttons. Can be turned on / off. The image data acquisition unit is an image reading unit that reads an image of a paper document, a network interface that is connected to a network and receives image data from another image processing apparatus equipped with the image reading unit on the network, and an image from an external memory It is composed of at least one of external interfaces for reading data and acquires image data. The image processing unit performs various types of image processing on the image data acquired by the image data acquisition unit, conversion processing of RGB image data and CMYK image data, conversion of RGB image data to PDF (Portable Document Format) data, and inclination of the image data Perform correction processing and the like. The data output unit is a printer unit that records and outputs an image on paper based on image data, a network interface unit that distributes data via a network, an external interface that stores and outputs data to an external memory, and the like.

  The image processing apparatus 1 includes the functional blocks shown in FIG. 1 by introducing an image processing program for executing the image processing method for detecting the orientation and inclination angle of the image data of the present invention. Is built as.

  That is, the image processing apparatus 1 includes a ROM (Read Only Memory), an EEPROM (Electrically Erasable and Programmable Read Only Memory), an EPROM, a flash memory, a flexible disk, a CD-ROM (Compact Disc Read Only Memory), and a CD-RW (Compact). Detects the orientation and inclination of the image data of the present invention recorded on a computer-readable recording medium such as Disc Rewritable (DVD), Digital Video Disk (DVD), SD (Secure Digital) card, MO (Magneto-Optical Disc), etc. An image processing program that executes the image processing method for detecting the orientation and inclination of image data, which will be described later, is provided by loading an image processing program for executing the image processing method to be read and introducing the program into a ROM, a hard disk, or the like. It is constructed as a processing device. This image processing program is a computer-executable program written in a legacy programming language such as assembler, C, C ++, C #, Java (registered trademark) or an object-oriented programming language, and is stored in the recording medium. Can be distributed.

  Then, the image processing apparatus 1 is installed with the image processing program and executed by the control unit, thereby constructing the client mechanism unit 2 and the inclination detection mechanism unit 10 as shown in FIG. 10, a main control function unit 11, a symbol identification function unit 12, an input / output function unit 13, a detection function unit 14, a coordinate match determination function unit 15, and an inclination calculation function unit 16 are constructed.

  In the image data acquired by the image data acquisition unit, one or more symbol images (angle detection images) are incorporated in advance, and the symbol images detect the inclination (direction and inclination) of the image data. The image has a corner shape having a plurality of corner portions (feature image portions) for providing detectable position information, and has predetermined image contents. As this symbol image, for example, a rectangular one-dimensional barcode, two-dimensional barcode, digital watermark, or the like can be used.

  The client unit 2 is realized by an image data acquisition unit, an operation input unit, a network interface, a control unit, and the like of the image processing apparatus 1, and the image data acquired by the image data acquisition unit and the image data (hereinafter, the target of inclination detection) Is output to the main control function unit 11 of the inclination detection function unit 10.

  The main control function unit 11 controls each function unit of the gradient detection function unit 10 in response to a gradient detection request from the client function unit 2 and performs a gradient detection process on the gradient detection target image data.

  The symbol specifying function unit (specific information acquisition means) 12 specifies a symbol image that is preliminarily incorporated in the slope detection target image data from the slope detection target image data, and uniquely specifies the symbol image. Information (specific information) is output to the main function unit 11. In this embodiment, the symbol specifying information is specific coordinates (x, y) that are coordinates of a specific corner of the symbol image. When a plurality of symbol images are included in the inclination detection target image data, the symbol specifying function unit 12 specifies one symbol image used for the inclination detection among the plurality of symbol images.

  The input / output function unit 13 is configured by the operation input unit and the display unit, and when the symbol specifying function unit 12 specifies one symbol image from the plurality of symbol images, one symbol image from the plurality of symbol images. Used to let the user select. When one symbol image is selected and specified from among a plurality of symbol images, the input / output function unit 13 is, for example, one symbol image having a specified corner as information for specifying the specified symbol image. The coordinates of the corner are passed to the symbol specifying function unit 12 as designated symbol image coordinates (x, y).

  That is, the symbol specifying function unit 12 automatically selects one symbol image for use in slope detection by a preset specific processing method when the slope detection target image data includes a plurality of symbol images. It may be specified, or one symbol image selected by the user by the input / output function unit 13 may be specified as a symbol image used for the inclination detection.

  Then, when the symbol specifying function unit 12 specifies the symbol image used for the inclination detection image data, as specific information for specifying the specific symbol image, for example, the specific symbol image coordinates (x of one corner of the specified symbol image) , Y) is passed to the main control function unit 11. Therefore, the symbol specifying function unit 12 and the input / output function unit 13 function as an angle detection image selection unit as a whole.

  The detection function unit (feature detection unit, all-feature detection unit) 14 receives the symbol detection request and the inclination detection target image data from the main control function unit 11 and receives all of the inclination detection target image data. Image information of the symbol image (symbol image information) is detected and returned to the main control function unit 11. This symbol image information is composed of the image contents of the symbol image and coordinates (x, y) which are position information of the full-angle portion (feature image portion) of the symbol image.

  The coordinate coincidence determination function unit (coincidence image detection means) 15 includes specific coordinates (x, y) that are specific information for specifying the specific symbol image specified by the symbol specification function unit 12 from the main control function unit 11 and the detection function unit 14. The coordinates (x, y) of all the corners in all the detected symbol images and the coordinate matching determination request are received, and the coordinates (x, y) of the corners coincide with the specific coordinates (x, y) of the specific symbol image. It is determined whether a symbol image exists in the symbol image detected by the detection function unit 14, and the determination result is passed to the main control function unit 11. When there is a symbol image having a corner coordinate (x, y) that matches the specific coordinate (x, y) of the specific symbol image, the coordinate matching determination function unit 15 matches the result with the matching symbol image. When information specifying the image is passed to the main control function unit 11 and there is no symbol image having corner coordinates (x, y) that match the specific coordinates (x, y) of the specific symbol image, there is no matching symbol image Is sent to the main control function unit 11.

  The inclination calculation function unit (inclination angle detection means) 16 has a symbol image having the coordinate (x, y) of the corner where the coordinate matching determination function unit 15 matches the specific coordinate (x, y) of the specific symbol image. When it is determined, the inclination (inclination angle), which is the direction and inclination of the symbol image, is calculated from the coordinates (x, y) of the full-angle part that is the characteristic information of the specific symbol image passed from the main control function unit 11. Then, the calculated inclination is transferred to the main control function unit 11.

  Then, the main control function unit 11 determines that there is a symbol image having a corner coordinate (x, y) that matches the specific coordinate (x, y) of the specific symbol image. When the slope calculation function unit 16 calculates the slope of the symbol image, it passes the slope to the client function unit 2 as the slope of the slope detection target image data, and the coordinate match determination function unit 15 sends the specific coordinates of the specific symbol image. If it is determined that there is no symbol image having a corner coordinate (x, y) that matches (x, y), an inclination detection error is passed to the client function unit 2.

  Next, the operation of this embodiment will be described. The image processing apparatus 1 according to the present embodiment detects the inclination of captured image data with high accuracy and low cost while improving operability.

  That is, the image processing apparatus 1 sends an inclination to the main control function unit 11 from the client function unit 2 that is an operation input unit or the like for image data acquired by an image data acquisition unit such as an image reading unit, a network interface, or an external interface. When there is a detection target image data and an inclination calculation request, the main control function unit 11 passes the inclination detection target data to the symbol specifying function unit 12 and specifies a symbol image existing in the inclination detection target data. The symbol specifying function unit 12 is requested to specify a symbol.

  The symbol specifying function unit 12 specifies a symbol image preliminarily incorporated in the inclination detection target image data from the inclination detection target image data received from the main control function unit 11, and uniquely specifies the symbol image. Symbol specific information, in this embodiment, specific coordinates (x, y) are output to the main function unit 11, and when a plurality of symbol images are included in the inclination detection target image data, a plurality of the symbol images are displayed. Among them, one symbol image used for the inclination detection is specified. The symbol specifying function unit 12 automatically specifies one symbol image to be used for slope detection using a preset specific processing method when the slope detection target image data includes a plurality of symbol images. Alternatively, the symbol image may be specified according to the user's selection using the input / output function unit 13. When specifying the symbol image in accordance with the user's selection, the symbol specifying function unit 12 causes the input / output function unit 13 to specify, for example, the user to select a symbol image used for the inclination detection as shown in FIG. The symbol inquiry screen G is displayed. In this case, for example, as shown in FIG. 2, the input / output function unit 13 displays an inclination detection target image on a display unit equipped with a touch panel, from a plurality of symbol images existing in the inclination detection target image. Displayed with a message requesting selection of a symbol image to be used for degree detection. In FIG. 2, an inclination detection target image KG in which four symbol images SG1 to SG4 are incorporated and a symbol image selection request message are displayed on the specific symbol inquiry screen G. In the input / output function unit 13, one of the symbol images SG1 to SG4 used for detecting the inclination of the inclination detection target image data is selected and designated by the user according to the specific symbol inquiry screen G by a touch operation on the touch panel or the like. Then, specific information for specifying the selected and designated symbol images SG1 to SG4. In the present embodiment, for example, the coordinates of one corner of the designated symbol image are designated as designated symbol image coordinates (x, y). Passed to the specific function unit 12.

  When the symbol image used for the inclination detection of the inclination detection image data is specified, the symbol specifying function unit 12 uses the coordinates of one corner of the specified symbol image as a specific symbol as specifying information for specifying the specific symbol image. The image coordinates (x, y) are passed to the main control function unit 11.

  When the main control function unit 11 receives the specific symbol image coordinates (x, y), the main control function unit 11 passes the inclination detection target image data to the detection function unit 14, and all the symbol images included in the inclination detection target image data. Requests for detection of SG1 to SG4 are made to the detection function unit 14, and the detection function unit 14 detects image information (symbol image information) of all the symbol images SG1 to SG4 included in the received skewness detection target image data. Then, it returns to the main control function unit 11. This symbol image information is composed of the image contents of the symbol image and the coordinates (x, y) of the full-angle part which is the characteristic information of the symbol image.

  When the main control function unit 11 receives the symbol image information from the detection function unit 14, the coordinates (x, y) of the symbol image information in all the symbol images SG <b> 1 to SG <b> 4 and the specific symbol received from the symbol specification function unit 12. The specific symbol image coordinates (x, y), which are the specific information of the image, are passed to the coordinate match determination function unit 15 and have the corner coordinates (x, y) that match the specific symbol coordinates (x, y). A request is made to determine whether SG1 to SG4 are present.

  The coordinate matching determination function unit 15 sequentially determines whether or not there are symbol images SG1 to SG4 having corner coordinates (x, y) that match the specific symbol coordinates (x, y) for each of the symbol images SG1 to SG4. Judgment is made and the judgment result is passed to the main control function unit 11. That is, the coordinate matching determination function unit 15 determines that there is a matching symbol image when there is a symbol image having corner coordinates (x, y) that match the specific coordinates (x, y) of the specific symbol image. Is transferred to the main control function unit 11, and when there is no symbol image having corner coordinates (x, y) that coincide with the specific coordinates (x, y) of the specific symbol image, determination result information indicating that there is no matching symbol image is displayed. Passed to the main control function unit 11.

  When the main control function unit 11 receives the determination result information indicating that there is a matching symbol image from the coordinate matching determination function unit 15, the corner coordinates (x, y) that coincide with the specific coordinates (x, y) of the specific symbol image. The coordinates (x, y) of all the corners in the symbol image having “” are passed to the slope calculation function unit 10 to request the slope calculation, and the slope calculation function unit 10 is passed from the main control function unit 11. The inclination that is the direction and inclination of the symbol image is calculated from the coordinates (x, y) of the plurality of corners that are the characteristic information of the specific symbol image, and the calculated inclination is passed to the main control function unit 11.

  That is, when the symbol images SG1 to SG4 are, for example, a quadrangular one-dimensional barcode BC having four corners as shown in FIG. 3, the coordinates of the corners are (x1, y1), (x2 , Y2), (x3, y3), (x4, y4).

  Therefore, the inclination calculation function unit 10 preliminarily selects the coordinates (x1, y1), (x2, y2), (x3, y3), (x4, y4) of the four corners of the specific symbol images SG1 to SG4. Two specific coordinates such as the two set coordinates, for example, as shown in FIG. 4, the gradients of the specific symbol images SG1 to SG4 from the coordinates (x2, y2) and the coordinates (x3, y3) ( (Inclination angle) θ is obtained by the following equation.

tan θ = (y2−y3) / (x2−x3) (1)
In this case, for example, in FIG. 3 and FIG. 4, when tan θ is calculated by setting the coordinates (x2, y2) as the base point coordinates, the magnitude of the tilt at which the symbol images SG1 to SG4 are tilted around the base point coordinates ( The inclination angle) and the inclination direction can be obtained from the magnitude of the inclination θ calculated by the equation (1) and the sign of ±.

  That is, the inclination θ of the specific symbol images SG1 to SG4 is uniquely determined by the coordinates (x2, y2) and the coordinates (x3, y3) of the two corners. Note that the corners used for calculating the inclination θ are not limited to the two coordinates (x2, y2) and the coordinates (x3, y3), but other two coordinates, for example, coordinates (x1, y1) and coordinates (x3, y3), etc. can be adopted as appropriate, and the number of coordinates used for calculating the inclination θ is not limited to two coordinates, and four or four coordinates are used. The slope may be calculated. In this case as well, the base point coordinates are set, and the inclination angle and direction of the symbol image at the base point coordinates are obtained from the magnitude and sign of θ.

  When the main control function unit 11 receives the gradient θ of the calculation result from the gradient calculation function unit 16, it passes the gradient θ to the client function unit 2 as the gradient calculation result of the gradient detection target image data.

  When the client function unit 2 receives the inclination θ, for example, the client function unit 2 passes it to the control unit of the image processing apparatus 1, and the control unit controls the image processing unit and the like, and based on the inclination θ, the inclination detection target image Correct the direction and inclination of the data. When the inclination correction is performed, the image processing apparatus 1 may notify the user of correction information such as correction of the image data on the display unit.

  On the other hand, the main control function unit 11 determines that the coordinate match determination function unit 15 determines that there is no symbol image having corner coordinates (x, y) that match the specific coordinates (x, y) of the specific symbol image. Then, the skew detection error is passed to the client function unit 2. In this case, the image processing apparatus 1 may notify the user by a method such as displaying error information such as the fact that the inclination correction cannot be performed on the display unit. Note that the control unit of the image processing apparatus 1 may control the image processing based on the inclination calculated by the inclination calculation function unit 10 to perform angle correction of the image data, or the image data When distributing to other devices, etc., the angle correction is not performed, and the image data and the inclination information that are tilted are distributed, and the distribution destination device is based on the inclination information as necessary. Then, the angle correction of the image data may be performed.

  As described above, the image processing apparatus 1 according to the present exemplary embodiment acquires image data read from a paper document by the image data acquisition unit, and the symbol specifying function unit 12 acquires the skew detection target image acquired by the image data acquisition unit. Extracts a symbol image (angle detection image) that includes a plurality of corners (feature image portions) that provide coordinates (position information) that can be detected in the inclination (tilt angle) of the image data included in the data. Position information of predetermined corners in the symbol image is acquired as specific information, and the detection function unit 14 detects the coordinates of a plurality of corners in the symbol image specified by the specific information acquired by the symbol specification function unit 12 Then, the slope calculation function unit 16 calculates (detects) the slope of the symbol image based on the coordinates of the plurality of corners detected by the detection function unit 14.

  Therefore, the user can detect the inclination of the read image data with high accuracy without performing various operations necessary for obtaining the inclination, and improve the operability of the orientation and inclination of the image data. Correction can be made at low cost and with high accuracy.

  Further, in the image processing apparatus 1 according to the present embodiment, when the symbol specifying function unit 12 includes a plurality of symbol images in the inclination detection target image data, the input / output function unit outputs one symbol image from the plurality of symbol images. 13, the specific information of the selected symbol image is acquired, and the detection function unit 14 detects the coordinates of all the corners of each of the plurality of symbol images included in the inclination detection target image data. Then, from the coordinates of all the corners in all the detected symbol images, the corners of the coordinates that coincide with the coordinates indicated by the specific information acquired by the symbol specifying function unit 12 from the symbol image selected by the input / output function unit 13 The coordinate coincidence determination function unit 15 searches for the symbol image having the symbol value, and the slope calculation function unit 16 determines the symbol image based on the coordinates of the corners of the searched symbol image. It is calculated (detected) the slope angle.

  Accordingly, even when a plurality of symbol images are included in the inclination detection target image data, the inclination of the read image data can be detected at low cost and with high accuracy based on the symbol image selected by the user's designation or the like. Can do.

  Furthermore, the image processing apparatus 1 of the present embodiment uses a one-dimensional barcode, a two-dimensional barcode, or a digital watermark having a plurality of (four) corners as a symbol image that is an angle detection image.

  Therefore, it is possible to easily and easily detect the inclination of the inclination detection target image data by simply and easily incorporating the symbol image into the inclination detection target image data.

  Further, in the image processing apparatus 1 of the present embodiment, the slope calculation function unit 16 has two or more corners included in a symbol image in the coordinate space when the slope detection target image data is positioned in a predetermined coordinate space. The inclination (inclination angle) of the symbol image is calculated based on the coordinates of the part.

  Therefore, the inclination of the read image data can be detected with higher accuracy, and the orientation and inclination of the image data can be corrected with higher accuracy while improving operability.

  FIG. 5 is a diagram showing the functional blocks and the skewness detection processing procedure of the image processing apparatus 20 to which the second embodiment of the image processing apparatus, image processing method, image processing program and recording medium of the present invention is applied.

  The present embodiment is applied to an image processing apparatus similar to the image processing apparatus 1 of the first embodiment, and the description of the present embodiment is the same as the image processing apparatus 1 of the first embodiment. The same reference numerals are given to the components, and detailed description thereof is omitted.

  Similar to the image processing apparatus 1 of the first embodiment, the image processing apparatus 20 of the present embodiment reads the image of the paper document by performing main scanning and sub-scanning on a paper document such as a scanner device, a copying apparatus, and a composite device. Image processing for receiving image data read by an image processing apparatus provided with an image reading unit such as an image processing apparatus, printer, computer, and distribution server provided with an image reading unit (image data acquisition means) via a network or the like Although not shown, a control unit that controls each unit, an image data acquisition unit, an image processing unit that performs various image processing and data conversion on the image data acquired by the image data acquisition unit, and an image processing unit A data output unit that outputs processed electronic data, an operation input unit that inputs various processing instructions, a display unit that displays various operation screens and other information, and the like are provided.

  The image processing apparatus 20 includes the functional blocks shown in FIG. 5 by introducing an image processing program for executing an image processing method for detecting and correcting the orientation and inclination angle of the image data of the present invention. It is constructed as an image processing apparatus, and a client mechanism unit 2 and an inclination detection mechanism unit 30 are constructed. The inclination detection mechanism unit 30 includes a main control function unit 11, a symbol identification function unit 12, an input / output function unit 13, a detection function unit 14, and an inclination calculation function unit similar to the inclination detection function unit 10 of the first embodiment. 16 is constructed, and a partial image extraction function unit 31 is constructed.

  The partial image extraction function unit 31 receives the inclination detection target image data, the specific symbol image coordinates (x, y), and the partial image extraction request from the main control function unit 11, and the specific symbol image coordinates from the received detection target image data. Partial image data centered on (x, y) is extracted, and the extracted partial image data is passed to the main control function unit 11. The extracted partial image data is partial image data in a range including the specific symbol image in the inclination detection target image data, and is partial image data in the narrowest possible range.

  The main control function unit 11 passes the partial image data received from the partial image extraction function unit 31 to the detection function unit 14 to make a symbol detection request, and the detection function unit 14 receives the image information of the symbol image from the received partial image data. (Symbol image information) is detected and returned to the main control function unit 11. This symbol image information is composed of the image contents of the symbol image and the coordinates (x, y) of the full-angle part which is the characteristic information of the symbol image.

  Next, the operation of this embodiment will be described. The image processing apparatus 1 according to the present embodiment extracts the partial image data of the portion where the symbol image of the image data exists, and the symbol image included in the partial image data. Based on this, it detects at high speed, low cost and high accuracy while improving operability.

  That is, the image processing apparatus 1 sends an inclination to the main control function unit 11 from the client function unit 2 that is an operation input unit or the like with respect to image data acquired by an image data acquisition unit such as an image reading unit, a network interface, or an external interface. When the detection target image data and the slope calculation request are passed, the main control function unit 11 passes the slope detection target data to the symbol specifying function unit 12 and also displays the symbol image existing in the slope detection target data. The symbol specifying function unit 12 is requested to specify the symbol.

  The symbol specifying function unit 12 specifies a symbol image preliminarily incorporated in the inclination detection target image data from the inclination detection target image data received from the main control function unit 11, and uniquely specifies the symbol image. Specific coordinates (x, y), which are symbol specific information, are output to the main function unit 11, and when a plurality of symbol images are included in the gradient detection target image data, the gradient of the plurality of symbol images is included. One symbol image used for detection is specified. When the slope detection target image data includes a plurality of symbol images, the symbol specifying function unit 12 asks the input / output function unit 13 to send a specific symbol inquiry as shown in FIG. 2 as in the first embodiment. The screen G is displayed, the symbol image is specified according to the designation by the user, and the specific symbol image coordinate (x, y) is used as the specific information for specifying the specific symbol image. ) To the main control function unit 11.

  When the main control function unit 11 receives the specific symbol image coordinates (x, y), it passes the inclination detection target image data, the specific symbol image coordinates (x, y), and the partial image extraction request to the partial image extraction function unit 31. The partial image extraction function unit 31 extracts partial image data centered on the specific symbol image coordinates (x, y) from the received detection target image data, and sends the extracted partial image data to the main control function unit 11. hand over.

  The main control function unit 11 passes the partial image data received from the partial image extraction function unit 31 to the detection function unit 14 to make a symbol detection request, and the detection function unit 14 receives the image information of the symbol image from the received partial image data. The image content of the symbol image as (symbol image information) and the coordinates (x, y) of the full-angle portion as the feature information of the symbol image are detected and passed to the main control function unit 11.

  When the main control function unit 11 receives the symbol image information from the detection function unit 14, the main control function unit 11 sends the coordinates (x, y) of all corners in the specific symbol image specified by the symbol image information to the slope calculation function unit 10. The slope calculation function unit 10 receives the slope calculation from the coordinates (x, y) of the full-angle part of the specific symbol image passed from the main control function unit 11. The degree is calculated in the same manner as described above, and the calculated inclination is passed to the main control function unit 11.

  When the main control function unit 11 receives the gradient of the calculation result from the gradient calculation function unit 16, it passes the gradient to the client function unit 2 as the gradient of the gradient detection target image data.

  When the client function unit 2 receives the inclination, for example, it passes it to the control unit of the image processing apparatus 1, and the control unit controls the image processing unit and the like, and based on the inclination, the inclination detection target image data Correct the orientation and tilt. When the inclination correction is performed, the image processing apparatus 1 may notify the user of correction information such as correction of the image data on the display unit.

  As described above, the image processing apparatus 1 according to the present embodiment converts the image data of the surrounding predetermined area portion from the image data of the inclination detection target image data to the partial image data around the coordinates of the specific corner acquired by the symbol specifying function unit 12. And the detection function unit 14 detects the coordinates of all corners in the symbol image from the partial image data extracted by the partial image extraction function unit 31, and calculates the inclination calculation function unit 16. However, the inclination of the symbol image is calculated based on the coordinates of a plurality of corners in the symbol image.

  Therefore, the direction and inclination detection processing of the read image data can be performed at low cost, high speed, and high accuracy while improving operability. In particular, a plurality of symbol images are included in the image data to be detected. The coordinates of the corner, which is information necessary for calculating the inclination of the symbol image, can be obtained easily and at high speed. As a result, it is possible to detect the inclination of the read image data at high speed and with high accuracy without performing various operations necessary for the user to obtain the inclination.

  The invention made by the present inventor has been specifically described based on the preferred embodiments. However, the present invention is not limited to that described in the above embodiments, and various modifications can be made without departing from the scope of the invention. It goes without saying that it is possible.

  The present invention relates to an image processing apparatus, an image processing method, an image processing program, and a recording medium that capture read image data such as a scanner apparatus, a composite apparatus, a copying apparatus, a printer apparatus, and a computer and perform distribution output, print output, storage output, and the like. Can be used.

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 2 Client mechanism part 10 Inclination detection mechanism part 11 Main control function part 12 Symbol specific function part 13 Input / output function part 14 Detection function part 15 Coordinate coincidence determination function part 16 Inclination calculation function part G Specific symbol inquiry screen SG1 to SG4 Symbol image 20 Image processing device 30 Inclination detection mechanism 31 Partial image extraction function unit

JP 2003-85529 A JP 2004-46637 A

Claims (8)

Image data acquisition means for acquiring image data read from a paper document;
Extracting an angle detection image including a plurality of feature image portions included in the image data acquired by the image data acquisition means and providing position information capable of detecting an inclination angle of the image data. Specific information acquisition means for acquiring position information of a predetermined feature image portion of the image as specific information;
Feature detection means for detecting the position information of the plurality of feature image portions of the image for angle detection specified by the specific information acquired by the specific information acquisition means;
An inclination angle detection means for detecting an inclination angle of the angle detection image based on the position information of the plurality of feature image portions detected by the feature detection means;
An image processing apparatus comprising: The specific information acquisition unit includes an angle detection image selection unit that selects one angle detection image from the plurality of angle detection images when the image data includes a plurality of the angle detection images. Obtaining the specific information of the angle detection image selected by the angle detection image selection means;
The feature detection means includes all feature detection means for detecting the position information of all the feature image portions respectively included in the plurality of angle detection images included in the image data, and detection by the all feature detection means. The specific information acquired by the specific information acquisition unit from the angle detection image selected by the angle detection image selection unit from the position information of all the feature image portions in all the angle detection images. Matching image search means for searching for an angle detection image having a feature image portion of position information to be
The tilt angle detection unit detects the tilt angle of the angle detection image based on the position information of the feature image portion of the angle detection image searched by the coincidence image search unit. The image processing apparatus according to 1. The image processing apparatus includes a partial image extraction unit that extracts, as partial image data, image data of a predetermined region around a position indicated by the specific information acquired by the specific information acquisition unit of the image data,
The feature detection unit detects the position information of a predetermined number of the feature image portions in the angle detection image specified by the specification information from the partial image data extracted by the partial image extraction unit. The image processing apparatus according to claim 1.   The angle detection image is a one-dimensional barcode, a two-dimensional barcode, or a digital watermark having a plurality of corners as the feature image portion. Image processing device.   5. The position information of the feature image portion is coordinate position information of the feature image portion in the coordinate space when the image data is positioned in a predetermined coordinate space. An image processing apparatus according to any one of the above. An image data acquisition processing step for acquiring image data read from a paper document;
An angle detection image including a plurality of feature image portions included in the image data acquired in the image data acquisition processing step and providing position information capable of detecting an inclination angle of the image data is extracted and the angle is extracted. A specific information acquisition processing step of acquiring position information of a predetermined feature image portion of the detection image as specific information;
A feature detection processing step of detecting the position information of the plurality of feature image portions of the angle detection image specified by the specification information acquired in the specification information acquisition processing step;
A tilt angle detection processing step of detecting a tilt angle of the angle detection image based on the position information of the plurality of feature image portions detected in the feature detection processing step;
An image processing method characterized by comprising: On the computer,
Image data acquisition processing for acquiring image data read from a paper document;
The angle detection is performed by extracting an angle detection image including a plurality of feature image portions included in the image data acquired by the image data acquisition process and providing position information capable of detecting an inclination angle of the image data. Specific information acquisition processing for acquiring position information of a predetermined feature image portion of the image for use as specific information;
A feature detection process for detecting the position information of the plurality of feature image portions of the angle detection image specified by the specific information acquired in the specific information acquisition process;
A tilt angle detection process for detecting a tilt angle of the angle detection image based on the position information of the plurality of feature image portions detected by the feature detection process;
An image processing program for executing   A computer-readable recording medium on which the image processing program according to claim 7 is recorded.

Images