JP2017228922A - Image reader, image reading method, and image reading program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable re-reading with high efficiency, when a script was not read appropriately.SOLUTION: An image reader includes a script reading unit for reading a script in any one of multiple reading areas preset on a reading surface, and generating an image of a read script, a synthesis unit 210 for generating a synthetic image by synthesizing multiple images generated, a detector 220 for detecting a defective part from the synthetic image synthesized, a defective area determination unit 230 for determining a defective area corresponding to a defective part in the script, based on a position in the synthetic image of the detected defective part, a selection unit 240 for selecting a minimum reading area having a size larger than that of the determined defective area out of the multiple reading areas, and a complement unit 270 for synthesizing a complementary image generated by the script reading unit and the synthetic image, in response to reading of the script in the reading area selected by the script reading unit.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image reading apparatus, an image reading method, and an image reading program capable of reading an original, and in particular, an image reading apparatus suitable for reading an original having a size larger than the size that can be read, and the image thereof The present invention relates to an image reading method and an image reading program executed by a reading device.

The image reading apparatus has reading means for reading a document. Here, when reading an original having a size larger than the size of the reading unit, the image reading apparatus reads the original by dividing it into a plurality of times, and joins the read images to output as one image. . As such an image reading apparatus, Japanese Patent Application Laid-Open No. 2010-93732 discloses a reading unit that reads an image, an image memory that stores image data read by the reading unit, and a plurality of images stored in the image memory. In an image composition device comprising an image composition means for compositing, when reading a document divided into a plurality of times, the size of the document, the size of the image region read so far, and the image region that can be read thereafter Based on the determination result by the determination means and the determination means for determining whether the size of the image area of the read document is smaller than the size necessary for joining the read image data And an image synthesizing device having control means for controlling the image synthesizing means.
JP 2010-93732 A

  Japanese Patent Application Laid-Open No. 2010-93732 discloses that in the above-described image composition apparatus, when the user sets a document on the document table (reading unit), there is little if the document is displaced from a designated position on the document table. It is stated that it can be read again by operation. However, since the original is reread over a uniform area regardless of the size of the deviation, the rereading operation cannot be sufficiently reduced, and the processing of the image data cannot be accelerated. . For this reason, the efficiency of reading a document is reduced.

  The present invention has been made to solve the above-described problems, and one of the objects of the present invention is an image reading apparatus that enables re-reading with high efficiency when a document is not read properly. Is to provide.

  Another object of the present invention is to provide an image reading method that enables re-reading with high efficiency when a document is not read properly.

  Still another object of the present invention is to provide an image reading program that enables re-reading with high efficiency when a document is not properly read.

  The present invention has been made to solve the above-described problems, and according to one aspect of the present invention, an image reading apparatus can read a document in one of a plurality of reading areas preset on a reading surface. A reading unit that generates an image of the read original, a combining unit that generates a combined image obtained by combining a plurality of images generated by the reading unit, and a missing portion is detected from the combined image combined by the combining unit A detection unit, a defect region determination unit that determines a defect region corresponding to the defect part in the document based on a position in the composite image of the defect part detected by the detection unit, and a determination from among a plurality of reading regions Selecting means for selecting a minimum reading area having a size larger than the defective area, and reading means in response to the reading of the document in the reading area selected by the reading means. Comprising a complementary image to be made, and complementary means for synthesizing a synthesized image.

  According to this aspect, when a defective portion is detected from the composite image, a minimum reading region having a size larger than the defective portion is selected from among the plurality of reading regions, and the image is read in the selected reading region. The generated complementary image is combined with the combined image. For this reason, since the minimum reading area larger than the missing portion is selected, the size of the complementary image can be made as small as possible, and the load when the composite image is complemented with the complementary image can be reduced. As a result, it is possible to provide an image reading apparatus that enables re-reading with high efficiency when a document is not properly read.

  Preferably, the selection unit includes a dividing unit that divides the defective portion into two when the size of the defective region is larger than the size of the largest reading region among the plurality of reading regions, and the two divided defects Two reading areas corresponding to the portions are selected.

  According to this aspect, when the size of the defect area is larger than the size of the maximum reading area, the defect part is divided into two, and two reading areas corresponding to the two divided defect parts are selected. Therefore, since one defective area is divided into two, the number of readings can be reduced as much as possible.

  Preferably, the information processing apparatus further includes notification means for displaying a guide image that supports an operation by a user who places the determined defective area in the selected reading area.

  According to this aspect, the user can easily perform the operation of arranging the missing area in the document in the selected reading area by visually recognizing the guidance image.

  Preferably, the defect area determination means includes a feature part detection means for detecting a feature part in the vicinity of the defect part in the synthesized image synthesized by the synthesis means, and includes an area including the defect part and the detected feature part. The corresponding area in the document is determined as a missing area, and each of the plurality of reading areas is arranged on the reading surface with reference to a predetermined reference position on the reading surface, and the guide image is displayed around the reading surface. A reference image indicating the reference position and an image indicating the relative position of the feature portion.

  According to this aspect, the guide image shows the relative position between the reference image indicating the reference position expressed around the reading surface and the characteristic portion near the missing portion, so that the user can visually recognize the guide image. By doing so, it is possible to recognize the relative position of the characteristic portion of the document with respect to the reading surface when the document is placed on the reading surface. As a result, the user can easily place the document on the reading surface.

  Preferably, the guide image includes an image indicating the orientation of the document with respect to the reading surface.

  According to this aspect, the user can easily place the document on the reading surface in an appropriate direction by visually recognizing the guide image.

  Preferably, the image processing apparatus further includes a feature image detection unit that detects a feature image that is the same as the feature portion detected from the complementary image when the document is read in the reading region selected by the reading unit, and the complementing unit includes the feature When the image is detected, the complementary image is combined with the combined image.

  According to this aspect, when a feature image that is the same as the feature portion is detected from the complement image, it is highly likely that the complement image includes a portion that complements the missing portion. Therefore, the missing portion in the composite image is complemented. Probability can be improved.

  Preferably, the complement means synthesizes the complement image on the condition that the relative position of the detected feature image in the complement image is within a predetermined range from the relative position of the detected feature portion in the missing area. Composite with the image.

  According to this aspect, when the relative position of the feature image in the complement image is within a predetermined range from the relative position of the detected feature portion in the defect region, a portion that complements the defect portion is included in the composite image. Since the possibility of being included is higher, the probability of complementing the missing portion in the composite image can be improved.

  Preferably, the image processing device further includes an image processing unit that extracts a missing portion from the complementary image in response to the reading of the document in the reading region selected by the reading unit.

  According to this aspect, since the missing portion is extracted from the complementary image, the size of the complementary image can be minimized. Thereby, the image processing for complementing the composite image can be further accelerated.

  Preferably, an operation receiving unit that receives a user's operation is further provided. When a predetermined operation is received by the operation receiving unit, the reading unit prohibits reading of the original in the selected reading area, and a missing portion of the composite image is deleted. Peripheral complementing means for complementing with the same value as the area around the missing part is further provided.

  According to this aspect, the reading of the document in the reading area is prohibited based on the user's operation, and the missing portion of the composite image is complemented with the same value as the surrounding area. Therefore, it is possible to complement the composite image while reducing the number of times of reading the document.

  Preferably, each of the plurality of reading areas is determined by a set of any one of a plurality of predetermined sizes and any one of a plurality of predetermined directions.

  According to this aspect, it is possible to select a reading area having a minimum size.

  According to another aspect of the present invention, an image reading method includes an image reading unit configured to read an original in any one of a plurality of reading areas set in advance on the reading surface and generate an image of the read original. An image reading method executed by a reading device, the step of generating a composite image obtained by combining a plurality of images generated by a reading unit, the step of detecting a missing portion from the combined image, and Based on the position of the missing part in the composite image, a step of determining a missing area corresponding to the missing part in the document, and a plurality of reading areas determined based on the determined size of the missing area Generated by the reading means in response to the step of selecting the smallest reading area having a size larger than the defective area and the reading of the document in the reading area selected by the reading means. Complementary image, comprising the steps of combining a synthetic image.

  According to this aspect, it is possible to provide an image reading method that enables re-reading with high efficiency when an original is not read properly.

  According to still another aspect of the present invention, an image reading program includes reading means for reading a document in any one of a plurality of reading regions set in advance on a reading surface and generating an image of the read document. An image reading program executed by the image reading device, the step of generating a composite image obtained by combining a plurality of images generated by the reading unit, the step of detecting a missing portion from the combined image, and A step of determining a defective region corresponding to the defective portion in the document based on the position of the defective portion in the composite image, and a plurality of reading regions based on the determined size of the defective region. In response to the step of selecting the smallest reading area having a size larger than the defective area and reading the document in the reading area selected by the reading unit, Complementary image generated by preparative means to execute the steps of synthesizing a composite image, to the computer.

  According to this aspect, it is possible to provide an image reading program that enables re-reading with high efficiency when a document is not properly read.

1 is a perspective view showing an external appearance of an MFP in one embodiment of the present invention. 2 is a block diagram illustrating an outline of a hardware configuration of an MFP. FIG. FIG. 3 is a diagram illustrating an example of functions of a CPU included in an MFP. FIG. 3 is a schematic plan view illustrating an example of a document reading unit. FIG. 3 is a schematic diagram illustrating a document that is read by a document reading unit. FIG. 6 is a schematic diagram illustrating an image generated by a document reading unit. It is a figure for demonstrating operation | movement of the defect | deletion area | region determination part when one defect | deletion part is input from a detection part. It is a figure for demonstrating operation | movement of the defect | deletion area | region determination part when one defect | deletion part is input from a detection part. It is a figure for demonstrating operation | movement of the defect | deletion area | region determination part when a some defect | deletion part is input from a detection part. It is a figure for demonstrating operation | movement of the defect | deletion area | region determination part when a some defect | deletion part is input from a detection part. It is a figure for demonstrating operation | movement of the selection part when the size of a defect | deletion area | region is larger than the size of the largest reading area | region. It is a figure for demonstrating operation | movement of the selection part when the size of a defect | deletion area | region is larger than the size of the largest reading area | region. It is a figure for demonstrating operation | movement of a notification part. It is a figure for demonstrating operation | movement of the notification part when a defect | deletion part exists in a synthesized image. It is a figure for demonstrating operation | movement of the notification part when a reread button is operated. It is a figure for demonstrating operation | movement of a notification part when the notification instruction | indication is input from the feature image detection part. It is a flowchart which shows an example of the flow of a synthetic | combination image generation process. It is a flowchart which shows an example of the flow of a defect | deletion area | region determination process. It is a flowchart which shows an example of the flow of a defect area | region division process. It is a flowchart which shows an example of the flow of a complementary image generation process.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a perspective view showing an appearance of an MFP according to one embodiment of the present invention. FIG. 2 is a block diagram showing an outline of the hardware configuration of the MFP. Referring to FIGS. 1 and 2, MFP (Multi Function Peripheral) 100 is an example of an image reading apparatus, and includes a main circuit 110, a document reading unit 130 for reading a document, and a document in document reading unit 130. An automatic document feeder 120 for conveying, an image forming unit 140 for forming an image on a sheet or the like based on image data output by the document reading unit 130 reading the document, and supplying the sheet to the image forming unit 140 A sheet feeding unit 150 for performing the operation and an operation panel 160 as a user interface.

  The main circuit 110 includes a CPU (Central Processing Unit) 111 that controls the entire MFP 100, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, and a hard disk drive (HDD) 115 as a mass storage device. A facsimile unit 116, and an external storage device 117. CPU 111 is connected to automatic document feeder 120, document reading unit 130, image forming unit 140, sheet feeding unit 150, and operation panel 160, and controls the entire MFP 100.

  The automatic document feeder 120 automatically conveys a plurality of documents set on the document tray 125 one by one to the document reading position of the document reading unit 130, and an image formed on the document by the document reading unit 130 The read original is discharged onto the original discharge tray 127.

  The document reading unit 130 has a rectangular reading surface for reading a document. The reading surface is formed of platen glass, for example. The automatic document feeder 120 is connected to the main body of the MFP 100 so as to be rotatable about an axis parallel to one side of the reading surface, and can be opened and closed. A document reading unit 130 is disposed below the automatic document feeder 120. With the automatic document feeder 120 rotated and opened, the reading surface of the document reader 130 is exposed. Therefore, the user can place a document on the reading surface of the document reading unit 130. The maximum size that can be read by the document reading unit 130 is smaller than the size of the reading surface of the document reading unit 130. Here, a case where the reading surface of the document reading unit 130 is A3 size will be described as an example. In this case, the document reading unit 130 can read a document having a size of A3 size or smaller.

  A plurality of rectangular reading areas are set in advance on the reading surface of the document reading unit 130. Each of the plurality of rectangular reading areas is determined by a set of the position of the reading area on the reading surface and the size of the reading area and the direction of the reading area with respect to the reading surface. The position of the reading area on the reading surface is a position where the upper left apex angle of the reading area overlaps with the upper left apex angle of the reading surface. Each of the plurality of reading areas is arranged on the reading surface with reference to the upper left position in the reading surface. The position of the reading area on the reading surface is not limited to the position where the upper left apex angle of the reading area overlaps the upper left apex angle of the reading surface. For example, the lower left apex angle of the reading area is The upper right apex angle of the reading area may overlap with the upper right apex angle of the reading surface, or the lower right apex angle of the reading area may overlap with the lower right apex angle of the reading surface. Good.

  Here, the size of the reading area is any one of A3 size, A4 size, A5 size, B4 size, B5 size, and letter size. The direction of the reading area with respect to the reading surface is either a vertical direction in which the long side of the reading area is parallel to the vertical direction of the reading surface, or a horizontal direction in which the long side of the reading area is parallel to the horizontal direction of the reading surface. is there.

  The plurality of reading areas are determined by a set of any one of A3 size, A4 size, A5 size, B4 size, B5 size, and letter size, and either the vertical direction or the horizontal direction. Here, the size of the reading surface is set such that the length in the horizontal direction is not less than the length in the longitudinal direction of the A3 size, and the length in the longitudinal direction is not less than the length in the short direction of the A3 size. In this case, the plurality of reading areas include an A3 size horizontal reading area, an A4 size vertical reading area, an A4 size horizontal reading area, an A5 size vertical reading area, and an A5 size horizontal direction. Reading area, B4 size horizontal reading area, B5 size vertical reading area, B5 size horizontal reading area, and letter size horizontal reading area.

  The document reading unit 130 includes a light source that emits light and a photoelectric conversion element that receives light, and scans an image formed on the document placed in the reading region. When a document is placed on the reading area, the light emitted from the light source is reflected by the document, and the reflected light is imaged by the photoelectric conversion element. When the photoelectric conversion element receives the light reflected from the document, the photoelectric conversion element generates image data obtained by converting the received light into an electric signal. Document reading unit 130 outputs image data to CPU 111. Hereinafter, the image data that is an electrical signal that the document reading unit 130 reads and outputs the document is simply referred to as an image.

  The paper feed unit 150 conveys the paper stored in the paper feed tray to the image forming unit 140. The image forming unit 140 is controlled by the CPU 111 and forms an image by a well-known electrophotographic method. The image forming unit 140 forms an image on a sheet conveyed by the paper feeding unit 150 based on an image input from the CPU 111. Then, the paper on which the image is formed is discharged to the paper discharge tray 155. The image output to the image forming unit 140 by the CPU 111 includes an image received from the outside in addition to an image input from the document reading unit 130.

  The facsimile unit 116 is connected to the public switched telephone network (PSTN) and transmits facsimile data to the PSTN or receives facsimile data from the PSTN. The facsimile unit 116 stores the received facsimile data in the HDD 115, converts it into print data that can be printed by the image forming unit 140, and outputs the print data to the image forming unit 140. As a result, the image forming unit 140 forms an image of facsimile data received by the facsimile unit 116 on a sheet. Further, the facsimile unit 116 converts the data stored in the HDD 115 into facsimile data, and transmits the facsimile data to a facsimile machine connected to the PSTN.

  Communication I / F unit 112 is an interface for connecting MFP 100 to a network. The communication I / F unit 112 communicates with other computers or data processing devices connected to the network using a communication protocol such as TCP (Transmission Control Protocol) or FTP (File Transfer Protocol). Note that the network to which the communication I / F unit 112 is connected is a local area network (LAN), and the connection form may be wired or wireless. The network is not limited to a LAN, and may be a wide area network (WAN), a public switched telephone network (PSTN), the Internet, or the like.

  The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. Further, the RAM 114 temporarily stores the read images continuously sent from the document reading unit 130.

  Operation panel 160 is provided on the upper surface of MFP 100. Operation panel 160 includes a display unit 161 and an operation unit 163. The display unit 161 is, for example, a liquid crystal display device (LCD), and displays an instruction menu for a user, information about acquired image data, and the like. For example, an organic EL (electroluminescence) display can be used in place of the LCD as long as it is an apparatus that displays an image.

  The operation unit 163 includes a touch panel 165 and a hard key unit 167. The touch panel 165 is a capacitive type. Note that the touch panel 165 is not limited to the capacitance method, and other methods such as a resistance film method, a surface acoustic wave method, an infrared method, and an electromagnetic induction method can be used.

  The touch panel 165 is provided with its detection surface superimposed on the display unit 161 on the upper or lower surface of the display unit 161. Here, the size of the detection surface of the touch panel 165 and the size of the display surface of the display unit 161 are the same. For this reason, the coordinate system of the display surface and the coordinate system of the detection surface are the same. The touch panel 165 detects the position where the user points the display surface of the display unit 161 on the detection surface, and outputs the coordinates of the detected position to the CPU 111. Since the coordinate system of the display surface and the coordinate system of the detection surface are the same, the coordinates output from the touch panel 165 can be replaced with the coordinates of the display surface.

  Hard key portion 167 includes a plurality of hard keys. The hard key is, for example, a contact switch. The touch panel 165 detects a position designated by the user on the display surface of the display unit 161. When the user operates the MFP 100, the user often takes an upright posture, and thus the display surface of the display unit 161, the operation surface of the touch panel 165, and the hard key unit 167 are arranged facing upward. This is because the user can easily visually recognize the display surface of the display unit 161 and the user can easily instruct the operation unit 163 with a finger.

  The external storage device 117 is controlled by the CPU 111, and a CD-ROM (Compact Disk Read Only Memory) 118 or a semiconductor memory is mounted. In this embodiment, an example in which the CPU 111 executes a program stored in the ROM 113 will be described. However, the CPU 111 controls the external storage device 117 to read a program to be executed by the CPU 111 from the CD-ROM 118. The read program may be stored in the RAM 102 and executed.

  The recording medium for storing a program to be executed by the CPU 111 is not limited to the CD-ROM 118, but is a flexible disk, a cassette tape, an optical disk (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile Disc). )), A semiconductor memory medium such as an IC card, an optical card, a mask ROM, an EPROM (Erasable Programmable ROM), and an EEPROM (Electrically EPROM). Further, the CPU 111 downloads a program from a computer connected to the network and stores it in the HDD 115, or loads the program stored in the HDD 115 into the RAM 114 so that the computer connected to the network writes the program to the HDD 115. Then, it may be executed by the CPU 111. The program here includes not only a program directly executable by the CPU 111 but also a source program, a compressed program, an encrypted program, and the like.

  When MFP 100 according to the present embodiment reads a document having a size larger than A3 size, for example, A0 size, the user needs to divide the document into a plurality of parts and cause document reading unit 130 to read each of the plurality of parts. There is.

  MFP 100 in the present embodiment has a composition function. The composition function is a function of reading a plurality of parts obtained by dividing a document having a size larger than A3 size, and composing the read images of the plurality of parts to generate one image corresponding to the document. When the user inputs an operation for enabling the composite function to operation unit 163, MFP 100 enables the composite function. After enabling the composition function of MFP 100, the user sets each of a plurality of portions of one document so as to overlap the reading surface, and causes document reading unit 130 to read.

  When MFP 100 combines two images, in order to align the positions of the two images, the same portion is extracted from each of the two images, and the same portion is overlapped between the two images. For this reason, a plurality of portions where the user divides the document needs to partially overlap two adjacent portions. Each of the two overlapping parts needs to include images such as characters, symbols, line drawings, and colors that can be extracted from an image obtained by reading the two parts by the MFP 100.

  FIG. 3 is a diagram illustrating an example of functions of a CPU included in the MFP. The functions shown in FIG. 3 are functions formed in CPU 111 when CPU 111 provided in MFP 100 executes an image reading program stored in ROM 113, HDD 115, or CD-ROM 118.

  Referring to FIG. 3, the CPU 111 includes a reading control unit 200, a synthesis unit 210, a detection unit 220, a missing area determination unit 230, a selection unit 240, a notification unit 250, a feature image detection unit 260, And a complementing unit 270.

  The reading control unit 200 controls the document reading unit 130 to cause the document reading unit 130 to read the document and acquire an image output from the document reading unit 130. When the compositing function is set to be valid, the reading control unit 200 instructs the reading after the user's operation for enabling the compositing function is accepted until the user's operation for instructing the end of reading is accepted. Each time an operation by the user is accepted, the original reading unit 130 is caused to read the original, and an image output by the original reading unit 130 is acquired. Here, the reading area scanned by the reading control unit 200 is a horizontal reading area of A3 size which is the maximum size. When the user designates a reading area, the reading control unit 200 may scan the reading area designated by the user. The reading control unit 200 outputs an image input from the document reading unit 130 to the combining unit 210 every time an operation by a user who instructs reading is received.

  The combining unit 210 generates a combined image obtained by combining a plurality of images input from the reading control unit 200. For example, the synthesizing unit 210 extracts a common portion in which images such as the same character, symbol, line drawing, and color are represented between two images, and synthesizes the two images at a position where the common portions overlap. The synthesizing unit 210 finally generates one synthesized image by sequentially extracting and synthesizing two images from a plurality of images. The combining unit 210 outputs the generated combined image to the complementing unit 270, the detecting unit 220, and the missing region determining unit 230.

  The detection unit 220 detects a missing portion from the combined image input from the combining unit 210. The missing portion is a portion where no image exists in a rectangular region of the minimum size surrounding the synthesized image. The non-existent portion is a set of pixels having no value in the minimum-sized rectangular region surrounding the synthesized image. When the user enables the composition function of MFP 100 and inputs an operation for specifying the size of a document to be read by document reading unit 130 to MFP 100, a portion where no image exists is specified by the user. A set of pixels having no value in a rectangular area having the same size as the size of the document may be used. The detection unit 220 outputs the detected defect portion to the defect region determination unit 230. When detecting a plurality of missing portions, the detecting unit 220 outputs the detected plurality of missing portions to the missing region determining unit 230. The missing portion detected by the detection unit 220 is detected as a polygon having an apex angle of 3 or more.

  The missing area determination unit 230 specifies the position of the missing part in the synthesized image input from the synthesizing unit 210 in response to the input of one or more missing parts from the detecting unit 220. The missing area determination unit 230 determines a missing area corresponding to the missing part in the document based on the position of the missing part in the composite image.

  The missing region determination unit 230 includes a feature portion detection unit 231. The feature portion detection unit 231 detects a feature portion existing in the vicinity of the missing portion in the composite image synthesized by the synthesis unit 210. The characteristic portion is a characteristic image that can be distinguished from other portions, and includes, for example, a symbol, a character, a color, or a pattern. The feature portion detection unit 231 detects a feature image having the closest distance from each of the apex angles of the missing portion, and has the shortest distance to any one of three or more apex angles among the three or more feature images. A characteristic image is determined as a characteristic part.

  The missing area determination unit 230 determines an area in the document corresponding to a rectangular area including the missing part and the feature part detected by the feature part detection unit 231 as a missing area. The missing area determination unit 230 outputs a set of the determined missing area and area identification information for identifying the missing area to the selection unit 240.

  When a plurality of missing portions are input from the detection unit 220, the missing region determining unit 230 determines a rectangular region having a minimum size including all of the plurality of missing portions as a candidate region. The missing area determination unit 230 determines a missing area corresponding to the candidate area in the document based on the position of the candidate area in the composite image. The feature part detection unit 231 detects a feature part existing in the vicinity of the candidate area in the composite image. The missing area determination unit 230 determines an area in the document corresponding to a rectangular area including the candidate area and the feature part detected by the feature part detection unit 231 as a missing area.

  The selection unit 240 selects a reading region for reading the defect region input from the defect region determination unit 230 from the plurality of reading regions. The selection unit 240 selects one or more reading areas having a size smaller than the missing area and having the smallest size from among the plurality of reading areas, and reads the selected reading area for the missing area. To decide. When selecting the reading area, the selection unit 240 outputs a set of the area identification information for identifying the missing area and the determined reading area to the reading control unit 200, and selects the missing area and the missing area. A set with the region identification information for identification is output to the feature image detection unit 260 and the notification unit 250.

  The selection unit 240 includes a division unit 241. The dividing unit 241 divides the missing area into two when the size of the missing area is larger than the largest reading area among the plurality of reading areas. In the present embodiment, the maximum reading area size is A3 size. When the size of the defect area is larger than the A3 size, the dividing unit 241 divides the defect area into two. The dividing unit 241 divides the defect area until the size of the two defect areas after the division becomes A3 size or less.

  When the defective area includes one defective part, the dividing unit 241 outputs a generation instruction including one defective part to each of the two defective parts included in the divided two defective areas, to the defective area determining unit 230. To do. When the defective region includes a plurality of defective portions, the dividing unit 241 divides the defective region into two so that the divided portion includes at least one of the plurality of defective portions. For each of the two missing areas after the division, when the missing area includes one missing part, the dividing unit 241 outputs a generation instruction including the one missing part to the missing area determining unit 230, and the missing area In the case where includes a plurality of missing portions, a generation instruction including a plurality of missing portions is output to the missing region determining unit 230.

  When a generation instruction including one defective portion is input from the dividing unit 241, the defective region determination unit 230 determines a defective region for the defective portion included in the generation instruction, and identifies the determined defective region and the defective region A pair with region identification information for output is output to the selection unit 240. When a generation instruction including a plurality of missing parts is input from the dividing unit 241, the missing area determination unit 230 determines a rectangular area having a minimum size including all of the plurality of missing parts included in the generation instruction as a candidate area. Then, the defective region is determined based on the position of the candidate region in the composite image, and a set of the determined defective region and region identification information for identifying the defective region is output to the selection unit 240.

  The selection unit 240 selects a reading region for reading the defect region for each of the plurality of defect regions input from the defect region determination unit 230 after the dividing unit 241 outputs the generation instruction to the defect region determination unit 230. The selected reading area is determined as a reading area for reading the defective area. The selection unit 240 outputs, to the reading control unit 200, a set of region identification information for identifying a defective region and the determined reading region for each determined reading region, and also includes the defective region and the defective region. Are output to the feature image detecting unit 260 and the notification unit 250.

  The notification unit 250 receives one or more pairs of missing regions and region identification information from the selection unit 240. The notification unit 250 displays a guide image on the display unit 161 of the operation panel 160 for each set of the missing region and the region identification information. Here, the guide image is an image that assists the user's operation of arranging the defective area determined by the defective area determination unit 230 in the reading area selected by the selection unit 240. The guide image includes a reference image that indicates the reference position of the reading surface of the document reading unit 130 and an image that indicates a relative position between the feature portion detected by the feature portion detection unit 231. In the present embodiment, the reference position is the upper left apex angle of the reading surface of document reading unit 130. The guide image includes an image indicating the orientation of the document with respect to the reading surface of the document reading unit 130. Specifically, the guidance image includes a composite image and an image of a defective area in the composite image. The image of the defect area in the guide image is rotated and arranged as necessary so that the characteristic part is at the upper left. In addition, the notification unit 250 displays a peripheral complement button on the display unit 161 of the operation panel 160 for each pair of the missing region and the region identification information.

  By visually recognizing the guide image, the user can recognize the missing area of the document corresponding to the missing part. In addition, the user can easily place the document on the document reading unit 130 so that the direction of the document is the direction indicated by the guide image and the characteristic portion included in the document is positioned at the upper left apex which is the reference position of the reading surface. Can be set.

  At this stage, the user can determine by looking at the document whether or not the defect portion included in the defect area indicated by the guide image is the same solid image as the surrounding color. When the missing part is a solid image having the same color as the surrounding color, it is possible to complement the composite image without reading the missing area. For this reason, the notification unit 250 outputs a prohibition instruction to the reading control unit 200 and outputs a peripheral complement instruction to the complementing unit 270 when accepting an operation to instruct the peripheral complementing button. The prohibition instruction and the peripheral complement instruction include area identification information for identifying a missing area corresponding to the guide image.

  On the other hand, when the user places an original on the reading surface according to the guide image and inputs an operation for instructing reading to the operation unit 163, the notification unit 250 outputs the reading instruction to the reading control unit 200. The reading instruction includes area identification information for identifying a missing area corresponding to the guide image.

  In response to the reading instruction input from the notification unit 250, the reading control unit 200 includes a group including the region identification information included in the reading instruction among the combination of the reading region and the region identification information input from the selection unit 240. And the reading area included in the selected set is determined. The reading control unit 200 controls the document reading unit 130 to read the document in the determined reading region, sets the image output from the document reading unit 130 as a complementary image, and region identification information included in the complementary image and the reading instruction. Are output to the feature image detection unit 260.

  The feature image detection unit 260 receives a set of a missing region and region identification information from the selection unit 240, and receives a set of a complementary image and region identification information from the reading control unit 200. The feature image detection unit 260 receives the combination of the complementary image and the region identification information from the reading control unit 200, and based on the combination of the missing region and the region identification information input from the selection unit 240. A missing area paired with the area identification information input from the reading control unit 200 is specified. The feature image detection unit 260 extracts the same image as the feature part in the defective area from the complementary image input from the reading control unit 200 as a feature image. If the difference between the relative position of the feature image in the complement image and the relative position of the feature portion in the missing area is within a predetermined range, the missing portion of the composite image is included in the complement image. In this case, the feature image detection unit 260 outputs a synthesis instruction to the complement unit 270. The compositing instruction includes area identification information input from the reading control unit 200 and a complementary image. On the other hand, when no feature image is detected from the complement image, the missing portion of the composite image is not included in the complement image. Even if a feature image is detected from the complement image, if the difference between the relative position of the feature image in the complement image and the relative position of the feature portion in the missing region is far greater than the predetermined range, There is a possibility that the missing portion of the image is located outside the complementary image and is not included in the complementary image. In these cases, the feature image detection unit 260 outputs a notification instruction to the reading control unit 200 and the notification unit 250.

  When a notification instruction is input from the feature image detection unit 260, the notification unit 250 displays a guide image on the display unit 161 of the operation panel 160 and notifies the user that the document has not been properly set. In this case, the user sets a document on the document reading unit 130. When a notification instruction is input from the feature image detection unit 260, the reading control unit 200 controls the document reading unit 130 in response to accepting an operation instructing the reading by the operation unit 163, and is determined in advance. The original is read in the reading area, the image output from the original reading unit 130 is set as a complementary image, and a set of the complementary image and the area identification information is output to the feature image detection unit 260.

  When a plurality of sets of missing regions and region identification information are input from the selection unit 240, the notification unit 250 sequentially displays a plurality of guide images respectively corresponding to the plurality of missing regions on the display unit 161 of the operation panel 160. As a result, the user can make the plurality of originals so that the orientation of the plurality of originals is the direction indicated by the guide image and the characteristic portion included in the plurality of originals is located at the upper left apex which is the reference position of the reading surface. Can be easily and sequentially set on the document reading unit 130.

  The complement unit 270 supplements the composite image with the supplement image included in the compositing instruction in response to the composite image input from the compositing unit 210 and the compositing instruction input from the feature image detection unit 260. The complement unit 270 complements the composite image by combining the supplement image with the composite image at a position where the same image overlaps the supplement image and the composite image. Thereby, a missing part is complemented with a complement image.

  The complement unit 270 includes a peripheral complement unit 271. In response to the input of the peripheral complement instruction from the notification unit 250, the peripheral complementing unit 271 specifies a missing region specified by the region identification information included in the peripheral complementary instruction in the composite image, and The composite image is complemented based on the missing area. Specifically, the peripheral complementing unit 271 sets all of the pixels included in the missing part to the same value as the values of the pixels in the peripheral area for the missing part included in the missing area of the composite image. Thereby, the missing part becomes a solid image of the same color as the surrounding area, and the composite image is complemented.

  FIG. 4 is a schematic plan view showing an example of the document reading unit. Referring to FIG. 4, two rectangular reading surfaces 131 and 132 are arranged on the upper surface of document reading unit 130. The reading surface 131 is located substantially at the center of the upper surface of the document reading unit 130. The reading surface 132 is located on the left side of the reading surface 131 so as to extend vertically. The reading surface 132 is used for reading a document conveyed by the automatic document conveying device 120.

  A plurality of rectangular reading areas are set in advance on the reading surface 131. Each of the plurality of reading areas is arranged on the reading surface with the upper left position in the reading surface 131 as a reference. Accordingly, the left side and the upper side of each of the plurality of reading areas coincide with the left side and the upper side of the reading surface 131, respectively. On the left side of the reading surface 131, a scale indicating each of the lower sides of the plurality of reading areas is formed. On the reading surface 131, a scale indicating each of the right sides of the plurality of reading areas is formed. A reference image 133 indicating the reference position of the reading surface 131 is formed on the upper left of the reading surface 131. In this example, the reference image 133 has an arrow shape, and indicates the position of the top left apex angle of the reading surface 131 as the reference position.

  FIG. 5 is a schematic diagram showing a document to be read by the document reading unit. Referring to FIG. 5, document 1 has an A0 size. On the other hand, the maximum reading area of the reading surface 131 is A3 size. Therefore, the entire document 1 cannot be placed on the reading surface 131 and read by the document reading unit 130. Therefore, the user divides the document 1 into a plurality of parts, that is, 15 parts M1 to M15 in the example of FIG. The sizes of the plurality of M1 to M15 are smaller than the A3 size.

  The user sets the composition function of the MFP 100 to be valid, and then sets the position so that the portion M1 of the document 1 overlaps the reading surface 131. In this state, the user operates the predetermined operation unit 163 of the operation panel 160 to select an A3 size reading area. The user further operates a predetermined operation unit 163 of the operation panel 160 to cause the document reading unit 130 to read the portion M1 with the selected size and generate an image corresponding to the portion M1. Similarly, the user sets the remaining portions M <b> 2 to M <b> 15 so as to sequentially overlap the reading surface 131 and operates the operation unit 163. Thus, each time the operation unit 163 is operated, the parts M2 to M15 are read by the document reading unit 130, and images corresponding to the parts M2 to M15 are generated.

  FIG. 6 is a schematic diagram illustrating an image generated by the document reading unit. Referring to FIG. 6, original reading unit 130 generates images G1 to G15 corresponding to portions M1 to M15, respectively. In FIG. 6, for easy visual recognition, the images G1, G3, G5, G7, G9, G11, G13, and G15 are illustrated by solid lines, and the images G2, G4, G6, G8, G10, G12, and G14 are dotted lines. Is illustrated. Since the size of the reading area is larger than the size of each of the parts M1 to M15, the generated images G1 to G15 include some images of adjacent parts in addition to the corresponding parts M1 to M15. For example, the image G1 includes some images of the adjacent portions M2, M6, and M7 in addition to the image of the portion M1. The image G2 includes a part of the images of the adjacent parts M1, M3, M6, M7, and M8 in addition to the image of the part M2. Thus, a common part is included in two adjacent images.

  The reading control unit 200 acquires the images G <b> 1 to G <b> 15 output from the document reading unit 130 and outputs them to the combining unit 210. The synthesizing unit 210 extracts the same common part between the two images from the images G1 to G15, and synthesizes the two images at positions where the common parts overlap. The synthesizing unit 210 finally generates one synthesized image 2 by sequentially extracting and synthesizing two images from the synthesized image and the remaining images G1 to G15. The combining unit 210 outputs the generated combined image 2 to the complementing unit 270, the detecting unit 220, and the missing region determining unit 230.

  If the portions M1 to M15 of the document 1 are not properly set on the reading surface 131 of the document reading unit 130, a missing portion in which no image exists in the composite image 2 occurs. The detection unit 220 detects a missing portion from the composite image 2 input from the synthesis unit 210. The detection unit 220 outputs the detected one or more defective portions to the defective region determination unit 230.

  7 and 8 are diagrams for explaining the operation of the missing region determination unit when one missing part is input from the detection unit. Referring to FIG. 7, when one missing portion is input from detection unit 220, missing region determination unit 230 specifies the position of one missing portion Y in composite image 2 input from combining unit 210. . The feature portion detection unit 231 detects a feature portion Z that exists in the vicinity of the missing portion Y of the composite image 2 and identifies a rectangular region R that includes the detected feature portion Z and the missing portion Y. Referring to FIG. 8, the missing area determination unit 230 determines the area in the document 1 corresponding to the specified rectangular area R as the missing area X. The dimension (horizontal width) in the left-right direction of the defect region X is Lx, and the dimension (vertical width) in the vertical direction is Ly.

  FIG. 9 and FIG. 10 are diagrams for explaining the operation of the missing area determination unit when a plurality of missing parts are input from the detection unit. Referring to FIG. 9, when a plurality of missing portions are input from detection unit 220, missing region determining unit 230 determines the positions of the plurality of missing portions Y <b> 1 and Y <b> 2 in composite image 2 input from combining unit 210. A rectangular region having the smallest size including all of the plurality of missing portions Y1 and Y2 is determined as the candidate region C. The feature portion detection unit 231 detects a feature portion Z that exists in the vicinity of the candidate region C in the composite image 2 and identifies a rectangular region R that includes the detected feature portion Z and the candidate region C. Referring to FIG. 10, missing area determination unit 230 determines an area in document 1 corresponding to area R as missing area X. The dimension (horizontal width) in the left-right direction of the defect region X is Lx, and the dimension (vertical width) in the vertical direction is Ly.

  The missing region determination unit 230 outputs a set of the determined defective region X and region identification information for identifying the defective region X to the selection unit 240. When the size of the defect area X is equal to or smaller than the size of the maximum reading area, the selection unit 240 is one or more reading areas larger than the defect area X input from the defect area determination unit 230 and has the smallest size. Is selected from a plurality of reading areas.

  For example, when the horizontal width Lx of the defect area X is 210 mm or less and the vertical width Ly is 148 mm or less, a horizontal reading area of A5 size is selected. When the horizontal width Lx of the defect area X is greater than 210 mm and not greater than 257 mm, and the vertical width Ly is greater than 148 mm and not greater than 182 mm, the B5 size horizontal reading area is selected. When the horizontal width Lx of the defect area X is greater than 257 mm and equal to or less than 297 mm, and the vertical width Ly is greater than 182 mm and equal to or less than 210 mm, the A4 size horizontal reading area is selected. When the lateral width Lx of the defect area X is greater than 297 mm and less than or equal to 364 mm, and the longitudinal width Ly is greater than 210 mm and less than or equal to 257 mm, a B4 size lateral reading area is selected. When the horizontal width Lx of the defect area X is greater than 364 mm and 420 mm or less, and the vertical width Ly is greater than 257 mm and 297 mm or less, the A3 size horizontal reading area is selected.

  When the horizontal width Lx of the defect area X is 148 mm or less and the vertical width Ly is 210 mm or less, an A5 size vertical reading area is selected. When the horizontal width Lx of the defect area X is greater than 148 mm and equal to or less than 182 mm, and the vertical width Ly is greater than 210 mm and equal to or less than 257 mm, a B5 size vertical reading area is selected. When the horizontal width Lx of the defect area X is greater than 182 mm and 210 mm or less, and the vertical width Ly is greater than 257 mm and 297 mm or less, the A4 size vertical reading area is selected.

  The selection unit 240 determines the selected reading region as a reading region for reading the defective region X, and sets the combination of the region identification information for identifying the defective region and the determined reading region to the reading control unit 200. Output. In addition, the selection unit 240 outputs a set of the defect region X and region identification information for identifying the defect region X to the feature image detection unit 260 and the notification unit 250.

  11 and 12 are diagrams for explaining the operation of the selection unit when the size of the defective area is larger than the size of the maximum reading area. Referring to FIG. 11, in the case where the size of defective region X is larger than the size of the largest reading region, when corresponding defective region R includes one defective portion Y, dividing unit 241 includes two defective regions X. Divide into In the example of FIG. 11, the two missing regions r1 and r2 after division include the missing portions Y1 and Y2, respectively. The dividing unit 241 outputs a generation instruction to the missing region determining unit 230 in which each of the missing regions r1 and r2 includes one missing portion Y1 and Y2.

  Referring to FIG. 12, in the case where the size of defective region X is larger than the size of the largest reading region, when corresponding defective region R includes a plurality of defective portions Y1, Y2, dividing unit 241 Divides the defect region X into two so that each includes a plurality of defect portions Y1, Y2. In the example of FIG. 12, the two missing regions r1 and r2 after the division include the missing portions Y1 and Y2, respectively. The dividing unit 241 outputs a generation instruction including the defective portion Y1 included in the defective region r1 and a generation instruction including the defective portion Y2 included in the defective region r2 to the defective region determining unit 230.

  The dividing unit 241 divides the defect regions r1 and r2 and outputs a generation instruction to the defect region determination unit 230 until the size of the two defect regions r1 and r2 after the division is equal to or less than the size of the maximum reading region. And repeat.

  When the generation instruction including one defect portion Y1 is input from the dividing unit 241, the defect region determination unit 230 determines the defect region X for the defect portion Y1 included in the generation instruction. Similarly, when a generation instruction including one defective portion Y2 is input from the dividing unit 241, the defective region determination unit 230 determines a defective region X for the defective portion Y2 included in the generation instruction.

  In FIG. 12, the defect region X is divided into two parts so that the part after being divided by the dividing unit 241 includes a plurality of missing parts Y1 and Y2, but the part after being divided by the dividing part 241 is It may contain multiple missing parts. In this case, the dividing unit 241 outputs a generation instruction including a plurality of missing portions to the missing region determining unit 230. When a generation instruction including a plurality of missing parts is input from the dividing unit 241, the missing area determination unit 230 sets a rectangular area having a minimum size including all of the plurality of missing parts included in the generation instruction as a candidate area C. The defect area X is determined based on the position of the candidate area C in the composite image 2. The missing region determination unit 230 outputs a set of the determined defective region X and region identification information for identifying the defective region to the selection unit 240.

  After the dividing unit 241 outputs the generation instruction to the defective region determining unit 230, the selecting unit 240 selects a reading region for reading the defective region X for each of the defective regions X input from the defective region determining unit 230. . The selection unit 240 determines the selected reading area as a reading area for reading the defective area X, and for each determined reading area, area identification information for identifying the defective area, the determined reading area, Are output to the reading control unit 200. In addition, the selection unit 240 outputs a set of the defect region X and region identification information for identifying the defect region X to the feature image detection unit 260 and the notification unit 250.

  FIG. 13 is a diagram for explaining the operation of the notification unit. Referring to FIG. 13, when one or more pairs of missing region R and region identification information are input from selection unit 240, notification unit 250 displays composite image 2 on display unit 161. Various figures and characters exist in the composite image 2 of FIG. Further, the composite image 2 includes a missing portion Y and a triangular shaped feature portion Z in the vicinity of the missing portion Y.

  FIG. 14 is a diagram for explaining the operation of the notification unit when a missing portion exists in the composite image. Referring to FIG. 14, when missing portion Y exists in composite image 2, notification unit 250 displays notification image 3 on display unit 161. The notification image 3 is an image for notifying the user that the missing portion Y exists in the composite image 2, and includes a peripheral complement button 3a and a reread button 3b. When a plurality of pairs of missing regions R and region identification information are input from the selection unit 240, the notification unit 250 sequentially displays a plurality of notification images 3 respectively corresponding to the plurality of missing regions R on the display unit 161. The user can determine whether or not the missing portion Y shown in the notification image 3 is the same solid image as the surrounding color. When the missing portion Y is the same solid image as the surrounding color, the user operates the surrounding complement button 3a.

  When the peripheral complement button 3 a is operated, the notification unit 250 outputs a prohibition instruction to the reading control unit 200 and outputs a peripheral complement instruction to the complementing unit 270. The prohibition instruction and the peripheral complement instruction include area identification information for identifying the missing area R corresponding to the guide image.

  In response to the input of the peripheral complement instruction from the notification unit 250, the peripheral complement unit 271 specifies the missing region R specified by the region identification information included in the peripheral complement instruction in the composite image 2. The peripheral complementing unit 271 sets all the pixels of the defective portion Y included in the specified defective region R to the same value as the values of the pixels around the defective portion Y in the composite image 2. As a result, the missing portion Y becomes a solid image of the same color as the periphery, and the composite image 2 is complemented.

  FIG. 15 is a diagram for explaining the operation of the notification unit when the reread button is operated. Referring to FIG. 15, when reread button 3 b is operated, notification unit 250 displays guide image 4 and guide image 5 on display unit 161. The guide image 4 is an image showing a relative position between the reference image 133 indicating the reference position of the reading surface 131 of the document reading unit 130 and the feature portion Z detected by the feature portion detection unit 231. A part and the image of the defect region R in the composite image 2 are included. In the example of FIG. 16, the reference position is the top left apex angle of the reading surface 131. Therefore, the guide image 4 is displayed in a rotated state so that the characteristic portion Z of the missing region R is in the upper left. Thereby, the orientation of the document 1 with respect to the reading surface 131 is indicated. The guide image 5 is a screen that guides the user to set the document 1 on the reading surface 131 in the direction indicated by the guide image 4 while indicating the size and direction of the reading area at the time of re-reading. By displaying the guide image 4 and the guide image 5, it is possible to support the user's operation at the time of re-reading.

  The user sets the document 1 on the reading surface 131 according to the guide image 4 and the guide image 5 and inputs an operation for instructing reading to the operation unit 163. As a result, the notification unit 250 outputs a reading instruction to the reading control unit 200. The reading instruction includes area identification information for identifying the missing area R corresponding to the guide image 4. In response to the reading instruction input from the notification unit 250, the reading control unit 200 includes a group including the region identification information included in the reading instruction among the combination of the reading region and the region identification information input from the selection unit 240. And the reading area included in the selected set is determined. The reading control unit 200 reads the document 1 by the document reading unit 130 in the determined reading area. The reading control unit 200 uses the image output from the document reading unit 130 as a complementary image, and outputs a set of the complementary image and the area identification information included in the reading instruction to the feature image detection unit 260.

  The feature image detection unit 260 receives a set of the missing region R and the region identification information from the selection unit 240, and receives a set of the complementary image and the region identification information from the reading control unit 200. The feature image detection unit 260 is based on the combination of the missing region R and the region identification information input from the selection unit 240 in response to the input of the complementary image and the region identification information from the reading control unit 200. Then, the missing region R paired with the region identification information input from the reading control unit 200 is specified. The feature image detection unit 260 extracts the same image as the feature part Z in the defect region R from the complementary image input from the reading control unit 200 as a feature image.

  When the feature image is not detected from the complementary image, or when the difference between the relative position of the feature image in the complementary image and the relative position of the feature portion Z in the missing region R is larger than a predetermined range, the feature image The detection unit 260 outputs a notification instruction to the reading control unit 200 and the notification unit 250. FIG. 16 is a diagram for explaining the operation of the notification unit when a notification instruction is input from the feature image detection unit. Referring to FIG. 16, when a notification instruction is input from feature image detection unit 260, notification unit 250 displays guidance image 4 again on display unit 161 and displays warning image 6. The warning image 6 is a screen that warns the user that the document 1 has not been properly set on the reading surface 131. In this case, the user sets the document 1 on the reading surface 131 according to the guide image 4 and the warning image 6, and inputs an operation for instructing reading to the operation unit 163.

  When a notification instruction is input from the feature image detection unit 260, the reading control unit 200 receives the operation instructed to be read by the operation unit 163 and causes the document reading unit 130 to read the document in the previously determined reading area. 1 is read. The reading control unit 200 uses the image output from the document reading unit 130 as a complementary image, and outputs a set of the complementary image and region identification information to the feature image detection unit 260.

  When the difference between the relative position of the feature image in the complement image and the relative position of the feature portion Z in the defect area R is within a predetermined range, the feature image detection unit 260 outputs a synthesis instruction to the complement unit 270. The compositing instruction includes area identification information input from the reading control unit 200 and a complementary image. The complement unit 270 supplements the composite image 2 with the supplement image included in the synthesis instruction in response to the synthesis image 2 being input from the synthesis unit 210 and the synthesis instruction being input from the feature image detection unit 260. The complement unit 270 supplements the composite image 2 by combining the supplement image with the composite image 2 at a position where the same image overlaps the supplement image and the composite image 2. Thereby, a missing part is complemented with a complement image.

  FIG. 17 is a flowchart illustrating an example of the flow of the composite image generation process. The composite image generation process is a process executed by CPU 111 when CPU 111 provided in MFP 100 executes a composite image generation program stored in ROM 113, HDD 115, or CD-ROM 118.

  Referring to FIG. 17, CPU 111 generates a plurality of images G1 to G15 respectively corresponding to a plurality of portions M1 to M15 by receiving an operation from a user who instructs reading (step S01). For example, after the user sets the composition function of the MFP 100 to be valid, the user sets the 15 portions M1 to M15 of the document 1 in order so as to overlap the reading surface 131 of the document reading unit 130, and sets the MFP 100. To read 15 times. Thereby, the MFP 100 generates 15 images G1 to G15. When the user causes MFP 100 to read 15 portions M1 to M15 of document 1, and inputs an operation to instruct completion of the reading operation to operation unit 163, CPU 111 advances the process to step S02. In step S02, synthesized image 2 is generated by synthesizing 15 images G1 to G15, and the process proceeds to step S03.

  In step S03, it is determined whether a missing portion is detected from the composite image 2. Specifically, it is determined whether or not a set of pixels having no value in a rectangular area of the minimum size surrounding the composite image 2 is detected. If a missing portion is detected, the process proceeds to step S04. If not, the process proceeds to step S12. In step S04, a missing area determination process is executed, and the process proceeds to step S05. Although details of the defect area determination process will be described later, the defect area determination process is a process for determining one or more defect areas for reading a defect portion with the minimum reading area and determining a reading area corresponding to the defect area. It is.

  In step S05, one defective region is selected as a processing target from the determined one or more defective regions, and the process proceeds to step S06. In step S06, notification image 3 corresponding to the selected missing area is displayed on display 161, and the process proceeds to step S07. For example, the notification image 3 shown in FIG. 14 is displayed. In step S07, it is determined whether re-reading is instructed. Specifically, it is determined that rereading is instructed when the reread button 3b of the notification image 3 is operated, and it is determined that rereading is not instructed when the peripheral complement button 3a is operated. If re-reading is instructed, the process proceeds to step S09; otherwise, the process proceeds to step S08.

  In step S08, the value of the pixel in the area around the missing portion is specified, and the process proceeds to step S10. In step S09, a complementary image generation process is executed, and the process proceeds to step S10. Although details of the complementary image generation process will be described later, the complementary image generation process is a process of generating a complementary image corresponding to the selected missing area.

  In step S10, the composite image is complemented, and the process proceeds to step S11. When the process proceeds from step S08, the value of the pixel in the area around the missing portion is specified. In this case, the composite image is complemented by setting the value of the pixel of the defective part included in the defective area to the specified value. When the process proceeds from step S09, a complementary image has been generated. In this case, the synthesized image 2 is complemented by synthesizing the complemented image with the synthesized image 2 at the position where the same image overlaps the complemented image and the synthesized image 2. In step S11, it is determined whether there is another missing area. If there is no other missing area, the process proceeds to step S12. If not, the process returns to step S05.

  In step S12, the generated or supplemented composite image 2 is output, and the process ends. Here, when the output target is the HDD 115, the composite image 2 is stored in the HDD 115, and when the output target is the external storage device 117, the composite image 2 is stored in the CD-ROM 118. When the output target is the I / F unit 112, the composite image 2 is stored in another information processing apparatus such as a server, a cloud, or a computer. When the output target is the image forming unit 140, the composite image is printed on a sheet or the like. 2 is formed.

  FIG. 18 is a flowchart illustrating an example of the flow of a missing area determination process. The missing area determination process is a process executed in step S04 of the composite image generation process shown in FIG. One or more missing portions are determined at a stage before the missing region determining process is executed. Referring to FIG. 18, CPU 111 identifies the position and size of the missing part (step S21). When there are a plurality of missing portions, the position and size of each of the plurality of missing portions are specified.

  In the next step S22, it is determined whether or not all missing portions have been specified. If all the missing portions have been specified, the process proceeds to step S23; otherwise, the process returns to step S21. In step S23, it is determined whether there are a plurality of missing portions. If there are a plurality of missing portions, the process proceeds to step S24; otherwise, the process proceeds to step S25.

  In step S24, a candidate area is determined, and the process proceeds to step S25. A rectangular area having a minimum size including all of the plurality of missing portions is determined as a candidate area. In step S25, a feature portion is detected, and the process proceeds to step S26. When there is one missing part, a characteristic image that can be distinguished from other parts existing in the vicinity of the missing part is detected. If there are a plurality of missing portions, a characteristic image that can be distinguished from other portions existing in the vicinity of the candidate region is detected.

  In step S26, a missing area is determined, and the process proceeds to step S27. Specifically, when there is one missing part, a rectangular area including the missing part and the characteristic part is determined as a missing area in the document 1. If there are a plurality of missing parts, a rectangular area including the candidate area and the characteristic part is determined as a missing area in the document 1.

  In step S27, it is determined whether or not the determined width of the missing area is greater than or equal to the vertical width. If the horizontal width is greater than or equal to the vertical width, the process proceeds to step S28; otherwise, the process proceeds to step S29. In step S28, the direction of the reading area is set to the horizontal direction, and the process proceeds to step S30. In step S29, the direction of the reading area is set to the vertical direction, and the process proceeds to step S30.

  In step S30, the minimum reading area is selected, and the process proceeds to step S31. Specifically, when a horizontal reading area is set, an A5 size horizontal reading area is selected. When the vertical reading area is set, the A5 size vertical reading area is selected.

  In step S31, it is determined whether or not the reading area is greater than or equal to the missing area. Specifically, it is determined whether or not the horizontal width of the reading area is equal to or larger than the horizontal width of the defective area and the vertical width of the reading area is equal to or larger than the vertical width of the defective area. If the reading area is greater than or equal to the missing area, the process proceeds to step S35; otherwise, the process proceeds to step S32. Since the reading area is preferably larger than the defective area, the horizontal width of the reading area is several percent larger than the horizontal width of the defective area, and the vertical width of the reading area is several percent larger than the vertical width of the defective area. In addition, the process may be advanced to step S35.

  In step S32, it is determined whether or not the next largest reading area exists. If the next largest reading area exists, the process proceeds to step S33; otherwise, the process proceeds to step S34. In step S33, the next largest reading area is selected, and the process returns to step S31. In step S34, a defective area dividing process is executed, and the process returns to step S27. Although details of the defect area dividing process will be described later, the defect area dividing process is a process of dividing a defect area larger than the maximum reading area into a plurality of defect areas below the maximum reading area.

  In step S35, the selected reading area is determined as a reading area corresponding to the missing area set as the processing target, and the process proceeds to step S36. In step S36, it is determined whether or not another missing area exists. Here, when the defect region is divided by the defect region executed in step S34, another defect region exists. If another missing area exists, the process proceeds to step S37; otherwise, the process returns to the composite image generation process. In step S37, another missing area is selected, and the process returns to step S27.

  FIG. 19 is a flowchart illustrating an example of the flow of a defective area dividing process. The missing area dividing process is a process executed in step S34 of the missing area determining process shown in FIG. Referring to FIG. 19, CPU 111 divides the selected missing area into two (step S41). Specifically, the defective region is divided into two so that each includes one or more defective portions.

  In the next step S42, one defective region is selected from the two divided defective regions, and the process proceeds to step S43. In step S43, it is determined whether or not the selected defective region includes a plurality of defective portions. If there are a plurality of missing portions, the process proceeds to step S44; otherwise, the process proceeds to step S45.

  In step S44, a candidate area is determined, and the process proceeds to step S45. A rectangular area having a minimum size including all of the plurality of missing portions is determined as a candidate area. In step S45, a feature portion is detected, and the process proceeds to step S46. When there is one missing part, a characteristic image that can be distinguished from other parts existing in the vicinity of the missing part is detected. If there are a plurality of missing portions, a characteristic image that can be distinguished from other portions existing in the vicinity of the candidate region is detected.

  In step S46, the missing area is updated, and the process proceeds to step S47. Specifically, when there is one missing part, a rectangular area including the missing part and the characteristic part is set as a new missing area in the document 1. When there are a plurality of missing parts, a rectangular area including the candidate area and the characteristic part is set as a new missing area in the document 1.

  In step S47, it is determined whether or not all missing areas have been updated. If not all the missing areas have been updated, the process proceeds to step S48. If not, the process returns to the missing area determination process. In step S48, another defective region is selected from the two divided defective regions, and the process returns to step S43.

  FIG. 20 is a flowchart illustrating an example of the flow of complementary image generation processing. The complementary image generation process is a process executed in step S09 of the composite image generation process shown in FIG. One missing area is selected before the complementary image generation process is executed. Referring to FIG. 20, CPU 111 displays guide image 4 and guide image 5 corresponding to the selected missing area on display 161 (step S51). The user can set a corresponding portion of the document 1 on the reading surface 131 according to the guide image 4 and the guide image 5. Based on the positional relationship between the feature image indicated by the guide image 4 and the reference position, the user places a defect area in the document 1 placed on the reading surface 131 of the document reading unit 130 and the document 1 on the reading surface 131 of the document reading unit 130. It is possible to easily identify the direction to be placed on. If the user sets a missing area of the document 1 on the reading surface 131 and then inputs an operation for instructing reading to the operation unit 163, the CPU 111 advances the process to step S52.

  In step S52, an image is read in the reading area corresponding to the selected missing area, and the process proceeds to step S53. Specifically, the document reading unit 130 is caused to read the document 1 in the reading area corresponding to the missing area. Thereby, a complementary image corresponding to the selected missing area is generated. The size of the complementary image is the same as the size of the reading area. In step S53, it is determined whether or not the feature image is within a predetermined range in the complementary image. Specifically, the same image as the feature part in the defect area is extracted as a feature image from the complement image, and the difference between the relative position of the feature image in the complement image and the relative position of the feature part in the defect area is a predetermined value. Determine if it is within range. The case where the feature image is not extracted from the complementary image also corresponds to the fact that the feature image does not exist within the predetermined range. If the feature image exists within the predetermined range, the process returns to the composite image generation process. If not, the process proceeds to step S54.

  When the process proceeds to step S54, the missing area of the document 1 is not set at the correct position on the reading surface 131 of the document reading unit 130. In step S54, guide image 4 and warning image 6 corresponding to the selected missing area are displayed on display 161, and the process returns to step S52. The user can reset the missing area of the document 1 at the correct position on the reading surface 131 according to the guide image 4 and the warning image 6. After that, if the user inputs an operation for instructing reading to the operation unit 163, the processing after step S52 is executed. In other words, the reading of the missing area of the document 1 is repeated until a complementary image in which the characteristic image is within a predetermined range is generated. Thereby, it is possible to obtain a complementary image capable of complementing the missing portion of the composite image 2 before the composite image 2 is supplemented with the supplement image.

  As described above, MFP 100 according to the present embodiment functions as an image reading apparatus, and when defective portion Y is detected from composite image 2, the minimum size that is larger than defective portion Y among the plurality of read regions. Select the reading area. Then, the complementary image generated by reading the image in the selected reading region is combined with the combined image 2. For this reason, since the minimum reading area that is larger than the missing portion Y is selected, the size of the complementary image can be made as small as possible, and the load when the composite image 2 is complemented with the complementary image can be reduced. As a result, when the document 1 is not properly read, re-reading with high efficiency becomes possible.

  Further, when the size of the defect area X is larger than the A3 size, the MFP 100 divides the defect part Y into two, and selects two reading areas corresponding to each of the two defect parts Y1 and Y2. Therefore, since one defect region X is divided into two, the number of readings can be reduced as much as possible.

  Further, when the reread button 3b is operated, the MFP 100 displays the guide image 4 on the display unit 161. By visually recognizing the guide image 4, the user can easily perform the operation of arranging the missing area X in the document 1 in the selected reading area.

  The guide image 4 indicates the relative position between the reference image 133 indicating the reference position shown around the reading surface 131 of the document reading unit 130 and the feature portion Z in the vicinity of the missing portion Y. By visually recognizing the guide image 4, it is possible to recognize the relative position of the characteristic portion Z of the document 1 with respect to the reading surface 131 when the document 1 is arranged on the reading surface 131. Thereby, the user can easily place the document 1 on the reading surface 131.

  Further, since the guide image 4 includes an image indicating the orientation of the document 1 with respect to the reading surface 131, the user can easily place the document 1 on the reading surface 131 in an appropriate direction by viewing the guide image 4. it can.

  Further, MFP 100 detects the same feature image as feature portion Z from the complement image, and the relative position of the feature image in the complement image is within a predetermined range from the relative position of feature portion Z detected in defect area X. In some cases, the complementary image is combined with the combined image 2. In this case, since there is a high possibility that the composite image 2 includes a portion that complements the missing portion Y, the probability of complementing the missing portion Y in the composite image 2 can be improved. In addition, it is possible to obtain a complementary image that can complement a missing portion of the composite image 2 before the composite image 2 is supplemented with the supplement image.

  Further, it is preferable that the CPU 111 has a function of an image processing unit that extracts the missing portion Y from the complementary image in response to the reading of the document 1 in the selected reading area. In this case, since the missing portion Y is extracted from the complementary image, the size of the complementary image can be minimized. Thereby, the image processing for complementing the composite image 2 can be further accelerated.

  When a predetermined operation of the operation unit 163 by the user is accepted, reading of the document 1 in the selected reading area is prohibited, and the missing portion Y of the composite image 2 has the same value as the area around the missing portion Y. Supplemented with Therefore, the composite image 2 can be complemented while reducing the number of times of reading the document 1.

  Each of the plurality of reading regions is determined by a set of any one of a plurality of predetermined sizes and any one of a plurality of predetermined directions. In this case, the reading area includes an A3 size horizontal reading area, an A4 size vertical reading area, an A4 size horizontal reading area, an A5 size vertical reading area, and an A5 size horizontal reading. Area, B4 size horizontal reading area, B5 size vertical reading area, B5 size horizontal reading area, letter size horizontal reading area, and the like. As a result, it is possible to select a reading area having the smallest size.

  In the present embodiment, a plurality of images, a composite image, and a complementary image are generated by MFP 100 and the complementary image is complemented. However, a plurality of images and complementary images are generated by MFP 100, and the server, cloud Alternatively, the composite image may be generated and complemented by another information processing apparatus such as a computer. In this case, a plurality of images and complementary images generated by MFP 100 are transmitted to another information processing apparatus. Since the MFP 100 determines the missing area as small as possible, the data amount of the complementary image is reduced. Thereby, the network traffic at the time of transmitting a complementary image can be reduced. Furthermore, when the missing part is extracted from the complementary image by the function of the image processing unit and the MFP 100 transmits the defective part as a complementary image, the data amount of the complementary image is further reduced. Network traffic can be further reduced.

  1 manuscript, 2 composite image, 3 notification image, 3a peripheral complement button, 3b reread button, 4 guide image, 5 guide image, 6 warning image, 100 MFP, 110 main circuit, 111 CPU, 112 I / F unit, 113 ROM, 114 RAM, 115 HDD, 116 facsimile unit, 117 external storage device, 118 CD-ROM, 120 automatic document feeder, 125 document tray, 127 document discharge tray, 130 document reading unit, 131, 132 reading surface, 133 Reference image, 140 Image forming unit, 150 Paper feeding unit, 160 Operation panel, 161 Display unit, 163 Operation unit, 165 Touch panel, 167 Hard key unit, 200 Reading control unit, 210 Compositing unit, 220 Detection unit, 230 Defect area determination , 231 feature portion detection unit, 240 selection unit, 2 1 dividing unit, 250 notifying unit, 260 feature image detecting unit, 270 complementing unit, 271 peripheral complementing unit, C candidate region, G1-G15 image, Lx horizontal width, Ly vertical width, M1-M15 part, R region, r1, r2 , X missing area, Y, Y1, Y2 missing part, Z feature part

Claims (12)

Reading means for reading a document in any one of a plurality of reading areas set in advance on a reading surface and generating an image of the read document;
A combining unit that generates a combined image by combining a plurality of images generated by the reading unit;
Detecting means for detecting a missing portion from the synthesized image synthesized by the synthesizing means;
A defect area determining means for determining a defect area corresponding to the defect portion in the document based on the position of the defect portion detected by the detection means in the composite image;
A selection means for selecting a minimum reading area having a size larger than the determined defect area from the plurality of reading areas;
An image reading apparatus, comprising: a complementing unit that synthesizes a complementary image generated by the reading unit with the synthesized image in response to the reading of the document in the selected reading area by the reading unit. The selecting means includes a dividing means for dividing the missing portion into two when the size of the missing area is larger than the size of the largest reading area among the plurality of reading areas,
The image reading apparatus according to claim 1, wherein two reading areas respectively corresponding to the divided two missing portions are selected.   The image reading apparatus according to claim 1, further comprising a notification unit that displays a guide image that supports an operation by a user who places the determined defect area in the selected reading area. The missing area determining means includes a feature part detecting means for detecting a feature part in the vicinity of the missing part in the synthesized image synthesized by the synthesizing means,
Determining an area in the document corresponding to an area including the missing portion and the detected characteristic portion as the missing area;
Each of the plurality of reading areas is arranged on the reading surface with reference to a predetermined reference position in the reading surface,
The image reading apparatus according to claim 3, wherein the guide image includes a reference image indicating the reference position expressed around the reading surface and an image indicating a relative position of the characteristic portion.   The image reading apparatus according to claim 4, wherein the guide image includes an image indicating an orientation of the document with respect to the reading surface. A feature image detecting means for detecting the same feature image as the detected feature portion from the complementary image in response to the reading of the document in the selected reading area by the reading means;
The image reading apparatus according to claim 4, wherein the complementing unit synthesizes the complementary image with the synthesized image when the feature image is detected.   The complement means is further provided that the relative position of the detected feature image in the complement image is within a predetermined range from the relative position of the detected feature portion in the missing region. The image reading apparatus according to claim 6, wherein an image is synthesized with the synthesized image.   The image reading device according to claim 1, further comprising an image processing unit that extracts the missing portion from the complementary image in response to a document being read in the selected reading area by the reading unit. apparatus. It further comprises operation accepting means for accepting user operations,
When a predetermined operation is accepted by the operation accepting unit, the reading unit prohibits reading of the original in the selected reading area, and the missing portion of the composite image has the same value as the area around the missing portion. The image reading apparatus according to claim 1, further comprising a peripheral complementing unit that complements the data.   The image reading according to claim 1, wherein each of the plurality of reading areas is determined by a set of any one of a plurality of predetermined sizes and any one of a plurality of predetermined directions. apparatus. An image reading method executed by an image reading apparatus including a reading unit that reads a document in any one of a plurality of reading areas set in advance on a reading surface and generates an image of the read document.
Generating a composite image by combining a plurality of images generated by the reading unit;
Detecting a missing portion from the synthesized composite image;
Determining a defect region corresponding to the defect portion in the document based on the position of the detected defect portion in the composite image;
Selecting a minimum reading area having a size larger than the determined defect area from the plurality of reading areas;
And a step of combining a complementary image generated by the reading unit with the synthesized image in response to the reading of the document in the selected reading area by the reading unit. An image reading program that is executed by an image reading apparatus that includes a reading unit that reads a document in any one of a plurality of reading areas set in advance on a reading surface and generates an image of the read document.
Generating a composite image by combining a plurality of images generated by the reading unit;
Detecting a missing portion from the synthesized composite image;
Determining a defect region corresponding to the defect portion in the document based on the position of the detected defect portion in the composite image;
Selecting a minimum reading area having a size larger than the determined defect area from the plurality of reading areas;
An image reading program that causes the computer to execute a step of combining a complementary image generated by the reading unit with the synthesized image in response to a document being read in the selected reading area by the reading unit. .

Images