JP2020178220A - Image reading device, image reading method, and computer program - Google Patents

Abstract

To provide an image reading device capable of allowing a user to read a plurality of documents more efficiently than before.SOLUTION: An image reading device acquires images 42d, 42e, and 42f to 42i of each of a plurality of documents arranged in a predetermined range by imaging a predetermined range, and performs notification that facilitates a user to perform imaging by removing a proper document other than the document to be rearranged, and rearranging a plurality of documents to be rearranged such that the documents do not overlap, and appropriate images 42f to 42i from among the images 42d, 42e, and 42f to 42i are output in a case in which there are the plurality of documents to be rearranged which are partially overlapped when the imaging is performed in the plurality of documents.SELECTED DRAWING: Figure 12

Description

The present invention relates to a technique for reading images of a plurality of original documents arranged on a platen glass.

The flatbed type image reading device has a usage in which a plurality of originals are placed side by side on the platen glass and read when reading a large number of originals. In such usage, reading may be performed with two or more originals partially overlapping. In this case, a part of the upper document among the overlapping documents in the scanned image is missing. Prior art for solving this problem is disclosed in Patent Document 1.

The image reading device described in Patent Document 1 binarizes the preview image data obtained by scanning the platen glass, and calculates the position of the document from the data. When the position detection result of the original is recognized as a polygon of pentagon or more, an error is displayed as if the originals are overlapped, and the user is warned to confirm the position of the printed original.

Japanese Unexamined Patent Publication No. 2004-260457

In the technique of Patent Document 1, error display and confirmation of the position of the original by the user are repeated until all of the plurality of originals are not overlapped on the platen glass, and the user cannot easily perform the reading operation. There was a problem that sometimes it could not be finished.

The present invention has been made in view of this problem, and an object of the present invention is to provide an image reading device capable of allowing a user to read a plurality of documents more efficiently than before.

The image reading device according to the embodiment of the present invention includes an imaging means for acquiring an image of each of a plurality of documents arranged in the predetermined range by imaging a predetermined range, and the plurality of documents. When there are a plurality of documents to be rearranged that are partially overlapped when imaged by the imaging means, the appropriate documents other than the plurality of documents to be rearranged among the plurality of documents are removed. A notification means for notifying the user to rearrange the plurality of repositioned originals so as not to overlap each other and for the imaging means to take an image, and an output for outputting an appropriate image of the appropriate original among the images. Means and.

According to the present invention, the user can proceed with the work of scanning a plurality of original documents more efficiently than before.

It is a figure which shows the schematic structure of the image forming apparatus which concerns on one Embodiment of this invention. It is a figure which shows the example of the hardware composition of the image forming apparatus. It is a figure which shows the example of the functional configuration related to the batch scan operation in an image forming apparatus. It is a figure which shows an example of document overlap. It is a flowchart which shows the outline flow of a batch scan operation. It is a flowchart which shows the example of the flow of the original image detection processing. It is a figure which shows typically the document image detection processing. It is a flowchart which shows the example of the flow of the document overlap detection processing in FIG. It is a flowchart which shows the example of the flow of the holding / notification processing in FIG. It is a figure which shows the example of the screen which notifies that the document overlap has occurred. It is a figure which shows the relationship of the orientation of the original image in a scanned image, and the original in a platen glass. It is a figure which shows the example of the capture in the individual capture mode. It is a figure which shows the example of the flow of the image import process which is executed when there is overlap of documents in FIG. It is a figure which shows another example of the capture in the individual capture mode. It is a figure which shows the example of the import in the batch import mode. It is a figure which shows another example of the flow of the image import process which is executed when there is overlap of documents in FIG. It is a figure which shows another example of the flow of the document overlap detection processing in FIG.

FIG. 1 is a diagram showing a schematic configuration of an image forming apparatus 1 according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of the hardware configuration of the image forming apparatus 1. FIG. 3 is a diagram showing an example of a functional configuration related to a batch scan operation in the image forming apparatus 1. FIG. 4 is a diagram showing an example of overlapping documents.

The image forming apparatus 1 shown in FIGS. 1 and 2 is an apparatus generally called an MFP (Multi-functional Peripheral) or a multifunction device, and integrates functions such as copying, PC printing, fax, scanner, and document server. It is a device. The image forming apparatus 1 can operate as an image reading apparatus for reading an image from a document.

The PC print function is a function of receiving image data from a terminal device such as a personal computer and printing the image on a sheet. It is also called "network printer function" or "network printing function".

The document server function is a function of providing and managing a storage area called a "personal box" or "box" for each user, which corresponds to a folder or directory in a personal computer. Sometimes called "box function". The user can save image data and the like in a file unit in his / her own box.

The image forming apparatus 1 includes a CPU (Central Processing Unit) 10a, a RAM (Random Access Memory) 10b, a ROM (Read Only Memory) 10c, a large-capacity storage device 10d, a scanning unit 10e, a printing unit 10f, a network interface 10g, and an operation panel. It is composed of 10h, a facsimile unit 10i, an image processing circuit 10j, an automatic document feeder 10k, and the like.

The CPU 10a is a control unit that performs overall control of the image forming apparatus 1.

Software such as an operating system and middleware for realizing the above-mentioned functions such as copying and scanner is installed in the ROM 10c or the large-capacity storage device 10d. In particular, in the present embodiment, the batch scan program 10P (see FIG. 3) for realizing the batch scan operation is installed. The batch scan operation is an operation in which images of a plurality of originals are collectively read by the scan unit 10e and stored as one image file or a plurality of image files for each original.

The software modules constituting these software are loaded into the RAM 10b as needed and executed by the CPU 10a. As the large-capacity storage device 10d, a non-volatile storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) is used.

The network interface 10g communicates with an external device via a communication line using a protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol). As the network interface 10g, for example, a NIC (Network Interface Card) is used.

The operation panel 10h is composed of a key input unit 10h1, a touch panel display 10h2, an auxiliary power switch 10h3, and the like.

The key input unit 10h1 is a panel on which hardware keys are arranged, and has a stop key, a numeric keypad, a function key, and the like together with a start key 10h4.

The touch panel display 10h2 has a screen for giving a message or instruction to the user, a screen for inputting the type and processing conditions of the process desired by the user, a screen showing the result of the process executed by the CPU 10a or the like, and the like. Is displayed. The user can input information and commands to the image forming apparatus 1 by operating the key input unit 10h1 or the touch panel display 10h2 while looking at these screens.

The auxiliary power switch 10h3 is a switch for instructing the image forming apparatus 1 to shift to a power saving mode such as a sleep mode.

The automatic document feeder 10k is an ADF (Auto Document Feeder) that conveys the documents set in the document paper feed tray one by one to the reading position of the scan unit 10e, and ejects the documents after the documents are read by the scan unit 10e. Discharge the document to the paper tray.

Further, the automatic document feeder 10k includes a document set sensor 10k1. The document set sensor 10k1 detects that the document has been set by a known tact switch and notifies the CPU 10a.

Further, the automatic document feeder 10k is provided so as to be able to rotate around a rotation axis on the back side to open and close in order to cover or expose the platen glass 10e2 (document base glass) of the scan unit 10e. There is. The user can use the automatic document feeder 10k as the document cover 10k2 that holds the document and serves as the background (white background) around the document when it is read by the scan unit 10e.

The scan unit 10e is a flatbed type image scanner that captures an image of a document placed on the upper surface of the platen glass 10e2. A line sensor for the main scan and a slider for moving in the sub-scan direction are provided on the lower side of the platen glass 10e2. The method of imaging by the line sensor may be a reduced projection method or a close contact method. In the reduced projection method, the slider is provided with a light source and a mirror that guides the reflected light from the document to the line sensor.

The scan unit 10e optically reads an image consisting of photographs, characters, pictures, charts, etc. written on a manuscript sheet, a book, or other printed matter placed on the platen glass 10e2 to read image data. Generate. Hereinafter, this image data may be referred to as "scan data".

The scan unit 10e includes a device lifting sensor 10e1. The device lifting sensor 10e1 detects that the automatic document feeder 10k has been lifted and returned, that is, the document cover 10k2 has been opened and returned to the closed state by a known magnetic sensor. , Notifies the CPU 10a.

The image processing circuit 10j performs processing related to the characteristics of the reading optical system, such as shading correction and chromatic aberration correction, on the scan data received from the scan unit 10e. Furthermore, it is in charge of part or all of the data output processing such as generation of raster data for printing and generation of compressed data for storage. The image processing circuit 10j is configured to include hardware for performing the processing in charge at a higher speed than when the processing is performed only by software. The image processing circuit 10j can be configured by an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like.

The facsimile unit 10i is a device for exchanging image data with a fax terminal via a public telephone line by a protocol such as G3.

In addition to the image read by the scan unit 10e, the print unit 10f prints an image shown in the image data received from an external information processing device, a fax terminal, or the like on the sheet.

The printing unit 10f is composed of an image forming unit 11, an automatic double-sided unit 12, a paper feeding unit 13, a paper feeding cabinet 14, and the like.

The image forming unit 11 is an electrophotographic tandem color printer engine, and includes photoconductor drums 31a, 31b, 31c, 31d, an exposure scanning unit 32a, 32b, 32c, 32d, a transfer belt 33, and a front door sensor. It is composed of 34 and the like.

The photoconductor drums 31a to 31d are photoconductor drums corresponding to yellow, magenta, cyan, and black, respectively. Similarly, the exposure scanning units 32a to 32d are exposure scanning units corresponding to yellow, magenta, cyan, and black, respectively.

Each of the exposure scanning units 32a to 32d creates an electrostatic latent image on the photoconductor drums 31a to 31d by exposing the image to be printed based on the signal from the CPU 10a. By adhering the toner of each color to the photoconductor drums 31a to 31d, the electrostatic latent image is visualized in the toner image.

Toner images of each color formed on the photoconductor drums 31a to 31d are superimposed on the transfer belt 33. As a result, a full-color toner image is formed on the transfer belt 33.

The front door sensor 34 detects that the front door cover has been opened by a known tact switch, and notifies the CPU 10a.

The paper feed unit 13 is a unit for supplying a sheet to the image forming unit 11 which is provided as standard in the image forming apparatus 1. The paper feed unit 13 is composed of one or more paper feed cassettes 13a, a pickup roller 13b, and the like. Paper is stored in the paper cassette 13a. The pickup roller 13b picks up the sheets one by one from the paper feed cassette 13a and carries them out to the image forming unit 11.

The paper feed cabinet 14 is a unit that supplies sheets to the image forming unit 11 like the paper feeding unit 13, but is provided as an option in the image forming apparatus 1. The sheet sent out from the paper feed cassette 14a of the paper feed cabinet 14 by the pickup roller 14b is supplied to the image forming unit 11 via the paper feed unit 13.

Then, the toner image formed on the transfer belt 33 is transferred to the sheet carried out from the paper feed unit 13 or the paper feed cabinet 14.

The automatic double-sided unit 12 reverses the front and back of the sheet on which the image is printed on one side, switches back once on the paper passing path, and feeds the image to the image forming unit 11 again. This enables double-sided printing.

As shown in FIG. 3, according to the batch scan program 10P, the image forming apparatus 1 has functions such as a document image detection unit 101, a document overlap detection unit 102, a holding processing unit 103, a document overlap notification unit 104, and an image output unit 105. Will be realized. When the batch scan program 10P is executed by the CPU 10a, the RAM 10b is used as a work area.

With reference to FIGS. 3 and 4, the CPU 10a instructs the scan unit 10e to read the document when the scan instruction 3 by the user is input via the operation panel 10h. When this command is given, the scan unit 10e scans the reading target area 92 on the platen glass 10e2 to generate scan data 4. The scanning target area 92 is determined based on the reading size specified by the user or the detection result by the document size sensor. Basically, the scanning target area 92 is the smallest rectangular area including all the originals 20 (20a, 20b, 20c) arranged with the starting point 91 of the main scan and the sub scan as the apex.

The scan data 4 is subjected to necessary processing determined by the mode among image processing such as shading correction, tilt correction, trimming, and compression. The scan data 4 is converted into a file and stored as an image file 5 in the large-capacity storage device 10d. After that, the image file 5 may be continuously stored (that is, stored) in the large-capacity storage device 10d, or may be immediately read out and transferred to an external personal computer or the like.

In the following, it is described as "importing" that all or part of the stored scan data 4 is converted into a file when a predetermined condition is satisfied and stored as an image file 5 in the large-capacity storage device 10d. Taking in is expressed as "taking in".

By the way, the user of the image forming apparatus 1 arranges a plurality of sheet-shaped documents 20a to 20c on the platen glass 10e2, and causes the image forming apparatus 1 to read the images of these documents 20a to 20c all at once and convert them into data. You can copy it. For example, there are cases where images of a large number of sheets having various small sizes or sizes that cannot be conveyed by the automatic document feeder 10k, such as shopping receipts, tickets, or photographs, are collectively converted into data. By arranging and reading a plurality of sheets at a time, the number of steps for data conversion is reduced as compared with the case where only one sheet is arranged and read. You can also finish the work early. The same applies to copying.

In the present embodiment, the image forming apparatus 1 has a "batch import mode" as a unit for importing the scanning target area 92 and an "individual import mode" as a unit for importing individual documents. It is configured for the user to select these modes. When three originals 20a to 20c are arranged as in the example of FIG. 4A, one image file 5 is generated in the batch import mode, and three image files 5 are generated in the individual import mode. File.

However, in both the batch import mode and the individual import mode, in order to improve the accuracy of discrimination between the documents 20a to 20c by the image forming apparatus 1 and its surroundings, it is recommended to close the document cover 10k2 after arranging the documents 20a to 20c. preferable.

However, if the documents 20a to 20c are curved or bent, the documents 20a to 20c are pushed by the document cover 10k2 and flattened when the document cover 10k2 is closed, so that the documents 20 partially overlap each other. "Overlapping documents" may occur.

Further, in the state where the document cover 10k2 is opened, even if the documents 20a to 20c are lined up without overlapping, the documents 20a to 20c move due to the air flow generated between the document cover 10k2 and the platen glass 10e2 when the document cover 10k2 is closed. Overlapping of documents may occur. In the example of FIG. 4B, there is a document overlap in which the document 20a and the document 20b overlap. Since the document cover 10k2 rotates about the rotation axis on the back side as described above, an air flow that moves the documents 20a to 20c from the back side to the front side is generated.

When the originals overlap, the image of the overlapping portion of the upper original 20 (the original 20b in the example of FIG. 4B) of the plurality of overlapping originals 20 cannot be read, and the data conversion is incomplete. Become. Even if the user opens the document cover 10k2 and corrects the arrangement of the documents 20a to 20c, the document overlap may occur again when the document cover 10k2 is closed. Therefore, a situation may occur in which the user is forced to correct the arrangement of the documents 20a to 20c many times simply by warning the user that the documents have overlapped as in the conventional case.

Therefore, the image forming apparatus 1 performs the following processing to improve the usability of the image forming apparatus 1 when reading the images of a plurality of originals at the same time.

FIG. 5 is a flowchart showing a schematic flow of the batch scan operation. FIG. 6 is a flowchart showing an example of the flow of the original image detection process. FIG. 7 is a diagram schematically showing the original image detection process.

In FIG. 5, when the scanner function is selected by the user using the operation panel 10h, the document size and resolution are specified as necessary, and then the start key 10h4 is pressed, the scanning unit 10e is subjected to the scanning target area. Scan 92 (# 201). The scan unit 10e generates scan data 4 showing a scan image 40 (40a in FIG. 7) in which the entire reading target area 92 is read by scanning.

Based on the scan data 4, the document image detection unit 101 detects the document image 42, which is the portion of the scan image 40 in which the document is captured, by the following procedure (# 202).

With reference to FIGS. 6 and 7, the document image detection unit 101 detects a white background level (first background level) L41 and a document background level (second background level) L42 in the scanned image 40a (FIG. 6). 6 # 221 and # 222). The white background level L41 is the brightness level of the background image 41 that is not the original image 42 (42a, 42b, 42c) of the scanned images 40a. The document background level L42 is the brightness level of the background portion of each of the document images 42a to 42c.

Specifically, when the pixel value (brightness) when the white background of the document cover 10k2 is read is stored in advance, the pixel value is set to the white background level L41. If the pixel value when the white background is read is not stored, the frequency distribution (histogram) of the pixel value of the scanned image 40a is obtained, and the pixel value having the highest frequency within a predetermined pixel value range on the bright side is used as the white background. The background level is L41.

Regarding the document background level L42, in the frequency distribution of the pixel values of the scanned image 40a, the pixel value having a large frequency within the (dark) pixel value range lower than the white background level L41 by a predetermined value is defined as the document background level L42.

As shown in FIG. 7B, the document image detection unit 101 sets the pixel value between the white background level L41 and the document background level L42 to the threshold value Lth, and sets the scanned image 40a to the threshold value Lth. A binarized image divided into a bright white area and a black area darker than the threshold Lth is generated. Then, the black region is extracted from the binarized image (# 223). Alternatively, only the pixels whose pixel values are the document base level L42 or less are extracted from the scanned image 40a. Performing such extraction will detect the original images 42a to 42c.

After detecting the original images 42a to 42c, the original image detection unit 101 extracts the contours 43 (43ab, 43c) of the original images 42a to 42c by using a known edge detection method, and the pixel corresponding to the contour 43. The position information indicating the position is notified to the document overlap detection unit 102 (# 224).

Returning to FIG. 5, the document overlap detection unit 102 detects the document overlap based on the contours 43ab and 43c extracted by the document image detection unit 101 (# 203). The detection method will be described later.

Further, the document overlap detection unit 102 discriminates the document images 42a to 42c detected in the document image detection process of step # 202 into a proper image 421 and an inappropriate image 422. The proper image 421 is an image of a manuscript in which no part overlaps with any other manuscript. The improper image 422 is a manuscript image 42 that is not the proper image 421. The improper image 422 is composed of an image of the lowest original among a plurality of overlapping originals and an image of a portion of a non-bottom original that does not overlap with other originals. In the scanned image 40a of the example of FIG. 7A, the original image 42c is determined to be the proper image 421, and the original images 42a and 42b are determined to be the inappropriate images 422.

The holding processing unit 103 holds the proper image 421 (# 205) when the document overlap detecting unit 102 detects the document overlap (YES in # 204). Specifically, the position information (coordinates or pixel numbers) of the appropriate image 421 in the scanned image 40a is associated with the scanned image 40a and stored in the appropriate image holding unit 106. Alternatively, the pixel values of all the pixels of the proper image 421 are stored together with the pixel numbers. The appropriate image holding unit 106 is a storage area provided for holding the appropriate image 421 in the RAM 10b, the memory in the image processing circuit 10j, or the large-capacity storage device 10d.

Further, in step # 205, the document overlap notification unit 104 notifies the user that the document overlap has occurred, thereby prompting the user to rearrange (rearrange) the documents.

In the present embodiment, the following two modes are assumed for rearranging the manuscript.
(A1): Remove the non-overlapping documents and change the arrangement of the overlapping documents so that they do not overlap.
(A2): Perform (A1) and place another original in the vacant area (space) by removing the non-overlapping originals.

It should be noted that the user can also perform a general rearrangement that is conventionally performed, that is, a rearrangement in a mode (A3) in which all the originals are rearranged so as not to overlap without removing the non-overlapping originals.

When the user rearranges the documents and presses the start key 10h4 again, the scan unit 10e scans (rescans) the scanning target area 92 again to generate scan data 4. Based on the scan data 4, the original image is detected, the original overlap is detected, and the like, as in the previous scan.

Then, when the original overlap is not detected, the image output unit 105 captures the proper image 421 held during the previous scan and the original image 42 of the scanned image 40 obtained by the current rescan. (# 206). When the original overlap is detected, the user is notified again to relocate the originals. However, if there is a proper image 421 in the scanned image 40 by rescanning, the holding processing unit 103 holds the proper image 421.

On the other hand, if no document overlap is detected in the scanned image 40 obtained by the first scanning (NO in # 204), the scanned image 40 is captured by the image output unit 105 (# 207). At this time, in the batch import mode, one image file 5 showing the entire scanned image 40 is stored. In the individual capture mode, an image file 5 showing each of the plurality of original images included in the scanned image 40 is stored.

Hereinafter, the processes from step # 203 to step # 206 will be described in more detail.

FIG. 8 is a flowchart showing an example of the flow of the document overlap detection process in FIG. FIG. 9 is a flowchart showing an example of the flow of the holding / notification process in FIG. FIG. 10 is a diagram showing an example of screens 81 and 81b for notifying that document overlap has occurred. FIG. 11 is a diagram showing the orientation relationship between the original images 42d and 42e in the scanned image 40b and the originals 20d and 20e in the platen glass 10e2.

As shown in FIG. 8, the document overlap detection unit 102 acquires information for identifying the contours 43ab and 43c from the document image detection unit 101 (# 231). Next, pay attention to the contour specified by the acquired information, that is, one of the contours 43ab and 43c, identify the inflection point at which the line constituting the focused contour 43 bends at a right angle, and determine the number and coordinates thereof. It is determined (# 232) and whether or not the shape of the contour 43 of interest is a rectangle (quadrangle) which is a general document shape (# 233). Specifically, when the number of inflection points (vertices) is 4, it is determined that it is a rectangle, and when it is other than 4, it is determined that it is not a rectangle.

When the document overlap detection unit 102 determines that the image is rectangular (YES in # 233), the document overlap detection unit 102 determines that the document image 42 included in the contour 43 of interest is a proper image 421 (# 234). When the coordinate value X (or Y) of one of the vertices in the rectangular contour 43 is the same as the coordinate value X (or Y) of any of the other vertices, the contour 43 of interest is relative to the coordinate axes. It will not be tilted.

On the other hand, when the document overlap detection unit 102 determines that the contour 43 of interest is not rectangular (NO in # 233), the document overlap detection unit 102 determines that the document image 42 included in the contour 43 of interest is an inappropriate image 422 (#). 235).

The document overlap detection unit 102 checks whether or not all contours 43 have been paid attention to (# 236), and if not all contours 43 have been paid attention (NO in # 236), returns to step # 232 and pays attention. Pay attention to one of the contours 43 that are not. The document overlap detection unit 102 determines in all contours 43 whether the document area 42 included in each is a proper image 421 or an inappropriate image 422 (YES in # 236), and steps # 232 to # 232. The process of step # 236 is repeated.

As shown in FIG. 9, the holding processing unit 103 pays attention to one of the document images 42 detected by the document image detection unit 101, and acquires the result of determination by the document overlap detection unit 102 for the focused document image 42. (# 241).

When the result of the determination is not the improper image 422 (NO in # 242), that is, the proper image 421, the original image 42 of interest is stored by being stored in the appropriate image holding unit 106 (# 243).

On the other hand, when the result of the determination is an inappropriate image 422, it is determined not to hold the focused manuscript image 42 (# 244), and the focused manuscript image 42 is not held as determined.

The holding processing unit 103 checks whether or not all the original image 42 detected by the original image detecting unit 101 has been processed (# 245), and if all the original images 42 have not been processed (# 245). NO at 245), return to step # 241 and focus on one of the manuscript images 42 that has not been noticed. The holding processing unit 103 repeats the processing from step # 241 to step # 245 until the processing for all the original images 42 is completed (YES in # 245).

The document overlap notification unit 104 displays the screen 81 shown in FIG. 10A, for example, on the touch panel display 10h2 when there is even one document area 42 determined not to be held by the holding processing unit 103 (YES in # 246). Notifies the user that the document overlap has occurred (# 247).

The screen 81 has a message 810, a yes button 811 and a no button 812. The message 810 is composed of a sentence notifying that the manuscripts are overlapped and a sentence implicitly prompting the user to rearrange the manuscripts by asking the user whether or not to rearrange the manuscripts. The Yes button 811 is a button for inputting an intention to relocate, and the No button 812 is a button for inputting an intention not to relocate.

When the user touches the Yes button 811 on the screen 81, the document overlap notification unit 104 causes the screen 82 to be displayed on the touch panel display 10h2 instead of the screen 81. The screen 82 has a message 820, a yes button 821, and a no button 822.

The message 820 is a sentence asking the user whether or not he / she wants to save the image of the original without overlapping. By displaying this message 820, the user is asked to determine whether or not it is necessary to retain the proper image 421.

The Yes button 821 is a button for inputting that the user wants to save, and the No button 822 is a button for inputting that the user does not want to save. When the no button 822 is touched, for example, when the user wants to correct the arrangement of a plurality of overlapping originals (manuscripts to be rearranged) without removing the non-overlapping originals, that is, the above-described embodiment ( You may want to relocate A3).

When the user touches the Yes button 821 on the screen 82, the document overlap notification unit 104 causes the screen 83 to be displayed on the touch panel display 10h2 instead of the screen 82.

The screen 83 has a message 830 and a confirmation button 831. The message 830 is a sentence that requests the rearrangement of the manuscript 20 and guides the operation when the rearrangement is completed. The confirmation button 831 is a so-called OK button for inputting that the rearrangement is completed. The user slowly opens the document cover 10k2 so that the arrangement of the documents 20 does not change as much as possible, removes the non-overlapping documents 20 and rearranges the overlapping plurality of documents 20 so as not to overlap. Then, the document cover 10k2 is closed and the confirmation button 831 is touched. When the document cover 10k2 is opened and closed and the confirmation button 831 is touched, the image forming apparatus 1 accepts the press of the start key 10h4. When the user presses the start key 10h4, the scan unit 10e scans (rescans) the read target area 92.

When the press of the start key 10h4 is accepted, the document overlap notification unit 104 causes the touch panel display 10h2 to display a screen having a message prompting the user to press the start key 10h4 instead of the message 830 on the screen 83.

By the way, in order to encourage the user to rearrange the document 20, the screen 81b shown in FIG. 10B may be displayed instead of the screen 81. The screen 81b is a screen in which the message 810 of the screen 81 is replaced with the message 810b.

The message 810b is a sentence indicating the approximate position of the overlapping documents 20 at the time of imaging and requesting the user to rearrange the documents 20.

In showing the positions of the overlapping documents 20, as shown in FIG. 11, the scanned image 40b may be divided into four sections, for example, top, bottom, left, and right, and the positions of the sections mainly occupied by the improper image 422 may be shown. In the illustrated example, the original images 42d and 42e, which are inappropriate images 422, are present in the upper left of the scanned image 40b.

It should be noted that the arrangement of the original images 42d and 42e in the scanned image 40b and the arrangement of the originals 20d and 20e when the platen glass 10e2 is viewed from above are in an inverted relationship. In the example of FIG. 11, the sub-scanning direction M2 is the same direction, but the main scanning direction M1 is upward in the scanned image 40b, whereas it is downward in the platen glass 10e2. Therefore, the documents 20d and 20e corresponding to the document images 42d and 42e are arranged at the lower left of the platen glass 10e2. Therefore, the message 810b on the screen 81b is a sentence informing that the "lower left side" documents are overlapped.

FIG. 12 is a diagram showing an example of capture in the individual capture mode. FIG. 13 is a flowchart showing an example of a flow of image capture processing executed when there is an overlap of documents in FIG.

In FIG. 12, the scanned image 40b is obtained at the time of the first (first) scanning. The scanned image 40b has original images 42d, 42e, 42f, 42g, 42h, 42i. Of these original images 42d to 42i, the original images 42f to 42i are determined to be proper images 421 and are retained. The original images 42d and 42e are determined to be inappropriate images 422 and are therefore not retained.

The user is notified that the documents overlap, and the documents are rearranged. At that time, the originals corresponding to the original images 42f to 42i are removed, and the two originals corresponding to the original images 42d and 42e are arranged so as not to overlap each other. That is, the rearrangement of the above-described aspect (A1) is performed.

A scan image 40c is obtained by rescanning performed after the rearrangement. The scanned image 40c has original images 42j and 42k. These manuscript images 42j and 42k are proper images 421.

The original images 42f, 42g, 42h, and 42i held during the first scanning are stored as image files 5f, 5g, 5h, and 5i, respectively.

Further, the original images 42j and 42k obtained by rescanning are stored as image files 5j and 5k, respectively.

Next, the flow of processing after the rescanning in the image forming apparatus 1 that performs such an operation will be described with reference to the flowchart of FIG.

The image forming apparatus 1 checks the button touched by the user on the screen 81 (or 81b) (# 251). When the Yes button 811 is touched, the screen 82 is displayed as a save inquiry (# 252).

Then, when the yes button 821 is touched by the user on the screen 82, the image forming apparatus 1 prompts the user to relocate by displaying the screen 83 (# 255). If the No button 821 is touched on the screen 82, the process ends without importing. In this case, when the process is completed, the address area used for holding the proper image 421 may be released by the proper image holding unit 106.

On the other hand, when the result of the check in step # 251 is the No button 812, the image forming apparatus 1 scans a state in which the proper image 421 and the improper image 422 are mixed without being rearranged. Image 40 is captured (# 253). That is, the individual capture mode is canceled, and the entire scanned image 40 is converted into a file and stored in the large-capacity storage device 10d.

When the screen 83 is displayed in step # 255 and then rescanned, the image forming apparatus 1 acquires the scan data 4 by the rescanning (# 256) and detects the document overlap (# 257).

The image forming apparatus 1 trims the original images 42j and 42k from the scanned image 40c this time when the originals do not overlap (NO in # 258), that is, when the overlapping of the originals 20 is eliminated by rearrangement (NO). # 261), each is imported as one image file 5 (# 262). Subsequently, the image forming apparatus 1 trims each of the original images 42f to 42i held during the previous scanning from the previous scanned image 40b (# 263), and captures each as one image file 5 (# 264).

On the other hand, if there is document overlap (YES in # 258), the image forming apparatus 1 holds the proper image 421 if it exists (# 259), and then displays the screen 83 for further rearrangement. Prompt the user (# 260). In this case, the flow returns from step # 260 to step # 256.

FIG. 14 is a diagram showing another example of capture in the individual capture mode.

FIG. 14A shows an example of the scanned image 40d obtained by rescanning after the rearrangement of the aspect (A2) described above is performed. The scanned image 40d has the original images 42p, 42q, 42r, 42s, 42t in addition to the original images 42j and 42k similar to the scanned image 40c of FIG. These manuscript images 42j, 42k, 42p to 42t are all proper images 421.

The original images 42j and 42k, which were inappropriate images 422 at the time of the first scanning, became proper images 421 due to the rearrangement of the original 20.

The original images 42p to 42t are images of the originals arranged on the platen glass 10e2 for the first time in the rearrangement prior to the current rescanning.

As shown in FIG. 14B, for the scanned image 40b obtained by the first scanning, the original images 42f to 42i are stored as image files 5f to 5i, respectively, as in the example of FIG.

For the scanned image 40d by the rescanning this time, the original images 42j, 42k, 42p, 42q, 42r, 42s, and 42t are stored as image files 5j, 5k, 5p, 5q, 5r, 5s, and 5t, respectively.

FIG. 15 is a diagram showing an example of capture in the batch capture mode. FIG. 16 is a flowchart showing another example of the flow of the image acquisition process executed when the documents overlap in FIG.

In FIG. 15, it is the same as the example of FIG. 12 that the original images 42f to 42i of the scanned images 40b by the first scanning are retained and that the scanned images 40c by the rescanning have the original images 42j and 42k. is there. The differences from the example of FIG. 12 are as follows.

In the example of FIG. 15, after the rescanning, it is checked whether or not the original images 42j and 42k of the scanned image 40c and the original images 42f to 42i held at the time of the first scanning overlap. That is, it is checked whether or not the original images 42j and 42k and the original images 42f to 42i can all be arranged in the reading target area 92. Then, when they do not overlap, one aggregated image 40e in which the original images 42j and 42k and the original images 42f to 42i are lined up is generated, and the aggregated image 40e is captured as one image file 5e.

The aggregated image 40e is an image obtained by synthesizing the scanned image 40b and the scanned image 40c after setting the pixel values other than the original images 42f to 42i and the pixel values other than the original images 42j and 42k to the white background level L41, respectively. It can be generated by processing. Alternatively, the original images 42f to 42i, 42j, 42k may be trimmed from the scanned images 40b and 40c and generated by image processing in which they are arranged at predetermined intervals.

The aggregated image (composite image) 40e is an image equivalent to the scanned image 40 that would have been obtained if the originals did not overlap during the first scan. The user can obtain a reading result as if the originals corresponding to the original images 42f to 42i were removed at the time of rearrangement, but the originals were not removed.

Next, the flow of processing after the rescanning in the image forming apparatus 1 that performs such an operation will be described with reference to the flowchart of FIG.

The processing of steps # 271 to # 278, the processing of step # 279, and the processing of step # 280 are the processing of processing steps # 259 and step # 260 from step # 251 to step # 258 in FIG. Is similar to.

The image forming apparatus 1 determines whether or not the previously held original images 42f to 42i overlap with the original images 42j and 42k obtained by rescanning when there is no original overlap (NO in # 278). (# 281). Specifically, it is determined that overlap occurs when the coordinates of any pixel of the original images 42f to 42i and the coordinates of any pixel of the original images 42j or 42k match, and no overlap occurs in other cases. Is determined.

When it is determined that no overlap occurs (NO in # 282), the original images 42j and 42k and the original images 42f to 42i are arranged side by side to generate and capture the aggregated image 40e (# 283).

If it is determined that overlap occurs (YES in # 282), it is checked whether individual import is permitted (# 284). For example, individual import is permitted when individual import is permitted in advance in such a case, or when a screen for inquiring the user is displayed and permission is obtained.

If individual import is permitted (YES in # 284), the original images 42j, 42k and the original images 42f to 42i are individually imported as image files 5j, 5k, 5f to 5i (# 285). If individual capture is not allowed (NO at # 284), return to step # 280 and prompt the user to relocate.

FIG. 17 is a flowchart showing another example of the flow of the document overlap detection process in FIG.

Next, a modified example of the document overlap detection process will be described with reference to FIG. In the example of FIG. 8, the original overlap is detected based on the shape of the contour 43 of the original image 42, but in the modified example of FIG. 17, the original overlap is detected based on the number of the originals 20 and the number of the original images 42.

The document overlap detection unit 102 acquires the number (number of sheets) of documents 20 input by the user (# 291). In this modification, the user inputs the number of documents 20 before or after arranging the documents 20 on the platen glass 10e2, and then presses the start key 10h4 to start scanning.

The document overlap detection unit 102 counts the number of document images 42 detected by the document image detection unit 101 (# 292). Then, when the number of documents 20 and the number of document images 42 are equal (match) (YES in # 293), it is determined that there is no document overlap (# 294).

On the other hand, if the number of manuscripts 20 and the number of manuscript images 42 are not equal (do not match) (NO in # 293), it is determined that there is document overlap (# 295). Then, in cooperation with the document overlap notification unit 104, the scanned image 40 and a message requesting the user to discriminate the document image 42 are displayed on the touch panel display 10h2 (# 296). Specifically, on the screen for displaying the scanned image 40, the user is asked to touch the original image 42, which is determined by the user to be an image of a plurality of overlapping originals 20. Alternatively, the user is asked to touch the original image 42, which is determined to be an image of a single original 20 that does not overlap.

When the user touches the completion button for inputting the completion of discrimination, the document overlap detection unit 102 sets the original image 42 as a proper image 421 and an inappropriate image based on the result of the discrimination of the original image 42 performed by the user. It is determined to be 422 (# 297). For example, when the user touches the original image 42 that is determined to be an image of a plurality of overlapping originals 20, the touched original image 42 is determined to be an inappropriate image 422, and the untouched original image 42 is determined. 42 is determined to be a proper image 421.

When the number of detected original images 42 is 1, the user can omit the determination of the original image 42 and determine the original image 42 as an inappropriate image 422.

According to the above embodiment, the proper image 421 is retained when the originals overlap, so that even if the user removes the non-overlapping original 20 from the platen glass 10e2, the reading of the proper image 421 is not wasted. .. Therefore, the user can remove the non-overlapping documents 20 without hesitation and rearrange the overlapping documents 20 so as not to overlap. By removing the non-overlapping originals 20, the number of originals 20 to be arranged is reduced, so that the originals are less likely to overlap again when the original cover 10k2 is closed. Since the number of re-arrangements is reduced, the user can proceed with the work of scanning a plurality of documents more efficiently than before.

Further, in the individual import mode, there is no problem even if the originals 20 are rearranged using the vacant space by removing the non-overlapping originals 20, so a sufficient space is provided so that the originals do not overlap with each other. It will be easier than before to relocate.

Further, since the proper image 421 is retained, the non-overlapping document 20 can be removed and a new document can be placed in the vacant space. That is, when only a part of the arranged plurality of originals overlaps, only the overlapped originals 20 can be left, and new originals 20 can be arranged one after another to proceed with the reading operation. Eliminates the waste of repeatedly reading non-overlapping documents 20. In particular, when scanning a large number of documents 20 that cannot be arranged at one time, the scanning operation can be made more efficient.

In the embodiment described above, when the image output unit 105 captures the appropriate image 421 held by the holding processing unit 103 and the appropriate image 421 obtained by rescanning as individual images, these appropriate images 421 You can make it clear that they are related. For example, the file name can include a common character string. One folder can be generated for these appropriate images 421, and the image file 5 can be stored in this folder. Further, for example, a file of a multi-page document in which a plurality of appropriate images 421 are arranged one by one on one page, such as a PDF (Portable Document Format) file, can be imported.

The image output unit 105 can capture the appropriate image 421 (output to the large-capacity storage device 10d) at any time in the individual capture mode. For example, when the original image 42 is determined to be the proper image 421, the original image 42 may be captured immediately.

In the embodiment described above, when the aggregated image 40e is output, the image output unit 105 trims the appropriate images 421 from the plurality of scanned images 40b and 40c, corrects the inclination, and further establishes a predetermined interval. The image processing circuit 10j is made to perform the process of arranging the images. As a result, the user can obtain the aggregated image 40e in which the document images 42 are arranged in an orderly manner without having to pay attention to the tilt when arranging the document 20.

Further, when the image output unit 105 outputs the aggregated image 40e by compositing, when the retained proper image 421 overlaps with the proper image 421 due to rescanning, the position of the proper image 421 so as to eliminate the overlap. Is made to perform the process of shifting the image processing circuit 10j. In this case, in FIG. 16, step # 284 and step # 285 are omitted, and the image output unit 105 causes the image processing circuit 10j to perform composition when YES in step # 282, and the obtained aggregated image 40e Should be taken in.

In the embodiment described above, the screen 81 is displayed in step # 205 of FIG. 5 to notify the user that the document overlaps, but the step of notifying the user that the document overlaps is performed after step # 203. It may be provided. In this case, the holding processing unit 103 holds the proper image 421 when the yes button 811 is touched on the screen 81 and the yes button 821 is touched on the screen 82. As a result, unlike the case where the proper image 421 is held before the screen 82 is displayed, the no button 822 is touched on the screen 82, and as a result, the holding of the proper image 421 is wasted. Absent. If the No button 812 is touched on the screen 81, step # 204 is skipped and step # 208 is performed to capture the scanned image 40. If the Yes button 811 is touched on the screen 81 and the No button 821 is touched on the screen 82, the process returns to step # 201 to perform scanning again.

In the embodiment described above, as the document cover 10k2 covering the platen glass 10e2, a plate or sheet having a white ground on the lower surface may be provided instead of the automatic document feeder 10k.

Although the image forming apparatus 1 is mentioned as an example of the image reading apparatus, the image reading apparatus may not have the functions of copying, PC printing, faxing, and a document server.

When the contour 43 of the document area 42 is extracted and the document overlap is detected as shown in FIG. 7, the document overlap notification unit 104 displays the scanned image 40 on the touch panel display 10h2 in order to inform the user of the position of the overlapping documents. It may be displayed on. At that time, the front and back sides of the scanned image 40 are reversed so that the position of the document to be rearranged in the scanning target area 92 can be easily understood.

The method of notifying the user that the document overlap has occurred is not limited to the display of the messages 810 and 810b. For example, the error indicator lamp may be blinked or a warning sound may be emitted. It is possible to indicate in advance to the user, for example, an operation manual how to notify that the overlapping of documents has occurred and what to do when the notification is given.

In addition, the configuration of the entire or each part of the image forming apparatus 1, the content, order, or timing of processing, the configuration of screens 81 to 84, and the method of notifying the position of the inappropriate image 422 (or the appropriate image 421) are described in the present invention. It can be changed as appropriate according to the purpose of the invention.

1 Image forming device (image reading device)
10e scan unit (imaging means)
10e2 Platen glass (manuscript stand glass)
10k2 manuscript cover 20 manuscript 40 scanned image (range image)
41 Background image 42 Manuscript image (rearranged image)
43 Contour 92 Read target area (predetermined range)
101 Original image detection unit (imaging means)
102 Document overlap detection unit 103 Holding processing unit 104 Document overlap notification unit (notification means)
106 Image output unit (output means)
421 Appropriate image

Claims (9)

An imaging means for acquiring an image of each of a plurality of documents arranged in the predetermined range by imaging a predetermined range, and
When there are a plurality of documents to be rearranged that are partially overlapped when imaged by the imaging means among the plurality of documents, the plurality of documents to be rearranged among the plurality of documents are to be rearranged. A notification means for removing an appropriate original document other than the original document and rearranging the plurality of documents to be rearranged so as not to overlap each other and for notifying the user to have the imaging means take an image.
An output means for outputting an appropriate image of the appropriate original among the images, and
An image reader characterized by having. The notification means informs the user of the position when the plurality of repositioned originals are imaged in the predetermined range when the notification is given.
The image reading device according to claim 1. Further, when the plurality of repositioning target documents are rearranged in the predetermined range, the imaging means re-images the plurality of repositioning target documents, thereby causing the plurality of repositioning target documents. Get each rearranged image and
The output means further outputs the rearranged images of the plurality of repositioned originals when they do not overlap when the plurality of repositioned originals are re-imaged.
The image reading device according to claim 1 or 2. Further, when the plurality of repositioning target documents are rearranged in the predetermined range, the imaging means re-images the plurality of repositioning target documents, thereby causing the plurality of repositioning target documents. Get each rearranged image and
In the output means, the proper image and the rearranged image of each of the plurality of rearranged manuscripts are arranged side by side when the plurality of repositioned originals do not overlap when re-imaged. By outputting one aggregated image, the proper image is output.
The image reading device according to claim 1 or 2. As the aggregated image, the output means re-images the position when the proper image and the plurality of the rearranged images are captured in the predetermined range and the plurality of repositioned originals. Outputs images that are lined up with the same positional relationship as the position when they were created.
The image reading device according to claim 4. Further, when the plurality of repositioning target documents are rearranged in the predetermined range, the imaging means re-images the plurality of repositioning target documents, thereby causing the plurality of repositioning target documents. Get each rearranged image and
When the plurality of repositioned originals do not overlap when the plurality of repositioned originals are re-imaged, the output means provides the proper image and the relocated image of each of the plurality of repositioned originals according to the user's selection. Is output as an individual image, or the proper image is output by outputting one aggregated image in which the proper image and the rearranged image of each of the plurality of repositioned originals are arranged.
The image reading device according to claim 1 or 2. The platen glass having the predetermined range and
It has a document cover that covers the platen glass, and has
The imaging means acquires the image by a process of dividing a range image obtained by capturing the predetermined range into a background image of the document cover and other images.
The output means outputs an image having a rectangular outline as the appropriate image.
The image reading device according to any one of claims 1 to 6. It is an image reading method that reads the image of each of a plurality of documents by an image reading device.
The image reader
The image is acquired by imaging the plurality of documents arranged in a predetermined range, and the image is acquired.
When there are a plurality of documents to be rearranged that are partially overlapped when imaged in the plurality of documents, the appropriateness of the plurality of documents other than the plurality of documents to be rearranged is appropriate. A notification is given to the user to remove the original and reposition the plurality of originals to be rearranged so as not to overlap each other and instruct the user to read the originals.
Outputs the proper image of the proper original among the images.
An image reading method characterized by that. A computer program that is executed in an image reader that reads the images of each of multiple documents.
To the computer of the image reader
The process of acquiring the image is executed by imaging the plurality of originals arranged in a predetermined range.
When there are a plurality of documents to be rearranged that are partially overlapped when imaged in the plurality of documents, the appropriateness of the plurality of documents other than the plurality of documents to be rearranged is appropriate. A process of removing the originals and rearranging the plurality of originals to be rearranged so as not to overlap each other and instructing the user to read the originals is executed.
A process of outputting an appropriate image of the appropriate original among the images is executed.
A computer program characterized by that.

Images