JP7287547B2 - IMAGE INSPECTION APPARATUS, IMAGE INSPECTION PROGRAM, IMAGE INSPECTION SYSTEM AND IMAGE INSPECTION METHOD - Google Patents

Description

The present invention relates to an image inspection apparatus, an image inspection program, an image inspection system , and an image inspection method .

2. Description of the Related Art Conventionally, a sheet on which an image is formed (printed) by an image forming apparatus is inspected for image formation defects, such as whether an appropriate image is formed, whether there is dirt, and whether there is any misalignment of the image. The inspection is performed to confirm whether the image printed on the paper satisfies the quality intended by the creator (user) of the image forming data (for example, the document image). There are various inspection items such as print position, image smear, image rubbing, density unevenness, streaks, and gloss unevenness.

In the past, the user inspected the image printed on the paper by directly viewing it. However, when printing a large number of pages and a large number of copies, the user's visual inspection requires an extremely large number of man-hours and has limitations.

Therefore, an image inspection apparatus is used for image inspection, which inspects an image generated by reading an image formed on a sheet with a scanner or the like (hereinafter referred to as a "read image") for the presence or absence of image formation defects. was Some of these image inspection apparatuses have a function of displaying inspection results such as the presence or absence of image formation defects so that the user can check them. The displayed inspection results include information on the presence/absence of image formation defects, as well as information such as image information of the inspected paper.

For example, the inspection result indicates the location (position) of the image formation defect in the read image. However, when the user compares the inspection result with the data for image formation, the corresponding portion can be recognized, but the cause of the image formation defect may not be identified.

In view of this, Japanese Patent Laid-Open No. 2002-200001 discloses a technique for comparing a read image with a corresponding document image and printing a defect detection report on paper. In the defect detection report, a read image and a document image are formed on a sheet, and a detection result of image formation defect of the corresponding image is printed.

FIG. 1 is an explanatory diagram showing an example of the defect detection report 58. As shown in FIG.
The defect detection report 58 includes the normal image 51 and the defect detection image 52 printed on paper. The normal image 51 is generated from the document image, and the defect detection image 52 is generated from the read image of the image formation defect. The normal image 51 and the defect detection image 52 are generated at a reduced magnification with respect to the printed sizes of the original image and the read image. In addition, the defect detection image 52 includes a colored firefly 53 and a white streak 54 . Each defective portion is indicated by being surrounded by red circles 55 and 56 .

JP 2017-202627 A

However, the normal image 51 generated from the document image disclosed in Patent Document 1 is merely an ideal image. An image actually formed on a sheet by the image forming apparatus may differ from the document image due to various settings made to the image forming apparatus .

SUMMARY OF THE INVENTION An object of the present invention is to enable a user to easily recognize an abnormality contained in a read image.

An image inspection apparatus according to the present invention performs an inspection to determine whether a read image generated by reading a recording material on which an image is formed contains an abnormality, and controls the display of the read image on a display unit. When receiving a request from the user to display the read image determined to include an abnormality on the display unit, the control unit displays the read image determined to include an abnormality on the display unit, and performs a user operation. based on, controls to enlarge a part of the displayed read image and display it on the display unit. Control is performed so that an enlarged read image around the abnormal site including the performed site is displayed on the display unit, and the inspection executed by the control unit includes a plurality of types of inspection, and for a predetermined type of inspection, The display unit is controlled to display an inspection standard for the user to compare with the read image together with the read image determined to include an abnormality.

According to the present invention , a user can easily recognize an abnormality included in a read image.
The image inspection apparatus described above is one aspect of the present invention, and the image inspection program, image inspection system, and image inspection method reflecting one aspect of the present invention are also the image inspection apparatus reflecting one aspect of the present invention. has the same configuration as
Problems, configurations, and effects other than those described above will be clarified by the following description of the embodiments.

FIG. 10 is an explanatory diagram showing an example of a conventional defect detection report; 1 is a schematic diagram showing a schematic configuration example of an image forming apparatus according to an embodiment of the present invention; FIG. 1 is a control block diagram showing a configuration example of main parts of an image forming apparatus according to an embodiment of the present invention; FIG. 1 is a functional block diagram showing an internal configuration example of an image forming apparatus according to an embodiment of the present invention; FIG. 3 is a functional block diagram showing an operation example of each part of the image forming apparatus according to one embodiment of the present invention; FIG. FIG. 4 is an explanatory diagram showing an example of image inspection performed by an image inspection unit according to one embodiment of the present invention; FIG. 10 is an explanatory diagram showing an example of storing inspection results of read images by the image inspection unit according to the embodiment of the present invention; It is an explanatory view showing an example of composition of an inspection result report concerning one embodiment of the present invention. FIG. 5 is an explanatory diagram showing a display example of an inspection result report according to one embodiment of the present invention; FIG. 10 is an explanatory diagram showing an example of an inspection result report displaying an abnormal image according to one embodiment of the present invention; FIG. 10 is an explanatory diagram showing an example of an inspection result report in which normal images and abnormal images are displayed in a comparable manner according to one embodiment of the present invention; FIG. 10 is an explanatory diagram showing an example of an inspection result report in which a normal image and an abnormal image are enlarged and displayed so as to allow comparison according to one embodiment of the present invention; FIG. 5 is an explanatory diagram showing a display example of an inspection level setting screen according to one embodiment of the present invention; FIG. 5 is an explanatory diagram showing an example in which an abnormal portion is highlighted and displayed according to one embodiment of the present invention; FIG. 4 is an explanatory diagram showing a display example of a normal image according to one embodiment of the present invention; FIG. 9 is an explanatory diagram showing a display example of a comparison report according to one embodiment of the present invention; FIG. 10 is an explanatory diagram showing an example of image inspection of sheets printed in sets according to one embodiment of the present invention; FIG. 5 is an explanatory diagram showing an example in which a reference image, a normal image, and an abnormal image are associated with each page and stored in a storage unit during color inspection of a read image according to the embodiment of the present invention; 6 is a flowchart showing an example of processing for associating normal image page information and abnormal image page information according to an embodiment of the present invention; 4 is a flow chart showing an example of processing for generating a test result report according to one embodiment of the present invention;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings. In the present specification and drawings, constituent elements having substantially the same function or configuration are denoted by the same reference numerals, thereby omitting redundant description.

[One embodiment]
<Example of Schematic Configuration of Image Forming Apparatus>
First, a schematic configuration example of the image forming apparatus 1 will be described.
FIG. 2 is a schematic diagram showing a schematic configuration example of the image forming apparatus 1. As shown in FIG. FIG. 2 shows elements considered necessary for explaining the present invention or elements related thereto, but the image forming apparatus 1 is not limited to this example.

As shown in FIG. 2, the image forming apparatus 1 according to the present embodiment includes a main unit 10, a large-capacity paper feeding unit 20, a reading unit 30, and a post-processing unit 40. As shown in FIG. The image forming apparatus 1 is connected to an information terminal 50 via a network N such as a LAN.

As shown in FIG. 2 , the main unit 10 includes a scanner section 200 , an ADF (Auto Document Feeder) section 300 , an operation display section 400 and a printer section 500 . That is, the image forming apparatus 1 according to the present embodiment is a so-called digital multi-function machine having a scanner function, a copy function, and a printer function.

In addition, the main unit 10 is provided with a plurality of paper feed trays having a paper feed mechanism, and a paper feed sensor (not shown) for detecting the fed paper is provided near each paper feed tray. ing. These paper feed trays can accommodate paper (an example of recording materials) of different types and sizes, such as plain paper, reverse paper, recycled paper, high-quality paper, and tab paper. Also, a resin sheet may be used as the recording material.

The reading unit 30 is provided as an example of an image inspection device that reads printed paper conveyed from the main unit 10 and inspects whether or not the paper is normal. Then, the paper is inspected based on the images read by CCDs (Charge Coupled Devices) 31 (see FIG. 3, which will be described later) respectively arranged on the front and back sides of the paper to be passed.

The post-processing section 40 is a so-called finisher that performs various post-processing on the sheet inspected by the reading section 30 . For example, the post-processing section 40 includes a sorting unit for sorting sheets conveyed from the main body 10, a punching unit for punching, a folding unit for folding, a cutting unit for cutting, and a cutting unit for cutting. Equipped with units, etc. Illustrations of these units are omitted.

Further, the post-processing section 40 is provided with a paper discharge tray. The sheet conveyed through the reading section 30 is discharged to the discharge tray. When the reading unit 30 detects an abnormality in the printed paper, the post-processing unit 40 performs control to discharge the printed paper separately from normal paper. For this reason, the sheet ejection trays of the post-processing unit 40 include an abnormal sheet ejection tray for ejecting sheets for which an abnormality has been detected, in addition to a normal sheet ejection tray for ejecting normal sheets.

In the image forming apparatus 1 , for example, a document placed on the document tray of the ADF section 300 is conveyed to the contact glass which is the reading portion of the scanner section 200 , and the image of the document is read by the optical system of the scanner section 200 . Here, the image includes not only image data such as graphics and photographs, but also text data such as characters and symbols.

An image (analog image signal) read by the scanner unit 200 is output to the management unit 100 shown in FIG. It is output to the printer unit 500 provided inside. Then, the printer unit 500 forms an image based on the digital image data on the paper fed from the paper feed tray or the large-capacity paper feed unit 20 . The sheet on which the image is formed passes through the reading section 30 by the sheet discharge mechanism, is transported to the post-processing section 40, and is discharged to the sheet discharge tray after undergoing predetermined post-processing in the post-processing section 40. be.

The image forming apparatus 1 is also connected to an external information terminal 50 via a network N. FIG. Various data such as a print instruction are transmitted from the information terminal 50 to the image forming apparatus 1 . Then, the image forming apparatus 1 performs print processing for forming an image on paper according to an instruction from the information terminal 50 .

The operation display unit 400 also displays a message indicating that an abnormality has occurred in the printed paper, an abnormal image, etc., based on the inspection result of the image read by the reading unit 30 . Note that these messages and images may be transmitted to the information terminal 50 through the network N and displayed on the information terminal 50 . The operation display unit 400 is used as an example of the test result report output unit 127, which will be described later with reference to FIG.

<Configuration Example of Principal Part of Image Forming Apparatus>
Next, a configuration example of the main part of the image forming apparatus 1 will be described.
FIG. 3 is a control block diagram showing a configuration example of a main part of the image forming apparatus 1. As shown in FIG.
The main unit 10 includes a management unit 100 , a scanner unit 200 , an ADF unit 300 , an operation display unit 400 , a printer unit 500 and a controller unit 600 .

The management unit 100 includes an image control CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a read processing unit 105, a write processing unit 106, and a DRAM (Dynamic Random Access Memory) control. It comprises an IC 107 , a compression IC 108 , an expansion IC 109 and an image memory 110 . A storage unit 104 is connected to the management unit 100 .

The image control CPU 101 reads various processing programs such as a system program, an image forming processing program, and a paper discharge processing program stored in the ROM 102, develops them in the RAM 103, and centralizes the operation of each unit of the image forming apparatus 1 according to the developed programs. Control.

For example, the image control CPU 101 combines image information input from the scanner unit 200 or the controller unit 600 connected to the management unit 100 with setting information input via the operation display unit 400 connected to the management unit 100. Generate a job based on By executing this job, an image is formed on paper. Here, a job refers to a series of operations related to image formation. For example, when a copy of a predetermined number of pages of a document is to be produced, a series of operations for forming images on the predetermined page of the document constitutes one job.

The ROM 102 is composed of a non-volatile memory such as a semiconductor memory, etc., and stores a system program corresponding to the image forming apparatus 1, an image forming processing program executable on the system program, various processing programs such as a paper discharge processing program, and the like. do. These programs are stored in the form of computer-readable program codes, and the image control CPU 101 sequentially executes operations according to the program codes.

The RAM 103 forms a work area for temporarily storing various programs executed by the image control CPU 101 and data related to these programs, and stores job queues, various operation settings, and the like.
The storage unit 104 is configured by a nonvolatile memory or the like, and stores various setting data and the like related to the image forming apparatus 1 . The storage unit 104 also stores image information regarding job execution.

The read processing unit 105 performs various processes such as analog signal processing, A/D conversion processing, and shading processing on the analog image signal input from the scanner unit 200 to generate digital image data and outputs the digital image data to the compression IC 108 .
The write processing unit 106 generates a PWM (Pulse Width Modulation) signal based on the image data input from the decompression IC 109 and outputs it to the printer unit 500 .

The DRAM control IC 107 controls the compression processing of image data by the compression IC 108 and the decompression processing of the compressed data by the decompression IC 109 based on the control from the image control CPU 101, and controls input/output of image data in the image memory 110. . For example, when an instruction to save image data read by the scanner unit 200 is given, the DRAM control IC 107 causes the compression IC 108 to compress the image data input from the read processing unit 105, and converts the compressed image data into an image. Store in compression memory 111 of memory 110 .

Further, when image formation of the compressed image data stored in compression memory 111 is instructed, DRAM control IC 107 reads out the compressed image data from compression memory 111 , causes expansion IC 109 to execute expansion processing, and stores it in page memory 112 . Let Furthermore, DRAM control IC 107 reads out the image data stored in page memory 112 and outputs it to write processing unit 106 .

The compression IC 108 compresses input image data under the control of the DRAM control IC 107 .
The decompression IC 109 decompresses input compressed image data under the control of the DRAM control IC 107 .

The image memory 110 is composed of, for example, a DRAM, which is a volatile memory, and has a compression memory 111 and a page memory 112 . A compression memory 111 is a memory for storing compressed image data, and a page memory 112 is a memory for temporarily storing compressed image data relating to image formation before image formation.

The scanner unit 200 includes an image sensor such as a CCD 201 and a scanner control unit 202 . A scanner control unit 202 drives and controls each unit of the scanner unit 200 based on a control signal from the image control CPU 101 . Specifically, the surface of the document placed on the contact glass is scanned by exposure, and the reflected light is focused on the CCD 201 to read the image. Then, the imaged optical signal is photoelectrically converted to generate an analog image signal, which is output to the reading processing unit 105 .

The ADF section 300 includes an ADF control section 301 that controls the ADF section 300 based on a control signal from the image control CPU 101 , and moves the document placed on the document tray (not shown) onto the contact glass of the scanner section 200 . automatically feed one sheet at a time.

The operation display unit 400 includes an LCD (Liquid Crystal Display) 401, an operation display control unit 402, an operation key group (not shown), and a touch panel.
The LCD 401 displays various setting screens, image status display, operation status of each function, etc. on the screen in accordance with a display control signal from the operation display control unit 402 . In addition, on the screen of the LCD 401, a pressure-sensitive (resistive film pressure) touch panel in which transparent electrodes are arranged in a grid pattern is configured, and the XY coordinates of the force point operated with a finger or a touch pen are detected as voltage values. , and outputs the detected position signal to the operation display control unit 402 as an operation signal.

The operation display control unit 402 performs display control on the LCD 401 based on control signals from the image control CPU 101 . For example, the LCD 401 is caused to display various setting screens for paper used for image forming processing, various processing results, and the like. The operation display control unit 402 also outputs an operation signal input from the touch panel on the LCD 401 or the operation key group to the image control CPU 101 .

A user can view a basic screen for inputting print conditions for image forming processing, a list of jobs reserved for the image forming apparatus 1, and the like, on the LCD 401 of the operation display unit 400. FIG. By operating the touch panel or the like on the LCD 401, the user can change various settings related to the image forming process to desired settings.

The printer unit 500 includes an LD unit (Laser Diode) 501 and a printer control unit 502 and forms an image on paper based on image data input from the write processing unit 106 .

The LD section 501 includes an LD, a photosensitive drum, a charging section, an exposure section, a developing section, a transfer section, a cleaning section, a fixing section, and the like. The LD unit 501 also includes various rollers such as a paper feed roller, a registration roller, and a paper discharge roller for transporting the paper along the transport path in the LD unit 501, a transport path switching plate, a reversing unit, and the like. The transport unit of the LD unit 501 feeds the paper specified in the job from the paper feed tray and transports the fed paper onto the transport path under the control of the printer control unit 502 .

A plurality of sensors are provided on the transport path of the LD section 501 . These sensors generate a detection signal when the paper passes through and output it to the printer controller 502 .

A printer control unit 502 receives a control signal from the image control CPU 101 and controls the operation of each unit of the LD unit 501 . The printer control unit 502 also counts the number of sheets fed for each job based on the detection signal from the sensor provided on the transport path, and outputs the count to the image control CPU 101 .

In the printer unit 500, the surface of the photosensitive drum is charged by the charging unit based on the instruction from the printer control unit 502, and the laser beam is applied to the surface of the photosensitive drum by the LD based on the PWM signal input from the write processing unit 106. to form an electrostatic latent image. Then, the developing section causes toner to adhere to an area including the electrostatic latent image on the surface of the photosensitive drum, and the transfer section transfers the toner onto a sheet to form an image. After the transferred image is fixed by the fixing section, the sheet on which the image has been formed is conveyed to the reading section 30 and the post-processing section 40 by the discharge roller.

The controller unit 600 includes a controller control unit 601, a DRAM control IC 602, an image memory 603, a communication control unit 604, a NIC (Network Interface Card) 605, and the like.
The controller control unit 601 centrally controls the operation of each unit, and distributes data input from the external information terminal 50 to the management unit 100 as jobs via the communication control unit 604 and the NIC 605 .

The DRAM control IC 602 controls storage of data received by the NIC 605 and the communication control unit 604 in the image memory 603 and reading of data from the image memory 603 . The DRAM control IC 602 is connected to the DRAM control IC 107 of the management unit 100 via a PCI (Peripheral Components Interconnect) bus. Output to the control IC 107 .

The image memory 603 is composed of a DRAM and temporarily stores input data. A communication control unit 604 controls communication of the NIC 605 . The NIC 605 is a communication interface for connecting to the network N, receives image information, jobs, etc. from the information terminal 50 via the network N and outputs them to the DRAM control IC 602 .

The reading unit 30 includes an image sensor such as a CCD 31 and a scanner control unit 32 . The scanner control unit 32 drives and controls each unit of the reading unit 30 based on control signals from the image control CPU 101 received via the printer control unit 502 . Specifically, the front and back surfaces of the paper conveyed from the main unit 10 are scanned, the reflected light from the paper is imaged on the CCD 31, and the image formed on the paper is read. The scanner control unit 32 then generates image data based on the optical signal output from the CCD 31 and transmits the image data to the image control CPU 101 via the printer control unit 502 .

The post-processing section 40 includes a paper ejection control section 41 . After performing various post-processing, the post-processing unit 40 discharges the paper inspected by the reading unit 30 to the discharge tray. Therefore, the paper discharge control unit 41 controls paper discharge based on the inspection result by the scanner control unit 32 of the reading unit 30 . Then, the user can retrieve the paper accumulated in the discharge tray.

<Example of Internal Configuration of Image Forming Apparatus>
Next, an internal configuration example of the image forming apparatus 1 will be described.
FIG. 4 is a functional block diagram showing an internal configuration example of the image forming apparatus 1. As shown in FIG.

The image forming apparatus 1 includes an image input section 121 , a control section 122 , an inspection result report generation section 124 , a storage section 125 , an image inspection section 126 , an inspection result report output section 127 , an image forming section 128 and an image reading section 129 . FIG. 4 outlines the functions of each unit.

The image input unit 121 transfers an image input from the controller unit 600 shown in FIG. 3 to the control unit 122 . Further, the image input unit 121 receives from the controller unit 600 or the information terminal 50 an instruction for switching between the main print mode and the proof mode, an instruction for image inspection, and the like. Here, in the main print mode, the image forming apparatus 1 performs main printing, in which an image is printed on paper based on the document image. In this print mode, it is inspected whether or not the read image for each sheet to be printed contains stains, scratches, or the like.

On the other hand, in the proof mode, a read image read from the paper first printed by the image forming apparatus 1 on which the calibration settings have been changed is generated as an image for proof (hereinafter referred to as a "reference image"). processing is performed. The timing at which the reference image is created in the proof mode is, for example, before the start of actual printing. In general, an image printed on paper by the image forming apparatus 1 in the proof mode is visually checked by a user or the like to determine whether or not there is an abnormality. After that, the reference image and the read image are compared to inspect the read image. A document image that has undergone RIP (Raster Image Processor) processing may be used as the reference image.

The control unit 122 provides an image input instruction, an image formation instruction, an image inspection instruction, recovery printing control, an instruction to store images and page information in the storage unit 125, an inspection result report generation instruction, an inspection result report output instruction, and the like. control. Here, when the control unit 122 controls recovery printing, in addition to the page at the time when the read image is determined to be abnormal by the image inspection unit 126, an image is formed following this page, or an image is formed during transportation. Recovery printing is also instructed for the page where the error occurred.

The inspection result report generating unit 124 generates an inspection result report based on the read image generated by the image reading unit 129 reading the paper and the page information of the job. Job page information will be described later with reference to FIG.
The storage unit 125 stores read images, job page information, inspection result reports, and the like.

The image inspection unit 126 inspects the read image according to an instruction from the control unit 122 . Then, the image inspection unit 126 outputs an inspection result in which the read image determined to contain no abnormality is regarded as a normal image, and the read image determined to contain an abnormality is regarded as an abnormal image. A normal image is, for example, a read image that does not include an abnormality such as dirt. An abnormal image is, for example, a read image including an abnormality such as dirt.

The inspection result report output unit 127 displays the inspection result report generated by the inspection result report generation unit 124 on the operation display unit 400 . The operation display unit 400 includes hardware keys provided as physical devices and a touch panel display. Software keys (operation object images), which are keys reproduced by software, are displayed on the touch panel display. The user can perform various operations of the image forming apparatus 1 by touching hardware keys or software keys on the operation display unit 400 . Also, a test result report is displayed on the touch panel display (screen) of the operation display unit 400 . Details of the inspection result report will be described with reference to FIG. 8 and later.
Note that the inspection result report output unit 127 may instruct the image forming unit 128 to print the inspection result report. In this case, the inspection result report is printed on paper.

The inspection result report output unit 127 has an abnormal image output instructing unit 127a for instructing display of an abnormal image, and an inspection level setting unit 127b for setting an inspection level. The abnormal image output instruction unit 127a and the inspection level setting unit 127b are displayed on the same screen together with the inspection result report, and operate based on the input from the operation object image that receives the user's instruction operation.

The abnormal image output instruction unit 127a has a function of instructing the control unit 122 to display an abnormal image. The abnormal image output instruction unit 127a operates by touch input (pressing) performed on the abnormal image button 404 or the abnormal image comparison button 403 shown in FIG. 9 to be described later. For example, when the abnormal image button 404 is pressed, only abnormal images are displayed on the inspection result report, and when the abnormal image comparison button 403 is pressed, the normal image and the abnormal image are displayed side by side on the inspection result report.

The inspection level setting unit 127b adjusts the inspection level (severity of inspection) with which the image inspection unit 126 inspects the read image. The inspection level setting unit 127b operates, for example, by touch input (pressing) performed on an adjustment button 415 shown in FIGS. 10 to 12, which will be described later. When the adjustment button 415 is pressed, the display is switched from the screen displaying the inspection result report to the screen on which the inspection level setting can be operated. On the screen after switching, a level button for setting an inspection level is displayed as an operation object image for receiving an instruction operation. When the user performs touch input on this operation object image, it becomes possible to change the setting of the inspection level.

The image forming section 128 forms an image on a sheet according to an instruction from the control section 122 and outputs the sheet on which the image has been formed.
The image reading unit 129 reads the paper output from the image forming unit 128 and outputs a read image generated. This read image is stored in the storage unit 125, for example.

Note that the function of the image input unit 121 is realized by the DRAM control IC 107 provided in the management unit 100 shown in FIG. 3, for example. Functions of the control unit 122, the inspection result report generation unit 124, the storage unit 125, the image inspection unit 126, and the inspection result report output unit 127 are realized by the image control CPU 101 provided in the management unit 100, for example. Also, the functions of the image forming unit 128 are realized by the printer unit 500, for example. Also, the function of the image reading unit 129 is realized by the reading unit 30, for example.

<Operation example of each part of the image forming apparatus>
FIG. 5 is a functional block diagram showing an operation example of each part of the image forming apparatus 1. As shown in FIG. Each functional block shown in FIG. 5 is the same as each functional block shown in FIG. In FIG. 5, it will be explained how each functional block cooperates with other functional blocks to perform processing according to the processes (1) to (19) attached in the figure.

(1) First, an image is input from the image input unit 121 to the control unit 122 . The image here also includes a job composed of job information and a document image. This image is received by the image input unit 121 from the controller unit 600 . Then, the control unit 122 starts the job. When the job is started, the control unit 122 compresses the image input from the image input unit 121 using the compression IC 108 and stores it in the compression memory 111 . After that, the control unit 122 expands the compressed image stored in the compression memory 111 using the expansion IC 109, and stores the expanded image in the first page memory 112a.

(2) Next, the control section 122 instructs the image forming section 128 to form an image. At this time, the image forming section 128 reads the document image from the first page memory 112a. The image forming unit 128 that has received the instruction from the control unit 122 performs print processing for forming an image on paper. Then, the sheet on which the image is formed is conveyed from the main unit 10 to the reading unit 30 .
(3) After completing the output of the paper, the image forming unit 128 notifies the control unit 122 of the completion of the output of the paper on which the image is formed.

(4) Next, the control section 122 instructs the image reading section 129 to read an image. (5) The image reading unit 129 reads an image formed on a sheet conveyed from the main unit 10, and stores the read image in the second page memory 112b. Then, the image reading unit 129 notifies the control unit 122 of completion of reading.

(6) Next, the control unit 122 instructs the image inspection unit 126 to inspect the image. At this time, the image inspection unit 126 reads the read image from the second page memory 112b.
(7) The image inspection unit 126 inspects each sheet whether or not the read image read out from the second page memory 112b contains an abnormality such as dirt. When the image inspection unit 126 determines that the read image contains an abnormality, the image inspection unit 126 notifies the control unit 122 of the inspection results such as the detected location of the abnormality. When the image inspection unit 126 determines that the read image does not contain an abnormality, the image inspection unit 126 notifies the control unit 122 of the inspection result indicating no abnormality. The control unit 122 notified of the inspection result calculates the number of recovery pages required for recovery printing based on the paper on which the abnormality was detected.

(8) Next, the control unit 122 saves the read image inspected by the image inspection unit 126 in the storage unit 125 together with the page information of the job.
(9) The control unit 122 reads the read image inspected by the image inspection unit 126 and the page information of the job from the storage unit 125, and writes them to the third page memory 112c.
(10) The control unit 122 instructs the inspection result report generation unit 124 to generate an inspection result report. The inspection result report generator 124 generates an inspection result report for all pages included in the job. At this time, the inspection result report generation unit 124 reads out the read image inspected by the image inspection unit 126 and page information from the third page memory 112c.

(11) The inspection result report generator 124 stores the inspection result report in the storage unit 125 .
(12) The inspection result report generation unit 124 notifies the control unit 122 of completion of generation of the inspection result report.

(13) The control unit 122 writes the inspection result report read from the storage unit 125 to the report reading memory 113 .
(14) The control unit 122 instructs the test result report output unit 127 to display the test result report including the normal image.
(15) The inspection result report output unit 127 reads the inspection result report stored in the report reading memory 113 and displays a normal image.

Next, a case where an instruction to display an abnormal image is given from the abnormal image output instruction unit 127a will be described. An instruction from the abnormal image output instruction unit 127 a is given by the user touching (pressing down) an operation object image on the inspection result report output unit 127 . There are two types of operation object images, an abnormal image comparison button 403 and an abnormal image button 404, which will be described later with reference to FIG.

(16) The abnormal image output instruction unit 127a instructs the control unit 122 to display an abnormal image. (17) When the abnormal image comparison button 403 of the abnormal image output instruction unit 127a is pressed, the control unit 122 instructs display of the normal image and the corresponding abnormal image. Further, when the abnormal image button 404 of the abnormal image output instruction unit 127a is pressed, the control unit 122 instructs the inspection result report output unit 127 to display an abnormal image.

(18) The inspection result report output unit 127 reads the inspection result report stored in the report reading memory 113, and displays only the abnormal image or the normal image and the abnormal image side by side according to the instruction.

Next, a case of adjusting the inspection level of the image inspection unit 126 will be described.
(19) The inspection level setting unit 127b instructs the control unit 122 to switch to the inspection level setting screen. The inspection level setting unit 127 b is instructed by the user touching (pressing) an operation object image on the inspection result report output unit 127 . The operation object image is indicated by a level button in FIG. 13, which will be described later. Then, the control unit 122 displays an inspection level setting screen (described later with reference to FIG. 13).

Next, recovery printing instructed by the control unit 122 will be described.
When the control unit 122 determines that the read image is abnormal, the control unit 122 instructs recovery printing of the page on which the image corresponding to the read image is formed. Therefore, the control unit 122 notifies the controller unit 600 of the read image information to be printed for recovery, and instructs the image forming unit 128 to perform recovery printing. The image forming unit 128 performs recovery printing based on the information of the read image to be recovery printed calculated by the control unit 122 . The recovery-printed paper is also read by the image reading unit 129 and inspected by the image inspecting unit 126, and an inspection result report is generated and output as necessary.

<Example of image inspection performed by the image inspection department>
FIG. 6 is an explanatory diagram showing an example of image inspection performed by the image inspection unit 126. As shown in FIG.
Here, an example in which ten pages of images are formed on a sheet of paper will be described. Arrows in FIG. 6 indicate that the image inspection unit 126 has detected that the read image is abnormal. Then, the page of the read image determined to be abnormal by the image inspection unit 126 is described as "determined abnormal".

Each rectangular frame shown in FIG. 6 represents a sheet on which an image has been formed by the image forming unit 128 or a sheet before image formation and in the middle of being conveyed along the conveying path in the image forming apparatus 1 . The number inside each rectangular frame indicates which page of the image is or was scheduled to be formed on each sheet. Here, it is assumed that 10 pages of images are formed on each sheet. In the following description, the read image of the first page will be referred to as "read image 1". Similarly, the read images of pages 2 to 10 are referred to as "read image 2" to "read image 10".

(1) First, it is assumed that the image inspection unit 126 determines that the read images 1 to 4 do not contain an abnormality. Therefore, the sheets on which the images of the first to fourth pages are formed are discharged to a normal discharge tray (normal discharge tray). In the following description, the image inspection unit 126 inspecting the read image and determining that it does not contain an abnormality is also called "normality determination".

(2) Assume that after the four sheets of pages 1 to 4 are discharged to the normal discharge tray, the read image 5 of the fifth page inspected by the image inspection unit 126 is determined to include an abnormality. In the following description, the process by which the image inspection unit 126 inspects the read image and determines that it contains an abnormality will also be referred to as "abnormality determination". When the read image 5 of the 5th page is determined to be abnormal, the paper on which the images of the 6th to 9th pages after the 5th page that has been determined to be abnormal has already been image-formed, or has not been conveyed in the image forming apparatus 1. transported to the road. If the read images of the 6th to 9th pages are determined to be normal, the sheets on which the images of the 6th to 9th pages are formed are normally discharged to the discharge tray. After that, the recovery printing of the fifth page is performed, and when the read image 5 of the fifth page is determined to be normal, the paper on which the images of the sixth to ninth pages that have already been ejected to the normal paper ejection tray are printed. Later, the sheet on which the image of the fifth page is formed will be discharged, and the sheets will not be stacked in page order. Therefore, the sheets on which the images of the sixth to ninth pages, which have already been image-formed or are conveyed on the conveying path in the image forming apparatus 1, are treated as wasted sheets. Therefore, the sheets on which the images of the 6th to 9th pages are formed are ejected to the abnormal ejection tray together with the sheet on which the images of the 5th page that have been determined to be abnormal are formed.

(3) Next, the image forming apparatus 1 starts recovery printing from the image of the fifth page according to an instruction from the control unit 122 . Then, in FIG. 6, it is assumed that the read image 5 is determined to be abnormal again by the image inspection unit 126 . In this case, the sheets on which the images of the 6th to 9th pages are formed by the recovery printing are discharged to the abnormal discharge tray together with the sheets on which the image of the 5th page which is determined to be abnormal is formed.

(4) Next, according to an instruction from the control unit 122, the image forming apparatus 1 starts recovery printing again from the image of the fifth page. Assume that the image inspection unit 126 determines that the read image 8 is abnormal. In this case, the paper on which the images of the 5th to 7th pages judged to be normal are formed is discharged to the normal paper discharge tray, and the paper on which the image of the 8th page judged to be abnormal is formed and the paper on which the image of the 8th page is formed. Alternatively, the sheet on which the images of the 9th and 10th pages are to be formed, which is conveyed along the conveying path in the image forming apparatus 1, is discharged to the abnormal sheet discharge tray.

(5) Next, the image forming apparatus 1 starts recovery printing from the image of the eighth page according to an instruction from the control unit 122 . Then, the image inspection unit 126 determines that the read images 8 to 10 are normal. The sheets on which the images of the 8th to 10th pages that have been determined to be normal are formed are normally discharged to the discharge tray. Then, the job for 10 pages is completed.

In the present embodiment, after the recovery printing of the image corresponding to the read image determined to be abnormal by the image inspection unit 126 in the job, the image is generated by the image reading unit 129 and determined to be normal by the image inspection unit 126 . The read image is called a normal image. Further, by executing the same job as the job executed in the past, the image formed on the paper is read by the image reading unit 129, and the read image determined to be normal by the image inspection unit 126 is also a normal image. called.

<Example of storage of inspection result of read image by image inspection unit>
FIG. 7 is an explanatory diagram showing an example in which inspection results of read images by the image inspection unit 126 are saved. Here, how the inspection results of the read images 1 to 10 (FIG. 6) inspected by the image inspection unit 126 are stored in the storage unit 125 is shown.

The inspection result of the image inspection unit 126 includes, for example, job information and page information of each page. The page information of each page includes, for example, a read image generated by the image reading unit 129 reading the paper. The page information includes normal image page information regarding normal images and abnormal image page information regarding abnormal images.

The job information holds at least the address of the page information of the read image 1 determined to be normal by the image inspection unit 126 . The page information of read image 1 determined to be normal is called normal image page information 1 . Similarly, page information of read images 2 to 10 determined to be normal will be referred to as normal image page information 2 to 10. FIG.

Each normal image page information (for example, normal image page information 1) holds at least an address on the storage unit 125 where each read image (for example, read image 1) is saved. Furthermore, each normal image page information (for example, normal image page information 1) holds the address of the page information (for example, normal image page information 2) of the read image determined to be normal on the next page.

The normal image page information of a page having a normal image and an abnormal image holds the address of the abnormal image page information, which is the read image determined to be abnormal by the image inspection unit 126 . For example, the page information of read image 1 determined to be abnormal is called abnormal image page information 1 . Similarly, page information of read images 2 to 10 determined to be abnormal will be referred to as abnormal image page information 2 to 10. FIG. FIG. 7 shows how two pieces of abnormal image page information 5 are stored in page 5 and one piece of abnormal image page information 8 is stored in page 8. FIG.

Each piece of abnormal image page information (for example, abnormal image page information 5) holds the address of each read image (for example, read image 5) on the storage unit 125 . Further, each abnormal image page information (for example, abnormal image page information 5) also holds the address of the page information of the read image determined to be abnormal as a result of recovery printing.

Each abnormal image page information holds information on at least the number of detected abnormalities, the type of abnormalities, and the coordinates of abnormal locations for each read image. Here, the coordinates of the abnormal location are represented, for example, by the upper left and lower right coordinates of a rectangular frame surrounding the abnormal location. Note that the center of the rectangular frame may be set as the coordinates of the abnormal location.

Then, if the read image of the page is determined to be abnormal before the read image of the page is determined to be normal, the control unit 122 associates the abnormal image page information with the normal image page information, and stores the normal image page in the storage unit 125. Save information and anomaly image page information.

<Configuration example of inspection result report>
FIG. 8 is an explanatory diagram showing a configuration example of an inspection result report.
The inspection result report is a data file saved in the storage unit 125 for each executed job based on the job information in FIG. In this specification, there are an inspection result report as a data file stored in the storage unit 125 and an inspection result report output to a screen or the like by the inspection result report output unit 127 .

The inspection result report stored in the storage unit 125 includes the read image, the number of detected abnormalities, the type of abnormality, the coordinates of the abnormal location, and the like, which are stored in the page information. The inspection result report generation unit 124 generates an inspection result report in the storage unit 125 according to an instruction from the control unit 122 and stores this inspection result report in the storage unit 125 .

An inspection result report in which normal image page information on pages 1 to 10 shown in FIG. 7, abnormal image page information on two pages on page 5, and abnormal image page information on page 8 are linked. It is saved in the storage unit 125 . This inspection result report consists of a file header and a report page for each page. Each report page consists of page information and images.

The file header holds at least information about the number of pages of the job (the number of normal images) and the total number of pages (the total number of pages including abnormal images).
If it is the read image 1, the normal image page information 1 of the read image 1 determined to be normal by the image inspection unit 126 is stored in the report page. Similarly, for read images 2 to 10 determined to be normal by the image inspection unit 126, normal image page information 2 to 10 is also stored in the report page.

Here, the read images 5 and 8 include the read images read from the images formed on the paper of the page on which the recovery printing was performed due to the judgment as the abnormal image.
If it is the read image 5, the abnormal image page information 5 of the read image 5 determined as abnormal by the image inspection unit 126 is stored in the report page. Similarly, the abnormal image page information 8 of the read image 8 determined to be abnormal by the image inspection unit 126 is stored in the report page.

The normal image of read image 1 saved in the report page is called page 1 (normal image). Similarly, normal images of read images 2 to 10 saved in the report page are called page 2 (normal image) to page 10 (normal image), respectively.
An abnormal image of read image 5 saved in the report page is called page 5 (abnormal image). Similarly, the abnormal image of read image 8 saved in the report page is called page 8 (abnormal image).

Each piece of page information corresponding to a read image stores a normal judgment or abnormality judgment classification, read image size (vertical, horizontal), read image resolution, and read image gradation.
Furthermore, when the read image is determined to be abnormal, abnormal image link information, the number of detected abnormalities, the type of abnormality, and the coordinates of the abnormal location are stored in the page information. The abnormal image linking information is represented as an address in the storage unit 125 where the abnormal image is stored when the read image of the page represented by the page information is determined to be abnormal. The address is, for example, a value calculated relative to address 0 of the file header at the top of the inspection result report, and represents the logical position of each report page stored in the inspection result report.

For example, if the read image 5 is determined to be abnormal before the read image 5 is determined to be normal, the normal image page information 5 and the abnormal image are arranged so that the report page corresponding to the abnormal image is positioned after the report page corresponding to the normal image. Page information 5 is linked. In the figure, from the normal image page information 5 of the report page storing page 5 (normal image), page 5 (abnormal image), which is the read image that was first determined to be abnormal, is stored. An arrow R1 directed to the abnormal image page information 5 is shown. This arrow R1 indicates that the address, which is the abnormal image link information, is stored.

Further, an arrow R2 indicates that the address, which is the abnormal image link information, is stored. This arrow R2 indicates the page 5 (abnormal image), which is the read image whose abnormality was first determined, from the abnormal image page information 5 of the report page storing the page 5 (abnormal image), which is the read image whose abnormality is next determined. 5 (abnormal image) is stored in the abnormal image page information 5 of the report page.
Similarly, an arrow R3 also indicates that an address, which is abnormal image link information, is stored. This arrow R3 indicates the direction of the report page storing the page 8 (abnormal image), which is the read image in which the abnormality is first determined from the abnormal image page information 8 of the report page storing the page 8 (normal image). Go to Abnormal Image Page Information 8 .

In this way, when the image inspection unit 126 determines that the read image is normal, the page information stores the address where the read image previously determined to be abnormal on the same page as the read image is stored. be. However, if the read image previously determined to be abnormal has not been saved, "no image" is stored in the page information.

<Display example of inspection result report>
Next, display examples of inspection result reports will be described with reference to FIGS. 9 to 15. FIG.
FIG. 9 is an explanatory diagram showing a display example of an inspection result report.

FIG. 9 shows an example in which an inspection result report created based on the read image 5 in which an abnormality was detected in FIG. 6 is displayed on the screen of the operation display unit 400 (inspection result report output unit 127). . First, an example in which the normal image 407 is displayed in the inspection result report will be described.

In this inspection result report, "Image00005" is selected and the normal image 407 of the read image 5 corresponding to "Image00005" is displayed. Here, on the left side of the screen of the operation display unit 400, a switching tab is provided for switching the read images 1 to 10 of the displayed inspection result report page by page. In order to select and switch inspection result reports managed page by page, the switching tab displays the file names of the inspection result reports "Image00001" to "Image00010".

Here, the inspection result report shown in FIG. 9 shows a normal image 407 of the read image 5 determined to be normal. An enlargement/reduction button 406 is provided below the normal image 407 for the user to operate to enlarge/reduce the normal image 407 . For example, when the "+" enlargement/reduction button 406 is pressed, the normal image 407 is displayed in an enlarged size, and when the "-" enlargement/reduction button 406 is pressed, the normal image 407 is displayed in a reduced size. Further, an end button 405 is provided at the bottom of the inspection result report for the user to instruct to end the display of the inspection result report. When the user presses the end button 405, the inspection result report display ends.

Here, the abnormal image output instruction unit 127a shown in FIG. Output to the control unit 122 .
The abnormal image comparison button 403 is used by the user to instruct the inspection result report output unit 127 to display the normal image and the abnormal image side by side. When the user presses the abnormal image comparison button 403, a normal image 407 and an abnormal image 408 are displayed side by side in the inspection result report shown in FIG. 9 (see FIG. 11 described later).
The abnormal image button 404 is used by the user to instruct the inspection result report output unit 127 to display an abnormal image. In the inspection result report shown in FIG. 9, when the user presses the abnormal image button 404, only the abnormal image 408 is displayed (see FIG. 10 described later).

FIG. 9 shows an example of display on the operation display unit 400 of the image forming apparatus 1, but the display is not limited to the operation display unit 400, and may be an external PC, tablet terminal, or the like connected to the network.

Also, although the normal image 407 shown in FIG. 9 is displayed so that the tree is vertically oriented, it may be displayed so that the tree is horizontally oriented. In that case, there may be an operation object image such as a drawing rotation button (not shown). Since the normal image 407 displayed horizontally is enlarged and displayed as compared with the normal image 407 displayed vertically, the normal image 407 can be easily recognized.

<Example of inspection result report showing abnormal image>
FIG. 10 is an explanatory diagram showing an example of an inspection result report in which an abnormal image 408 is displayed. When the user presses the abnormal image button 404 on the inspection result report on which the normal image 407 shown in FIG. 9 is displayed, the inspection result report shown in FIG. 10 is displayed.

Here, the inspection result report output unit 127 emphasizes and displays the abnormal portion detected as abnormal by the image inspection unit 126 in the abnormal image 408 . For example, anomalies such as stains or streaks are highlighted with a red circle (an example of the first aspect). As shown in FIG. 10 , an abnormal image 408 includes abnormalities such as stains 409 and white streaks 410 , and the respective abnormalities are surrounded by red circles 411 and 412 .

An enlargement/reduction button 406 for enlarging/reducing the abnormal image 408 is provided at the bottom of the inspection result report. For example, when the "+" enlargement/reduction button 406 is pressed, the abnormal image 408 is displayed in an enlarged size, and when the "-" enlargement/reduction button 406 is pressed, the abnormal image 408 is displayed in a reduced size.

In addition, a return button 416 for returning the display of the screen is provided at the bottom of the inspection result report. When the return button 416 is pressed, the display returns to displaying only the normal image 407 shown in FIG. By returning from the abnormal image 408 to displaying only the normal image 407, it becomes easier to confirm the abnormal portion by switching the display.

Note that there may be an operation object image for rotating and displaying the abnormal image 408 as well as the normal image 407 . The abnormal image 408 displayed horizontally is enlarged and displayed as compared with the abnormal image 408 displayed vertically. Then, when the return button 416 is pressed by the user, the abnormal image 408 enlarged in the horizontal direction is switched to the normal image 407 enlarged in the horizontal direction. On the other hand, when the abnormal image button 404 is pressed by the user, the display is switched to an abnormal image 408 enlarged and displayed sideways. Since the normal image 407 and the abnormal image 408 are enlarged horizontally and displayed in this manner, the user can easily recognize the abnormal portion.

Further, a page forward button 413, a page backward button 414 and an adjustment button 415 are displayed at the bottom of the inspection result report. Page forward button 413 and page backward button 414 will be described later with reference to FIG. Adjustment button 415 will be described later with reference to FIG.

<Example of inspection result report displaying normal and abnormal images for comparison>
FIG. 11 is an explanatory diagram showing an example of a test result report in which a normal image 407 and an abnormal image 408 are displayed for comparison. When the user presses the abnormal image comparison button 403 in the inspection result report on which the normal image 407 shown in FIG. 9 is displayed, the inspection result report shown in FIG. 11 is displayed.

When the abnormal image comparison button 403 is pressed, the control unit 122 instructs the inspection result report output unit 127 to display the normal image 407 and the abnormal image 408 side by side. In response to this instruction, the inspection result report output unit 127 displays the normal image 407 and the abnormal image 408 side by side on the inspection result report. Therefore, the user can easily recognize the type of abnormality and the location of the abnormality, which is the cause of the abnormality determination by the image inspection unit 126 .

Further, there may be a plurality of abnormal images linked to the read image due to the image inspection unit 126 performing the abnormality determination multiple times on one read image. In this case, the inspection result report output unit 127 can display only the abnormal images by page forwarding or page backward according to the page forwarding button 413 or the page backward button 414 pressed by the user.

For example, the read image 5 of the fifth page shown in FIG. Therefore, when the page feed button 413 is pressed, the abnormal image 408 determined to include an abnormality is displayed for the second time. Conversely, when the page return button 414 is pressed, an abnormal image 408 that is determined to include an abnormality for the first time is displayed.

A scaling button 406 provided below the normal image 407 and the abnormal image 408 is used to scale both the normal image 407 and the abnormal image 408 to the same scale.

<Example of inspection result report showing normal and abnormal images enlarged for comparison>
FIG. 12 is an explanatory diagram showing an example of an inspection result report in which the normal image 407 and the abnormal image 408 are enlarged and displayed for comparison. When the user presses the vicinity of the area surrounded by the red circle 411 of the inspection result report shown in FIG. 11, the inspection result report in which the image of this vicinity is enlarged is displayed.

The inspection result report output unit 127 enlarges and displays both the region including the abnormal portion of the abnormal image 408 and the region corresponding to the abnormal portion of the normal image 407 . By displaying the abnormal portion of the abnormal image 408 in an enlarged manner together with the normal image 407, the user can easily recognize the type of abnormality and the abnormal portion that caused the image inspection unit 126 to determine the abnormality.

<Display example of inspection level setting screen>
FIG. 13 is an explanatory diagram showing a display example of the inspection level setting screen. When the user presses the inspection result report adjustment button 415 shown in FIGS. 10 to 12, an inspection level setting screen for setting the inspection level of the image inspection unit 126 is displayed. Adjustment button 415 is an example of an operation object image that receives an instruction operation by the user.

The inspection level setting unit 127b receives an input to the adjustment button 415 displayed together with the inspection result report, and sets the inspection level to the control unit 122. FIG. When the adjustment button 415 is pressed, the inspection level setting screen shown in FIG. 13 is displayed. The user can adjust the inspection level of the image inspection unit 126 through the inspection level setting screen. For example, if the user who has checked the abnormal image 408 displayed in the inspection result report determines that the inspection level of the image inspection unit 126 is too strict, the inspection level can be adjusted through the inspection level setting screen.

Here, there are Level 1 to Level 7 as inspection levels that can be adjusted by the user. When Level 1 is set, the image inspection unit 126 detects an abnormality when the size of stains, scratches, etc. determined by inspection of the read image is 0.1 mm or more. On the other hand, when Level 7 is set, the image inspection unit 126 detects an abnormality when the size of stains, scratches, etc. determined by inspection of the read image is 3 mm or more. As described above, the smaller the Level number of the inspection level, the more the image inspection unit 126 detects an abnormality even if the size of the stain or flaw is slight. Therefore, the user can adjust the inspection level of the image inspection unit 126 by selecting and pressing one of the level buttons from Level1 to Level7.

<Example in which an abnormal part is highlighted>
FIG. 14 is an explanatory diagram showing an example in which an abnormal portion is highlighted and displayed. Here, a display example of an inspection result report in which the normal image 407 shown in FIG. 9 is displayed will be described by pressing the abnormal image button 404 by the user.

The inspection result report output unit 127 determines that the read image contains an abnormality a plurality of times for the same page by the image inspection unit 126, and furthermore, if the cause of the determination that the same page contains an abnormality is the same, the inspection result report output unit 127 An abnormal location including an abnormality is highlighted and displayed in a form such as a double red circle (an example of the second form) different from the form shown in FIG. For example, assume that the same portion of the read image 5 is determined to be abnormal a plurality of times. In this case, the dirt 409 is highlighted by surrounding it with a double red circle 417, which is a different aspect from the red circle 411 in FIG. This makes it easier for the user to recognize that an abnormality has occurred at the same position in the read image multiple times.

<Display example of normal image>
FIG. 15 is an explanatory diagram showing a display example of a normal image. Here, a test result report in which a normal image 407 that is not associated with an abnormal image 408 is displayed will be described.

The inspection result report output unit 127 does not display the abnormal image comparison button 403 and the abnormal image button 404 in the inspection result report when displaying the normal image 407 to which the abnormal image 408 is not linked in the inspection result report. Note that the inspection result report displays a normal image 407 to which the abnormal image 408 is not linked, an enlargement/reduction button 406 for enlarging/reducing the normal image 407, and an end button 405. FIG. Then, when the user presses the end button 405, the inspection result report output unit 127 ends the display of the inspection result report.

<Display example of comparison report>
FIG. 16 is an explanatory diagram showing a display example of a comparison report.
The inspection result report can organize the inspection results in ways other than the inspection result reports shown in FIGS. 9 to 12 . The comparison reports of explanatory diagrams (A) to (C) in FIG. 16 shown below are examples of inspection result reports, and are output as electronic files such as PDF (Portable Document Format), for example. By making it an electronic file, it becomes possible to view it on an external PC or the like using a USB (Universal Serial Bus) or the like. The configuration of each report will be described below using the job in FIG.

The explanatory diagram (A) of FIG. 16 is a report generated by the test result report generator 124 by collecting only normal images. This report includes normal images of pages 1 to 4 determined to be normal by the image inspection unit 126 before recovery printing, normal images of pages 5 to 7 determined to be normal during the second recovery printing, and normal images of pages 5 to 7 determined to be normal during the second recovery printing. Normal images of pages 8 to 10 determined to be normal at the time of printing are included.

The explanatory diagram (B) of FIG. 16 is a report created by the inspection result report generator 124 by collecting only abnormal images. The explanatory diagram (B) of FIG. 16 includes two abnormal images on the 5th page and one abnormal image on the 8th page that have been determined to be abnormal.

An explanatory diagram (C) of FIG. 16 is a report generated by the inspection result report generation unit 124 by collecting abnormal images and normal images linked to the abnormal images. This report is generated by arranging an abnormal image and a normal image associated with the abnormal image. For example, an image in which a normal image associated with the read image of the fifth page and an abnormal image determined as abnormal for the first time are displayed. In addition, an image in which a normal image associated with the read image 5 on the fifth page and an abnormal image determined to be abnormal for the second time are arranged. Further, an image in which a normal image and an abnormal image linked to the read image 8 on page 8 are arranged is shown. For example, red circles 411 and 412 that emphasize the abnormal locations described with reference to FIG. 10 may be added to these abnormal images.

In the report shown in the explanatory diagram (C) of FIG. 16, two images (a normal image and an abnormal image) are displayed. It is also possible to reduce the size of the normal image and the abnormal image included in the report shown in the explanatory diagram (C) of FIG. However, if normal images and abnormal images, which were originally A4 size, are reduced in size, it may be difficult for the user to discern a small difference between the normal image and the abnormal image. Therefore, the inspection result report generation unit 124 generates an inspection result report in which the image sizes of the normal image and the abnormal image are arranged while maintaining the image size of the read image. For example, if the size of the normal image and the abnormal image is A4 size, the size of the report itself is preferably A3 size or larger so as not to change the size of the normal image and the abnormal image.

<Example of performing an image inspection on sheets printed in units of copies>
FIG. 17 is an explanatory diagram showing an example of image inspection of sheets printed in sets. In this example, it is assumed that the image forming apparatus 1 has executed a job of forming images on a plurality of copies of paper. When the job is executed, the first copy printed by the image forming apparatus 1 is called the "first copy", and the sheet printed by the image forming apparatus 1 after that is called the "Nth copy". The explanatory diagram (A) of FIG. 17 shows the first sheet, and the explanatory diagram (B) of FIG. 17 shows the Nth set of sheets. The image inspection unit 126 inspects the read images generated from the sheets of each set. Each part has 10 pages.

In the leading portion shown in the explanatory diagram (A) of FIG. 17, the read images 1 to 6 are determined to be normal by the image inspection unit 126 . The sheets on which the images of pages 1 to 6 have been formed are discharged to a normal discharge tray (normal discharge tray). However, since the read image 7 was determined to be abnormal by the image inspection unit 126, the sheets on which the images of the 8th to 10th pages after the 7th page, which was determined to be abnormal, are formed are treated as waste sheets and discharged to the abnormal paper discharge tray. be done. After that, the image forming apparatus 1 starts recovery printing of the seventh page and thereafter. Since the read images 7 to 10 are determined to be normal by the image inspection unit 126, printing of the leading portion is completed.

In the N-th copy shown in the explanatory diagram (B) of FIG. 17, the read images 1 to 4 are determined to be normal by the image inspection unit 126 . Here, since the printing result and inspection result of each page in the Nth copy are the same as those shown in FIG. 6, detailed description thereof will be omitted.

In the upper part of the explanatory diagram (C) of FIG. 17, normal images determined to be normal from the first read image are displayed side by side. In the lower part of the explanatory diagram (C) of FIG. 17, abnormal images determined to be abnormal from the read image of the Nth set are displayed side by side. Here, the normal image of the top portion and the abnormal image of the N-th set are linked for each page and stored in the storage unit 125 . In this example, the normal images at the top of the 5th and 8th pages and the abnormal image of the Nth copy are linked and stored in the storage unit 125 .

In this way, even if the printed paper is different, the normal image and the abnormal image can be associated with each other and stored in the storage unit 125 . Then, the inspection result report output unit 127 can output the normal image and the abnormal image for each page to the inspection result report even if they are different units.

<Example of inspecting the color of the scanned image>
FIG. 18 is an explanatory diagram showing an example in which a reference image, a normal image, and an abnormal image are associated with each page and stored in the storage unit 125 during color inspection of a read image. When the image inspection unit 126 inspects the color tone of the read image, the image reading unit 129 saves the reference image generated from the read image in the proof mode in association with the normal image page information.

Explanatory diagram (A) of FIG. 18 shows an example of reference images for 10 pages generated from read images in the proof mode. For example, reference images 1 to 10 corresponding to read images 1 to 10 of pages 1 to 10 are stored in the storage unit 125 .

Explanatory diagram (B) of FIG. 18 shows an example of a read image of a sheet printed in this print mode and an example of a sheet treated as a waste sheet. Here, since the printing results and inspection results of each page are the same as those shown in FIG. 6, detailed description thereof will be omitted.

An explanatory diagram (C) of FIG. 18 shows how the inspection result report generation unit 124 links the reference image, the normal image, and the abnormal image for each page and stores them in the storage unit 125 . A reference image, a normal image, and an abnormal image are saved in page order for job information unique to each job.

Here, the job information holds the address of the normal image page information of the read image determined to be normal. Each piece of normal image page information (for example, normal image page information 1) holds the address on the storage unit 125 of each piece of reference image page information (for example, reference image page information 1). Therefore, the inspection result report output unit 127 can display an inspection result report in which the reference image and the read image are arranged so that they can be compared.

The reference image can also be used for inspection by the image inspection unit 126 in reprinting. Here, the setting of the image forming apparatus 1 at the time of registering the reference image and the setting of the image forming apparatus 1 at the time of reprinting may differ due to calibration or the like being performed. Therefore, the color of the image reprinted by the image forming apparatus 1 after the setting change may differ from the reference image. Therefore, when the inspection items of the image inspection unit 126 include color, comparing and displaying the reference image and the read image makes it easier for the user to visually recognize the difference in color. Therefore, the image displayed in the inspection result report when the user presses the abnormal image comparison button 403 may be used as the read image and the reference image.

<Example of processing for associating normal image page information and abnormal image page information>
Next, various types of processing performed by the image forming apparatus 1 will be described with reference to FIGS. 19 and 20 in the order of processing for linking normal image page information and abnormal image page information and processing for creating a report page. .
FIG. 19 is a flowchart illustrating an example of processing for associating normal image page information and abnormal image page information.

First, control unit 122 receives a job from image input unit 121 . Then, the control unit 122 starts the job. When the job is started, the control unit 122 compresses the image data input from the image input unit 121 using the compression IC 108 and stores it in the compression memory 111 . After that, the control unit 122 decompresses the compressed image stored in the compression memory 111 using the decompression IC 109, and stores the decompressed image in the first page memory 112a (S1).

Next, the control unit 122 feeds the paper from the paper feed tray or the large capacity paper feed unit 20 to the image forming unit 128 (S2).
Next, the control section 122 instructs the image forming section 128 to form an image. The image forming unit 128, which has received the instruction from the control unit 122, performs print processing for forming the image read from the first page memory 112a on paper (S3). After discharging the print-processed paper to the reading unit 30, the image forming unit 128 notifies the control unit 122 that the print-processed paper has been discharged.

Next, the image reading unit 129 reads the image formed on the sheet conveyed from the main unit 10, and stores the read image in the second page memory 112b (S4). Then, the image reading unit 129 notifies the control unit 122 of completion of reading.

Next, the control unit 122 instructs the image inspection unit 126 to inspect the read image. At this time, the image inspection unit 126 inspects the read image read from the second page memory 112b (S5). When the image inspection unit 126 determines that the read image does not contain an abnormality, the image inspection unit 126 notifies the control unit 122 of the inspection result indicating no abnormality. On the other hand, when the image inspection unit 126 determines that the read image contains an abnormality, the image inspection unit 126 notifies the control unit 122 of the inspection results such as the detected location of the abnormality.

Next, the control unit 122 saves the inspection result of the read image inspected by the image inspection unit 126 in the storage unit 125 (S6). The control unit 122 determines whether or not the read image contains an abnormality based on the inspection result of the image inspection unit 126 (S7). If the control unit 122 determines that the read image contains an abnormality (YES in S7), it stores the address of the read image (abnormal image) on the storage unit 125 in the abnormal image page information (S8). .

On the other hand, if the control unit 122 determines that the read image does not contain an abnormality (NO in S7), it stores the address of the read image (normal image) on the storage unit 125 in the normal image page information (S9). ).

Next, the control unit 122 determines whether or not the printing process performed by the image forming unit 128 is recovery printing (S10). If the control unit 122 determines that recovery printing is performed (YES in S10), the control unit 122 associates the page information of the recovery-printed image with the page information of the same image that was determined to be abnormal before the recovery printing (S11), Proceed to step S12. On the other hand, when the control unit 122 determines that recovery printing is performed (NO in S10), the process proceeds to step S12. Next, the control unit 122 determines whether or not the inspection result of the image inspection unit 126 is for the read image of the image printed on the last page of paper (S12).

If the control unit 122 determines that the inspection result is not the final page (NO in S12), it returns to step S2 and causes the image forming unit 128 to continue the image forming process in order to continue the image forming process for the next and subsequent pages. On the other hand, when the control unit 122 determines that the inspection result is the final page (YES in S12), the process ends. By these processes, linking of normal image page information and abnormal image page information in the same image (page) is completed.

<Example of processing to generate inspection result report>
FIG. 20 is a flowchart illustrating an example of processing for generating an inspection result report.

First, the control unit 122 instructs the inspection result report generation unit 124 to generate an inspection result report. The inspection result report generator 124 creates a file header of the inspection result report based on the job information (S21). As described above, the file header holds at least the number of pages (the number of normal images) and the total number of pages (the total number of pages including abnormal images) of the job.

Next, the inspection result report generator 124 creates normal image page information shown in FIG. 8 based on the job information. As described above, the normal image page information holds the normality judgment or abnormality judgment classification of the read image and the read image size (vertical and horizontal). Further, the normal image page information holds information about the resolution of the read image, the gradation of the read image, and the connection of the abnormal image, etc. (S22).

The test result report generation unit 124 reads the read image and normal image page information from the storage unit 125 (S23), and generates a report page regarding the normal image based on the read image and normal image page information (S24).

Next, the inspection result report generator 124 determines whether or not there is link information between the normal image and the abnormal image based on the job information (S25). When the inspection result report generation unit 124 determines that there is no link information with the abnormal image (NO in S25), the process proceeds to step S30.

On the other hand, if it is determined that there is information associated with the abnormal image (YES in S25), the inspection result report generation unit 124 creates abnormal image page information based on the job information (S26). The abnormal image page information includes normality determination or abnormality determination classification of the read image by the image inspection unit 126, read image size (vertical, horizontal), read image resolution, read image gradation, abnormal image linking, etc. Information is retained. Further, the abnormal image page information holds information regarding the number of detected abnormalities, the type of abnormality, and the coordinates of the abnormal location.

Next, the inspection result report generation unit 124 reads the read image and the abnormal image page information from the storage unit 125 (S27). Next, the inspection result report generator 124 generates a report page based on the read image and the abnormal image page information (S28). This report page is generated after the normal image page information on the same page.

Next, the inspection result report generation unit 124 determines whether generation of report pages for all abnormal images on the same page has been completed (S29). When the inspection result report generation unit 124 determines that generation of report pages for all abnormal images on the same page has not been completed (NO in S29), the process returns to step S26. The inspection result report generator 124 then continues to generate report pages for other abnormal images.

On the other hand, if the inspection result report generation unit 124 determines that generation of report pages for all abnormal images on the same page has been completed (YES in S29), the inspection result report generation unit 124 generates report pages for the read images of all pages in the job. It is determined whether or not generation is completed (S30).

When the inspection result report generation unit 124 determines that report page generation has not been completed for the read images of all pages in the job (NO in S30), the process returns to step S22. On the other hand, if the inspection result report generation unit 124 determines that report page generation has been completed for the read images of all pages in the job (YES in S30), the process ends. By repeating the generation of the report page for each page in this manner, the generation of the inspection result report is completed.

In the image forming apparatus 1 according to the present embodiment described above, the image inspection unit 126 inspects each page of a read image generated by reading a sheet by the image reading unit 129 to determine whether it is normal or abnormal. The image inspection unit 126 outputs an inspection result determined to be normal or abnormal depending on whether or not the read image of each page contains an abnormality. Then, the inspection result report generating unit 124 generates an inspection result report composed of report pages for each page based on the output inspection result. If the read image of the same page is determined to be abnormal before being determined to be normal, the abnormal image and the normal image are linked to the report page. Therefore, the inspection result report output unit 127 can output the inspection result report in a comparable manner based on the inspection result report.

Here, in the conventional defect detection report, by forming a read image (defect detection image) and a normal image (original image) again on paper, another abnormality such as dirt is added to the paper after image formation. was there. In this case, it becomes impossible to determine whether the abnormality added to the defect detection report is an abnormality included in the original read image or an abnormality caused by creating the defect detection report. On the other hand, in the inspection result report according to the present embodiment, the normal image and the abnormal image are displayed side by side by the inspection result report output unit 127 . Therefore, unlike the defect detection report disclosed in Patent Document 1, the read image (defect detection image) and the normal image (original image) are formed again on paper and printed. In this way, the inspection result report output unit 127 can display the abnormal image linked with the normal image in the inspection result report according to the user's request. Therefore, the user can confirm the contents of the abnormality included in the abnormal image, and can easily recognize the page number of the read image determined to be abnormal.

In the inspection result report displayed on the screen, normal images and abnormal images are displayed side by side by pressing the abnormal image comparison button 403 . Since the normal image and the read image are displayed in such a way that they can be compared, the user can easily recognize stains, streaks, and the like included in the read image. Further, when the abnormal image button 404 is pressed, the normal image and the abnormal image are switched and displayed. Therefore, the user can easily recognize the abnormal point. Further, in the inspection result report, when the vicinity of the abnormal part of the abnormal image being displayed is touched, the vicinity of the touched area is enlarged and displayed, so that the user can easily recognize the cause of the abnormality.

Further, by displaying the reference image created in the proof mode and the read image so as to be able to be compared, it is possible to easily determine whether or not the color tone of the read image is normal with respect to the reference image. In other words, by displaying the reference image and the read image so that they can be compared, it becomes easier for the user to perform an inspection in consideration of the color of the read image.

It should be noted that the present invention is not limited to the above-described embodiment, and it goes without saying that various other application examples and modifications can be made without departing from the gist of the present invention described in the claims.
For example, the above-described embodiments are detailed and specific descriptions of the configurations of the devices and systems in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the configurations described. Further, it is possible to replace part of the configuration of the embodiment described here with the configuration of another embodiment, and furthermore, it is possible to add the configuration of another embodiment to the configuration of one embodiment. It is possible. Moreover, it is also possible to add, delete, or replace a part of the configuration of each embodiment with another configuration.
Further, the control lines and information lines indicate those considered necessary for explanation, and not all control lines and information lines are necessarily indicated on the product. In practice, it may be considered that almost all configurations are interconnected.

Reference Signs List 1 image forming apparatus 30 image inspection apparatus 40 post-processing unit 122 control unit 124 inspection result report generation unit 125 storage unit 126 image inspection unit 127 inspection result report output unit 129 image reading unit

Claims (24)

a control unit that performs an inspection to determine whether or not a read image generated by reading a recording material on which an image is formed contains an abnormality, and displays the read image on a display unit;
The control unit
displaying the read image determined to include the abnormality on the display unit when receiving a request from a user to display the read image determined to include the abnormality on the display unit;
controlling to enlarge a partial area of the displayed read image and display it on the display unit based on a user operation;
When the user operation is an operation on the periphery of an abnormal portion in the displayed read image, an enlarged read image of the periphery of the abnormal portion including the portion where the user operation is performed is displayed on the display unit. control and
The inspection performed by the control unit includes multiple types of inspection,
An image inspection apparatus for controlling, for a predetermined type of inspection, to display on the display unit, together with the read image determined to include the abnormality, an inspection standard for a user to compare with the read image . The image inspection apparatus according to claim 1, wherein the control unit performs control so as to emphasize and display the region including the abnormal portion. 3. The image inspection apparatus according to claim 2, wherein the periphery of the abnormal site includes a highlighted area. The control unit displays an enlargement button for enlarging and displaying the displayed read image, and a second user operation of pressing the enlargement button, which is an operation different from the user operation, is performed. 4. The image inspection apparatus according to any one of claims 1 to 3, wherein control is performed so that the read image is enlarged and displayed when the read image is displayed. The image inspection apparatus according to any one of claims 1 to 4, wherein the user operation is an operation of touching the displayed read image. The image inspection according to any one of claims 1 to 5, wherein the control unit switches and displays the read image displayed on the display unit to the enlarged read image based on the user operation. Device. A computer of an image inspection apparatus that performs an inspection to determine whether or not a read image generated by reading a recording material on which an image is formed contains an abnormality, and displays the read image on a display unit. a program,
a procedure for executing an inspection to determine whether the read image generated by reading the recording material on which the image is formed contains an abnormality;
a step of displaying the read image determined to include the abnormality on the display unit when a request is received from the user to display the read image determined to include the abnormality on the display unit;
a step of enlarging and displaying a partial area of the displayed read image based on a user operation;
causing the computer to execute
When the user operation is performed on the periphery of the abnormal portion in the displayed read image, the step of displaying the enlarged image is an enlarged read image of the abnormal portion including the portion where the user operation is performed. including instructions for displaying the
The inspection includes multiple types of inspection,
The displaying step includes a step of displaying, for a predetermined type of inspection, the read image determined to include the abnormality and an inspection standard for a user to compare with the read image on the display unit. program. 8. The image inspection program according to claim 7, further causing the computer to execute a procedure of emphasizing and displaying the region including the abnormal portion. 9. The image inspection program according to claim 8, wherein the periphery of the abnormal site includes a highlighted area. a procedure for displaying an enlargement button for enlarging and displaying the displayed scanned image;
a step of enlarging and displaying the read image when a second user operation, which is an operation different from the user operation and presses the enlargement button, is performed;
The image inspection program according to any one of claims 7 to 9, further causing the computer to execute. The image inspection program according to any one of claims 7 to 10, wherein the user operation is an operation of touching the displayed read image. 12. The step of displaying the enlarged read image includes the step of switching the read image displayed on the display unit to the enlarged read image based on the user operation and displaying the read image. The image inspection program according to any one of . An image inspection system that performs an inspection to determine whether or not a read image generated by reading a recording material on which an image is formed contains an abnormality, and displays the read image on a display unit,
an image forming unit that forms the image on the recording material;
an image reading unit that reads the recording material on which the image is formed and generates the read image;
a control unit that performs an inspection to determine whether the read image contains an abnormality,
The control unit
displaying the read image determined to include the abnormality on the display unit when receiving a request from a user to display the read image determined to include the abnormality on the display unit;
controlling to enlarge a partial area of the displayed read image and display it on the display unit based on a user operation;
When the user operation is an operation on the periphery of an abnormal portion in the displayed read image, an enlarged read image of the periphery of the abnormal portion including the portion where the user operation is performed is displayed on the display unit. control and
The inspection performed by the control unit includes multiple types of inspection,
An image inspection system for controlling, for a predetermined type of inspection, displaying on the display unit, together with the read image determined to include the abnormality, an inspection standard for a user to compare the read image with . 14. The image inspection system according to claim 13, wherein the control unit performs control so as to emphasize and display the region including the abnormal portion. 15. The image inspection system according to claim 14, wherein the vicinity of the abnormal site includes a highlighted area. The control unit displays an enlargement button for enlarging and displaying the displayed read image, and a second user operation of pressing the enlargement button, which is an operation different from the user operation, is performed. 16. The image inspection system according to any one of claims 13 to 15, wherein control is performed so that the read image is enlarged and displayed when the read image is displayed. The image inspection system according to any one of claims 13 to 16, wherein the user operation is an operation of touching the displayed read image. The image inspection according to any one of claims 13 to 17, wherein the control unit switches and displays the read image displayed on the display unit to the enlarged read image based on the user operation. system. 19. The image inspection system according to any one of claims 13 to 18, wherein the image forming unit executes recovery printing for forming again on a recording material an image corresponding to the read image determined to include the abnormality. . The image forming unit is a recording material on which an image is formed subsequent to the recording material on which the read image is determined to include an abnormality, and is formed on the recording material that was being conveyed at the time of determination by the control unit. Also for images that are
20. The image inspection system of claim 19. An image inspection performed in an image inspection system that inspects whether or not a read image generated by reading a recording material on which an image is formed contains an abnormality, and displays the read image on a display unit. a method,
forming an image on a recording material;
reading the recording material on which the image is formed to generate the read image;
performing an inspection to determine whether the read image contains anomalies;
displaying the read image determined to include the abnormality on the display unit;
enlarging and displaying a partial area of the displayed read image based on a user operation;
has
In the step of displaying in an enlarged manner, when the user operation is an operation on the periphery of the abnormal part in the displayed read image, the reading of the enlarged periphery of the abnormal part including the part where the user operation is performed. displaying an image;
The inspection includes multiple types of inspection,
The displaying step includes the step of displaying, for a predetermined type of inspection, the read image determined to include the abnormality and an inspection standard for a user to compare with the read image on the display unit. Method. 22. The step of displaying the magnified read image includes the step of switching the read image displayed on the display unit to the magnified read image based on the user operation and displaying the read image. image inspection method. The step of forming the image includes the step of performing recovery printing to form an image corresponding to the read image determined to include the abnormality on a recording material again,
The image inspection method according to any one of claims 21-22. In the step of forming the image, a recording material on which an image is formed subsequent to the recording material on which the read image is determined to include an abnormality is conveyed when it is determined whether or not the read image includes an abnormality. The image formed on the recording material that was in the middle is also subject to the recovery printing,
The image inspection method according to claim 23.

Images