JP7400448B2 - Image forming method, image forming device, and program - Google Patents

Description

The present disclosure relates to an image forming method, an image forming apparatus, and a program.

Conventional image forming apparatuses such as MFPs (Multi-Functional Peripherals) include, for example, as described in Japanese Patent Application Publication No. 2012-108828 (Patent Document 1) and Japanese Patent Application Publication No. 2012-109895 (Patent Document 2). , there was one that executed "additional printing" in which a completed printed product was created by additionally printing an image on a sheet of paper on which an image was previously printed.

JP2012-108828A Japanese Patent Application Publication No. 2012-109895

In Patent Document 1 and Patent Document 2, as shown in each of FIGS. 2A and 2B, paper sheets on which only images to be additionally printed in reprint printing are printed are required. Therefore, for example, if a user forgets to include an element such as a page number and outputs an image of a document, and then wants to reprint that element on the output paper, prepare paper on which only that element is printed for all pages. That is required. Generally, paper on which only page numbers are printed is discarded after additional printing. As a result, paper on which only page numbers are printed is used redundantly.

On the other hand, when an image of a document with the above-mentioned elements added is printed again, the paper on which it was initially printed becomes unnecessary and is generally discarded. As a result, the paper originally printed is used in excess.

As described above, in the conventional technology, when an element is missing in an image formed on paper (first image), an image (second image) is formed by adding the element to the first image. In order to obtain a printed paper, the use of extra resources including paper and coloring materials (ink, toner, etc.) could not be avoided.

The present disclosure has been devised in view of such circumstances, and its purpose is to form a second image in which elements are added to the first image after the first image is formed on the paper. The purpose of the present invention is to provide a technology for reducing the amount of resources required to obtain paper.

According to an aspect of the present disclosure, there is provided a method of forming an image on paper placed in a tray performed by a computer, the method comprising: obtaining an on-paper image that is an image of the paper; and outputting the on-paper image. An image forming method is provided that includes the steps of specifying output content of the output image using an output image that is a target image, and causing a print engine to form an image of the output content on paper. .

Preferably, the step of specifying the output content includes comparing the image on the paper and the image for output, and if the image for output includes elements common to the image on the paper at a predetermined rate or more, the output content is determined. This includes specifying elements of the image that are different from the on-paper image as output content.

Preferably, comparing the on-paper image and the output image includes rotating one of the on-paper image and the output image, and comparing the other of the on-paper image and the output image with the rotated one. including.

Preferably, the image forming method further includes the step of performing character recognition on the image on the paper, and the step of specifying the output content includes: when the different element includes a word for correction to the word on the image on the paper; This includes excluding a portion of the different elements that constitute the correction word from the output content.

Preferably, the step of specifying the output content includes specifying an output object that is an object that includes at least a part of different elements in the output image, and a paper sheet that is an object that corresponds to the output object in the paper image. determining whether the difference between the output object and the on-paper object satisfies given requirements; and determining whether the difference between the output object and the on-paper object If the given requirements are met, this includes excluding portions of the different elements that constitute the output object from the output content.

Preferably, the step of identifying the output content includes identifying the entire output object as the output content if the difference between the output object and the on-paper object does not meet the given requirements, and the image forming method The method further includes the step of causing the print engine to form an image of the output content on recording paper different from a paper when the entire output object is specified as the output content.

Preferably, the method further comprises the step of displaying given information on the display if the difference between the output object and the on-paper object does not meet given requirements.

Preferably, determining whether the difference satisfies the given requirements includes determining whether the set of the first image containing the first object and the second image containing the second object allows the change. This includes using a classifier that has been subjected to a learning process using teacher data so as to output whether or not the change satisfies a given requirement when the change is input in association with information indicating whether or not the change satisfies a given requirement.

Preferably, the step of identifying the output content includes identifying an output object that is an object that includes different elements in the output image, and identifying a paper object that is an object that corresponds to the output object in the paper image. and generating image data of the output content as image data for adjusting the difference between the output object and the object on the paper.

Preferably, the step of specifying the output content includes specifying the entire output image as the output content when the on-paper image does not include printing elements.

Preferably, the image forming method further includes the step of avoiding outputting the output image when the on-paper image does not include printing elements.

Preferably, the image forming method further includes the step of transporting the paper placed on the tray to obtain an image on the paper, and in the transporting step, an image that does not include printing elements is obtained as the image on the paper. will continue until

Preferably, the image forming method further includes the step of conveying the paper placed on the tray in order to obtain an image on the paper, and the step of forming the output content includes the step of conveying the paper placed on the tray in order to obtain an image on the paper, and the step of forming the output content includes the step of conveying the paper placed on the tray in order to obtain an image on the paper, and the step of forming the output content includes the step of conveying the paper placed on the tray to obtain an image on the paper, and the step of forming the output content includes the step of conveying the paper placed in the tray to obtain an image on the paper, and the step of forming the output content includes the step of conveying the paper placed on the tray to obtain an image on the paper, and the step of forming the output content includes the step of conveying the paper placed on the tray to obtain an image on the paper. to cause the print engine to form an image of the output content on the paper if the paper is available for printing, and to cause the print engine to form the image for output on a recording paper different from the paper if the paper is not available for printing. include.

Preferably, the step of forming the output content includes causing the print engine to suspend image formation in response to occurrence of ink shortage for image formation, and restart image formation in response to resolution of ink shortage; including.

Preferably, the step of obtaining the output image includes obtaining a first output image associated with the first job and a second output image associated with the first job, The step of obtaining the upper image includes obtaining a first output image from a first sheet associated with a second job, and obtaining a second output image from a second sheet associated with a second job. The step of forming the output content includes outputting the first output content, which is specified using the first on-paper image and the first output image, to the print engine. and causing a print engine to form the first output content on a second sheet.

Preferably, the image forming method further includes the step of avoiding image formation on the paper if the image on the paper matches the output image.

According to another aspect of the present disclosure, there is provided an image forming apparatus that includes a print engine and a controller that executes the image forming method described above.

According to still another aspect of the present disclosure, a program is provided that is executed by a computer to cause the computer to execute the image forming method.

According to the present disclosure, an image to be formed on paper by a print engine among output images that are output target images is specified using the paper image and the output image. This may reduce the amount of printing paper and coloring material required to obtain the paper on which the output image is formed.

1 is a diagram illustrating an example of an internal configuration of an image forming apparatus. 1 is a diagram showing a hardware configuration of an image forming apparatus 1. FIG. FIG. 3 is a diagram for explaining an overview of an additional printing function. FIG. 7 is a diagram schematically showing an example of an image with a specified difference. FIG. 7 is a diagram for explaining an example of specifying a difference between an image on paper and an image for output in the additional printing function. FIG. 7 is a diagram for explaining a specific example of a comparison pattern between an on-paper image and an output image for identifying a difference. FIG. 7 is a diagram for explaining a second specific situation in which the additional printing function is used. FIG. 7 is a diagram for explaining a third specific situation in which the additional printing function is used. FIG. 7 is a diagram for explaining a fourth specific situation in which the additional printing function is used. FIG. 12 is a diagram for explaining a fifth specific situation in which the additional printing function is used. 3 is a flowchart of processing executed by the image forming apparatus 1 to realize an additional printing function. FIG. 12 is a diagram for explaining a sixth specific situation in which the additional printing function is used. FIG. 12 is a diagram for explaining a seventh specific situation in which the additional printing function is used. FIG. 12 is a diagram for explaining an eighth specific situation in which the additional printing function is used.

An embodiment of an image forming apparatus will be described below with reference to the drawings. In the following description, the same parts and components are given the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.

[1. Internal configuration of image forming apparatus]
FIG. 1 is a diagram showing an example of the internal configuration of an image forming apparatus. The image forming apparatus 1 includes a first scanner 3 , a paper feed tray 4 , a manual feed tray 4</b>X, a transfer section 5 , a fixing section 6 , and a paper discharge tray 70 .

The first scanner 3 reads the image of the document P1. Paper feed tray 4 stores recording paper P2. Recording paper P2 is placed on the manual feed tray 4X. The transfer unit 5 transfers the toner image onto the recording paper P2 fed from the paper feed tray 4 or the manual feed tray 4X. The fixing section 6 fixes the toner image transferred by the transfer section 5 onto the recording paper P2. The recording paper P2, on which the toner image has been fixed by the fixing unit 6, is discharged to the paper discharge tray 70.

The first scanner 3 includes a reading section 31 that reads an image from a document P1, and an automatic document feeder (ADF) 32 that causes the reading section 31 to feed the document P1 one by one. An operation panel ("operation panel 9" described later in FIG. 2) is provided on the front side (front side) of the apparatus main body 2.

The reading section 31 of the first scanner 3 includes a document table 33 , a light source section 34 , an image sensor 35 , an imaging lens 36 , and a mirror group 37 . The document table 33 includes a platen glass (not shown) on the upper surface side. The light source section 34 irradiates light onto the document P1. The image sensor 35 photoelectrically converts the reflected light from the document P1 into image data. The imaging lens 36 forms an image of the reflected light from the document P1 onto the image sensor 35. The mirror group 37 sequentially reflects the reflected light from the document P1 and makes it incident on the imaging lens 36. The light source section 34, the image sensor 35, the imaging lens 36, and the mirror group 37 are provided inside the document table 33.

When the first scanner 3 reads the document P1 on the platen glass (not shown) of the document table 33, light is irradiated onto the document P1 from the light source section 34 that moves in the right direction (sub-scanning direction). The light reflected from the document P1 is sequentially reflected by a mirror group 37 that moves to the right like the light source section 34, enters the imaging lens 36, and forms an image on the image sensor 35. The image sensor 35 performs photoelectric conversion for each pixel according to the intensity of incident light, and generates an image signal (RGB signal) corresponding to the image of the document P1.

On the other hand, when the image sensor 35 reads the document P1 placed on the document tray 38, the document P1 is conveyed to a reading position by a document conveyance mechanism 40 composed of a plurality of rollers and the like. The light source section 34 and mirror group 37 of the reading section 31 are fixed at predetermined positions inside the document table 33. The light source unit 34 irradiates the reading position portion of the document P1 with light, and the reflected light is imaged on the image sensor 35 via the mirror group 37 of the reading unit 31 and the imaging lens 36. Thereafter, the image sensor 35 converts the reflected light into an image signal (RGB signal) corresponding to the image of the document P1. Thereafter, the original P1 is ejected onto the original ejection tray 39.

In the example of FIG. 1, the first scanner 3 reads an image of the lower side of the document P1 on the document table 33. The first scanner 3 may further include an additional image sensor inside the document ejection tray 39, and may read the image of the upper surface of the document P1 using the additional image sensor. That is, the first scanner 3 may be configured to simultaneously read images on both sides of the document P1.

The transfer section 5 includes an image forming section 51, an exposure section 52, an intermediate transfer belt 53, a primary transfer roller 54, a driving roller 55, a driven roller 56, a secondary transfer roller 57, and a cleaner section 58. include. The image forming unit 51 generates toner images of each color of Y (Yellow), M (Magenta), C (Cyan), and K (Key tone). The exposure section 52 is provided below the image forming section 51. When the intermediate transfer belt 53 comes into contact with the image forming sections 51 of each color arranged in the horizontal direction, toner images of each color are transferred from the image forming section 51 to the intermediate transfer belt 53. The primary transfer roller 54 holds the intermediate transfer belt 53 together with the image forming section 51 for each color of the image forming section 51 . The drive roller 55 rotates the intermediate transfer belt 53. The driven roller 56 rotates as the rotation of the drive roller 55 is transmitted through the intermediate transfer belt 53 . The secondary transfer roller 57 is installed at a position facing the drive roller 55 with the intermediate transfer belt 53 in between. The cleaner section 58 is installed at a position facing the driven roller 56 with the intermediate transfer belt 53 interposed therebetween.

The image forming section 51 includes a photoreceptor drum 61 that comes into contact with the outer peripheral surface of the intermediate transfer belt 53, a charger 62 that charges the outer peripheral surface of the photoreceptor drum 61 by corona discharge, and a charger 62 that charges the agitated and charged toner onto the photoreceptor. It includes a developing device 63 that is attached to the outer circumferential surface of the drum 61 and a cleaner section 64 that removes toner remaining on the outer circumferential surface of the photoreceptor drum 61 after the toner image is transferred to the intermediate transfer belt 53. The photosensitive drum 61 is installed at a position facing the primary transfer roller 54 with the intermediate transfer belt 53 in between, and rotates in the clockwise direction in FIG. 1 . A primary transfer roller 54 , a cleaner section 64 , a charger 62 , and a developing device 63 are arranged around the photoreceptor drum 61 in this order along the rotational direction of the photoreceptor drum 61 .

The intermediate transfer belt 53 is composed of, for example, an endless conductive belt member. The intermediate transfer belt 53 is wound around the drive roller 55 and the driven roller 56 without loosening, so that it rotates in the counterclockwise direction in FIG. 1 as the drive roller 55 rotates. A secondary transfer roller 57, a cleaner section 58, and image forming sections 51 for each color of YMCK are arranged in order around the intermediate transfer belt 53 along the rotation direction of the intermediate transfer belt 53.

The fixing unit 6 fixes the toner image transferred to the recording paper P2. The fixing unit 6 includes a heating roller 59 equipped with a halogen lamp or the like that heats the toner image on the recording paper P2 to fix it, and a pressure roller that clamps the recording paper P2 together with the heating roller 59 and presses the recording paper P2. 60. The heating roller 59 may heat its surface by generating an eddy current on its surface by electromagnetic induction.

In the image forming apparatus 1, the transfer section 5 and the fixing section 6 can implement an example of a print engine.

The conveyance device that conveys the recording paper P2 includes a feed roller 81 that feeds the recording paper P2 stored in the paper feed tray 4 from the top layer to the paper feed path R1, and a feed roller 81 that feeds the fed recording paper P2 further to the paper feed path R1. A paper feed roller pair 82, a transport roller pair 83 that vertically transports the recording paper P2 fed by the paper feed roller pair 82 on the main transport path R0, and a transport roller pair 83 arranged downstream of the transport roller pair 83 in the main transport path R0. and a timing roller pair 84 that transports the recording paper P2 toward the transfer section 5. The main transport path R0 is the main transport path for the recording paper P2 in the process of image formation (printing). The paper feed path R1 is provided for each paper feed tray 4. Each paper feed path R1 joins the main transport path R0. Paper feed path R1 is an example of a conveyance path.

The conveyance device that conveys the recording paper P2 further includes a feed roller 81X that feeds the recording paper P2 stored in the manual feed tray 4X from the top layer to the paper feed path R1X, and a feed roller 81X that feeds the fed recording paper P2 further into the paper feed path R1X. It further includes a pair of paper feeding rollers 82X for feeding out the paper. The recording paper P2 fed by the paper feed roller pair 82X is vertically transported by the transport roller pair 83 on the main transport path R0.

That is, the recording paper P2 in each paper feed tray 4 is delivered to the paper feed path R1 one by one, starting from the top layer, by the rotation of the corresponding feed roller 81, and is then delivered to the main paper feed path R1 by the paper feed roller pair 82. It is further sent out toward the conveyance path R0. The recording sheets P2 in the manual feed tray 4X are fed out one sheet at a time from the top layer to the paper feed path R1X by the rotational drive of the feed roller 81X, and are then sent toward the main conveyance path R0 by the paper feed roller pair 82X. More will be sent out.

A second scanner 7 is provided in the paper feed path R1X. The second scanner 7 reads an image of the recording paper P2 conveyed through the paper feed path R1X, that is, the recording paper P2 placed on the manual feed tray 4X. The second scanner 7 may read images on both sides of the recording paper P2.

In the main conveyance path R0, the recording paper P2 conveyed from the paper feed roller pair 82 or the paper feed roller pair 82X is rotated by the conveyance roller pair 83 toward the timing roller pair 84 disposed in front of the transfer unit 5. transported. The timing roller pair 84 conveys the recording paper P2 to the transfer section 5 in synchronization with the timing of formation of the toner image at the transfer section 5, so that the toner image is normally transferred to the recording paper P2 at the transfer section 5. That is, when the recording paper is conveyed to the timing roller pair 84 by the conveyance roller pair 83, the recording paper P2 is loosened and forms a loop by stopping the timing roller pair 84, and the paper skew is corrected by the loop. from there to a secondary transfer roller 57.

In the main conveyance path R0, a conveyance sensor (movement amount detection unit) 85 is installed above the conveyance roller pair 83 (on the downstream side in the conveyance direction) for detecting the recording paper P2 vertically conveyed by the conveyance roller pair 83. Ru. A pre-timing sensor (recording paper detection unit) 86 is installed below the timing roller pair 84 (on the upstream side in the conveying direction) to detect the leading edge of the recording paper P2 that has arrived before the timing roller pair 84. Based on detection signals from the transport sensor 85 and the pre-timing sensor 86, paper transport and loop control in the main transport path R0 are executed.

A paper ejection roller pair 91 that ejects the printed recording paper P2 is arranged at the most downstream end portion of the main transport path R0. The printed recording paper P2 is discharged onto the paper discharge tray 70 by rotation of the paper discharge roller pair 91. In the main transport path R0, a paper ejection sensor 90 that detects the trailing edge of the recording paper P2 is arranged below the paper ejection roller pair 91 (on the upstream side in the transport direction). As a result, the paper ejection sensor 90 detects the trailing edge of the recording paper P2, thereby confirming that the recording paper P2 has been normally ejected from the paper ejection roller pair 91 to the paper ejection tray 70.

[2. Hardware configuration of image forming device]
FIG. 2 is a diagram showing the hardware configuration of the image forming apparatus 1. As shown in FIG.

As shown in FIG. 2, the image forming apparatus 1 includes a main body control section 10. The main body control section 10 controls each section constituting the image forming apparatus 1 . As a result, various operations in the image forming apparatus 1 (printing operation on the recording paper P2, image reading operation from the document P1, etc.) are executed.

The main body control section 10 includes a CPU (Central Processing Unit) 101, a storage device 102, a RAM (Random Access Memory) 103, an image processing section 104, an image memory 105, and an input/output interface 106.

The CPU 101 executes various calculation processes and controls. The storage device 102 is realized by, for example, a hard disk drive, and stores data such as control programs. RAM 103 temporarily stores calculation data. The image processing unit 104 generates image data that is the basis of the toner image formed by the transfer unit 5. Image memory 105 temporarily stores image data obtained by image processing section 104.

The input/output interface 106 receives data from an external device and transmits data to the external device via a communication network 110 such as a LAN (Local Area Network). The input/output interface 106 is realized by, for example, a network card. For example, the main body control unit 10 obtains a print job instruction from a user's personal computer via the input/output interface 106.

That is, the image forming apparatus 1 can form an image read by the first scanner 3, or can form an image of a document file obtained via the input/output interface 106.

Image forming apparatus 1 includes an operation panel 9 . In one implementation example, the operation panel 9 includes a touch sensor that receives operations from the user and a display. That is, in one implementation example, the operation panel 9 is realized by a touch panel.

The image forming apparatus 1 includes an image reading control section 113 , an exposure control section 114 , a transfer control section 115 , a fixing control section 116 , and a transport control section 118 .

The image reading control unit 113 controls the first scanner 3 and the second scanner 7. Exposure control section 114 controls exposure section 52. The transfer control section 115 controls the transfer section 5. The fixing control section 116 controls the fixing section 6. The conveyance control unit 118 drives a motor that drives the feed rollers 81, 81X, etc., that is, a roller used to convey the recording paper P2.

[3. Additional printing functions]
The image forming apparatus 1 can read the image of the paper placed on the manual feed tray 4X and identify the difference between the image of the document and the image of the paper. The image forming apparatus 1 can further form an image corresponding to the identified difference (not the entire image of the entire document) on the paper. In this specification, the function of the image forming apparatus 1 to form an image corresponding to the identified difference is referred to as an "additional printing function." The additional print function will be explained below.

<Summary>
FIG. 3 is a diagram for explaining an overview of the additional printing function. Referring to FIG. 3, frame 300 shows an example of a set of sheets to be set in manual feed tray 4X. More specifically, each of the sheets 301, 302, 303, and 304 within the frame 300 represents the first, second, third, and fourth sheets, respectively.

A frame 310 shows an example of a set of documents. The set of manuscripts is, for example, a document file to be printed. Each of the manuscripts 311, 312, 313, and 314 within the frame 310 represents the first page, second page, third page, and fourth page, respectively, in the set of manuscripts.

The frame 320 represents an example of a set of print sheets output by the additional print function. Each of the sheets 321, 322, 323, and 324 in the frame 320 represents the first, second, third, and fourth sheets, respectively.

On the paper 321, an image that is a difference between the image on the paper 301 and the image on the original 311 is additionally printed on the paper 301. Each of the sheets 322, 323, and 324 includes an additional image of the difference between the image on each sheet 302, 303, and 304 and the image on the original 312, 313, and 314. It is printed.

The image of each page within the frame 300 is an example of an image on paper. The image of each page within the frame 310 is an example of an output image.

FIG. 4 is a diagram schematically showing an example of the identified difference image. The image of the document 311 shown in FIG. 4 includes elements surrounded by the frame 3112 in addition to the elements surrounded by the frame 3111 (common elements with the image of the paper 301). In this case, in one implementation example, the image forming apparatus 1 identifies an element (a collection of black pixels) surrounded by the frame 3112 as a difference image.

Hereinafter, a specific situation will be illustrated in order to more specifically explain the relationship between the paper in the frame 300, the original in the frame 310, and the paper in the frame 320.

<Specific situation>
A user instructs the image forming apparatus 1 to print a print job (job (1)) from a computer to print a certain document file. The user then updates the document file on the computer by adding elements to each page (eg, a page number, a string representing the file name of the document file, a company mark, etc.). Thereafter, the user instructs the image forming apparatus 1 from the computer to perform a print job (job (2)) for printing the updated document file while using the "additional print function". The instruction for job (2) may include information that specifies job (1).

In this example, the sheets output by job (1) correspond to sheets 301, 302, 303, and 304 in frame 300 in FIG.

After job (1), the user sets the output sheets (sheets 301, 302, 303, and 304) on manual feed tray 4X, and instructs image forming apparatus 1 to start job (2).

In job (2), the image forming apparatus 1 uses the second scanner 7 to acquire images of each of the sheets (sheets 301, 302, 303, and 304) set in the manual feed tray 4X. On the other hand, the image forming apparatus 1 develops images of each page of the updated document file. The updated document file image corresponds to the originals 311, 312, 313, and 314 within the frame 310 in FIG.

In job (2), the image forming apparatus 1 compares the image of each sheet acquired using the second scanner 7 with the image of each page of the updated document file, thereby determining the difference for each sheet. Identify images. Then, the image forming apparatus 1 forms images with the identified differences on each sheet of paper.

The sheets output by job (2) correspond to the sheets 321, 322, 323, and 324 in the frame 320 in FIG. More specifically, the image forming apparatus 1 obtains the paper 301 from the manual feed tray 4X, forms a difference image between the original 311 and the paper 301 on the paper 301, and outputs the paper 321. The image forming apparatus 1 obtains the paper 302 from the manual feed tray 4X, forms an image of the difference between the original 312 and the paper 302 on the paper 302, and outputs the paper 322. The image forming apparatus 1 obtains the paper 303 from the manual feed tray 4X, forms an image of the difference between the original 313 and the paper 303 on the paper 303, and outputs the paper 323. The image forming apparatus 1 obtains the paper 304 from the manual feed tray 4X, forms an image of the difference between the original 314 and the paper 304 on the paper 304, and outputs the paper 324.

According to this specific situation, after job (1), in order to obtain the sheets 321, 322, 323, 324 in the frame 320 in job (2), the sheets 301, 302 that have already been used in job (1) , 303, 304 are used. This prevents new paper from being used in job (2). That is, the number of sheets used to obtain sheets 321, 322, 323, and 324 can be reduced.

Furthermore, in this specific situation, in order to obtain the sheets 321, 322, 323, 324, it is not necessary to form an image on the portions of the sheets 301, 302, 303, 304 that have already been imaged. As a result, the amount of coloring material (toner in the image forming apparatus 1; ink if the image forming apparatus forms images using ink) used to obtain the sheets 321, 322, 323, and 324 can be reduced.

<Identification of differences>
FIG. 5 is a diagram for explaining an example of specifying the difference between the on-paper image and the output image in the additional print function. In FIG. 5, an image 800 is shown in a frame 8A as an example of an image on paper.

A frame 8B shows a state in which a process for identifying a difference is in progress. An image 810 represents an example of an image generated by overlapping the output image and the on-paper image.

The frame 8C shows the paper to which the difference is added and output. Image 820 represents an example of an image formed on a sheet of paper to be output.

When the image forming apparatus 1 acquires an image of the paper set in the manual feed tray 4X using the second scanner 7, the image forming apparatus 1 adds the job being executed (the above-mentioned job) to the acquired image, as shown in the frame 8B. In the example, images of originals of "Job (2)") are superimposed. The grid shown in frame 8B is shown for reference to represent pixels.

In one implementation example, the image forming apparatus 1 compares the image on the paper and the image for output pixel by pixel, and determines whether the image on the paper has a gradation value of 0 (or a given value or less) and the image for output. Then, pixels whose gradation value is above 0 (or a given value) are identified. For example, in the image 810 within the frame 8B, the pixel 811 is an example of a pixel whose tone value is higher than 0 in the on-paper image. The pixel 812 is an example of a pixel whose tone value is 0 in the on-paper image and whose tone value is higher than 0 in the output image. Pixel 813 is an example of a pixel whose tone value is 0 in both the on-paper image and the output image.

Then, the image forming apparatus 1 identifies a set of pixels such as the pixels 812 as the difference between the on-paper image and the output image.

FIG. 6 is a diagram for explaining a specific example of a comparison pattern between an on-paper image and an output image for identifying a difference. In FIG. 6, an image 501 represents an example of an image on paper, and an image 502 represents an example of an output image.

Two comparison patterns are shown in FIG. 6, designated as Comparison (1) and Comparison (2). In comparison (2), image 501 is rotated by 180 degrees with respect to comparison (1). In one implementation example, comparison (1) represents comparing the on-paper image and the output image, respectively, in their input state, and comparison (2) represents comparing the on-paper image and the output image after rotating the on-paper image by 180 degrees. This indicates that the image is compared with the output image in the state as input.

The image forming apparatus 1 may calculate the degree of matching between the image 501 and the image 502 for each of the comparison (1) and comparison (2) states before identifying the difference between the image 501 and the image 502. . Then, the image forming apparatus 1 may identify the difference between the image 501 and the image 502 using the pattern with a higher degree of matching. Here, the degree of matching represents, for example, the ratio of the number of pixels with matching gradation values to the total number of pixels.

In the example of FIG. 6, it is understood that the pattern according to comparison (2) has a higher degree of matching between images 501 and 502 than the pattern according to comparison (1). More specifically, in comparison (1), image 501 includes an area representing the letter "A," while image 502 includes an area in which the letter "A" is displayed upside down. On the other hand, in comparison (2), both images 501 and 502 include areas where the letter "A" is displayed upside down. Therefore, in comparison (2), while the gradation values of pixels constituting the area representing the letter "A" displayed upside down are the same in images 501 and 502, such a match is found in comparison ( 1) cannot be seen.

Therefore, in the example shown in FIG. 6, the image forming apparatus 1 identifies the difference between the image 501 and the image 502 using the pattern according to comparison (2).

Note that in the example shown in FIG. 6, the image on the paper is rotated without rotating the image for output, but the image on the paper may not be rotated but the image for output may be rotated.

Furthermore, in the example shown in FIG. 6, the degree of matching is calculated only for two patterns: a pattern in which both are not rotated (comparison (1)), and a pattern in which one is rotated by 180 degrees (comparison (2)). However, the degree of matching may be calculated for each of three or more patterns including other rotation angles (for example, 90°).

<Specific situation (2)>
FIG. 7 is a diagram for explaining a second specific situation in which the additional printing function is used.

In the situation shown in FIG. 7, as explained with reference to FIG. , 313, 314.

In the situation shown in FIG. 7, the user sets sheets 301, 302, 304 of the sheets 301, 302, 303, 304 output in job (1) in the manual feed tray 4X, as shown in the frame 300A. do. That is, the user instructs execution of job (2) without setting the paper 303 in the manual feed tray 4X.

In job (2), the image forming apparatus 1 selects a document corresponding to each of the sheets 301, 302, 304 from among the documents 311, 312, 313, and 314, for example, according to the degree of image matching. More specifically, the image forming apparatus 1 selects the original 311 as the original corresponding to the paper 301, the original 312 as the original corresponding to the paper 302, and the original 314 as the original corresponding to the paper 304. .

Then, the image forming apparatus 1 forms images of differences from the originals 311, 312, and 314 on the sheets of paper 301, 302, and 304, respectively, by job (2). As a result, sheets 321, 322, and 324 are output as shown in frame 320A.

As described above, in the example of FIG. 7, the image forming apparatus 1 additionally prints the difference image only for the paper set in the manual feed tray 4X as a result of the job (job (2)) using the additional print function. Output printed paper. That is, the image forming apparatus 1 does not perform image formation on sheets that are not set in the manual feed tray 4X.

<Specific situation (3)>
FIG. 8 is a diagram for explaining a third specific situation in which the additional printing function is used.

In the situation shown in FIG. 8, as explained with reference to FIG. , 313, 314.

In the situation shown in FIG. 8, the user sets sheets 301, 302, 304 of the sheets 301, 302, 303, 304 output in job (1) in the manual feed tray 4X, as shown in a frame 300B. do. That is, the user instructs execution of job (2) without setting the paper 303 in the manual feed tray 4X.

In job (2), the image forming apparatus 1 forms images of differences from originals 311, 312, and 314 on sheets 301, 302, and 304, respectively, as in the example of FIG. As a result, sheets 321, 322, and 324 are output as shown in frame 320A.

In the situation of FIG. 8, the image forming apparatus 1 further outputs a sheet on which the original (original 313) that is not the target of forming the difference image among the originals within the frame 310 is formed. In FIG. 8, the paper output in this manner is shown as paper 323B. As the paper 323B, the image forming apparatus 1 may use a spare paper set in the manual feed tray 4X, or may use a paper set in the paper feed tray 4.

In this specification, the output of paper 323B in the situation of FIG. 8 is also referred to as "missing page printing." More specifically, if the paper set in the manual feed tray 4X does not include the paper on which an image corresponding to the original 313 is formed among the originals 311, 312, 313, and 314 included in job (2), image formation is performed. The apparatus 1 supplements and outputs the paper (paper 323B) on which the image of the original 313 is formed.

As a result, even if some of the sheets output in job (1) are missing in the set of sheets set in the manual feed tray 4X in job (2), the image forming apparatus 1 ), the document (page) corresponding to the missing paper is printed on a new paper and output.

<Specific situation (4)>
FIG. 9 is a diagram for explaining a fourth specific situation in which the additional printing function is used.

In the situation shown in FIG. 9, the document files to be output by job (2) include originals 311, 312C, 313C, and 314C, as shown by a frame 310C. The images on the originals 312C, 313C, and 314C are unchanged from the images on the sheets 302, 303, and 304.

That is, in the situation shown in FIG. 9, the user updates the document file so that only the first page thereof is changed, and then instructs to execute job (2).

The sheets (sheets 321, 302, 303C, and 304) output by job (2) are shown within the frame 320C. In job (2), the image forming apparatus 1 prints an image of the difference between the paper 301 and the original 311 on the paper 301, and outputs the paper 321. On the other hand, the image forming apparatus 1 outputs each of the sheets 302, 303, and 304 as is (without image formation) since there is no difference between each of the sheets 302, 303, and 304 with respect to each of the originals 312C, 313C, and 314C. That is, in the situation shown in FIG. 9, each of the sheets 302, 303, and 304 passes through the image forming apparatus 1 and is output as is.

<Specific situation (5)>
The method of acquiring the image to be printed (output image) of job (2) may be changed. More specifically, the image to be printed in job (2) may be an image of a document file stored in a storage device within the image forming apparatus 1, or an image of a document obtained by the first scanner 3. It may be an image. For example, the user may add elements by hand to the print image (the image output in job (1)), set it on the manual feed tray 4X, and instruct execution of job (2).

FIG. 10 is a diagram for explaining a fifth specific situation in which the additional printing function is used.
In the situation shown in FIG. 10, as shown by a frame 310D, the document file that is the output target of job (2) includes only the document 311 corresponding to the paper 301, and the document file corresponding to the paper 302, 303, and 304. Does not include manuscript.

For example, in the situation shown in FIG. 10, the user manually adds elements to only a portion of the paper output in job (1) and sets the paper in the manual feed tray 4X. Then, the user sets two or more sheets of paper output in job (1) on manual feed tray 4X, and instructs execution of job (2).

The sheets (sheets 321, 322D, 323D, 324D) output by job (2) are shown within the frame 320D. In job (2), the image forming apparatus 1 prints an image of the difference between the paper 301 and the original 311 on the paper 301, and outputs the paper 321. Then, the image forming apparatus 1 prints on each of the sheets 302, 303, and 304 the same difference images as those printed on the sheet 301, and outputs them as sheets 322D, 323D, and 324D.

<Targets for additional printing>
If there is a difference between the on-paper image and the output image, the image forming apparatus 1 may determine whether to form the difference image based on the content of the difference.

In one implementation example, when the size of an element included in the original document after updating is changed in the original document after updating, the image forming apparatus 1 determines that the change is within a predetermined range (for example, the change magnification is 1. 1 times or less). Elements within the document and elements within the paper may be identified, for example, as areas in the document or paper where there are consecutive dots.

If the size change between the on-paper image and the output image is within the above range, the image forming apparatus 1 uses the additional print function to perform additional printing on the difference between the on-paper image and the output image. may be excluded from

In another implementation example, when the position of an element included in the original original is changed in the updated original, the image forming apparatus 1 determines that the change is within a predetermined range (for example, the moving distance of the element is 0.1 cm or less). Elements within the document and elements within the paper may be identified, for example, as areas in the document or paper where there are consecutive dots.

If the change in the position of the element between the on-paper image and the output image is within the above range, the image forming apparatus 1 uses the additional printing function to calculate the difference between the on-paper image and the output image for additional printing. It may be excluded from the target.

In yet another implementation example, when the color of an element included in the original original is changed in the updated original, the image forming apparatus 1 determines that the change is within a predetermined range (for example, the color density It is determined whether the change is below a predetermined level (where the level is associated with, for example, RGB values). Elements within the document and elements within the paper may be identified, for example, as areas in the document or paper where there are consecutive dots.

If the change in the color of the element between the on-paper image and the output image is within the above range, the image forming apparatus 1 uses the additional printing function to calculate the difference between the on-paper image and the output image for additional printing. It may be excluded from the target.

Note that regardless of whether or not the color change is within the above range, the image forming apparatus 1 may change the color of the element on the paper to the document as image data for additional printing. (image data for adjusting the color of the element). For example, if the color of a certain element in the image on paper is yellow, and if the color of the element is green in the output image, the image forming apparatus 1 adds the element to the image data for additional printing. Data may be generated such that a blue coloring material is applied to the corresponding area. The areas of the yellow elements on the paper may be given a green color in the paper output in job (2) by being given a blue colored material in an additional print.

The above range may be defined by a classifier (trained model). That is, the image forming apparatus 1 may use a classifier to determine whether the change is within the range.

Learning of the learned model may be executed in the image forming apparatus 1 or may be executed by an external device (for example, a server managed by the manufacturer of the image forming apparatus 1).

In one implementation, the training data utilized for learning includes multiple sets of first images and second images. Each set of images in the teacher data is tagged with information that specifies whether the first image in the set should be changed to the second image.

In one example, a set includes a first image and a second image modified such that an element in the first image is moved a first distance. The set is tagged with information indicating whether the user who viewed the first image and the second image wishes to change the first image to the second image. Another set includes a first image and a second image modified such that elements in the first image are moved a second distance. The set is tagged with information indicating whether the user who viewed the first image and the second image wishes to change the first image to the second image.

In other examples, a set includes a first image and a second image modified such that elements in the first image are scaled by a first factor. The set is tagged with information indicating whether the user who viewed the first image and the second image wishes to change the first image to the second image. Another set includes a first image and a second image modified such that elements in the first image are scaled by a second factor. The set is tagged with information indicating whether the user who viewed the first image and the second image wishes to change the first image to the second image.

In yet another example, a set includes a first image and a second image in which the colors of elements in the first image are changed by a first level (respective RGB values). The set is tagged with information indicating whether the user who viewed the first image and the second image wishes to change the first image to the second image. Another set includes a first image and a second image in which the colors of elements in the first image are changed by a second level (RGB respective values). The set is tagged with information indicating whether the user who viewed the first image and the second image wishes to change the first image to the second image.

In the image forming apparatus 1 , data defining a learned model (for example, a learning model and parameters used in the learning model) may be stored in the storage device 102 . The storage device 102 may further store a program for learning the learned model.

Data defining the trained model may be updated. In one implementation, machine learning of the trained model may be performed on a server. Machine learning may utilize neural network algorithms.

Machine learning can update the parameters used in the learning model. The image forming apparatus 1 may update the parameters in the image forming apparatus 1 with the parameters in the server at a given opportunity. An example of a given trigger may be an update operation on the operation panel 9, a reception of an update notification from a server, or the arrival of a preset time in the image forming apparatus 1. It may be.

<When the difference between the image on the paper and the output image corresponds to word correction>
After outputting the paper in job (1), the user updates the document file by correcting misspelled words in the document file, and instructs to output the updated document file in job (2). good. In this case, at least some pages in the updated document file (output image) include words for correcting words (including spelling errors) included in the unupdated document file (paper image).

In one example, the document file before update includes "pqtent", and in the document file after update, "pqtent" in the document file before update is replaced with "patent". "Patent" is a specific example of a word to correct "pqtent."

In this case, the image forming apparatus 1 specifies the difference between the image on the paper and the image for output by subtracting the pixels forming the "a" of the output image from the pixels forming the "q" of the image on the paper. It is possible. In this case, the image forming apparatus 1 may exclude such differential images from the additional printing target in the additional printing function.

More specifically, the image forming apparatus 1 may perform character recognition on the image on the paper. By executing character recognition on the image on the paper, the image forming apparatus 1 recognizes that the portion of the image on the paper where a difference occurs in the output image is a portion that constitutes a word. It is possible. The image forming apparatus 1 further acquires words that are included in the portion where the difference occurs in the output image. The image forming device 1 recognizes an area between two blanks as an area corresponding to one word, provided that a blank of a given length or more occurs in the direction in which characters are arranged. It is possible.

In the output image, if the word in which the difference occurs is a word that is not listed in the dictionary (i.e., a simple character string), the image forming apparatus 1 outputs the difference image. Can be excluded from additional printing. By excluding such an image from being subject to additional printing, it is possible to avoid a situation where "patent" is printed over "pqtent" and the user finds it difficult to read the content written in that part.

[4. Process flow]
FIG. 11 is a flowchart of processing executed by the image forming apparatus 1 to realize the additional printing function. The process in FIG. 11 is, for example, when the image forming apparatus 1 executes a print job using the additional print function after sheets (for example, sheets 301, 302, 303, and 304 in FIG. 3) are set in the manual feed tray 4X. It starts when an instruction is received. The instruction includes an instruction to use the additional printing function.

A print job includes a specification of a document file to be printed. The image of this document file to be printed is treated as an output image. Note that the process in FIG. 11 may be started upon receipt of a copy job instruction instead of a print job instruction. In this case, the image obtained by scanning the original corresponds to the output image.

Hereinafter, in the description of FIG. 11, the job that is instructed to be executed as the cause of the start of FIG. 11 will be referred to as a "job in progress."

In one implementation example, the process in FIG. 11 is realized by the CPU 101 of the main body control unit 10 executing a given program. In this sense, the main body control section 10 is an example of a controller in the image forming apparatus 1. The processing in FIG. 11 will be described below.

In step S500, the image forming apparatus 1 causes the transport control unit 118 to transport the paper on the manual feed tray 4X.

In step S502, the image forming apparatus 1 determines whether or not paper is placed on the manual feed tray 4X. In one implementation example, a sensor may be provided near the feed roller 81X to detect the paper in the paper feed path R1X. The image forming apparatus 1 may determine that the paper is placed on the manual feed tray 4X if the sensor detects the paper a predetermined time after the start of paper conveyance in step S500. Otherwise, it may be determined that no paper is placed on the manual feed tray 4X.

In step S502, if the image forming apparatus 1 determines that paper is placed on the manual feed tray 4X (YES in step S502), the image forming apparatus 1 advances the control to step S504; NO), the process of FIG. 11 is ended.

In step S504, the image forming apparatus 1 causes the second scanner 7 to scan the paper.

In step S506, the image forming apparatus 1 determines whether the image data acquired by the scan in step S504 includes data for printing. Printing data means data representing pixels to which toner is applied. For example, if the scanned paper is blank, it is determined in step S506 that the image data does not include data for printing. On the other hand, if an image is printed on the scanned paper as shown as paper 301 in FIG. 3, it is determined in step S506 that the image data includes data for printing.

If the image forming apparatus 1 determines that the image data includes print data (YES in step S506), the control proceeds to step S508; otherwise (NO in step S506), the control proceeds to step S520. Proceed.

In step S520, the image forming apparatus 1 determines whether the setting value for missing page printing (FIG. 8) is ON in the image forming apparatus 1. In one implementation example, the image forming apparatus 1 may have set values for printing missing pages. In other implementations, the instructions for the job being executed may include settings for printing missing pages.

If the missing page printing setting value is ON (YES in step S520), the image forming apparatus 1 advances the control to step S524; otherwise (NO in step S520), the process in FIG. 11 ends. let

In step S508, the image forming apparatus 1 analyzes the image data acquired in step S504. The analysis may include character recognition for the image data.

In step S510, the image forming apparatus 1 compares the image of the image data acquired in step S504 (image on paper) with the image to be printed in the job being executed (image for output). The comparison in step S510 may include, as described with reference to FIG. 6, rotating either the on-paper image or the output image and then comparing the two with the other.

In step S512, the image forming apparatus 1 determines whether the output image includes an on-paper image.

For example, if the output image includes the images shown as original documents 311 and 312 in FIG. 3, and the on-paper image includes the image shown as paper 301 in FIG. is included in the original 311, that is, pixels at the same positions as all colored positions on the paper 301 are also colored on the original 311, so it is determined that the output image includes the on-paper image. On the other hand, if the output image includes the images shown as original documents 311 and 312 in FIG. 3, and the image on paper includes the image shown as paper 304 in FIG. Since both the image of the original 311 and the image of the original 312 include colored pixels at uncolored positions, it is determined that the output image does not include an on-paper image.

Note that "the output image includes an on-paper image" means that the output image includes a given percentage of the on-paper image (for example, 95% or more (or 98% or more) of the pixels constituting the on-paper image). ) may also be meant to include.

If the image forming apparatus 1 determines that the output image includes an image on paper (YES in step S512), the control proceeds to step S514; otherwise (NO in step S512), the control proceeds to step S524. Proceed.

In step S514, the image forming apparatus 1 identifies a portion where the output image differs from the on-paper image. An example of a different portion is a portion of the output image that is additionally colored with respect to the image on the paper. The portion identified in step S514 is also referred to as an "additional portion" in this specification.

For example, if the output image includes the images shown as the originals 311 and 312 in FIG. 3, and the on-paper image includes the image shown as the paper 301 in FIG. 312), in the image of the original 311 including the on-paper image, an additional portion to the on-paper image is specified. In this example, the colored portion within the frame 3112 in FIG. 4 is specified as the additional portion to be specified.

In step S516, the image forming apparatus 1 determines whether the output image and the image on the paper match. An example of "matching" may mean that the output image does not include any colored portions other than the colored portions common to the on-paper image. Another example may mean that the output image does not include any colored portions other than the colored portions common to the image on the paper, and the colors of the colored portions match. Note that when the positions of the colored portions of the output image and the image on the paper match, and only the colors of the colored portions differ, the additional portion may mean a portion whose color is different between the two.

If the image forming apparatus 1 determines that the output image and the image on the paper match (YES in step S516), control proceeds to step S534; otherwise (NO in step S516), control proceeds to step S534. Control proceeds to S518.

In step S518, image forming apparatus 1 instructs the print engine within image forming apparatus 1 to print an additional portion on the paper conveyed in step S500.

In step S524, the image forming apparatus 1 instructs the print engine within the image forming apparatus 1 to print the image of the entire page of the document onto the paper on the paper feed tray 4. A specific example of a situation in which printing is instructed in step S524 will be described with reference to FIGS. 12 and 13.

FIG. 12 is a diagram for explaining a sixth specific situation in which the additional printing function is used. In the situation shown in FIG. 12, the paper placed on the manual feed tray 4X is shown as a paper 301 in the frame 300E. The document file that is the output target of the job being executed (job (2)) includes only the original document 312, as shown in the frame 310E. In this case, although the image on paper 301 includes a colored portion (YES in step S506), it is not included in the original 312 (NO in step S512). In this case, the image forming apparatus 1 prints the entire image of the original document 312 on a sheet different from the sheet conveyed in step S500.

FIG. 13 is a diagram for explaining a seventh specific situation in which the additional printing function is used. In the situation shown in FIG. 13, a blank sheet (sheet 301F) is placed on the manual feed tray 4X. The document file that is the output target of the job being executed (job (2)) includes a manuscript 312, as shown in a frame 310E. In this case, since the paper conveyed in step S500 is blank (NO in step S506), the condition is that the missing page printing setting value is ON (YES in step S520). The image forming apparatus 1 prints the entire image of the original document 312 on the paper conveyed in step S500.

Returning to FIG. 11, in step S526, the image forming apparatus 1 determines whether or not a jam has occurred within the image forming apparatus 1 with the paper that has started to be conveyed in step S500. If the image forming apparatus 1 determines that a jam has occurred (YES in step S526), the control proceeds to step S530, and if not (NO in step S526), the control proceeds to step S528.

In step S528, the image forming apparatus 1 determines whether toner has run out in the image forming apparatus 1. If the image forming apparatus 1 determines that toner has run out (YES in step S528), the process proceeds to step S530, and if not (NO in step S526), the process proceeds to step S5324.

In step S530, the image forming apparatus 1 temporarily stops the job being executed. Thereafter, in step S532, the image forming apparatus 1 waits until the job can be restarted (the current jam and toner shortage are resolved) (NO in step S532), and when it determines that the job can be restarted (step S532 (YES), control proceeds to step S533.

In step S533, the image forming apparatus 1 restarts the stopped job. Thereafter, the conveyance of the paper that was started in step S500 (and printing on the paper as necessary) is completed.

In step S534, the image forming apparatus 1 determines whether or not there is an unoutputted page in the job being executed, or whether or not paper is placed on the manual feed tray 4X. If the image forming apparatus 1 determines that there is an unoutputted page in the job being executed or that paper is placed on the manual feed tray 4X (YES in step S534), control returns to step S500. On the other hand, if the image forming apparatus 1 determines that there are no unoutput pages in the job being executed and that no paper is placed on the manual feed tray 4X (NO in step S534), the image forming apparatus 1 executes the process of step S11. Terminate it.

In the process described above with reference to FIG. 11, the image forming apparatus 1 acquires an on-paper image that is an image of the paper placed on the manual feed tray 4X (step S504). The image forming apparatus 1 uses the on-paper image and the output image (the image of the document of the job being executed), which is the image to be output, to specify the output content of the output image (steps S510 to S510). S514), and causes the print engine to form an image of the output content on paper (step S518).

In the process of FIG. 11, if the image on the paper matches the output image, the conveyance of the paper on the manual feed tray 4X ends without forming an image (YES in step S516).

In the process shown in FIG. 11, a job being executed due to paper jam or toner exhaustion is temporarily stopped, and a job is resumed when the cause is resolved.

When restarting a job that has been stopped due to the occurrence of a paper jam, the image forming apparatus 1 may change the contents of the restarted job depending on the state of the paper. More specifically, if the paper transported in step S500 becomes unusable due to a paper jam (many wrinkles, tears, etc.), the image forming apparatus 1 The image that is scheduled to be printed is printed on another sheet of paper in the paper feed tray 4. If the scheduled print content is only a part of the original image (the additional part identified in step S514), the paper to be printed is changed from the paper on the manual feed tray 4X to the paper in the paper feed tray 4. In this case, the image forming apparatus 1 may change the print content from a part of the image of the document to the entire image of the document. In one example, the image forming apparatus 1 may detect that the paper has become unprintable due to a button operation by the user.

In the process of FIG. 11, when a blank sheet of paper is placed on the manual feed tray 4X, it is determined whether or not to print the image on which the output image has been formed, according to the missing page printing setting value. More specifically, if the setting value for printing missing pages is ON, the output image is printed (YES in step S520, step S524), and if the setting value for printing missing pages is OFF, the output image is printed. No (NO in step S520). If the output image includes images of a plurality of pages, images of pages that have not yet been output are formed as images to be output in step S524.

FIG. 14 is a diagram for explaining the eighth specific situation in which the additional printing function is used. In the process shown in FIG. 11, when a blank sheet of paper is placed on the manual feed tray 4X and the setting value for printing missing pages is ON, the job is executed as shown in FIG. 14.

More specifically, in the situation shown in FIG. 14, the configuration of the paper on the manual feed tray 4X shown in the frame 300G is different from the situation shown in FIG. That is, as shown in the frame 300G, in addition to the sheets 301, 302, and 304, a fourth sheet of paper 305G is placed on the manual feed tray 4X. Paper 305G is blank.

When the image forming apparatus 1 determines that the paper 305G does not include data for printing (NO in step S506), the image forming apparatus 1 prints the frame on the condition that the missing page printing setting value is ON (YES in step S520). The unoutputted images are searched from among the four pages of images in 310. In the example of FIG. 14, the images of originals 311, 312, and 314 have already been output as sheets 321, 322, and 324, but the images of original 313 have not yet been output. Therefore, image forming apparatus 1 obtains the image of document 313 as a search result. Then, the image forming apparatus 1 prints the entire image of the document 313 on the paper 305G, thereby outputting it as the paper 323B.

In the process of FIG. 14, if the missing page printing setting value is OFF and the sheet conveyed in step S500 is blank, the next sheet is not conveyed. In other words, the conveyance in step S500 continues until it is detected that the conveyed paper is blank.

In the process of FIG. 11, the additional portion is printed on the paper in step S518. Note that if the difference between the image on the paper and the output image cannot be compensated for by additional printing, the image forming apparatus 1 removes the paper from the paper feed tray 4 instead of printing the additional portion in step S518. The entire output image may be printed on the paper by unrolling the paper. At this time, the paper conveyed in step S500 is discharged to the paper discharge tray 70 without forming an image thereon.

An example of a case where the difference between the image on the paper and the image for output cannot be compensated for by additional printing is that the image for output is created by adding the first character string to the position corresponding to the first character string in the image on the paper. This is a case where a second character string with spelling errors corrected is included. Another example is a case where the output image includes a second character string unrelated to the first character string at a position corresponding to the first character string in the paper image. Yet another example is a case where the output image includes a second object, which is a reduced version of the first object, at a position corresponding to the first object in the image on the paper. Still another example is that the output image has a color lighter than the first color or a color tone completely different from the first color at a position corresponding to an object colored with the first color in the image on the paper. This is the case when objects are colored in different colors.

If the image forming apparatus 1 detects that the above-mentioned difference that cannot be compensated for by additional printing has occurred, the image forming apparatus 1 prints the output image on the paper in the paper feed tray 4 before printing the output image on the paper in the paper feed tray 4. In parallel with printing the original image, a screen indicating that the above-mentioned difference has occurred may be displayed on the operation panel 9. An example of the displayed screen includes a message indicating that a difference has occurred between the on-paper image and the output image that cannot be compensated for by additional printing. Another example displays the on-paper image and the output image itself.

If the image forming apparatus 1 detects that the above-mentioned difference that cannot be compensated for by additional printing has occurred, the image forming apparatus 1 prompts the user to transfer the entire output image to a paper different from the paper placed on the manual feed tray 4X (paper feed tray 4 It is also possible to select whether to print on the above-mentioned paper) or to omit the additional printing regarding the above-mentioned difference. The user inputs the contents according to the selection into the image forming apparatus 1. The image forming apparatus 1 prints the entire output image on paper (paper in the paper feed tray 4) different from the paper placed on the manual feed tray 4X, or performs additional printing related to the above-mentioned difference, according to input from the user. Omitted.

In the process of FIG. 11, the image forming apparatus 1 identifies the additional portion in step S514 each time the paper on the manual feed tray 4X is conveyed, but the additional portion may be identified once during job execution. . For example, in the situation shown in FIG. 3, when the image forming apparatus 1 identifies the additional portion (the colored portion within the frame 3112 in FIG. 4) by comparing the image on the paper 301 and the image on the original 311, In the case of sheets 302, 303, and 304, the control in step S514 can be omitted. That is, the additional portion specified for paper 301 can also be used as an additional portion for sheets 302, 303, and 304.

Note that when printing the additional portions on each of the sheets 302, 303, and 304, the image forming apparatus 1 may specify the arrangement of the additional portions based on the images of the sheets 302, 303, and 304, respectively. That is, the image forming apparatus 1 sets the arrangement of the additional portions so that the images on the sheets 302, 303, and 304 form the respective images on the original documents 312, 313, and 314 by printing the additional portions. Good too.

Furthermore, if the additional portion matches a given pattern, the image forming apparatus 1 may modify the additional portion to be printed based on the pattern. More specifically, assume that the additional portion matches the page number pattern. If the additional portion includes two hyphen signs and a number between the two hyphen signs, the image forming apparatus 1 may determine that the additional portion matches the page number pattern. In this case, the image forming apparatus 1 may change the number included in the additional portion for each page on which the additional portion is printed. In the example of FIG. 3, paper 301 corresponds to manuscript 311 (the first page of the file to be output). Therefore, when printing the additional portion on the paper 301, the image forming apparatus 1 uses “1” as the number in the additional portion. Paper 303 corresponds to manuscript 313 (the third page of the file to be output). Therefore, when printing the additional portion on the paper 303, the image forming apparatus 1 uses “3” as the number in the additional portion.

Each of the embodiments disclosed this time should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is indicated by the claims rather than the above description, and it is intended that all changes within the scope and meanings equivalent to the claims are included. Further, the inventions described in the embodiments and each modification are intended to be implemented alone or in combination to the extent possible.

Reference Signs List 1 image forming apparatus, 2 apparatus main body, 3 first scanner, 4 paper feed tray, 4X manual feed tray, 7 second scanner, 9 operation panel, 10 main body control unit, 70 paper output tray.

Claims (17)

A computer-implemented method of forming an image on paper placed in a tray, the method comprising:
obtaining an on-paper image that is an image of the paper;
a step of specifying output content of the output image using the on-paper image and an output image that is an image to be output;
causing a print engine to form an image of the output content on the paper,
The step of specifying the output content includes:
Comparing the on-paper image and the output image;
When the output image includes elements that are common to the paper image at a predetermined ratio or more, elements of the output image that are different from the paper image are specified as the output content. An image forming method , including : Comparing the on-paper image and the output image includes:
rotating one of the on-paper image and the output image;
2. The image forming method according to claim 1 , further comprising comparing the other of the on-paper image and the output image with the rotated one. further comprising the step of performing character recognition on the on-paper image,
In the step of specifying the output content, when the different element includes a word for correction with respect to the word of the image on the paper, a part of the different element that constitutes the correction word is excluded from the output content. The image forming method according to claim 1 or claim 2 , comprising: The step of specifying the output content includes:
identifying an output object that is an object that includes at least a portion of the different elements in the output image;
identifying an on-paper object that is an object corresponding to the output object in the on-paper image;
determining whether a difference between the output object and the on-paper object satisfies given requirements;
If the difference between the output object and the paper object satisfies the given requirements, excluding a portion of the different elements that constitute the output object from the output content; The image forming method according to claim 1 or 2 . The step of specifying the output content includes specifying the entire output object as the output content if the difference between the output object and the paper object does not meet the given requirements,
Image formation according to claim 4 , further comprising the step of causing the print engine to form an image of the output content on recording paper different from the paper when the entire output object is specified as the output content. Method. 5. The image forming method according to claim 4 , further comprising the step of displaying given information on a display if a difference between the output object and the paper object does not meet the given requirements. Determining whether the difference satisfies the given requirement includes determining whether the set of a first image including a first object and a second image including a second object is different from the second image. Any one of claims 4 to 6 , comprising using a classifier that has been subjected to a learning process using training data tagged with information indicating whether or not the user wishes to change to the first image. The image forming method according to item 1. The step of specifying the output content includes:
identifying an output object that is an object including the different element in the output image;
identifying an on-paper object that is an object corresponding to the output object in the on-paper image;
According to any one of claims 4 to 7 , the method includes generating image data of the output content as image data for adjusting a difference between the output object and the paper object. image forming method. Any one of claims 1 to 8 , wherein the step of specifying the output content includes specifying the entire output image as the output content when the on-paper image does not include an element for printing. The image forming method according to item 1. The image forming method according to any one of claims 1 to 9 , further comprising the step of avoiding outputting the output image when the on-paper image does not include an element for printing. further comprising the step of transporting the paper placed on the tray in order to obtain an image on the paper,
11. The image forming method according to claim 10 , wherein in the conveying step, conveyance of the paper is continued until an image that does not include printing elements is obtained as the image on the paper. further comprising the step of transporting the paper placed on the tray in order to obtain an image on the paper,
In the step of forming the output contents, when a jam occurs during the conveyance,
causing the print engine to form an image of the output content on the paper if the paper is available for printing;
The image according to any one of claims 1 to 11 , comprising causing the print engine to form the output image on recording paper different from the paper if the paper is not available for printing. Formation method. The step of forming the output content includes causing the print engine to:
Interrupting image formation in response to an occurrence of ink shortage for image formation;
restarting image formation in response to resolution of the ink shortage;
The image forming method according to any one of claims 1 to 12 , comprising: 14. The step of forming the image of the output content on the paper includes forming the image of the output content on a paper other than the paper in the same job as the paper. The image forming method according to item 1. The image forming method according to any one of claims 1 to 14 , further comprising the step of avoiding image formation on the paper if the image on the paper matches the output image. . print engine and
An image forming apparatus, comprising: a controller that executes the method according to any one of claims 1 to 15 . A program that, when executed by a computer, causes the computer to execute the method according to any one of claims 1 to 15 .

Images