JP2010062710A - Image processor and image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a user to quickly recognize a present processing state by shortening the time for preview image generation. <P>SOLUTION: A digital multifunction machine 1 which is one embodiment of the image processor generates a preview image by using image data to be the object of copying, filing and data transmission, etc. Then, the generation of the preview image is started in the stage of obtaining the image data and the generation state is displayed by a message or the like. For instance, at a processing amount display part 71 on a screen displayed in the figure, it is indicated that the generation of the preview image is completed to the twelfth sheet and it is displayed that the total amount of the image data to be processed finally is 125 sheets. That is, since the processing amount display part 71 for indicating that the preview image is generated displays a processing amount in each time the preview image of the image data of one sheet is generated, the time for the preview image generation is shortened and the user quickly recognizes the present processing state. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing apparatus and an image processing method, and more particularly to an image processing apparatus and an image processing method capable of displaying a preview of image data before final processing.

  Conventionally, in an image processing apparatus such as a multi-function device having multiple functions such as copying, printer, scanner, facsimile, and Internet communication, a preview is displayed before execution of the image data to be output for printing or transmission. Some of them have a function to perform.

For example, in the information processing apparatus described in Patent Document 1, in order to eliminate the trouble of executing a print instruction after displaying a preview, an actual output result is displayed as an image image from the spooled intermediate code, and an output page preview is displayed. The print data is generated by the despooling means and the actual print output is performed without inputting a print instruction after the display is completed.
In the information processing apparatus, when preview display is performed, the number of pages on which preview display is performed can be set.
JP 2006-171861 A

The above-mentioned patent document 1 shows the contents of preview display only for a predetermined number of pages desired by the user, but the generation status is recognized by the user by displaying the preview image generation status as needed. There is no description about the points to be performed, and the user cannot determine whether the device is generating a preview image or is in a hang-up state, which may cause anxiety to the user.
Further, in Patent Document 1, when a preview image having a predetermined number of pages is generated, the preview image can be displayed at the stage where the generation of the preview image having the predetermined number of pages has been completed. For example, it takes time to display the preview image, which causes the user to wait.

  The present invention has been made in view of the above-described circumstances. When previewing image data to be final processed such as print output, the user can reduce the time until preview image generation so that the user can An object of the present invention is to provide an image processing apparatus and an image processing method capable of quickly recognizing a state.

  In order to solve the above problems, a first technical means of the present invention includes an input unit that inputs image data, a processing unit that executes predetermined final processing using the image data input to the input unit, and final processing An image processing apparatus including a preview image generation unit that generates a preview image of image data to be processed and a display unit that displays the preview image generated by the preview image generation unit. When one preview image is generated by the generation unit, a display indicating that one preview image has been generated is performed.

  The second technical means includes an image reading unit that reads an original image and outputs image data in the first technical means, and the image data read and output by the image reading unit is input to the input unit. It is characterized by that.

  According to a third technical means, in the first or second technical means, an image forming unit that forms an image of image data to be output on an image forming medium is provided as one of final processes. Is.

  According to a fourth technical means, in any one of the first to third technical means, the display unit displays a display indicating that a preview image has been generated for each image when there are a plurality of image data. It is characterized by executing.

  According to a fifth technical means, in the fourth technical means, the display unit updates and displays a display indicating that a preview image has been generated for each preview image. .

  A sixth technical means is any one of the first to fifth technical means, wherein the preview image generating means starts generating the preview image when the image data is input to the input unit. is there.

  In a seventh technical means, in any one of the first to sixth technical means, the display unit inputs all the image data to be generated as a preview image to the input unit, and then inputs the input image data. The total number of pages is displayed.

  According to an eighth technical means, in any one of the first to seventh technical means, the preview image generation unit further displays a preview image when a display indicating that the preview image is generated is performed on the display unit. When there is image data to be generated, the generation of the preview image is continued even when the display unit is displaying.

  According to a ninth technical means, in any one of the first to eighth technical means, the display unit can display the generated preview image after executing the display indicating that the preview image has been generated. It is characterized by.

  The tenth technical means is the ninth technical means characterized in that the final processing can be executed after the display unit displays the preview image.

  The eleventh technical means is the tenth technical means characterized in that the final processing includes image data transmission processing, image forming processing by the image forming means, and image data storage processing.

  The twelfth technical means includes an input step of inputting image data, a processing step of executing a predetermined final process using the image data input in the input step, and a target of the final process before executing the final process. An image processing method having a preview image generation step for generating a preview image of the image data and a display step for displaying the preview image generated in the preview image generation step. The display step is 1 in the preview image generation step. It is characterized in that a display indicating that one preview image has been generated is performed at the stage where one preview image has been generated.

  According to the present invention, when previewing image data to be subjected to final processing such as printout, an image that allows a user to quickly recognize the current processing state by shortening the time until preview image generation. A processing apparatus and an image processing method can be provided.

Furthermore, according to the present invention, generation of a preview image is started immediately upon input of image data, so that it is possible to shorten the time for generating a preview image.
Also, by displaying the preview image generation result for each image, the user can grasp the generation status of the preview image. In addition, without waiting for the user to complete the generation of all the preview images, the preview image can be grasped as needed to be displayed, and the user can confirm the necessary image data and perform final processing such as transmission and printing. Can be executed.

<Description of the overall configuration example of a digital multi-function peripheral to which the present invention is applicable>
FIG. 1 is a diagram illustrating an example of an apparatus to which the image processing apparatus of the present invention can be applied, and is a diagram illustrating a configuration of a digital multifunction peripheral having an inner finisher.
The digital multi-functional peripheral 1 shown in FIG. 1 includes a post-processing device 300 and two paper feeding devices 400 and 500. The digital multi-function peripheral 1 is a scanner using a CCD (Charge Coupled Device), and is used for reading a document as a bitmap image of RGB (R: red, G: green, B: blue) having a predetermined resolution. A document conveying / reading unit 200 having a unit is attached.

The digital multi-function peripheral 1 selectively performs multi-color and single-color image formation by electrophotography based on image information input via a network or the like, and records the formed image on a sheet. The digital multi-function peripheral 1 includes an image forming unit 106, a paper storage unit 107, and a paper transport unit 108.
The image forming unit 106 includes an exposure unit 110, an intermediate transfer belt 111, and a secondary transfer roller 114. The image forming stations 112A to 112D are arranged in a line between the intermediate transfer belt 111 and the exposure unit 110. ing.

Each of the image forming stations 112 </ b> A to 112 </ b> D forms an image based on the image information of each of the four hues including cyan, magenta, and yellow, which are three subtractive primary colors obtained by color separation of a color image. I do.
The black image forming station 112A includes a photosensitive drum 101A, a developing unit 102A, a charging roller 103, a primary transfer roller 104, a cleaning unit 105, and the like.

  The charging roller 103 is a contact-type charger that uniformly charges the surface of the photosensitive drum 101A to a predetermined potential. Instead of the charging roller 103, a contact-type charger using a charging brush or a contact-type charger using a charging charger can be used. The exposure unit 110 includes a light source such as a semiconductor laser, a polygon mirror, a reflection mirror, and the like. The photosensitive drum 101A is irradiated with image light based on the black image information from the exposure unit 110, and an electrostatic latent image corresponding to the image information of the black hue is formed.

The developing unit 102A supplies black toner to the surface of the photosensitive drum 101A on which the electrostatic latent image is formed, and develops the electrostatic latent image into a toner image. The cleaning unit 105 collects the toner remaining on the surface of the photosensitive drum 101A.
The intermediate transfer belt 111 forms a loop-shaped movement path. The intermediate transfer belt 111 passes between the photosensitive drum 101A and the primary transfer roller 104 in the lower movement path. A primary transfer bias having a polarity opposite to the toner charging polarity is applied to the primary transfer roller 104 by constant voltage control, and the toner image formed on the photosensitive drum 101 </ b> A is transferred to the outer peripheral surface of the intermediate transfer belt 111.

  Each of the image forming stations 112B, 112C, and 112D for each hue of cyan, magenta, and yellow is configured in the same manner as the image forming station 112A. However, the image forming stations 112B, 112C, and 112D are irradiated from the exposure unit 110 with image light modulated by image information of each hue of cyan, magenta, and yellow. Each of the developing units 102B, 102C, and 102D supplies toners of cyan, magenta, and yellow hues to the photosensitive drums 101B, 101C, and 101D. As a result, toner images of hues of cyan, magenta, and yellow are formed on the photosensitive drums 101B, 101C, and 101D, respectively.

  When image information of only a part of the hues of yellow, magenta, cyan, and black is input, an electrostatic latent image is displayed in only part of the four image forming stations corresponding to the hue of the input image information. And a toner image are formed. For example, when a monochrome image is formed, an electrostatic latent image and a toner image are formed only at the black image forming station 112 A, and only the black developer image is transferred to the outer peripheral surface of the intermediate transfer belt 111.

  At the time of full-color image formation, electrostatic latent image formation and toner image formation are performed in all of the four image forming stations 112A, 112B, 112C, and 112D. Yellow, magenta, cyan, and black toner images are sequentially superimposed and transferred onto the outer peripheral surface of the intermediate transfer belt 111. The toner image transferred to the outer peripheral surface of the intermediate transfer belt 111 is conveyed to a position facing the secondary transfer roller 114 by the rotation of the intermediate transfer belt 111. The secondary transfer roller 114 is in pressure contact with the outer peripheral surface of the intermediate transfer belt 111 with a predetermined nip pressure. A position where the intermediate transfer belt 111 and the secondary transfer roller 114 face each other is an image forming position 130 where an image is formed on a sheet (image forming medium).

The paper storage unit 107 includes paper feed cassettes 116 </ b> A and 116 </ b> B and a manual feed tray 117 that each store a plurality of sheets of a single type. In addition, the digital multi-function peripheral 1 is optionally provided with paper feeding devices 400 and 500 as external paper storage units.
The paper feeding device 400 is disposed below the digital multifunction peripheral 1 and includes paper feeding cassettes 116C and 116D. The paper feeding device 500 is disposed on the side surface of the digital multi-function peripheral 1 and stores a large amount of a single type of plural sheets.

A first paper transport path 131 is formed in the paper transport unit 108 from the paper feed cassettes 116 </ b> A and 116 </ b> B via the image forming position 130 to the post-processing device 300 installed on the upper surface of the digital multifunction peripheral 1. Pickup rollers 121A and 121B, paper feed rollers 122A and 122B, registration rollers 132, a fixing unit 133, a fourth transport roller, a first paper discharge roller 134, and the like are arranged in the first paper transport path 131.
In addition, a second paper transport path 135 that connects the manual feed tray 117 to the upstream side of the registration roller 132 in the paper transport direction of the first paper transport path 131 is formed in the paper transport unit 108.

Further, the sheet conveying unit 108 is connected to the upstream side of the registration roller 132 in the sheet conveying direction of the first sheet conveying path 131 between the fixing unit 133 of the first sheet conveying path 131 and the first paper discharge roller. A third sheet conveyance path 136 (double-side conveyance path) is formed. The third paper transport path 136 is for transporting a single-sided image-formed paper that is switched back and transported by reversing the first paper discharge roller during double-sided image formation for forming images on both sides of the paper.
In addition, a fifth paper transport path 137 that connects the paper feeding device 500 to the first paper transport path 131 is also formed in the paper transport unit 108. The paper feed cassettes 116 </ b> C and 116 </ b> D in the paper feed device 400 are communicated with the first paper transport path 131 via a sixth paper transport path 138 provided in the paper feed apparatus 4.

  The paper supplied from the paper storage unit 7 and the paper feeding devices 400 and 500 is transported through the first paper transport path 131 and receives the transfer of the toner image from the intermediate transfer belt 111 when passing through the image forming position 130. . Further, when forming a double-sided image, the sheet on which the toner image has been transferred is conveyed in a switchback manner by the reversal of the first discharge roller, and is conveyed again to the first sheet conveying path 131 via the third sheet conveying path 136. . When passing through the image forming position 130, the toner image is transferred from the intermediate transfer belt 111 to the other surface. The registration rollers 132 arranged in the first paper transport path 131 are provided from the paper storage unit 107 (paper feed cassettes 116 </ b> A and 116 </ b> B, manual feed tray 117), the paper feeder 400, the paper feeder 500, or the third paper transport path 136. When the leading edge of the conveyed paper arrives, the rotation is stopped.

  The registration roller 132 rotates at the timing when the leading edge of the toner image attached to the intermediate transfer belt 111 reaches the image forming position 130 when the leading edge of the paper that has passed the registration roller 132 reaches the image forming position 130. To start. As a result, the sheet is conveyed through the first sheet conveyance path 131 by the registration roller 132 so that the leading end of the sheet faces the leading end of the toner image at the image forming position 130. Note that the registration roller 132 also has a function of correcting the oblique feeding of the paper by contacting the leading edge of the paper while the rotation is stopped.

  The sheet on which the toner image is transferred at the image forming position 130 is guided to the fixing unit 133. The fixing unit 133 includes a heating roller 113A that has been heated to the toner melting temperature, and a pressure roller 113B that is in pressure contact with the heating roller 113A with a predetermined nip pressure. The sheet is heated and pressurized when passing through the fixing unit 133, and is discharged to the post-processing apparatus 300 in a state where the toner image is fixed on the surface.

  At the image forming position 130, all of the toner image adhering to the peripheral surface of the intermediate transfer belt 111 should be transferred to the sheet. However, a part may remain on the intermediate transfer belt 111. Further, the toner image attached to the peripheral surface of the intermediate transfer belt 111 may pass through the image forming position 130 without being transferred to the paper by the processing described later. The toner remaining on the intermediate transfer belt 111 after passing through the image forming position 130 is collected by the cleaning unit 113.

  On the other hand, the post-processing device 300 carries the paper discharged from the option delivery port of the digital multi-function peripheral 1 into the device, performs each post-processing, and stacks it on the paper discharge tray. Post-processing includes stapling the paper, discharging the paper to a designated paper discharge tray among a plurality of paper discharge trays, and offsetting the discharge position on the paper discharge tray.

Taking the copy mode as an example, the operation of the digital multi-function peripheral 1 will be described.
First, when a document is set on the document set tray 211 of the document conveyance reading unit 200, the document detection sensor 212 detects that the document is set. Then, by operating the operation panel of the document conveying / reading unit 200, the print paper size, magnification, and the like are input and set. Thereafter, the start of copying is instructed by operating the operation panel 213.

  In response to these operations, in the document conveyance reading unit 200, each document on the document set tray 211 is pulled out one by one by the pickup roller 213, and the document is transferred to the platen glass 216 via the gap plate 214 and the conveyance roller 215. Then, the document is conveyed on the platen glass 216 in the sub-scanning direction and discharged to the document discharge tray 217.

  At this time, the first reading unit 221 reads the surface (lower side) of the document. The first scanning unit 223 of the first reading unit 221 is moved and positioned, the second scanning unit 224 is positioned at a predetermined position, and the surface of the document is placed on the platen glass 216 by the exposure lamp of the first scanning unit 223. The reflected light of the document is guided to the imaging lens 226 by the respective reflection mirrors of the first and second traveling units 223 and 224, and the reflected light of the document is CCD (Charge Coupled Device) by the imaging lens 226. The image on the surface of the original is focused on the CCD 227, and the image on the surface of the original is read.

  Further, the second reading unit 222 reads the back surface (upper side surface) of the document. The second reading unit 222 is disposed above the platen glass 216, and collects reflected light of the original for each exposure lamp (LED (Light Emitting Diode) array, fluorescent lamp, etc.) that irradiates the back side of the original. A light-sensitive Selfoc lens array, and a contact image sensor (CIS) that photoelectrically converts reflected light of a document received through the Selfoc lens array and outputs an analog image signal are provided.

  Further, it is possible to open the upper housing of the document conveyance reading unit 200, place the document on the platen glass 216, and read the surface of the document by the first reading unit 221 in this state. In this case, the first and second scanning units 223 and 224 are moved in the sub-scanning direction while maintaining a predetermined speed relationship with each other, the original on the platen glass 216 is exposed by the first scanning unit 223, and the first The reflected light from the original is guided to the imaging lens 226 by the second scanning units 223 and 224, and the image of the original is formed on the CCD 227 by the imaging lens 226.

  When one or both sides of the document are read in this way, image data indicating an image on one or both sides of the document is input to a control unit such as a microcomputer, where various image processing is performed on the image data, and the image data is The image is output to the image forming unit 106.

<Description of inner finisher operation>
FIG. 2 is an enlarged view of the post-processing device 300. In the post-processing apparatus 300, as post-processing, a stapling process for stapling a sheet and a punching process for punching a sheet can be supported. The post-processing apparatus 300 includes an entrance roller 171, a stapler 172, a punch pin 178, an alignment processing unit 173, a paper discharge roller 174, a paper rear end detection sensor 176, a paper discharge tray 175, and the like. The paper discharged by the first paper discharge roller 134 of the digital multi-function peripheral 1 is conveyed to the alignment processing unit 173 by the entrance roller 171, and the alignment processing unit 173 sequentially aligns the paper on the processing table. . The alignment processing unit 173 includes an alignment plate, a paddle, a scraping belt, and the like.

  In the case of stapling, the stapler 172 performs stapling at a designated location on the aligned bundle of sheets. The stapled sheet bundle is discharged onto a discharge tray 175 by a discharge roller 174. In the punching process, when the sheet trailing edge detection sensor 176 detects the trailing edge of the sheet, the sheet conveyance is temporarily stopped and the punch pin 178 punches a hole at the trailing edge of the sheet. Thereafter, the sheet is conveyed to the alignment processing unit 173 and aligned, and then discharged onto the discharge tray 175 by the discharge roller 174.

  As described above, the first paper transport path 131 is formed in the digital multi-function peripheral 1 from the paper storage unit 107 to the post-processing device 300 via the image forming position 130 of the image forming unit 106. Yes. In the first sheet conveyance path 131, sheets are fed from the sheet storage unit 7 and the sheet feeding cassettes of the sheet feeding devices 400 and 500. Whether or not a sheet is fed from each sheet feeding cassette is detected by a sheet feeding sensor provided corresponding to each sheet feeding cassette.

In addition, a registration sensor is disposed in the vicinity of the registration roller 132 disposed in the first paper transport path 131. The registration sensor detects whether the leading edge of the paper has reached the position where the registration roller 132 is disposed.
The first paper discharge roller (first discharge unit) 134 disposed in the first paper transport path 131 is configured to be driven forward and backward. The first paper discharge roller 134 is driven to rotate forward to convey the paper to the post-processing device 300 through the option delivery port. Further, the first paper discharge roller 134 is driven to rotate in the reverse direction with the trailing edge of the paper chucked, so that the paper is switched back and conveyed to the third paper conveyance path 136.

  A first sheet trailing edge detection sensor is disposed in the vicinity of the first paper discharge roller 134. The first paper trailing edge detection sensor detects whether or not the trailing edge of the paper conveyed to the post-processing device 300 has reached the first paper discharge roller 134. Before and after the switchback conveyance, the leading edge and the trailing edge of the sheet are switched.

  The third paper transport path 136 branched from the first paper transport path 131 is a fixing unit of the first transport roller 161 disposed between the fixing unit 133 and the first paper discharge roller 134 in the first paper transport path 131. Branches on the 133 side. Similarly to the first paper discharge roller 134, the first transport roller 161 is configured to be driven forward and backward. The first transport roller 161 transports the paper to the first paper discharge roller 134 by being driven forward. In addition, the first transport roller 161 transports the paper that is switchback transported by being driven in the reverse direction to the third paper transport path 136.

  Second and third transport rollers 162 and 163 are further arranged in the third paper transport path 136. These second and third transport rollers 162 and 163 rotate only in one direction and transport the paper to the registration roller 132 again.

<Other embodiments of the finisher>
FIG. 3 is a schematic diagram illustrating another example of the post-processing apparatus. The post-processing device 301 in this example guides the paper discharged from the main body of the digital multifunction device 1 to the inside of the device by the entrance roller 311, and passes the inside of the device without processing the paper according to an instruction from the digital multifunction device 1. Or a stapling process in which sheets are bundled and stapled inside the apparatus.

  In the post-processing device 301, when the non-staple mode is selected according to an instruction from the digital multi-function peripheral 1, the sheet is introduced into the device by the entrance roller 311 and passes through the branching claws 321 and 322 (normally branching). The claws 321 and 322 are positioned in the direction of the non-staple conveyance path 331), and are discharged and stacked on a discharge tray 341 that can be moved up and down by a discharge roller 312. At this time, the paper discharge guide plate 351 is in a closed state.

When the interrupt tray discharge mode is selected in the operation unit of the digital multi-function peripheral 1, the branching claw 321 rotates by a predetermined angle, the paper is transported to the interrupt tray transport path 332, and is discharged to the interrupt tray 342 by the paper discharge roller 313. Loaded.
When the staple mode is selected in the operation unit of the digital multi-function peripheral 1, the branching claw 322 is activated, the paper is carried into the staple conveyance path 333, and is further ejected to the staple tray 361 by the staple tray ejection roller 314 and stacked. Is done.

The paper discharged to the staple tray 361 is dropped downward on the staple tray 361 for each sheet by the tapping roller 315, pressed against the paper trailing edge reference fence 362, and the trailing edge is aligned.
The aligned sheets are subjected to binding processing at one or two positions at a predetermined position at the rear end of the sheet bundle by the end surface binding stapler 363. The sheet bundle subjected to the binding process is lifted up to the discharge roller 312 by a discharge claw (not shown) integrated with a discharge belt (not shown). The paper discharge roller 312 is pressurized by the paper discharge guide plate 351 and is discharged and stacked on the paper discharge tray 341 by the paper discharge roller 312.

<Configuration example of an image processing system using a digital multifunction machine>
FIG. 4 is a schematic diagram illustrating a configuration example of an image processing system constructed using a digital multifunction peripheral as an example of an image processing apparatus according to an embodiment of the present invention. In FIG. 4, 1 is a digital multifunction peripheral, 2 and 3 are external computers, 4 is an Internet facsimile machine (Internet FAX machine), and 5 is a facsimile machine.

  In addition to the print function and the copy function, the digital multi-function peripheral 1 has a function of transmitting / receiving image data by fax (facsimile function) and / or a function of transmitting / receiving image data by Internet FAX (Internet FAX function). Various external devices are connected to the digital multi-function peripheral 1 via a communication network. For example, an external computer 2 such as a personal computer (PC) is connected to a communication network LN laid as a local communication network and connected to an Internet network IN connected via a gateway or the like not shown in the figure. Is connected to an external computer 3 and an Internet FAX apparatus 4.

  An external facsimile machine 5 is connected to the digital multi-function peripheral 1 via a public telephone line network PN. As described above, only the case where the image processing apparatus according to the present invention is applied to the digital multifunction peripheral 1 will be described. However, the image processing apparatus according to the present invention is not limited to an image forming apparatus such as a multifunction peripheral or a printer. In addition, the present invention can be applied to image transmission apparatuses such as the Internet FAX apparatus 4 and the facsimile apparatus 5.

  Hereinafter, the configuration and operation of the digital multi-function peripheral 1 will be described. FIG. 5 is a schematic block diagram illustrating a configuration example of the digital multifunction peripheral of FIG. 4, and FIG. 6 is an external view illustrating an example of a touch panel and a key operation unit in the digital multifunction peripheral of FIG.

  5 includes a touch panel 10, a panel control unit 11, a recording unit 12, a reading unit 13, a format conversion unit 14, an image storage unit 15, an image processing unit 16, an encoding / decoding unit 17, a main unit. Control unit 18, control memory 19, key operation unit 20, LAN (Local Area Network) control unit 21, control buffer 22, network control unit (NCU) 23, modem 24, and USB (Universal Serial Bus) ) Interface (I / F) 25 is provided. The digital multi-function peripheral 1 may be provided with a post-processing device as described above for performing punching (punching), stapling processing, and the like.

  The main control unit 18 includes a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). The control memory 19 includes a nonvolatile memory such as a ROM (Read Only Memory) or an EEPROM (Electrically Erasable and Programmable ROM). A program (firmware) and various setting data are stored in the control memory 19 so as to be readable from the main control unit 18. Among these, at least various setting data are stored in a rewritable memory. Further, these programs and various setting data may be stored in a hard disk as a configuration example of the image storage unit 15 described later. The control buffer 22 is composed of a volatile memory such as a RAM (Random Access Memory).

  The above-mentioned program includes commands related to generation and display of preview images, commands related to generation / transmission / reception of facsimile images and e-mails, commands related to document reading, commands related to printing, document reading and This is for the main control unit 18 to issue commands relating to printing (that is, copying) to other parts. This program is developed on the control buffer 22 by the main control unit 18, and is executed while referring to various setting data as appropriate, with the control buffer 22 used as a data area for temporary storage (work).

  The reading unit 13 is a scanner using a CCD (Charge Coupled Device), reads a document as a bitmap image of RGB (R: red, G: green, B: blue) having a predetermined resolution, and reads the read RGB image data. (Dot image data) is output to the image processing unit 16. The image processing unit 16 is configured by an application specific integrated circuit (ASIC) or the like, and performs various image processing on target image data. An example of image processing will be described later. Other parts such as the encoding / decoding unit 17 may be incorporated in the ASIC described above.

  The image storage unit 15 is configured by a hard disk or the like, and stores image data read by the reading unit 13 and passed through the image processing unit 16, image data received from the outside via the LAN control unit 21, the NCU 23, and the like. When image data is stored in the image storage unit 15, the data encoded by the encoding / decoding unit 17 can be stored. The image storage unit 15 may also temporarily store intermediate data generated during image processing in the image processing unit 16.

  The encoding / decoding unit 17 compresses the image data by encoding and decodes (decompresses) the encoded image data into the original image data. For example, the encoding / decoding unit 17 performs encoding of image data obtained by reading a document, decoding of the encoded data, decoding of encoded image data received from the outside, and the like. In the encoding / decoding unit 17, JPEG (Joint Photographic Experts Group) generally used in filing, MH (Modified Huffman), MR (Modified READ), and MMR (Modified READ) generally used in facsimile communication are used. (Modified READ) or the like can be used according to the application. As an encoding method, MH can be adopted in IP facsimile communication, and JPEG and JBIG (Joint Bi-level Image Experts Group) can be adopted in Internet facsimile communication in addition to MH, MR, and MMR.

  The format conversion unit 14 converts the read image data or image data received from the outside into a predetermined file format such as PDF (Portable Document Format), GIF (Graphics Interchange Format), or TIFF (Tag Image File Format). .

The recording unit 12 includes a printer device that employs a printing method such as an electrophotographic method or an inkjet method, and records (that is, prints) image data stored in the image storage unit 15 on an image forming medium such as recording paper. To do.
The USB I / F 25 is an I / F for connecting to a USB device such as a USB memory, and outputs image data after reading a document stored in the image storage unit 15 to the USB device. Read a file from.

  The modem 24 is composed of a facsimile modem capable of facsimile communication, and is connected to a telephone line and directly connected to the NCU 23. The NCU 23 is connected to a telephone line and controls the line. That is, the NCU 23 is hardware that performs operations for closing and opening a line with an analog public telephone line network (PSTN), and connects the modem 24 to the public telephone line network as necessary. With this configuration, the image data stored in the image storage unit 15 is transmitted to the outside by facsimile, or the facsimile image data is received from the telephone line and stored in the image storage unit 15 or directly printed by the recording unit 12. It becomes possible to do.

  The LAN control unit 21 is connected to the LAN, and performs communication of electronic mail data and Internet FAX via the Internet. The Internet FAX transmits and receives electronic mails via a computer network such as a LAN using a LAN interface or the like.

  When the touch panel 10 or the key operation unit 20 executes an operation for selecting a desired process from processes such as a document reading process, image data transmission, and printing, an operation for starting the process, and each process An operation (selection operation or input operation) or the like for performing settings necessary for the operation is received. Examples of the setting include various settings such as setting of the number of prints at the time of printing, setting of punching (punching) and stapling, setting of destination information at the time of transmitting a facsimile image and an e-mail, and the like.

  The key operation unit 20 includes a group of keys necessary for operation. The touch panel 10 includes a display unit and an operation receiving unit such as a touch sensor. The touch panel 10 is subjected to display control and operation acceptance control by the panel control unit 11. That is, the panel control unit 11 performs display control of the display unit and operation reception control of the operation reception unit on the touch panel 10.

  The display unit of the touch panel 10 displays the current operation state, setting information (for example, transmission destination) and the like. This display is realized by the panel control unit 11 controlling so as to display a GUI (Graphical User Interface) image. With the GUI, the display and operation reception position can be changed according to a user operation. Each GUI and its image may be stored in the internal memory of the panel control unit 11 or the control memory 19 so as to be readable. As the display unit, various display formats such as a liquid crystal display and an organic EL (Electroluminescence) display can be adopted.

  The user operation received on the touch panel 10 is interpreted by the panel control unit 11 and transmitted to the main control unit 18 as an operation signal. The user operation received by the key operation unit 20 is interpreted by the key operation unit 20 itself and transmitted to the main control unit 18 as an operation signal. The main control unit 18 issues a command according to the operation signal obtained in this manner to another part, thereby causing the other part to execute a process according to the user operation. Note that although the touch panel 10 in which the display device and the operation unit are integrated has been described, only the display device may be provided instead of the touch panel 10, and in this case, the user operation is accepted only by the key operation unit 20.

  The touch panel 10 and the key operation unit 20 may be configured as an operation panel 30 illustrated in FIG. 6, and the operation panel 30 includes a key operation unit 31 (corresponding to the key operation unit 20) including various hardware keys. And a touch panel 32 (corresponding to the touch panel 10) including a liquid crystal display and a touch sensor. Hereinafter, the touch panel 32 and the key operation unit 31 are applied instead of the touch panel 10 and the key operation unit 20 in the configuration of FIG.

  The key operation unit 31 includes, as hardware keys, a numeric keypad 31a for inputting a numerical value, a clear key 31b for clearing an input set value, an all cancel key 31c for canceling all input settings, a copy start, In addition to a start key 31d for receiving an instruction such as transmission start, function switching keys 31e, 31f, and 31g for switching a print function, a transmission function, and a copy function, and a system setting key 31h for receiving a setting by a user are provided.

An operation example in the digital multi-function peripheral 1 having the above-described configuration example will be described.
<Original scanning operation>
In the original reading operation, the image data of the read original is stored (filed) in the image storage unit 15, the image data of the read original is transmitted to the outside, or the image data of the read original is printed (that is, a copy). To be done).

  When a user operation for performing a process that requires reading of a document is received by the operation panel 30, the main control unit 18 reads the reading unit 13, the image storage unit 15, the image processing unit 16, and the encoding / decoding unit 17. Is instructed to execute processing as described below.

  The reading unit 13 optically reads an image of a document placed on a document table or an automatic document feeder, and passes RGB image data (RGB bitmap data) as a result of the reading to the image processing unit 16. The image processing unit 16 executes various types of image processing (hereinafter referred to as document image processing) such as A / D conversion, shading correction, and γ correction on the RGB image data. Here, the shading process is a process for removing various distortions generated in the illumination system, the imaging system, and the imaging system of the reading unit 13.

  As document image processing, document discrimination processing and region separation processing may be executed following A / D conversion, shading correction, and γ correction. The document determination processing includes processing for determining the type of document from input image data (here, image data after γ correction) and processing for determining whether the document is a color document or a monochrome document. Examples of the type of document include a character document, a printed photo document, and a character printed photo document in which they are mixed.

  The image processing unit 16 outputs a determination signal (hereinafter referred to as document determination data) as a result of these document determination processing and monochrome / color document determination processing. The area separation process is a process of determining what kind of area each pixel of input image data (here, image data after γ correction) belongs to. For example, each pixel is a black character area, This is a process of determining which region belongs to, such as a color character region or a halftone dot region. The image processing unit 16 outputs region separation data as the determination result. Note that this region separation processing may be executed based on the results of the document discrimination processing and the monochrome / color discrimination processing described above.

  The document determination data and the area separation data are stored in the image storage unit 15 in association with corresponding image data (image data after document image processing). At this time, after the original determination data and the region separation data are encoded by the encoding / decoding unit 17, each encoded data is stored in the image storage unit 15 in association with the corresponding image data. It should be noted that encoding at the time of storing in the image storage unit 15 is not essential, but in the following description, it is assumed that image data is stored in an encoded state. The same applies to operations other than the document reading operation.

<Printing action>
By the above-described original reading operation, filing of image data of the read original is completed. Next, a printing operation when printing image data of a read document (that is, when copying a document) will be described. When a user operation for performing processing that requires printing is received by the operation panel 30, the main control unit 18 includes the recording unit 12, the image storage unit 15, the image processing unit 16, the encoding / decoding unit 17, and the like. Is instructed to execute processing as described below. Note that the main control unit 18 also gives an instruction to the reading unit 13 (original reading instruction) when, for example, a copy operation is performed.

  Further, the digital multi-function peripheral 1 can add additional information such as a fixed stamp, date (or date / time), and page number to the image data at the time of printing. The main control unit 18 controls the image processing unit 16. It can be said that the additional information added to the image data is an additional image. The additional information is stored in the control memory 19 and is read out as necessary. Of course, additional information may be originally stored as additional image data.

  A plurality of additional information may be stored in the control memory 19 and the additional setting information may be stored in the control memory 19. This additional setting information includes at least information indicating a position to be added to image data (hereinafter referred to as an additional position), and also includes information on which one to select when a plurality of additional information is stored. Shall be. When there is an instruction to execute punching or stapling processing in the post-processing device, the main control unit 18 also controls this post-processing device.

  The encoding / decoding unit 17 reads out the image data to be printed and the corresponding document determination data and area separation data from the image storage unit 15, decodes them, and passes them to the image processing unit 16. The image processing unit 16 performs various image processing (hereinafter referred to as printing image processing) on the decoded image data (RGB image data). Image processing for printing, as outlined below, image quality adjustment processing, dichroic processing, color correction processing, black generation / under color removal processing, spatial filter processing, scaling processing, output tone correction Processing, halftone generation processing, and the like. The black generation / under color removal process, the spatial filter process, and the halftone generation process are processes corresponding to various areas indicated by the area separation data.

  As the image quality adjustment processing, the background is detected by detecting the background from the decoded image data. Further, as image quality adjustment processing, RGB adjustment (overall color adjustment such as color adjustment and reddish bluishness), brightness adjustment, and image data after background removal based on setting information set by the user through the operation panel 30. Also adjust the vividness. At this time, adjustment may be performed according to the document type indicated by the document determination data.

  As color correction processing, CMY data having CMY (C: cyan, M: magenta, Y: yellow), which are complementary colors of RGB, is generated from RGB data after image quality adjustment processing to improve color reproducibility. Process. Black generation / under color removal processing includes black generation processing for generating black (K) data from color-corrected CMY data, and new CMY data by subtracting K data obtained by black generation from the original CMY data. The undercolor removal process to be generated is performed.

As the spatial filter processing, enhancement processing and smoothing processing are performed on the CMYK data that is the data of these four colors. When a two-color mode for outputting image data in two colors (for example, red and black) is selected, a dichroic process is executed.
As the dichroic process, a process of converting RGB data into CMY data expressing two specified colors (in this case, red and black) is performed. In the two-color mode, the black generation / under color removal process is performed on the CMY data after the two-color process, and the spatial filter process is also performed, but the color correction process is not performed.

  As the scaling process, an image enlargement process or an image reduction process is performed on the CMYK data after the spatial filter process based on the print magnification set by the user operation on the operation panel 30. The printing magnification is the magnification of the image after printing with respect to the image indicated by the read and stored image data. Of course, the print magnification is not limited to the magnification obtained by the user operation, and is the default magnification when there is no operation for the print magnification. As output gradation correction processing, output γ correction processing for outputting to a recording medium such as recording paper is performed on the CMYK data. As halftone generation processing, tone reproduction processing for outputting an image is performed on the CMYK data after the output tone correction processing by error diffusion processing or dither processing. In the output tone correction process and the halftone generation process, for example, processing corresponding to the document type indicated by the document determination data may be performed, for example, processing contents are different between the character area and the other areas.

  The CMYK data after the halftone generation process is transferred to the recording unit 12. A case where additional information is added will be described. For additional information, there are a method of performing a scaling process according to the scaling ratio of the print data, and a method of not performing the scaling process for the additional information regardless of the scaling ratio of the print data. First, when the additional information is also scaled, the main control unit 18 reads the additional information and the information indicating the additional position, and the main control unit 18 or the image processing unit 16 converts it to image data as necessary. The image data of the additional information is transferred to the image processing unit 16 before the scaling process. This conversion is not necessary when the additional image data is originally stored. Subsequently, the image processing unit 16 may synthesize the image data of the additional information at the additional position with the image data of the addition destination that is the image data before the scaling process.

  When the additional information is not subjected to the scaling process, the main control unit 18 reads the additional information and information indicating the additional position, and the main control unit 18 or the image processing unit 16 converts the information into image data as necessary. In this example, CMYK data is obtained by conversion. This conversion is not necessary when the additional image data is originally stored. Subsequently, the image processing unit 16 adds the image data of the additional information to the addition destination image data that is the image data after the scaling process (the above-described CMYK data that is the target of the output gradation correction process or the halftone generation process). However, it may be synthesized at the additional position.

  In any case, the CMYK data after the halftone generation process with the additional information added by the image processing unit 16 can be output. In the digital multi-function peripheral 1, additional information and its additional position can be set by the user using the operation panel 30 while performing a preview display described below.

  The recording unit 12 receives the image data (in this example, CMYK image data) subjected to the image processing for printing by the image processing unit 16 in this way, and performs hard copy (printout) by an electrophotographic method or an inkjet method. To do. Then, the post-processing apparatus executes punching or stapling processing on the printed paper as necessary. Note that the print operation target data described here is not limited to the image data read by the reading unit 13, and is transferred in advance from an external recording medium such as a USB memory or a network-connected PC, for example. The same applies to image data (image file) stored in the image storage unit 15. The printing operation of the image data received by facsimile and stored in the image storage unit 15 will be described later.

<Preview display operation of image data to be printed>
Next, an operation (preview display operation) of previewing image data stored in the image storage unit 15 as a result of document reading on the touch panel 32 before printing will be described. The digital multi-function peripheral 1 has a configuration that enables preview display for image data to be printed. This preview display operation is performed when a user operation for performing a process that requires a preview display is received by the operation panel 30. For example, the preview display operation is also performed when the image data after reading the document is set to be previewed first before printing. For example, after setting to perform the preview display, reading of the document may be started when the copy condition is set and the start key is pressed, and the preview image may be displayed on the touch panel 32 after the reading.

  In the embodiment according to the present invention, when the preview display is executed, the fact that the preview image of the image data to be previewed is being generated and the progress of generation of the preview image are displayed by a message or the like, and the user is notified. The device status is recognized. The same applies to the preview display in the following operations. A specific example of this feature will be described later.

  The main control unit 18 instructs the image storage unit 15, the image processing unit 16, the encoding / decoding unit 17, the panel control unit 11, and the like to execute processing as described below. Note that the main control unit 18 also gives an instruction to the reading unit 13 (original reading instruction) when, for example, an operation for copying an original is performed.

  The encoding / decoding unit 17 reads out the image data to be previewed and the corresponding document determination data and region separation data from the image storage unit 15, decodes them, and passes them to the image processing unit 16. The image processing unit 16 performs various image processing (hereinafter referred to as preview image processing) on the decoded image data (RGB image data). Image processing for preview includes image quality adjustment processing, dichroic processing, color correction processing, spatial filter processing, scaling processing, output tone correction processing, and the like, as will be described below in outline. Spatial filter processing and output tone correction processing are processing according to various regions indicated by the region separation data.

  The image quality adjustment process here is the same as the image quality adjustment process in the image processing for printing. As the color correction processing, processing for converting the image data (RGB data) after the image quality adjustment processing into R′G′B ′ data is performed based on the display characteristics of the touch panel 32. As the spatial filter processing, enhancement processing and smoothing processing are performed on the R′G′B ′ data.

  As the scaling processing, the R′G′B ′ data after the spatial filter processing is subjected to image enlargement processing / image reduction processing according to the print magnification, and the number of pixels of the R′G′B ′ data is set on the touch panel. A process of converting the number of pixels to 32 (display resolution) is performed, and an image enlargement process and an image reduction process are performed based on the preview display magnification. Note that the preview display magnification is, for example, a magnification of 2 times, 4 times, or the like, and is a magnification of an image at the time of preview display.

  The preview image generation unit 16a provided in the image processing unit 16 generates an image for preview display (preview image) mainly by such scaling processing for preview display.

  Here, a preview image when additional information is added will be described. As described above, in the digital multi-function peripheral 1, it is possible to add and output additional information to the image data to be output. In the preview display, the panel control unit 11 displays an image indicating the additional information. It is executed by performing control. Therefore, the preview image generation unit 16a generates an image indicating such additional information and combines it with the preview image generated from the image data to be output, thereby generating a preview image with additional information. The panel control unit 11 displays this on the touch panel 32.

  The additional information can be output together with the image data to be printed by performing the scaling process according to the printing magnification, and added to the image data to be printed after the scaling process according to the printing magnification. It can also be output. First, when the additional information is also scaled and output, the main control unit 18 reads the additional information and its added position, and passes them to the image processing unit 16 before the scaling process. Subsequently, the preview image generation unit 16a generates R′G′B ′ data of an image indicating this additional information, and synthesizes it at the additional position with respect to the addition destination image data which is the image data before the scaling process. . Then, it is preferable to perform image enlargement processing / image reduction processing according to the print magnification on the R′G′B ′ data after the image of the additional information is added.

  When the additional information is not subjected to the scaling process, the main control unit 18 reads out the additional information and the additional position and passes it to the image processing unit 16. Subsequently, the preview image generation unit 16a generates R'G'B 'data of an image indicating additional information from the additional information, and uses the R'G' data after image enlargement processing / image reduction processing according to the print magnification. The B ′ data is combined at the additional position and the number of pixels of the added R′G′B ′ data is converted to the number of pixels (display resolution) of the touch panel 32, and the image is displayed based on the preview display magnification. Enlargement processing and image reduction processing are performed.

  When punching or stapling is performed in the post-processing apparatus, post-processing image data such as punch holes or staples is added to the preview image generated from the image data to be printed (and image data indicating additional information). , It can be combined and output at the punch position or staple position. Alternatively, separately from the preview image generated from the image data to be printed (and image data indicating additional information), post-processing image data such as punch holes and staples may be output in the vicinity thereof. . In the latter case, since the synthesis process is unnecessary, the processing speed is increased. Any method can display the finished state of the sheet on which the image is formed when the preview of the image data is displayed.

  As output tone correction processing, output γ correction for displaying image data on the touch panel 32 with respect to R′G′B ′ data of the preview image or R′G′B ′ data of the preview image and post-processing image is performed. Process. In the output tone correction process, for example, a process corresponding to the document type indicated by the document determination data may be performed, for example, the processing content is different between the character area and the other areas.

  The dichroic processing is executed only when a two-color mode that outputs image data in two colors, for example, red and black, is selected. As the dichroic processing, processing for converting the RGB data after the image quality adjustment processing into CMY data expressing the specified two colors (in this case, red and black) is performed. The generated CMYK data is converted into R′G′B ′ data based on the display characteristics of the touch panel 32 in the subsequent color correction processing.

  The R′G′B ′ data generated by the preview image generation unit 16 a and subjected to the output gradation correction processing is passed to the touch panel 32. The panel control unit 11 controls the touch panel 32 to display an image corresponding to the R′G′B ′ data in a GUI image, and displays the GUI image on the touch panel 32. The user confirms the preview-displayed image including the image indicating the additional information, and performs printing as it is, cancels the printing, deletes the additional information, or changes the additional position (or changes the additional information). It is possible to determine whether or not to execute the operation and perform an operation corresponding to the determination.

<Supplementary information on document reading, preview display, and printing>
Although the preview display operation has been described separately from the print operation, first, image data (CMYK data) that has been subjected to output gradation correction processing as the print operation is converted into R′G′B ′ data based on the display characteristics of the touch panel 32. It is also possible to perform conversion processing according to the number of pixels (display resolution) of the touch panel 32 or scaling processing at the time of preview display, and display the image on the touch panel 32 by being incorporated in the GUI image. Since the printing operation is completed to some extent and the printing operation after the preview display can be completed quickly, it is useful when, for example, the preview display is set in advance when a copy operation is performed.

  Further, as an example of a document reading operation, an example in which encoded image data, document type data, and area separation data are associated with each other and stored in the image storage unit 15 will be described. Based on this example, a printing operation and a preview display operation will be described. did. As an alternative method, only the image data read by the reading unit 13 may be encoded and stored in the image storage unit 15 once. In this case, at the time of printing operation or preview display operation, the image processing unit 16 performs document type determination processing or region separation processing on the image data read from the image storage unit 15 and decoded by the encoding / decoding unit 17. What is necessary is just to comprise. Such an alternative method can also be applied to image data transmission such as facsimile transmission and Internet FAX transmission described later.

<Supplementary information about filing action>
As described in the document reading operation, the filing operation (document filing operation) stores the read image data (encoded as necessary) in the image storage unit 15 provided in the digital multi-function peripheral 1. Is the action. Even during filing, it is possible to store (filing) after adding additional information to the image data to be stored. The preview display operation of the image data filed in the image storage unit 15 is basically as described for the image data to be printed.

<Printing operation of image data received by facsimile>
Next, a printing operation for image data received by facsimile communication will be described. When the main control unit 18 detects a facsimile communication request by the modem 24, the main control unit 18 instructs the recording unit 12, the image storage unit 15, the image processing unit 16, the NCU 23, the modem 24, and the like, and processes as described below. Is executed.

  First, the modem 24 and the NCU 23 sequentially receive image data (compressed image data) transmitted from the transmission source while performing a communication procedure, decompress the received compressed image data, and perform rotation processing (if necessary). Processing for rotating the transmission direction), resolution conversion processing, and the like are executed and passed to the image processing unit 16.

  Since the image data received by the facsimile communication is binary in black and white, the image processing unit 16 passes the image data (K data) that has been subjected to processing such as decompression to the recording unit 12 without performing any particular processing. It is. The recording unit 12 receives this image data, and executes printing by an electrophotographic method, an inkjet method, or the like. Also, image data received by facsimile communication can be printed after adding the above-described additional information.

  Although the facsimile reception with a monochrome image has been described, when a color facsimile image (RGB data) is received, the image processing unit 16 performs the facsimile reception image processing described here on the RGB data. do it.

<Preview display operation of image data received by facsimile>
A preview display operation of image data received by facsimile communication will be briefly described based on the printing operation of the image data. This preview display operation is performed when there is a prior setting or a user operation for executing printing after confirming received image data in advance. In this preview display operation, when the image processing unit 16 adds additional information to the image data after being subjected to processing such as decompression, the image data of the additional information is combined and then further displayed on the touch panel 32. Conversion processing according to the number of pixels (display resolution) and scaling processing at the time of preview display are performed, and the image data after scaling processing is incorporated into the GUI image and displayed on the touch panel 32.
In this way, image data received by facsimile may be handled as a copy mode when a preview is displayed before printing. The user can confirm the preview-displayed image, determine whether to execute printing or discard it, and perform a printing or discarding operation.

<Facsimile transmission operation>
Next, a transmission operation when the image data of the read original is transmitted by facsimile will be described. The facsimile image data is transmitted to the destination (transmission destination) information set by the user operation on the touch panel 32 or the key operation unit 31. The other party information (phone number in this example) is stored in the control memory 19 and is read out as necessary. Normally, the destination information is stored as address book data so that information on a plurality of destinations can be viewed and selected, or is directly input before transmission.

  When a user operation for executing facsimile transmission is accepted on the operation panel 30, the main control unit 18 instructs the image storage unit 15, the image processing unit 16, the encoding / decoding unit 17, the NCU 23, the modem 24, and the like. To execute processing as described below. Note that the main control unit 18 also gives an instruction (original reading instruction) to the reading unit 13 when an operation for facsimile transmission of the original is performed, for example. It is also possible to select image data to be transmitted while executing a preview display for the image data stored in the image storage unit 15 and start facsimile transmission for the image data.

  The encoding / decoding unit 17 reads out the image data to be printed and the corresponding document determination data and area separation data from the image storage unit 15, decodes them, and passes them to the image processing unit 16. The image processing unit 16 performs various image processing (hereinafter referred to as image processing for facsimile transmission) on the decoded image data (RGB image data). The image processing for facsimile transmission includes image quality adjustment processing, spatial filter processing, scaling processing, output tone correction processing, halftone generation processing, and the like as will be described below. The spatial filter process and the halftone generation process may be processes corresponding to various areas indicated by the area separation data, but the area separation data may not be used. Further, in the document reading operation accompanying facsimile transmission, it is not necessary to execute the region separation process on the read image data and the encoding and storage of the region separation data.

  As the image quality adjustment process, the decoded image data is converted into K data using a matrix coefficient. At this time, a matrix coefficient corresponding to the document type indicated by the document determination data may be used. As the spatial filter processing, enhancement processing and smoothing processing are performed on the K data. As the scaling process, an image enlargement process or an image reduction process is performed on the K data after the spatial filter process according to the transmission resolution set on the operation panel 30 or the default transmission resolution.

  As the output tone correction process, an output γ correction process is performed on the K data after the scaling process for the purpose of outputting the data to a recording medium such as a recording sheet at the transmission destination. Actually, output γ correction for a general device may be performed instead of output γ correction in consideration of the transmission destination device. As the halftone generation process, the K data after the output tone correction process is binarized by, for example, an error diffusion process. In the output tone correction process and the halftone generation process, a process according to the document type indicated by the document determination data may be performed.

Although the facsimile transmission with a monochrome image has been described, in the facsimile transmission with a color image, the image processing unit 16 uses the matrix coefficient as the decoded image data as an image quality adjustment process in the above-described facsimile transmission image processing. May be used to perform processing for conversion to L ^* a ^* b ^* data for color transmission, and subsequent processing may be performed on the L ^* a ^* b ^* data.

  The image data after the halftone generation process is subjected to a rotation process as necessary, and is compressed and encoded in the compression format at the time of facsimile transmission by the encoding / decoding unit 17 and temporarily stored in the image storage unit 15. The The modem 24 performs a transmission procedure with the transmission destination set via the NCU 23, and at the stage where communication with the transmission destination is established (when transmission is possible), this temporarily stored encoding is performed. The read K data is read, and after necessary processing such as changing the compression format, it is sequentially transmitted to the transmission destination via the public line network.

  The digital multi-function peripheral 1 can transmit the image data to be transmitted with additional information added thereto. When transmitting image data to the outside as in this example, in addition to the stamp, date (date and time), and page number, additional information can be added to the sender information (sender information) as additional information. It has become. Here, the sender information added at the time of image data transmission may include one or more of sender name information, sender telephone number information, and sender email address information. Further, as the additional information, information on the transmission destination (information on the other party) may be added at the time of image data transmission.

When facsimile transmission is performed with additional information added, the following composition processing may be performed. The main control unit 18 reads the additional information and the information indicating the additional position, the main control unit 18 or the image processing unit 16 converts it into image data, and the image processing unit 16 converts the converted image data (image data of the additional information). ) May be combined at the addition position with the addition destination image data which is the image data after the scaling process.
In the digital multi-function peripheral 1, the position to which the image data of the additional information is added can be set by the user using the operation panel 30 while performing a preview display described below. The combined image data is transmitted to the transmission destination after being subjected to the above-described output tone correction processing, rotation processing, compression processing, and the like.

<Preview display operation for image data to be sent by facsimile>
The digital multi-function peripheral 1 has a configuration that enables preview display of image data that is to be transmitted by facsimile transmission or the like. This preview display operation is performed when there is a prior setting or a user operation for performing transmission after confirming in advance the image data before transmission. A preview display operation of image data to be transmitted by facsimile will be described based on a facsimile transmission operation of the image data. In the preview display operation, the main control unit 18 also instructs the panel control unit 11.

In this preview display operation, the image processing unit 16 performs the same processing as that during facsimile transmission until image quality adjustment processing and spatial filter processing (and scaling processing), and executes preview image generation processing by the preview image generation unit 16a. Then, output γ correction processing for displaying image data may be performed as output gradation correction processing. As the preview image generation process, the preview image generation unit 16a performs a conversion process according to the number of pixels (display resolution) of the touch panel 32 on the image data subjected to the image enlargement process / image reduction process according to the transmission resolution. Then, preview image data is generated by performing scaling processing according to the reduction / enlargement ratio at the time of preview display.
In this preview display operation, the spatial filter process does not have to be executed, and the halftone generation process is not executed. Here, the data transmission mode is a mode for transmitting image data to the outside (external device) such as a facsimile transmission mode, an Internet FAX transmission mode, and a file transfer mode, and is also referred to as an image transmission mode.

  The R′G′B ′ data generated by the preview image generation unit 16 a and subjected to the output gradation correction processing is passed to the touch panel 32. The panel control unit 11 controls the touch panel 32 to display an image corresponding to the R′G′B ′ data in a GUI image, and displays the GUI image on the touch panel 32.

  A preview image when additional information is added and transmitted will be described. The additional information is output after being added to the image data after the scaling process corresponding to the transmission resolution. More specifically, the main control unit 18 reads the additional information and the additional position and passes it to the image processing unit 16. Subsequently, the preview image generation unit 16a generates R′G′B ′ data of an image indicating additional information from the additional information, and R′G′B ′ after image enlargement processing / image reduction processing according to the transmission resolution. What is necessary is just to synthesize | combine with the said additional position with respect to data. Then, processing for converting the number of pixels of the added R′G′B ′ data into the number of pixels (display resolution) of the touch panel 32 is performed, and image enlargement processing and image reduction processing are performed based on the preview display magnification.

  The image data obtained by synthesizing the image of the additional information in this way is subjected to the above-described output tone correction processing (output γ correction processing for displaying image data) at the time of preview display, and then the panel control unit 11. Thus, it is incorporated into the GUI image and displayed on the touch panel 32. The user confirms the preview-displayed image including the image of the additional information, and executes or stops the facsimile transmission as it is, deletes the additional information, or changes the additional position (or changes the additional information). It is possible to determine whether or not to execute the operation and perform an operation corresponding to the determination.

<Image data transmission operation via the Internet>
Next, a transmission operation in a case where image data of a read original is transmitted by electronic mail or Internet FAX via the Internet will be described. Also for the image data that is the target for transmission via the Internet, transmission destination information (e-mail address in this example) set by a user operation on the touch panel 32 or the key operation unit 31 and stored in the control memory 19 ).

  When a user operation related to transmission via the Internet is accepted by the operation panel 30, the main control unit 18 includes a format conversion unit 14, an image storage unit 15, an image processing unit 16, an encoding / decoding unit 17, and a LAN control unit. 21 is instructed to execute transmission processing via the Internet as described below. Note that the main control unit 18 also gives an instruction to the reading unit 13 (original reading instruction) when an operation for transmitting the original via the Internet is performed, for example.

  The encoding / decoding unit 17 reads out the image data to be printed and the corresponding document determination data and area separation data from the image storage unit 15, decodes them, and passes them to the image processing unit 16. The image processing unit 16 executes various types of image processing (hereinafter referred to as Internet transmission image processing) on the decoded image data (RGB image data). Examples of the image processing for Internet transmission include image quality adjustment processing, spatial filter processing, scaling processing, output tone correction processing, and halftone generation processing described in the facsimile transmission image processing.

Further, the image processing at the time of transmission with a color image is the same as the image processing for facsimile transmission, and the image processing unit 16 uses the matrix coefficient as the image data after decoding as image quality adjustment processing in the image processing for Internet transmission. It is possible to perform processing for conversion into L ^* a ^* b ^* data for color transmission and perform subsequent processing on the L ^* a ^* b ^* data.

  The encoding / decoding unit 17 encodes (compresses) the image data after the image processing for Internet transmission to obtain a compressed file. This compression is performed for each page of the document. Next, the format conversion unit 14 converts these compressed files into one file, and attaches the file to the multipart mail according to, for example, MIME (Multipurpose Internet Mail Extension). Through the processing so far, the read image data is converted into an e-mail format. This e-mail is transmitted to the transmission destination via the Internet by the LAN control unit 21 via the LAN interface using a mail transfer protocol such as SMTP (Simple Mail Transfer Protocol).

  Here, in the case of Internet facsimile transmission, the encoding / decoding unit 17 compresses in a compression format dedicated to facsimile, such as MH, and the format conversion unit 14 obtains a compressed file in page units into, for example, one TIFF file. Convert it. Further, in the case of transmission that is simply attached as an attached file to an e-mail (in the case of transmission by so-called scan to e-mail), the encoding / decoding unit 17 compresses it in a compression format such as JPEG and the format conversion unit 14 For example, the page-by-page compressed file obtained may be converted into one PDF file.

  Also, even if the image data to be transmitted is image data transmitted via the Internet, the digital multi-function peripheral 1 can transmit it with additional information as in the case of facsimile transmission image data. Yes. As the additional information adding process, it is only necessary to execute the synthesizing process described in the facsimile transmission. After the above-described output tone correction process, compression process, format conversion process, and the like are performed, the address of the transmission destination is sent as an e-mail. Will be sent to.

<Preview display operation for image data sent via the Internet>
Similarly to the description of the preview display at the time of facsimile transmission, the digital multi-function peripheral 1 can be configured so that preview data can be displayed on the touch panel 32 for image data to be transmitted via the Internet.

  In this preview display operation, the image processing unit 16 performs the same processing as the image processing for Internet transmission until the image quality adjustment processing and the spatial filter processing (and scaling processing), as described for the preview display at the time of facsimile transmission. The preview image generation processing by the preview image generation unit 16a is executed, and output γ correction processing for displaying image data is performed as output gradation correction processing. The R′G′B ′ data generated by the preview image generation unit 16 a and subjected to the output tone correction processing is transferred to the touch panel 32, incorporated into the GUI image by the panel control unit 11, and displayed on the touch panel 32. Become. The description of the preview display at the time of facsimile transmission can also be used for the preview display to which an image indicating additional information is added.

<Description of Preview Display According to the Present Invention>
As described above, the digital multi-function peripheral 1 appropriately displays a preview image when executing the printing operation of the read original image, performing filing by document filing, transmitting and receiving image data by facsimile, and transmitting and receiving image data by the Internet. A preview image generation unit 16a for generation is provided.
The preview image generated by the preview image generation unit 16 a is sent to the touch panel 32 under the control of the main control unit 18, and is controlled to be incorporated into the GUI image and displayed by the panel control unit 11 and displayed on the display unit of the touch panel 32. The Here, the touch panel 32 is an example of a display unit that previews image data to be formed.

Further, as described above, in the digital multi-function peripheral 1 of the present invention, the panel control unit 11 causes the touch panel 32 to display information indicating the finished state for the image data displayed as a preview based on the control of the main control unit 18. Control can be performed. As an example, a preview image of image data is displayed as a reduced image for each page, and information indicating a finished state is displayed on the same screen separately from the image data. Further, as described above, information indicating the finished state may be displayed in an overlapping manner on the image data.
The preview image generating unit 16a generates a preview image from the information indicating the finished state and the image data to be image formed. The preview image generation unit 16a and the panel control unit 11 are an example of a display control unit that performs control to display information indicating a finished state during preview display.

  Here, as information indicating the finished state, for example, information on staples and punch holes applied to a sheet on which image formation is performed, information on saddle stitching, information on double-sided printing, and different types of sheets with respect to sheets on which image formation is performed Information on the interleaving paper to be inserted at a predetermined position, information on the OHP interleaving paper in which different types of paper (address paper) are inserted between the OHP paper at this time, and different types for the paper on which the image is formed Information on the front cover that inserts the first paper at the first page position, and information on the back cover that inserts a different type of paper at the last page position.

  In this case, the user confirms the preview image on which the reduced image for each page of the image data and the information indicating the finished state are displayed, and executes or cancels the image formation as it is or changes the finish setting. It is possible to determine whether to execute the operation and perform an operation corresponding to the determination.

As described above, the digital multi-function peripheral 1 generates a preview image using image data to be copied, document filing, or image data transmission. In the embodiment according to the present invention, the preview image generation is performed at this time. The unit 16a starts generating the preview image when the image data for generating the preview image is obtained, and displays the generation state by a message or the like.
For example, when generating a preview image of a plurality of (multiple pages) image data, the preview image generating unit 16a starts generating the preview image when the first image data is obtained, and the generated preview is generated. Each time one image is generated, a display indicating that the one preview image has been generated is displayed on the display unit of the touch panel 32. Here, in the case where a preview image cannot be generated unless all image data such as saddle stitch printing is acquired, generation of the preview image may be started when the image data is obtained.
By such an operation, the user can recognize the generation state of the preview image.

In addition, even in the middle of the generation of preview images of a plurality of image data, the generated preview image can be displayed as a preview by appropriately performing a user operation. At this point, copying, data filing, It is also possible to execute final processing such as data transmission.
Hereinafter, the preview display, which is a feature of the present embodiment, will be described more specifically.

<Specific example of preview display>
Hereinafter, the flow of preview display of image data will be described with specific examples. The following screen display example shows a display example of the touch panel 32 in the digital multi-function peripheral 1 according to the embodiment of the present invention.

FIG. 7 is a diagram illustrating an example of a standard screen of the digital multifunction peripheral. The standard screen 40 is displayed on the touch panel 32 of the digital multifunction device 1 when the power of the digital multifunction device 1 is turned on or reset. In the standard screen 40, the upper copy key 41 is selected as an initial state, and various conditions for copying can be set.
On the standard screen 40, in addition to copying, by selecting the image transmission key 42 or the document filing key 43, an image transmission mode for performing image transmission such as FAX, or data storage and confirmation is performed. You can enter document filing mode.
Further, on this standard screen 40, a double-sided copy key 44 for setting double-sided copying, a finishing key 45 for setting post-processing such as punching and stapling, or a preview confirmation for instructing preview display of image data A key 46 and the like are provided.

  For example, when the duplex copy key 44 is operated (touched) on the standard screen of FIG. 7, a duplex copy setting screen 50 as shown in FIG. 8 can be opened. Here, the user sets a “single side → single side” key 51 for setting automatic single-sided copying from a single-sided original, a “single side → double-sided” key 52 for setting automatic double-sided copying from a single-sided original, By operating a “double-sided → double-sided” key 53 for setting double-sided copying, a “double-sided → single-sided” key 54 for setting single-sided copying from a double-sided document, desired double-sided copying can be set. it can.

FIG. 9 is a diagram showing an example of an initial screen for finishing displayed when the finishing key 45 is operated (touched) on the standard screen 40 of FIG.
In the initial finishing screen 60 of FIG. 9, the user instructs the sort key 61 for sorting and outputting the copies, the staple sort key 62 for setting the stapled copy output, and the output for each identical copy. A group key 63 for carrying out, a saddle stitching key 64 for instructing saddle stitching after stapling in the middle of double-open copy output, a punch key 65 for setting punch holes, and paper folding By operating a paper folding key 66 or the like for performing the copy output, it is possible to perform a desired finish regarding the copy output.

In the finishing initial screen 60 of FIG. 9, for example, by selecting the staple sort key 62, a staple setting screen 60 ′ shown in FIG. 10 is displayed.
In the staple setting screen 60 ′ of FIG. 10, the staple sort key 62 itself is highlighted so that the user can confirm that the staple sort key 62 is selected. Then, when the reading direction of the copy original is read from the left side, a key 62A for giving an instruction for stapling one place on the upper left of the copy output, and an instruction for stapling two places on the left side of the copy output And a key 62C for instructing to staple at one place are displayed at the lower left of the copy output, and the user can arbitrarily select each of the keys 62A, 62B, and 62C.

A user who has set the finishing state of the copy output can display a preview of the image data by operating the preview confirmation key 46 displayed on the standard screen 40 of FIG. 7 using the touch panel 32.
Image data displayed as a preview at this time is image data of a document image read by the reading unit 13 and stored in the image storage unit 15. In addition, the image data received from an external device by facsimile, Internet FAX, or the like and stored in the image storage unit 15 can be used as a preview target. Alternatively, it may be input from a recording medium such as a memory. These image data are targeted when an image is formed by the recording unit 12, filed in the image storage unit 15 such as an HDD, or transmitted to an external device by facsimile, Internet FAX, Internet mail, or the like. It is possible to display a preview of the current image data.

  In this case, in the copy mode, a preview display of image data to be read and printed can be performed. Further, when transmitting image data in the image transmission mode, it is possible to execute transmission after confirming the image data to be transmitted by displaying a preview. Here, when data is transmitted by facsimile or Internet FAX, or image data read by a reading unit (scanner) is transmitted by e-mail or transferred to a USB memory or the like, the image data is displayed as a preview. Can be confirmed in advance. In the document filing mode, for example, when image data read by a reading unit (scanner) or image data received by a facsimile, Internet FAX, or the like is stored in the image storage unit 15 such as an HDD and stored, the image data is stored. It is possible to display the preview and execute the saving process after confirmation by the user.

  For example, when attempting to copy a document in the copy mode, the user sets the document on the reading unit 13 and first operates the preview confirmation key 46. Then, by pressing a start key 31d (FIG. 6) for starting copying, the original image is read, and the image data temporarily stored in the image storage unit 15 is displayed as a preview. Alternatively, when the image data received from the external device is printed, the image data can be preview-displayed by operating the preview confirmation key 46 and then pressing the start key 31d.

As described above, the digital multi-function peripheral 1 can display the preview of the image data. However, the preview image can be displayed before the final processing of the input image data is executed. Final processing includes image formation processing for image formation (printing) of image data on an image forming medium such as recording paper, transmission processing for transmitting image data to an external device via facsimile or the Internet, or digital processing of image data. This corresponds to the process of recording and saving in the image storage unit 15 incorporated in the multifunction machine. Here, instead of the image storage unit 15, an external storage device or recording medium accessible by the digital multi-function peripheral 1 may be used.
The processing means of the present invention corresponds to each unit that executes these final processes. For example, when image formation is performed, the main control unit 18, the image processing unit 16, the encoding / decoding unit 17, the recording unit 12, and the like cooperate to execute processing, and when performing image transmission, the main control unit 18. The unit 18, the image processing unit 16, the encoding / decoding unit 17, the LAN control unit 21, the NCU 23, the modem 24, etc. cooperate to execute processing, and these correspond to the realization elements of the processing means.

<Display example during preview image generation>
Here, in the embodiment according to the present invention, the preview image generation unit 16a (FIG. 5) of the image processing unit 16 generates a preview image using the image data to be subjected to final processing as described above. Each time the preview image generated by the preview image generating unit 16a is generated (one page), the main control unit 18 displays a display indicating that the one preview image is generated on the display unit of the touch panel 10. Display. When there are a plurality of image data (a plurality of pages) to be subjected to final processing, a display indicating that one preview image has been generated can be executed for each image.

11 to 13 are diagrams illustrating display examples during preview image generation. In the example of FIG. 11, when the user operates the start key after operating the preview confirmation key 46 in the copy mode, an image 70 indicating that the preview is being generated is displayed as a pop-up image.
At this time, the preview image generation unit 16a starts generating a preview image of image data to be copied (that is, a target of final processing) in accordance with the reading of the document image by the reading unit 13. At this time, for example, a message “Preview is being created. Please wait for a while” is displayed on the image 70 indicating that the preview is being generated. Thus, the user can surely recognize that the preview image is currently being generated.

  In the preview image generation unit 16a, the generation of the preview image is started when the document image is read by the reading unit 13 and the image data is output. That is, since the image data of the original image is generated and output for each page (page) by the reading unit 13, the preview image generation unit 16a generates the preview image when one image data is obtained. Start. If there are a plurality of image data, the generation of the preview image is continued when the reading of the document image is sequentially completed.

  As described above, the preview image generation unit 16a sequentially executes the preview image generation process when the final processing target image data is obtained. When image data transmitted via a facsimile or the Internet is input, preview image generation processing is executed at the stage where one image data is input. In this case, as in the above-described saddle stitch printing, an exception that cannot immediately start generating a preview image when inputting image data for one sheet is excluded.

  The input of the image data is performed by reading the original image by the reading unit 13 as described above, transmitted by facsimile or the Internet, or transferred from a recording medium such as a memory. The interface part of the input path of these image data corresponds to the input part of the present invention, and image data to be subjected to final processing can be input from each input part. That is, in one embodiment of the present invention, the preview image generation unit 16a starts generating a preview image when image data is input to the input unit. At this time, when the image data read by the reading unit 13 is used, generation of a preview image is started using the image data read and output by the reading unit 13 as image data input to the input unit.

When the preview image generation unit 16a starts generating a preview image, a display indicating that one preview image has been generated is performed when one preview image is generated.
As shown in FIG. 12, when the preview image generating unit 16a completes generating the preview image of the first image data, the processed image is displayed on the processing amount display unit 71 set to the image 70 indicating that the preview is being generated. It is displayed that the data is “1”. The processing amount display unit 71 displays image data for which preview image generation has been completed for each number (page).
“????” should display the total number of image data. At this stage, the document image reading process is still in progress. Since it cannot be identified, “???” is displayed.

FIG. 13 shows a display example when the preview image generation process further proceeds. Here, the processing amount display unit 71 indicates that the generation of the preview image is completed up to the 12th sheet. At this point in time, it is displayed that all reading of the document image has been completed and the total amount of image data to be finally processed is 125 sheets.
That is, the processing amount display unit 71 indicating that a preview image has been generated displays the processing amount each time a preview image of one piece of image data is generated when there are a plurality of pieces of image data. Then, the display is updated for each preview image. When all the image data to be final processed is input to the input unit, the total number (page number) of the image data can be displayed.

12 and 13, an intermediate display button 72 displayed on the image 70 indicating that preview generation is in progress is an instruction to display a preview image when the generation processing of preview images for all target image data has not been completed. Input is possible. For example, when the user operates the intermediate display button 72 on the screen shown in FIG. 12, the first preview image generated at that time can be preview-displayed.
The cancel button 73 enables an instruction to cancel the preview image generation process. When the cancel button 73 is operated by the user, the preview image that has already been generated can be displayed as appropriate. Further, after the cancel button 73 is operated, it is possible to execute image data transmission processing in the image transmission mode and printing (image formation) processing in the copy mode.

  FIG. 14 is a diagram showing an example of a preview screen when the midway display button 72 is operated on the screen of FIG. For example, when the midway display button 72 is operated on the screen of FIG. 12, a preview screen 80 as shown in FIG. 14 is displayed. Here, a preview image 81 of the image data is displayed. At this time, the preview image 81 is the first preview image for which generation processing has been completed at the time of the screen of FIG.

  When the midway display button 72 is operated on the screen of FIG. 13, preview images up to the 12th can be displayed. Further, since the generation of the remaining preview image is continued even while the preview image is being displayed, other preview images that have been generated can be displayed at any time. That is, in the preview image generation unit 16a, when there is a display indicating that the preview image is generated on the display unit of the touch panel 32, there is further image data for generating a preview image. The preview image generation process is continued.

  The preview image 81 displayed on the preview screen 80 shown in FIG. 14 is displayed for each page (one image) as described above, and the user appropriately operates the page switching key 82 to change any page. A preview image can be displayed. However, in this case, since the preview image generation is completed only for the first image data, the page switching key 82 cannot switch the preview image. Here, the page of the image data currently displayed can be confirmed by the page display 83 to be the first (first page) of the total 125 sheets.

  In addition, a setting confirmation key 84, an enlargement / reduction key 85, a display rotation key 86, and the like are displayed on the preview screen 80 shown in FIG. 14, and the user sets the preview image 81 by appropriately operating these. Can be confirmed, or the preview image 81 can be confirmed by enlarging, reducing, or rotating. For example, the preview screen 80 shown in FIG. 15 shows a display example when an operation for enlarging the preview image 81 with the enlargement / reduction key 85 is performed on the preview screen 80 of FIG.

Further, when it is necessary to reset the printing conditions by checking the preview image 81, the user can open a screen for resetting the printing conditions by operating the reset key 87. Then, the print condition can be reset using the reset screen, and the preview image 81 based on the reset print condition can be displayed.
The preview screen 80 shown in FIGS. 14 and 15 displays a copy start key 88. When the user operates the copy start key 88, the previewed image data is formed (printed). be able to.

By performing the above processing, for example, at the time of copying, there may be a case where the user confirms in advance only by displaying the stamp information such as the title and secret of the cover page, or only the first few pages. In addition, when transmitting an image, there are many cases where the user only has to confirm the destination information described on the first page by preview.
Even in such a case, by enabling the display of the preview image as soon as possible, it is possible to avoid the continuation of unnecessary document reading and the generation of the preview image.
On the other hand, when the user's confirmation is completed by previewing one page or the first few pages, a copy instruction, a save instruction, or an image transmission instruction can be given at that time, and the working time can be reduced. . That is, after displaying the preview image, the final process can be executed.

FIG. 16 is a diagram showing another example of a preview screen that displays a preview image, and shows a display example of a preview screen that is displayed when saddle stitch printing is set.
In the example of FIGS. 12 to 13, the preview image generation unit 16 a generates a preview image immediately after the document image is read by the reading unit 13. However, when “saddle stitch printing” is set as the finishing state, for example, a preview image for each sheet (page) cannot be generated unless all target document images are read. This is because the two pieces of image data included in one preview image 81 cannot be determined unless the acquisition of all the image data is completed.

  As described above, depending on the finishing state, a preview image may not be immediately generated even if image data is obtained by reading a document image. In such a case, the preview image generating process by the preview image generating unit 16a is after all the original document images are read.

FIG. 17 is a flowchart for explaining an example of image processing according to the present invention. Here, an example of processing when a document image is read by the reading unit 13 of the digital multifunction machine 1 and displayed as a preview will be described.
First, the digital multi-function peripheral 1 starts reading a document in response to a predetermined operation input by the user (step S1). Here, for example, it is assumed that the preview confirmation key 46 is operated on the standard screen 40 in the copy mode, and then the start key 31d is pressed. It is assumed that a plurality of originals for reading original images are placed on the reading unit 13.

  When the document image is read by the reading unit 13, the preview image generation unit 16a generates a preview image from the image data of the read document image (step S2), and displays a message according to the generation state on the display unit of the touch panel 10. (Step S3). As the message, “Preview is being created. Please wait for a while” displayed on the image 70 indicating that the preview is being generated in FIG. 11 is used. In addition, the number of pages (number of pages) for which preview image generation has been completed and the total number of read image data (total number of pages) are displayed in the image 70.

When the generation of the preview image is completed (step S4-Yes), it is determined whether there is an operation by the user (step S5). Here, it is determined whether either the midway display button 72 or the cancel button 73 is operated on the screens shown in FIGS.
Here, if there is no operation by the user, it is further determined whether or not the reading of the document image is completed (step S6). If the reading of the document image has not been completed, the process returns to step S1 to continue reading the document image. If the reading of the document image has been completed, the process is terminated.

If there is an operation by the user in step S5, the type of the operation is determined (step S7), and if it is an operation on the midway display button 72, the preview image generated at that time is displayed (step S7). S8). If the preview display is finished (step S9-Yes), the process is finished. If it is the cancel button 73 in step S7, the preview image generation process is canceled and the process ends.
Even after the preview display ends or after the cancel processing, it is possible to start copying in the copy mode, image data transmission processing in the image transmission mode, image data storage processing in the document filing mode, as described above. .

1 is a diagram illustrating an example of an apparatus to which an image processing apparatus of the present invention is applicable, and is a diagram illustrating a configuration of a digital multi-function peripheral having an inner finisher. It is a figure which shows an example of the post-processing apparatus of a digital multi-function peripheral. It is a figure which shows the other example of the post-processing apparatus of a digital multi-function peripheral. 1 is a schematic diagram illustrating a configuration example of an image processing system constructed using a digital multifunction peripheral as an example of an image processing apparatus according to an embodiment of the present invention. FIG. 5 is a schematic block diagram illustrating a configuration example of the digital multifunction peripheral of FIG. 4. FIG. 6 is an external view illustrating an example of a touch panel and a key operation unit in the digital multi-function peripheral of FIG. 5. It is a figure which shows the example of the standard screen of a digital multi-function peripheral. It is a figure which shows an example of the setting screen of a double-sided copy when a double-sided copy key is operated on a standard screen. It is a figure which shows an example which is an initial screen of the finishing displayed when a finishing key is operated in the standard screen of FIG. FIG. 10 is a diagram illustrating an example of a staple setting screen when a staple sort key is selected on the finishing initial screen of FIG. 9. It is a figure which shows the example of a display during preview image generation. It is a figure which shows the other example of a display during preview image generation. It is a figure which shows the other example of a display during preview image generation. FIG. 13 is a diagram illustrating an example of a preview screen when an intermediate display button is operated on the screen of FIG. 12. FIG. 15 is a diagram illustrating a display example when an operation for enlarging a preview image is performed with the enlargement / reduction key on the preview screen of FIG. 14. It is a figure which shows the other example of the preview screen which displays a preview image, and shows the example of a display of the preview screen displayed when saddle stitch printing is set. It is a flowchart for demonstrating an example of the image processing which concerns on this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Digital multifunction device, 2, 3 ... External computer, 4 ... Internet FAX apparatus, 5 ... Facsimile apparatus, 7 ... Paper storage part, 10 ... Touch panel, 11 ... Panel control part, 12 ... Recording part, 13 ... Reading part, DESCRIPTION OF SYMBOLS 14 ... Format conversion part, 15 ... Image memory | storage part, 16 ... Image processing part, 16a ... Preview image generation part, 17 ... Decoding part, 18 ... Main control part, 19 ... Memory for control, 20 ... Key operation part, 21 ... LAN control unit, 22 ... control buffer, 23 ... NCU, 24 ... modem, 30 ... operation panel, 31 ... key operation unit, 31a ... ten key, 31b ... clear key, 31c ... all release key, 31d ... start key, 31d ... After start key, 31e, 31f, 31g ... Function switching key, 31h ... System setting key, 32 ... Touch panel, 40 ... Standard screen, 41 ... Copy Key 42... Image transmission key 43. Document filing key 44. Double-sided copy key 45. Finishing key 46. Preview confirmation key 51. Single-sided single-sided key 52 52 single-sided double-sided key 53 53-sided double-sided Key 54... Double-sided to single-sided key 61... Sort key 62. Staple key 63. Group key 64. Staple key 65. Punch key 66. Amount display section 72 ... Intermediate display button 73 ... Cancel button 80 ... Preview screen 81 ... Preview image 82 ... Page switch key 83 ... Page display 84 ... Setting confirmation key 85 ... Reduce key 86 ... Rotate Key, 87, reset key, 88, copy start key, 101A, 101B, 101C, 101D, photosensitive drum 102A, 102B, 102C, 102D ... development unit, 103 ... charge roller, 104 ... primary transfer roller, 105 ... cleaning unit, 106 ... image forming unit, 107 ... paper storage unit, 108 ... paper transport unit, 110 ... exposure unit, 111 ... Intermediate transfer belt, 112A, 112B, 112C, 112D ... Image forming station, 113 ... Cleaning unit, 113A ... Heating roller, 113B ... Pressure roller, 114 ... Secondary transfer roller, 116A, 116B, 116C, 116D ... Feed Paper cassette, 117: manual feed tray, 121A, 121B ... pickup roller, 122A, 122B ... paper feed roller, 125 ... total number, 130 ... image forming position, 131 ... paper conveyance path, 132 ... registration roller, 133 ... fixing unit, 134 ... Discharge roller, 1 35 to 138... Paper transport path, 161, 162, 163... Transport roller, 171... Entrance roller, 172... Stapler, 173 .. alignment processing unit, 174 ... paper discharge roller, 175 ... paper discharge tray, 176. Sensor: 178: Punch pin, 200: Document conveyance reading unit, 211: Document set tray, 212: Document detection sensor, 213: Pick-up roller, 214: Scaffle plate, 215 ... Conveyance roller, 216 ... Platen glass, 217 ... Document discharge tray 221 ... first reading unit, 222 ... second reading unit, 223 ... first scanning unit, 224 ... second scanning unit, 226 ... imaging lens, 227 ... CCD, 300 ... post-processing device, 301 ... post-processing device 311 ... Entrance roller, 312 ... Paper discharge roller, 313 ... Paper discharge roller, 314 ... Staple tray discharge roller 315... Roller 321 322 branching claw 331 non-staple transport path 332 tray transport path 333 staple transport path 341 discharge tray 342 interrupt tray 351 discharge guide plate 361 Staple tray, 362... Rear edge reference fence, 363. Stapler, 400, 500.

Claims (12)

An input unit that inputs image data, a processing unit that executes predetermined final processing using the image data input to the input unit, and a preview image generation unit that generates a preview image of the image data to be subjected to the final processing And a display unit for displaying the preview image generated by the preview image generation unit,
The image processing apparatus according to claim 1, wherein when the preview image generation unit generates one preview image, the display unit performs display indicating that the one preview image is generated.   The image processing apparatus according to claim 1, further comprising an image reading unit that reads an original image and outputs image data, and the image data read and output by the image reading unit is input to the input unit as image data An image processing apparatus.   3. The image processing apparatus according to claim 1, further comprising an image forming unit that forms an image of the image data to be output on an image forming medium as one of the final processes. Processing equipment.   4. The image processing apparatus according to claim 1, wherein when there are a plurality of pieces of image data, the display unit displays a display indicating that the preview image is generated for each image. Image processing apparatus characterized by executing   5. The image processing apparatus according to claim 4, wherein the display unit updates and displays a display indicating that the preview image has been generated for each preview image.   6. The image processing apparatus according to claim 1, wherein the preview image generation unit starts generating the preview image when image data is input to the input unit. Forming equipment.   The image processing apparatus according to claim 1, wherein the display unit inputs image data after all image data to be generated as a preview image is input to the input unit. The total number of pages is displayed.   The image processing apparatus according to claim 1, wherein the preview image generation unit further displays a preview image when a display indicating that the preview image is generated is performed on the display unit. When there is image data to be generated, an image processing apparatus continues to generate a preview image even when the display unit is displaying.   9. The image processing apparatus according to claim 1, wherein the display unit can display the generated preview image after executing display indicating that the preview image has been generated. 10. An image forming apparatus.   The image processing apparatus according to claim 9, wherein the final process is executable after the display unit displays the preview image.   The image processing apparatus according to claim 10, wherein the final process includes a transmission process of the image data, an image formation process by the image forming unit, and a storage process of the image data. An input step for inputting image data;
A processing step of executing a predetermined final process using the image data input in the input step;
A preview image generation step for generating a preview image of the image data to be subjected to the final process before executing the final process;
A display step of displaying the preview image generated in the preview image generation step,
The image processing method according to claim 1, wherein the display step performs display indicating that the one preview image has been generated at the stage where the one preview image is generated in the preview image generation step.

Images