JP2017063467A - Image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image formation apparatus which can display a preview image, without giving impression of a low processing speed, when an image edition instruction is designated.SOLUTION: An image processing apparatus includes: a storage device 172 (HDD) which stores a middle resolution image 324, a low resolution image 322 and a high resolution image 320; and a preview image generation unit 354 which generates and displays a preview image 362 from the low resolution image. The preview image generation unit includes: a low resolution preview image generation unit 356 which, in response to the edition instruction from a user to the displayed preview image, edits and displays a low resolution image; and a middle resolution preview image generation unit 358 which, in response to the edition instruction from the user, generates and edits a middle resolution image from a high resolution image or a low resolution image according to a document type, to display in substitution for the low resolution preview image. This enables displaying, after promptly displaying the low resolution preview image, a high-quality preview image in substitution.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an image processing apparatus having a preview function, and more particularly to an image processing apparatus capable of displaying a preview image that appropriately represents an output image obtained by image processing such as enlargement / reduction at high speed.

  As one type of image processing apparatus that is an electronic device, an image forming apparatus (typically a copier) that forms an image on a recording sheet is introduced in many offices (company, office, etc.). In such offices, there are many cases where an image forming apparatus having a printer function, a copy function, and the like is connected to a network and the image forming apparatus is shared by a plurality of users. A multifunction peripheral (MFP (Multi Function Peripheral)), which is one type of such an image processing apparatus, includes a copy mode, a facsimile mode (hereinafter, the facsimile is sometimes referred to as “FAX” or “fax”), a network compatible printer mode, And a plurality of basic operation modes such as a scanner mode. In these image processing apparatuses, each user selects an operation mode and sets functions such as double-sided printing and aggregation (2in1 to make 2 pages into 1 sheet, 4in1 to make 1 page into 4 sheets, etc.). Thus, an image is formed on the recording paper in a desired manner. Furthermore, these multiple functions are often used in combination as appropriate.

  Consider a digital machine equipped with an image forming unit for an electrophotographic process as an image processing apparatus. A digital machine can easily perform various processes electronically on a digital image before forming the image. For example, the image processing program can easily perform the above-described aggregation processing, setting of double-sided printing, masking a part of an image, moving a part of an image to another position, and the like. . In order to perform such work reliably, it is convenient if a preview image that displays an expected output mode (printed image) in advance can always be displayed on the display device. For this reason, an increasing number of image processing apparatuses use an operation unit including a display panel such as a liquid crystal display device capable of displaying an image and a touch panel formed by being laminated on the upper surface of the display panel as the operation panel.

  In such an image processing apparatus, if display processing is performed using the original image read by the original reading unit as it is, the amount of data processing is large, so that processing takes time and operability is deteriorated. Therefore, when reading a document, it has a function of simultaneously reading a low-resolution image together with a high-resolution image, or automatically generating a low-resolution image from a high-resolution image. An image processing apparatus using the above image is known.

  For example, in Patent Document 1 below, image data having a plurality of types of resolutions or a plurality of types of gradations is generated at the time of one reading by the scanner device, and different image data is used to suit the purpose of use at the data transfer destination. Is disclosed. In the image forming apparatus described in Patent Document 1, a low-resolution image is displayed at high speed in the preview display for confirming the image content, and an image read at a high resolution is used for output onto a recording sheet and image transmission to the outside. Is used.

  In Patent Document 2 below, in order to scroll or zoom the compressed image data at high speed, a plurality of decoded images having different resolutions are stored in a cache, and when scrolling or zooming is displayed, The use of cache images is disclosed.

In Patent Document 3 below, only thumbnails and preview images displayed on a screen displayed after a specific screen are displayed in order to display thumbnail images and preview images at high speed without consuming a large amount of memory. Is previously generated.

  Further, in Patent Document 4 below, in a system in which printing is instructed from a computer to a printer server device or the like, when preview processing is performed by a computer, preview data is first transmitted from the printer server device at a coarse resolution and specified from the computer. It is disclosed that when there is an enlargement request for an area, the printer server device generates and transmits preview data with a higher resolution.

JP-A-11-289416 JP 2009-206884 A JP 2006-203702 A Japanese Patent Laid-Open No. 11-110170

  When a preview image is generated and displayed, it is required that the preview image be generated promptly and that the preview image appropriately represents the actual output mode (hereinafter also referred to as “finish”). In particular, it is required to balance these in a balanced manner. However, according to any of the inventions described in Patent Documents 1 to 4, it is impossible to achieve a balance between a request for processing speed and a request for image quality of a preview image.

  In the image forming apparatus of Patent Document 1, since a low-resolution image is used for preview display, an image with a quality different from the finished image by the image forming unit is displayed as a preview, and the finished image desired by the user is displayed. There is a problem that there is a high possibility that cannot be output. In addition, there is a problem in that the data storage capacity is increased because image data having a plurality of resolutions or a plurality of gradations is generated at the time of reading by the scanner device so as to meet the intended purpose.

  Also in Patent Document 2, a plurality of images having different resolutions are stored in the cache, which causes a problem that the data storage capacity increases. Further, not all cached images are used, and there is a problem that an unnecessary process for generating an image that is not actually used must be executed.

  Also in Patent Document 3, since thumbnails and preview images are generated in advance, there is a problem that unnecessary processing for generating useless data that is not displayed must be executed.

  In the above-mentioned patent document 4, when the enlargement request is made for the preview image, the preview data with a higher resolution is generated. Therefore, the preview image after the enlargement process is not displayed until the generation is completed. It can be stressful.

  Therefore, the present invention provides an image processing apparatus capable of displaying an appropriate preview image corresponding to a processing target image without giving the user an impression of a slow processing speed when image processing such as enlargement / reduction is designated. The purpose is to provide.

An image processing apparatus according to a first aspect of the present invention is an image processing apparatus that generates a preview image. The image processing apparatus includes a first resolution image, a second resolution image lower than the first resolution, and a third resolution image generated by reading a document at a third resolution higher than the first resolution. An image storage unit for storing; a generation unit for generating a second resolution image from a third resolution image; a preview display unit for generating a preview image from the second resolution image and displaying the preview image on a display device; In response to an editing instruction for a preview image displayed on the display device, a first editing unit that processes a second resolution image according to the editing instruction to generate a first image and displays the first image on the display device In response to the editing instruction, a first resolution image is generated from the third resolution image or the second resolution image, and the second resolution image is generated by processing the first resolution image in accordance with the editing instruction. Second image And a second editing unit to be displayed on the display device.

  Preferably, the second editing unit generates a first resolution image from the third resolution image or the second resolution image according to the content of the editing instruction for the preview image.

  More preferably, the second editing unit generates a first resolution image from a third resolution image or a second resolution image according to the type of document.

  More preferably, the second editing unit displays the second image on the display device instead of the first image displayed by the first editing unit.

  Preferably, the process of generating the first image by the first editing unit and the process of generating the second image by the second editing unit are processes executed in parallel.

  More preferably, when an editing instruction is given to a predetermined area of a part of the preview image, the second editing unit determines that the number of pixels belonging to the character area among the pixels in the predetermined area is the number of pixels belonging to the photo area. The first resolution image is generated from the second resolution image, and among the pixels in the predetermined area, the number of pixels belonging to the photo area is larger than the number of pixels belonging to the character area, A first resolution image is generated from the three resolution image.

  More preferably, the image processing device assigns a numerical value corresponding to the type of document to each pixel of the image of the third resolution, and when an editing instruction is given to a predetermined region of a part of the preview image, the document in the predetermined region The type information is determined from the average value or the mode value of the numerical values given to the pixels in the predetermined area, and the second editing unit determines the third resolution according to the original type information determined for the predetermined area. A first resolution image is generated from the image or the second resolution image.

  Preferably, the image processing apparatus outputs a fourth resolution image between the first resolution and the third resolution from the third resolution image when the image quality-related processing is designated for the preview image by the user. A preview image is generated by executing specified image quality-related processing on the fourth resolution image.

  More preferably, the image quality-related processing is processing for a preview image that is a color image.

  A display method according to a second aspect of the present invention is a preview image display method in an image processing apparatus. This display method stores a first resolution image, a second resolution image lower than the first resolution, and a third resolution image generated by reading a document at a third resolution higher than the first resolution. A step of generating a second resolution image from the third resolution image, a step of generating a preview image from the second resolution image and displaying the preview image on the display device, and a step of being displayed on the display device by the user In response to the editing instruction for the preview image, a step of processing the second resolution image according to the editing instruction to generate a first image and displaying the first image on the display device; A first resolution image is generated from the third resolution image or the second resolution image, the first resolution image is processed in accordance with an editing instruction to generate a second image, and the second image is displayed on the display device. table And a step of.

  According to the present invention, when the user instructs image processing such as enlargement / reduction to the preview image (editing instruction), the preview image is displayed in a short time after the preview image is displayed. It is replaced with a resolution preview image. The user feels that the processing speed of the image processing apparatus is fast and the quality of the preview image that is finally displayed is high, so that the user can accurately grasp the finished image after the image processing.

  In addition, since an image having a resolution corresponding to the result of automatically determining the document type is used as the original image for generating the preview image, each of the document including many characters and the document including many photographs is used. It is possible to generate a preview image with an appropriate resolution according to the above. That is, unnecessary processing can be suppressed, and prompt generation of a preview image and generation of a preview image that appropriately represents a finished image can be achieved in a balanced manner.

  If the user can specify the document type, the preview image can be displayed at a processing speed and resolution according to the user's request. That is, an optimal preview display can be performed depending on whether the image quality is important or the processing speed is important.

  In addition, when image quality-related processing is specified for the preview image, a medium-high resolution image having a higher image quality than the medium resolution is used, so that the user can grasp the finished image after processing more accurately.

1 is a perspective view showing an external appearance of an image processing apparatus according to an embodiment of the present invention. It is sectional drawing which simplifies and shows the internal structure of the image processing apparatus shown in FIG. It is a functional block diagram which shows the hardware constitutions of the image processing apparatus shown in FIG. FIG. 2 is a diagram illustrating an example of a display screen at the time of document reading in the image processing apparatus illustrated in FIG. 1. It is a figure which shows an example of the display screen at the time of a fit to screen display. It is a figure which shows an example of the display screen at the time of 2in1 display. It is a block diagram which shows the function regarding the preview image generation process of the image processing apparatus which concerns on embodiment of this invention. It is a flowchart which shows the control structure of the computer program which implement | achieves a preview image generation process. It is a flowchart which shows the control structure of the computer program which implement | achieves scaling processing. It is a flowchart which shows the control structure of the computer program which implement | achieves processes other than an enlarging / reducing process. It is a figure which shows an example of the partial screen for designating original classification information.

  In the following embodiments, the same parts are denoted by the same reference numerals. Their functions and names are also the same. Therefore, detailed description thereof will not be repeated.

  An image processing apparatus, which is an example of an image processing apparatus according to an embodiment of the present invention, reads a document and stores images at two different resolutions. One resolution is 600 dpi (referred to herein as “high resolution”), and the other resolution is 75 dpi (referred to herein as “low resolution”). Furthermore, an image having an intermediate resolution of 150 dpi (referred to as “medium resolution” in this specification) and an image of 300 dpi (referred to as “medium high resolution” in this specification) are also used.

  This image processing apparatus forms an image on a recording sheet by an electrophotographic method. The image processing apparatus has, as operation modes, a copy mode, a FAX mode, a document filing mode (a mode in which a scanned image is stored in a storage device inside the image processing apparatus), and a mail mode (a format in which the scanned image is attached to an e-mail). Mode to transmit in). The image processing apparatus may further include a network printer mode.

[Image processing device: function]
The outline of the image processing apparatus 100 according to the present embodiment will be described with reference to FIGS. In the following, “image” means not only the displayed image itself but also image data.

  With reference to FIGS. 1 to 3, the image processing apparatus 100 includes a document reading unit 102, an image forming unit 104, a paper feeding unit 106, a paper discharge processing device 108, and an operation unit 120. As shown in FIG. 1, the operation unit 120 includes a touch panel display 130 and an operation key unit 140. The touch panel display 130 includes a display panel 132 configured by a liquid crystal panel or the like, and a touch panel 134 that detects a position pressed by a user's finger arranged on the display panel 132. In the operation key unit 140, several function keys (not shown) and a numeric keypad are arranged. The image processing apparatus 100 operates in one of the following operation modes.

-Copy mode-
In the copy mode, a document reading unit (hereinafter sometimes referred to as a scanner unit) 102 and an image forming unit 104 operate mainly.

  In the image processing apparatus 100, a document placed on a document placement table is read as an image by the document reading unit 102. The read image is input to a multi-core CPU (Central Processing Unit) 170 having a plurality of arithmetic processing units shown in FIG. 3 and subjected to various image processing. The processed image is output to the image forming unit 104. The multi-core CPU 170 can simultaneously execute a plurality of processes.

  The image forming unit 104 prints an image of a document indicated by the image on a recording medium (in many cases, a recording sheet). The image forming unit 104 includes a photosensitive drum 222, a charging device 224, a laser scanning unit 226, a developing device 228, a transfer device 230, a cleaning device 232, a fixing device 234 that is a heat fixing unit, and a static elimination device (not shown). Yes.

  The image forming unit 104 is provided with a main transport path 236 and a reverse transport path 238, and the recording paper fed from the paper feed unit 106 is transported along the main transport path 236. The paper feeding unit 106 pulls out the recording paper stored in the paper cassette 240 or the recording paper placed on the manual feed tray 242 one by one, and sends the recording paper to the main conveyance path 236 of the image forming unit 104.

  While the recording paper is being conveyed along the main conveyance path 236 of the image forming unit 104, the recording paper passes between the photosensitive drum 222 and the transfer device 230, and further passes through the fixing device 234 to be recorded. Printing on paper is performed.

  The photosensitive drum 222 rotates in one direction, and its surface is cleaned by the cleaning device 232 and the static eliminator and then uniformly charged by the charging device 224.

The laser scanning unit 226 modulates laser light based on the image to be printed, and repeatedly scans the surface of the photosensitive drum 222 in the main scanning direction with this laser light, and the electrostatic latent image is transferred to the surface of the photosensitive drum 222. To form.

  The developing device 228 develops the electrostatic latent image by supplying toner to the surface of the photosensitive drum 222, and forms a toner image on the surface of the photosensitive drum 222.

  The transfer device 230 transfers the toner image on the surface of the photosensitive drum 222 onto a recording sheet that passes between the transfer device 230 and the photosensitive drum 222.

  The fixing device 234 includes a heating roller 248 for heating the recording paper and a pressure roller 250 for pressing the recording paper. The recording paper is heated by the heating roller 248 and pressed by the pressure roller 250, whereby the toner image transferred onto the recording paper is fixed on the recording paper.

  A branching claw 244 is disposed at a connection position between the main conveyance path 236 and the reverse conveyance path 238. When printing is performed only on one side of the recording paper, the branching claw 244 is positioned, and the branching claw 244 guides the recording paper from the fixing device 234 toward the paper discharge tray 246 or the paper discharge processing device 108.

  When printing is performed on both sides of the recording paper, the branching claw 244 is rotated in a predetermined direction, and the recording paper is guided toward the reverse conveyance path 238. The recording sheet passes through the reverse conveyance path 238, is reversed on the front and back, and is conveyed again to the main conveyance path 236. During the re-conveyance of the main conveyance path 236, printing on the back surface is performed and the recording paper is discharged. It is guided toward the paper tray 246 or the paper discharge processing device 108.

  The recording paper printed as described above is guided toward the paper discharge tray 246 or the paper discharge processing device 108 and discharged to the paper discharge tray 246, or the recording paper on each paper discharge tray 110 of the paper discharge processing device 108. Discharged to either.

  The paper discharge processing device 108 performs processing for sorting and discharging a plurality of recording papers to each paper discharge tray 110, processing for punching each recording paper, and processing for stapling each recording paper. For example, when a plurality of printed materials are created, each recording sheet is sorted and discharged to each paper discharge tray 110 so that a part of the printed material is allocated to each paper discharge tray 110. In addition, a punching process or a stapling process is performed on each recording sheet on the discharge tray 110 to create a printed matter.

-Facsimile mode-
In the facsimile mode, the document reading unit (scanner unit) 102 and the FAX communication unit 160 mainly operate during the transmission operation, and the FAX communication unit 160 and the image forming unit 104 mainly operate during the reception operation.

Transmission Operation In the image processing apparatus 100, the facsimile mode is designated, and the document placed on the document table is read as an image by the document reading unit 102. The read image is input to the multi-core CPU 170 shown in FIG. 3, where various image processing is performed on the image. This image is output to the FAX communication unit (FAX communication unit 160 in FIG. 3).

  The FAX communication unit 160 of the image processing apparatus 100 on the transmission side connects the designated transmission line to the designated transmission destination. After the connection, the image is converted into communication data that conforms to the facsimile communication standard, and is transmitted to the receiving facsimile apparatus (for example, an image processing apparatus having a facsimile function).

Communication Operation When the line is connected, the FAX communication unit 160 of the reception-side image processing apparatus 100 detects a communication request signal from the FAX communication unit of the transmission-side image processing apparatus and transmits a response signal. After that, for example, the FAX communication unit 160 transfers the capability information implemented on the transmission side and the reception side, and determines the communication speed at the maximum available capability, the image encoding / code correction method, and the like. Set the modem communication method. Data is transmitted from the FAX communication unit 160 of the image processing apparatus 100 on the transmission side to the FAX communication unit of the image processing apparatus on the reception side using an image signal format adapted to this communication method. When transmission is completed, the line is disconnected.

Reception Operation The FAX communication unit 160 of the image processing apparatus 100 on the reception side converts the received data into an image and sends it to the image forming unit 104. Note that the image forming unit 104 may convert the received data into an image. Similar to the operation in the copy mode described above, the image forming unit 104 prints an image of a document indicated by an image converted from received data on a recording sheet.

-Document filing mode-
In the document filing mode, the document reading unit (scanner unit) 102 and the image forming unit 104 mainly operate.

  In the image processing apparatus 100, a document placed on a document placement table is read as an image by the document reading unit 102. The read image is input to the multi-core CPU 170, where various image processing is performed on the image. This image is stored in a storage device (a hard disk 172 described later) included in the image processing apparatus 100.

  The stored image is read from the storage device with the file name designated by the user, and printed on the recording paper in the same operation as in the copy mode described above.

-Mail mode (scan to mail)-
In the mail mode, the document reading unit (scanner unit) 102 and the network interface (hereinafter referred to as network I / F) 174 mainly operate.

  As an image communication mode provided in the image processing apparatus 100, the above-described facsimile mode in which an image is transmitted / received via a public line via the FAX communication unit 160, and a format in which an image is attached to an e-mail via the network I / F 174. There is an e-mail communication mode (e-mail mode) for transmitting and receiving via the Internet line. In addition, an Internet facsimile mode in which images are transmitted and received via the Internet line via the network I / F 174, an image transfer mode (scan to PC folder) in which images are transferred to a folder on a specific computer using the network line, and the like are provided. It does not matter.

  In the image processing apparatus 100, a document placed on a document placement table is read as an image by the document reading unit 102, and the read image is input to the multi-core CPU 170 and subjected to various image processing. This image is attached to the e-mail and transmitted.

  In the facsimile mode, the telephone number of the destination is designated, whereas in the mail mode, the destination mail address is designated.

[Image processing device: control block configuration]
Referring to FIG. 3, image processing apparatus 100 further includes a copy mode, a facsimile mode,
The operation unit 120 operating as a scanning display panel capable of setting functions related to the document filing mode and the mail mode, and a ROM (Read-Only Memory) 176 for storing a program and the like are cut off. Even if it is executed, a hard disk (hereinafter referred to as HDD) 172 that is a nonvolatile storage area capable of maintaining a program, data, and the like, and a RAM (Random Access Memory) for providing a storage area when executing the program: Memory 178 at any time).

  The image processing apparatus 100 is further connected to a document reading unit 102, an image forming unit 104, a FAX communication unit 160, an operation unit 120, a ROM 176, an HDD 172, and a RAM 178, a bus 180 connected to the bus 180, and stored in the HDD 172 or the like. And a multi-core CPU 170 for realizing a general function as an image processing apparatus by executing the program.

  Further, the image processing apparatus 100 can communicate with each unit of the image processing apparatus 100 via the bus 180, and according to a command from the multi-core CPU 170, a sheet feeding unit 162 for executing sheet feeding control regarding the image forming unit 104. And a discharge unit 164 that is connected to the bus 180 and controls the discharge of the recording sheet from the image forming unit 104 in accordance with a command from the multi-core CPU 170.

  The HDD 172 stores document image files scanned by the image processing apparatus 100 together with a save date and a save user name for each folder. The HDD 172 stores initial screen data for each operation mode.

  The ROM 176 stores a program and data necessary for controlling the operation of the image processing apparatus 100. As the data stored together with the program in the ROM 176, initial screen data for each operation mode may be stored. The multi-core CPU 170 controls the image processing apparatus 100 according to the program and data stored in the ROM 176 and executes control related to each function of the image processing apparatus 100. Since the multi-core CPU 170 has a plurality of arithmetic processing units, two or more processes can be executed in parallel at the same time.

  As shown in FIG. 3, a public line is connected to the FAX communication unit 160 of the image processing apparatus 100 for image transmission / reception, and a network I / F 174 is connected to the network line. A computer or the like that uses the image processing apparatus 100 as a network compatible printer is connected to the network line. A computer identified by a URL (Uniform Resource Locator) designated via the Internet may be connected to the network line. When connected to the Internet in this way, the image processing apparatus 100 can acquire necessary information via the Internet.

  The RAM 178 provides a function as a working memory that temporarily stores the results of calculations and processing by the multi-core CPU 170 and a function as a frame memory that stores images.

  The multi-core CPU 170 controls the document reading unit 102, the image forming unit 104, the touch panel display 130 constituting the operation unit 120, the paper feeding unit 162, the discharge unit 164 and the operation key unit 140, and the ROM 176, HDD 172, and RAM 178. This is done by executing the program. Note that the operation unit 120 communicates with the multi-core CPU 170 via an input / output interface.

  The operation unit 120 is a panel provided with an inclination so that the user can easily see it. A touch panel display 130 is arranged in the left area on the surface of the operation unit 120, and an operation key section 140 is arranged in the right area. The touch panel display 130 and the operation key unit 140 are integrated to form the operation unit 120.

  As described above, the touch panel display 130 includes the display panel 132 and the touch panel 134 disposed so as to overlap the display panel 132. In this touch panel display 130, a home screen for selecting an operation mode in the image processing apparatus 100, a current state of the image processing apparatus 100, a destination designation situation, a job processing situation, and the like are displayed on the display panel 132. A selection button which is a software button is displayed on the display area of the display panel 132. When the area where the selection button is displayed is pressed with a finger, the touch panel 134 detects the pressed position. The operation mode selection, function setting, operation instruction, and the like of the image processing apparatus 100 are performed by collating the display position of the selection button and the position where the touch panel 134 is pressed by the program. In addition to such a touch operation (command input operation based on a pressed position by a user), the image processing apparatus 100 also supports a gesture operation (command input operation based on an operation locus by a user).

  Hereinafter, display on the touch panel display 130 of the image processing apparatus 100 will be described. In the present embodiment, for example, when copying is performed after an original is read as an image and various settings are made, a preview image corresponding to the setting is displayed on the touch panel display 130 each time the setting is made. By always displaying the preview image, the user can accurately capture the finished image and perform the copy process without error.

  FIG. 4 shows a basic layout in the touch panel display 130 of the image processing apparatus 100. Referring to FIG. 4, the basic layout of the screen in a horizontally long touch panel display 130 (for example, horizontal 1024 pixels × vertical 600 pixels) includes a system area 200 arranged at the top, a preview area 204 arranged at the center, A function selection area 202 arranged on the left side of the preview area 204, an action panel area 206 arranged on the upper right side of the preview area 204, and a task trigger area 208 arranged on the lower right side of the preview area 204 are included. In the function selection area 202, an icon button and a function description for function setting and setting state confirmation are displayed. The action panel area 206 displays information that is not directly related to the work that the user is currently trying to perform, such as a recommended function, but would be useful to the user when displayed. In the task trigger area 208, a group of buttons for instructing the start of copying, the start of document scanning, and the like are displayed.

  Note that the number of regions is not limited to five. The left-right arrangement is not limited to that shown in FIG. It can also be made customizable so that the user can operate it easily. For example, the position of the system area 200 may be at the bottom of the screen.

  In the system area 200, information regarding the current image processing apparatus 100, that is, information about the title of the operation mode being operated and the state of the image processing apparatus 100 is displayed. For example, the system area 200 displays an operation mode name, an interrupt key, a login user name, a job status being processed, a built-in memory usage status, a time, and the like.

In the function selection area 202, function selection menus (icons, buttons, etc.) operated by the user for setting each function, switching the display, and confirming the settings are displayed in different display modes depending on the operation mode. The operation mode includes an icon mode, a regular mode, and an express mode. In the icon mode, only the function setting icons are displayed in the function selection area 202 so that the preview area 204 becomes the largest. In the express mode, the preview area 204 is the smallest, and the function selection area 202 displays a large screen on which functions can be set at one time. In the regular mode, the size of the preview area 204 is an intermediate size between the icon mode and the express mode, and the function name is displayed in the function selection area 202 together with the function setting icon. In the regular mode, only the function name may be displayed in text (no function setting icon is displayed).

  Switching between these icon mode, regular mode and express mode is based on the user's operation. That is, the size of the preview area 204 is automatically changed according to a user operation. Since the icon can transmit information to the user in a small area, it is preferable to prepare for all functions and display the preview area 204 in a large size. On the other hand, when it is not necessary to make the preview area so large, the function selection area 202 displays not only the icon but also the function description, so that the user can easily understand the operation.

  The function selection area 202 includes a change button group 210 for changing the display style of the function selection area 202 below the function selection area 202. In the change button group 210, a button for displaying the function selection area 202 in the icon mode, a button for displaying the function registered as “favorite”, a button for displaying the function whose setting has been changed, and setting in the selected operation mode are possible. A button for displaying a list of all functions, a button for displaying the function selection area 202 in the regular mode, a button for displaying the function selection area 202 in the express mode, and the like are arranged.

  When there is a lot of information displayed in the function selection area 202, the information is displayed in the function selection area 202 so as to be scrollable in the vertical direction. In this case, the change button group 210 is not scrolled and is always displayed at the bottom of the function selection area 202.

  In the preview area 204, a preview image representing an output mode (for example, a print image) of the image processing apparatus 100 is displayed. An image is displayed using dummy data or scan data, and the preview image displayed in the preview area 204 is changed every time the user instructs image processing.

  A preview change button group 212 for changing the display style of the preview area 204 is arranged below the preview area 204. The preview change button group 212 includes a left rotation button for rotating the preview image 90 degrees to the left, a right rotation button for rotating the preview image 90 degrees to the right, a color change button for adjusting the color, and enlargement / reduction of the preview image. A zoom bar area 214 and the like for manual operation are arranged.

  Touching the left rotation button once rotates the preview image 90 degrees to the left, and touching it twice rotates the preview image 180 degrees to the left. For the right rotation button, the same processing as that for the left rotation button is performed except that the rotation direction is opposite. Note that the preview image can also be rotated by a gesture operation. For example, if the fingertip is rotated 180 degrees counterclockwise so as to draw an arc while the fingertip is placed on the preview image, the preview image is rotated 180 degrees to the left. The same applies to the right rotation by gesture operation.

  The zoom bar area 214 includes a plus button 216 for instructing enlargement of the preview image, a minus button 220 for instructing reduction of the preview, and a slider 218 for continuously adjusting the display magnification of the preview image.

When the plus button 216 is touched or when the gesture operation (slide) of the slider 218 toward the plus button 216 is performed, the preview image is enlarged and displayed. Even when a gesture operation is performed on the preview image displayed in the preview area (for example, pinch out (pinch open) of the fingertip with respect to the preview image), the preview image is enlarged and displayed.

  When the minus button 220 in the zoom bar area 214 is touched or the slider 218 is moved to the minus button 220 side by a gesture operation (slide), the preview image is reduced and displayed. Even when a gesture operation is performed on the preview image displayed in the preview area (for example, pinch-in (pinch close) of the fingertip with respect to the preview image), the preview is reduced and displayed.

  When the number of preview images displayed in the preview area 204 is large, display page selection buttons (page number input button, page forward button, page return button, single page display button, multiple page display button) that can be touch-operated are displayed. Etc.) may be displayed. Note that the preview image can also be paged and paged back by a gesture operation (eg, flicking) the preview image. If the preview image displayed in the preview area 204 is large, a scroll bar that can be touched or gestured may be displayed.

  In the action panel area 206, information about assistance / advice / suggestion for operation is displayed. In this action panel area 206, for example, when a certain user selects a specific function, a function related to the function is displayed, or other functions regarding the function are displayed in a purpose-oriented manner. A function selected in combination in the past by a user of a group to which the user belongs is displayed as a “recommended function”.

  In the task trigger area 208, a trigger button that is operated by the user in order to actually operate the image processing apparatus 100 after all settings are completed in a specific operation mode is displayed. In the present embodiment, the task trigger area 208 includes a monochrome copy button 270 for starting a monochrome copy of a document, a color copy button 272 for starting a color copy, and a document that is once scanned and captured as an image by the image processing apparatus 100. A scan-in button 274 for starting the processing to be included, and a clear all button 276 for clearing all the settings.

  In this case, it is also preferable to display a start button that triggers the job only when the job to be triggered can be started. The state where the job can be started is a state where all the settings are completed and the consumables (recording paper and toner) are not exhausted in the operation mode with printing. In the facsimile mode (transmission), which is an operation mode that does not involve printing, the state in which the job can be started is a state in which all the transmission parameters including the destination have been set.

  The positions where these five areas are arranged are not changed even if the operation mode is changed (in the initial screen of any operation mode). When the icon mode / regular mode / express mode is switched, the function selection area 202 and the preview area 204 expand and contract in the horizontal direction (longitudinal direction) of the touch panel display 130.

  These five areas are arranged with attention paid to the flow line of the user's viewpoint and the flow line of the operation in consideration of the user interface in the conventional machine. With this arrangement, on the touch panel display 130, the user's line of sight moves from the upper left to the lower right, and the user's operation (the fingertip of the dominant hand) moves from the upper left to the lower right. Thereby, the effect that user-friendly operation is possible can be acquired.

In order to change from one operation mode to another operation mode, a home key (not shown) arranged on the operation key unit 140 is pressed. A home screen in which the operation mode including the fax can be selected is displayed. Other operation modes can be selected on this home screen.

  As described above, the image processing apparatus 100 includes the touch panel display 130 that displays information by paying attention to the flow line of the user's viewpoint and the flow line of the operation. In this touch panel display 130, there are a plurality of display modes for the preview area 204, and the display information is appropriately transmitted to the user by switching between these display modes according to the progress of scanning or / and the importance of the document. .

  FIG. 4 shows a display state of the touch panel display 130 during the scan execution. Referring to FIG. 4, when a plurality of originals are being read, a preview image of an already read original one page before the original being read is displayed on the right side of preview area 204 (during the reading of the first original). Is a dummy image) 280. When reading of one page of the document is completed, an animation in which the preview image 280 moves to the left is displayed, and a preview image 282 showing a state where the document is stacked (stacked) is displayed. Since it takes some time until the preview image is generated after the reading of the document is completed, the preview image displayed on the touch panel display 130 is displayed at a timing slightly delayed from the actual reading completion. In the present embodiment, at the time of reading a document, both a high resolution image used for printing and a low resolution image used for preview display are generated.

  FIG. 5 shows a display screen of touch panel display 130 when the scan-in is completed. The display format of FIG. 5 is called a fit-to-screen. In the fit-to-screen, the size of the preview image is adjusted so that the preview image 284 of the document is displayed as large as possible in the preview area 204. The preview image initially displayed on the fit to screen is generated from the low resolution image.

  For example, when the preview image is enlarged or reduced by operating the zoom bar area 214, in the present embodiment, a medium resolution image (an intermediate resolution image between a high resolution and a low resolution) is once generated from a low resolution image. The medium resolution image is enlarged or reduced. Since the medium resolution image is enlarged / reduced, the finally obtained image is closer to the finished image than that obtained from the low resolution image, and the user can correctly recognize the result of the operation. However, in this case, the final preview image cannot be displayed until an intermediate resolution image is generated and an enlargement / reduction process is performed on the intermediate resolution image. Therefore, when viewed from the user, the response is poor, and the operability of the image processing apparatus 100 is lowered. Therefore, in this embodiment, in parallel with the enlargement / reduction process for the medium resolution image, the enlargement / reduction process for the low resolution image is performed and the result is displayed as a preview image first. At the same time as the enlargement / reduction process for the medium resolution image is completed, the preview image obtained as a result is replaced with the preview image obtained from the low resolution image on the screen. The enlargement / reduction process for the low resolution image can be completed in a shorter time than the process for the medium resolution image. Therefore, by displaying in this way, the user is quickly presented with the enlargement / reduction result, and finally replaced with the preview obtained from the medium resolution image, so the processing is also fast and the image quality is high. The preview after enlargement / reduction can be confirmed in a form kept high.

  FIG. 6 shows a preview display when so-called 2-in-1 printing is performed as an example of the aggregation function. Referring to FIG. 6, in 2in1 printing, a preview image in which page images 286 and 288 are arranged in the same manner as the print image is generated and displayed in preview area 204. In the case of these preview images related to aggregate printing, the image quality does not change even if generated from a low resolution image or a high resolution image. Therefore, in such a case, a preview image is generated from a low-resolution image that requires a small amount of calculation.

  As described above, in the present embodiment, both a high-resolution image and a low-resolution image are generated when a document is read. When reading is completed, a preview image is generated from the low-resolution image and displayed. Thereafter, when the image read by the user is edited (including enlargement / reduction), an intermediate resolution image is generated from the low resolution or high resolution image, and a preview image is generated and displayed using the intermediate resolution image. For example, when the enlargement ratio is changed, a medium resolution image is generated from a high resolution image or a low resolution image according to the type of document, and enlargement / reduction for the low resolution image and enlargement / reduction for the medium resolution image are performed in parallel. To run. The preview image obtained from the low resolution image is displayed first, and the preview image is replaced when the preview image is obtained from the medium resolution image.

  Hereinafter, image processing related to preview display in the image processing apparatus 100 will be described.

  FIG. 7 shows a display image processing unit 310 extracted from the image processing apparatus 100 by extracting only functional parts responsible for display image processing related to preview display. Referring to FIG. 7, the display image processing unit 310 includes a low resolution image generation unit 340, a medium resolution image generation unit 342, a medium and high resolution image generation unit 344, an image processing unit 350, an output processing unit 352, and a preview image generation unit 354. , A control unit 380, a selector 384, a display processing unit 386, a touch panel 134, and an HDD 172. The preview image generation unit 354 includes a low resolution preview image generation unit 356, a medium resolution preview image generation unit 358, and a medium high resolution preview image generation unit 360. The functions of the units (excluding the HDD 172 and the touch panel 134) shown in FIG. 7 are functions realized by the multi-core CPU 170 in FIG. 3, for example. However, some functions can be realized by hardware (for example, ASIC).

  The low resolution image generation unit 340 generates a low resolution image 322 from the high resolution image 320 read by the document reading unit 102. The medium resolution image generation unit 342 generates a medium resolution image 324 from the high resolution image 320 or the low resolution image 322. The medium / high resolution image generation unit 344 generates a medium / high resolution image 326 from the high resolution image 320. Known image processing can be used for processing for generating an image with a different resolution from an image with a specific resolution. For example, an interpolation process may be used.

  The image processing unit 350 executes specified image processing on the high resolution image 320 to generate an output image, and inputs the output image to the output processing unit 352. The output processing unit 352 performs processing necessary for image formation using the input image data.

  Under the control of the control unit 380, the preview image generation unit 354 performs predetermined image processing (for example, enlargement / reduction processing) on the low-resolution image 322, the medium-resolution image 324, or the medium-high resolution image 326, and the low-resolution image A preview image 362, a medium resolution preview image 364, or a medium high resolution preview image 366 is generated. Specifically, the low resolution preview image generation unit 356 generates a low resolution preview image 362 from the low resolution image 322. A medium resolution preview image generation unit 358 generates a medium resolution preview image 364 from the medium resolution image 324. The medium / high resolution preview image generation unit 360 generates a medium / high resolution preview image 366 from the medium / high resolution image 326. When the generation of the preview image is completed, the medium resolution preview image generation unit 358 and the medium / high resolution preview image generation unit 360 output a processing completion signal to the control unit 380.

  The selector 384 is controlled by the control unit 380, selects one of the low resolution preview image 362, the medium resolution preview image 364, and the medium high resolution preview image 366, and outputs the selected image to the display processing unit 386. The display processing unit 386 performs a process for displaying the input image data on the display panel 132.

  The control unit 380 corresponds to the multi-core CPU 170, and in response to a predetermined image processing (for example, enlargement / reduction processing) being specified for the preview image by the touch panel 134, the medium resolution image generation unit 342, the medium high resolution image generation 344, preview image generation unit 354, and selector 384 are controlled.

  The high resolution image 320, the low resolution image 322, the medium resolution image 324, the medium high resolution image 326, the low resolution preview image 362, the medium resolution preview image 364, and the medium high resolution preview image 366 are all stored in the HDD 172. Note that the low-resolution preview image 362, the medium-resolution preview image 364, and the medium-high resolution preview image 366 are temporarily stored in the HDD 172. These are displayed on the preview of another page after the processing on the document being previewed is completed. Deleted when the screen transitions to or when the preview screen is closed.

[Program control structure]
In the image processing apparatus 100, among the functional parts related to copying or faxing, functional parts that scan and process a document are a computer program executed by the multi-core CPU 170 shown in FIG. 3, a multi-core CPU 170, an HDD 172, a RAM 178, an operation. This is realized by cooperation with hardware such as the unit 120. The control structure of this computer program will be described below.

  As a program for realizing a function of scanning and printing or transmitting a document with respect to copying or faxing in the image processing apparatus 100, a function related to copying or faxing is selected on the home screen, and a monochrome copy button 270 shown in FIG. It is activated when the color copy button 272 or the scan-in button 274 is pressed. Although FIG. 4 shows a screen for copying, a screen similar to this screen is also displayed for fax transmission. The only difference is whether the image is finally printed on the recording paper by the image processing apparatus 100 or whether the image is faxed to the transmission destination.

  Note that all the image processing can be executed by the multi-core CPU 170, but some functions can be realized by hardware such as an ASIC. Therefore, in the following description, the function block of FIG. Hereinafter, the multi-core CPU is also simply referred to as a CPU.

  Referring to FIG. 8, in step 400, in this program, CPU 170 controls document reading unit 102 to read a document image at a high resolution (600 dpi). The read image data is stored in the RAM 178.

  In step 402, the low resolution image generation unit 340 performs known image processing on the high resolution image data stored on the RAM 178, generates low resolution (75 dpi) image data, and stores the image data in the RAM 178.

  In step 404, the CPU 170 stores the high resolution and low resolution images on the RAM 178 in the HDD 172 as the high resolution image 320 and the low resolution image 322, respectively.

  In step 406, the CPU 170 determines whether a preview display is necessary according to the pressed button. If it is determined that the preview display is necessary, the process proceeds to step 408; otherwise, the process proceeds to step 414. For example, when the scan-in button 274 is pressed, it is determined that a preview display is necessary. In the case of simple copy or fax transmission, it is not determined that a preview display is necessary.

  In step 408, the CPU 170 controls the preview image generation unit 354 to generate a low resolution preview image 362 from the low resolution image 322 and stores it in the HDD 172. Here, the low-resolution image is an image of 75 dpi (resolution suitable for realistic display of the entire page of the original document) and can be used as it is as a preview image. Therefore, as shown in FIG. Do nothing against it. That is, the low resolution image 322 is handled as the low resolution preview image 362, or the low resolution image 322 is copied to generate the low resolution preview image 362. When the low resolution image is different from 75 dpi, the low resolution image 322 may be input to the low resolution preview image generation unit 356 to generate the low resolution preview image 362.

  In step 410, the CPU 170 controls the selector 384 and outputs the low resolution preview image 362 to the display processing unit 386. The display processing unit 386 generates screen data to be displayed on the touch panel display 130 using the input low resolution preview image 362. As a result, a screen as shown in FIG. 4 is displayed on the touch panel display 130. For example, the display processing unit 386 generates image data (except for the images 280 and 282 in the preview area 204) corresponding to the screen shown in FIG. 4 on the image memory (a part of the RAM 178), and the preview area 204 Are combined with the preview image input from the selector 384 to generate screen data to be displayed on the touch panel display 130. The generated image data is displayed on the display panel 132 of the touch panel display 130 by a video driver.

  In step 412, the CPU 170 determines whether or not enlargement / reduction processing has been designated by the user. If it is determined that the enlargement / reduction process has been designated, the process proceeds to step 414 to execute an enlargement / reduction process described later. Otherwise, the process proceeds to step 416.

  In step 416, the CPU 170 determines whether another process is designated by the user. If it is determined that another process has been designated, the process proceeds to step 418 to execute another process to be described later. Otherwise, the process proceeds to step 420.

  In step 420, the CPU 170 determines whether or not fax transmission is selected by the user. If it is determined that fax transmission is selected, the process proceeds to step 422. In step 422, the image processing unit 350 performs predetermined image processing on the high-resolution image 320 and then transmits the image to the designated number of fax transmitter / receiver, and the processing ends. Specifically, the image processing unit 350 executes image processing (for example, enlargement / reduction processing) set by the user on the high resolution image 320 and outputs the processed result to the output processing unit 352. The output processing unit 352 performs processing necessary for transmitting the input image data to the public line via the FAX communication unit. If it is determined in step 420 that fax transmission is not selected, the process proceeds to step 424.

  In step 424, the CPU 170 determines whether or not the function selected by the user is image printing (image formation on recording paper). If it is determined that image printing has been selected, the process proceeds to step 426. In step 426, image processing according to the setting is performed on the high resolution image 320, and then image formation is performed by the image forming unit 104 (see FIG. 3), and the processing is terminated. Specifically, the image processing unit 350 performs image processing on the high resolution image 320 and outputs the processing result to the output processing unit 352. The output processing unit 352 inputs the input image data to the image forming unit 104, whereby the image is printed on the recording paper. If it is determined in step 424 that image printing has not been selected, the process returns to step 412.

  As described above, in step 412, step 416, step 420, and step 424, the process of step 414 or step 418 is executed when some processing is designated for the preview image while waiting for the designation by the user. Thereafter, when fax transmission or printing is selected, a corresponding process is executed.

  Hereinafter, the process of step 414 executed when the enlargement / reduction process is designated will be described in detail. Referring to FIG. 9, in step 500, CPU 170 activates a program for executing enlargement / reduction processing of low-resolution image 322. Since the CPU 170 can execute a plurality of programs at the same time, it can execute the enlargement / reduction processing of the low-resolution image 322 in parallel with this program. Specifically, the low-resolution image 322 is enlarged or reduced by the low-resolution preview image generation unit 356 expanding the low-resolution image 322 read from the HDD at the magnification specified in step 412 (when the magnification is greater than 1). The image is enlarged and reduced when the magnification is smaller than 1, and the processing result is stored in the HDD 172 as a low resolution preview image 362. For the enlargement / reduction processing, known image processing may be used. For example, an interpolation process may be used.

  In step 502, the CPU 170 determines whether the processing target is a color image. If it is determined that the image is a color image, the process proceeds to step 526, and if not, the process proceeds to step 504.

  In step 504, the CPU 170 determines whether or not to automatically obtain the document type information of the image to be processed. For example, a partial screen (window) as shown in FIG. 11 is displayed on the touch panel display, and a user operation is awaited. If the user presses the automatic button 700 on the screen of FIG. If the user presses one of the text, text / print photo, text / print paper photo, print photo, photo paper photo, map, and light original displayed in the manual setting area 702, step 508 is performed. Migrate to

  The document type information is information for classifying the entire document or the type of a predetermined area into, for example, characters, characters / printed photographs, characters / photographic paper photographs, printed photographs, photographic paper photographs, maps, and light originals. A document whose document type is “character” means a document including only characters. Documents that are “printed photographs”, “photographic paper photographs”, and “maps” mean originals that include only printed photographs, photographic paper photographs, and maps, respectively. A document whose document type is “light document” means a document having a relatively light color. A document that is “character / printed photograph” means a document that includes characters and a printed photograph. Similarly, an original that is a “character / photographic paper photograph” means an original that includes characters and a photographic paper photograph.

  When reading a document, the effective area portion is processed for each pixel, the type of document (character, printed photograph, photographic paper photograph, etc.) to which the pixel belongs is determined, and the processing result is stored in the HDD 172 in correspondence with the pixel. The process for each pixel is a process for obtaining a feature amount using, for example, a target pixel and surrounding pixels. Characters, printed photographs, photographic paper photographs, and the like are each characterized by color distribution, luminance distribution, and the like. Therefore, for example, for an image color-separated into CMY, the density distribution, density gradient, density gradient direction, and the like in the local region including the pixel of interest are obtained, and the numerical value ( (Hereinafter referred to as “pixel type information”). In this way, since the pixel type information of the image corresponding to the original is obtained at the time of reading the original, the original type information is obtained using this as described later. For example, as the pixel type information, a discrete value (a value of a predetermined number of bits) predetermined for each original type (for example, a character, a printed photo, a photographic paper photo, a map, a light original) can be used.

In step 506, the CPU 170 determines the document type information using the pixel type information obtained at the time of reading the document. Specifically, predetermined processing is executed on the pixel type information of the entire image, and the original type information is determined according to the result. For example, one value is determined for the entire image by determining an average value of pixel type information for the entire image, a mode value, and the like, and document type information relating to the entire image is determined from the determined value. When the mode value is obtained, the obtained value directly corresponds to the document type information. However, when the average value is obtained, the average value can be thresholded to determine the document type information. When discrete numerical values predetermined for each document type are assigned, an upper limit value and a lower limit value set in advance for each document type can be used as the threshold value. The threshold value may be a value set in advance at the time of shipment of the image processing apparatus or a value set and adjusted after shipment.

  In step 508, the CPU 170 determines document type information corresponding to the button pressed in step 504. For this purpose, for example, predetermined document type information is assigned to each of the character, character / printed photo, character / photographic paper photo, printed photo, photographic paper photo, map, and light original shown in FIG. Just do it.

  In step 510, the CPU 170 determines whether or not the document type information determined in step 506 or step 508 corresponds to a photographic system. The photographic system means, for example, a printed photograph, a photographic paper photograph, and a light original. Therefore, it is only necessary to determine whether or not the document type information determined in step 506 or step 508 corresponds to any of the document type information corresponding thereto. If it is determined that it is a photographic system, the process proceeds to step 512; otherwise, the process proceeds to step 514.

  In step 512, the CPU 170 generates a medium resolution image 324 from the high resolution image 320. In step 514, the CPU 170 generates a medium resolution image 324 from the low resolution image 322. Specifically, in step 512, the medium resolution image generation unit 342 is controlled by the CPU 170, reads the high resolution image 320 from the HDD 172, and generates an image having a lower resolution than the image (for example, generates an image from 600 dpi to 150 dpi). ) And stored in the HDD 172 as the medium resolution image 324. In step 514, the medium resolution image generation unit 342 is controlled by the CPU 170, reads the low resolution image 322 from the HDD 172, generates an image having a higher resolution than the image (for example, generates an image from 75 dpi to 150 dpi), The resolution image 324 is stored in the HDD 172.

  In step 516, the CPU 170 activates a program that generates a preview image enlarged or reduced from the medium resolution image 324. This program realizes a process of enlarging the medium resolution image 324 at a designated magnification by the medium resolution preview image generating unit 358 and storing the generated image in the HDD 172 as the medium resolution preview image 364. As a result, in parallel with this program, the enlargement / reduction processing program for the low resolution image 322 and the enlargement / reduction processing program for the medium resolution image 324 are executed.

  On the other hand, if it is determined in step 502 that the image is a color image, in step 526, the CPU 170 determines whether or not the finish should be confirmed in the medium / high resolution image (300 dpi). When it is determined that the finish should be confirmed with the medium-high resolution image, the process proceeds to step 528. Otherwise, the process proceeds to step 504, and the processes after step 504 described above are executed. The case where the finish should be confirmed with the medium-high resolution image is, for example, a case where the enlargement ratio is equal to or greater than a predetermined value. When enlarging greatly, it is possible to generate a preview image that can display a finished image more appropriately by using an image with a higher resolution.

In step 528, the CPU 170 generates a medium high resolution image 326 from the high resolution image 320. Specifically, the medium / high resolution image generation unit 344 is controlled by the CPU 170, reads the high resolution image 320 from the HDD 172, and generates an image having a resolution between the high resolution and the medium resolution (for example, generates a 300 dpi image). Then, the medium 172 is stored in the HDD 172 as the medium / high resolution image 326.

  In step 530, the CPU 170 activates a program that generates a preview image enlarged or reduced from the medium / high resolution image 326. This program realizes a process of enlarging the medium / high resolution image 326 at a specified magnification by the medium / high resolution preview image generating unit 360 and storing the generated image in the HDD 172 as the medium / high resolution preview image 366. Thereby, in parallel with this program, the program for enlarging / reducing the low-resolution image 322 and the program for enlarging / reducing the medium-high resolution image 326 are executed.

  In step 518, the CPU 170 repeatedly determines whether or not the program started in step 500 has ended and the low-resolution preview image 362 has been generated. Specifically, the control unit 380 determines whether or not the processing completion signal output from the low resolution preview image generation unit 356 has been received. When it is determined that the low resolution preview image 362 has been generated, the process proceeds to step 520.

  In step 520, the CPU 170 displays the low resolution preview image 362 on the touch panel display 130. Specifically, the selector 384 is controlled by the CPU 170 and outputs the low resolution preview image 362 to the display processing unit 386. As a result, as described above, the enlarged / reduced preview image is displayed in the preview area 204. This image is an image obtained by enlarging and reducing the low-resolution image 322, and the image quality is low.

  In step 522, the CPU 170 repeatedly determines whether or not the program started in step 516 or step 530 has ended. Specifically, the control unit 380 determines whether or not the processing completion signal output from the medium resolution preview image generation unit 358 or the medium high resolution preview image generation unit 360 is received. If it is determined that the process has been completed, the process proceeds to step 524. At this time, the generation of the medium resolution preview image 364 or the medium high resolution preview image 366 is completed.

  In step 524, the CPU 170 displays the medium resolution preview image 364 or the medium high resolution preview image 366 on the touch panel display 130, and then returns. Specifically, the selector 384 is controlled by the CPU 170 to output the medium resolution preview image 364 or the medium high resolution preview image 366 to the display processing unit 386. As a result, as described above, the enlarged / reduced preview image is displayed in the preview area 204. The displayed preview image is a preview image obtained by enlarging / reducing the medium resolution image 324 or the medium high resolution image 326, and has a higher image quality than the preview image generated by enlarging / reducing the low resolution image 322. In particular, step 530 is executed to generate a medium / high resolution image 326 from the high resolution image 320, and when this is enlarged / reduced, a higher quality preview image is displayed.

  As described above, when the enlargement / reduction processing is designated, a preview image obtained by quickly enlarging / reducing the low-resolution image is displayed, and then a preview image with higher image quality is displayed.

  Table 1 shows an example of the correspondence between the document type and the original image used when generating the preview image. In the case of Table 1, when the original is a printed photograph, a photographic paper photograph, or a light original, a medium resolution image is generated from the high resolution image, and this is enlarged or reduced to generate a preview image. In the case of other documents, a medium resolution image is generated from a low resolution image, and a preview image is generated by enlarging or reducing the medium resolution image.

  Next, the process of step 418 executed when another process is designated will be specifically described. Referring to FIG. 10, in step 600, CPU 170 determines whether it is color-related processing. If it is determined that the process is color-related processing, the process proceeds to step 602; otherwise, the process proceeds to step 612. Color-related processing includes, for example, color adjustment (such as gamma correction in RGB or CMY), increase / decrease in the number of color gradations (such as two-color coloring), and the like.

  In step 602, the CPU 170 determines whether or not the medium / high resolution image 326 exists in the HDD 172. For example, when the process of step 528 in FIG. 9 is executed once, the medium / high resolution image 326 is stored in the HDD 172. If it is determined that the medium / high resolution image 326 exists, the process proceeds to step 606, and if not, the process proceeds to step 604.

  In step 604, the CPU 170 determines whether or not the finish should be confirmed in the medium / high resolution image. For example, it is displayed on the screen whether or not the finish is confirmed with the medium and high resolution image, and the user is allowed to select. When it is determined that the finishing should be confirmed with the medium / high resolution image, the process proceeds to step 528 to generate the medium / high resolution image 326 from the high resolution image 320. Otherwise, the process proceeds to step 610.

  In step 606, the CPU 170 executes designated image editing processing on the existing medium / high resolution image or the medium / high resolution image generated in step 528, and stores the resultant image in the HDD 172.

  If it is not necessary to confirm the finish with the medium-high resolution image, in step 610, the CPU 170 executes the designated processing for the low-resolution image 322 and stores the result in the HDD 172.

  If it is not determined in step 502 that the process is a color-related process, the process proceeds to step 612. In step 612, whether or not the function selected by the user is a process related to image editing other than the enlargement / reduction process. Determine. If it is determined that the process is related to image editing, the process proceeds to step 614, and if not, the process proceeds to step 618.

  In step 614, the CPU 170 determines whether or not the medium resolution image 324 exists in the HDD 172. For example, when step 512 of FIG. 9 is executed once, the medium resolution image 324 exists in the HDD 172. If it is determined that the medium resolution image 324 exists, the process proceeds to step 616, where the CPU 170 executes the designated process for the medium resolution image 324 and stores the result in the HDD 172. Otherwise, the process proceeds to step 610, and the CPU 170 executes the process of step 610 described above.

  In step 618, the selector 384 receives the control of the CPU 170, reads the image generated in step 604, step 610, or step 616 from the HDD 172 and outputs it to the display processing unit 386. Thereby, the image after image editing is displayed on the touch panel display 130 as a preview image.

  As described above, a preview image corresponding to the importance of the image quality processing is generated and displayed in the designated image editing processing (other than enlargement / reduction) without lowering the processing efficiency. If color-related processing in which image quality is important is designated, image editing is performed on the medium / high resolution image 326 in step 606. In the case of image editing where the image quality is not important, in step 610, image editing is executed on the low resolution image 322. However, even in color processing, when the image quality is not so important and there is no medium-high resolution image in the HDD 172, image editing is executed on the low-resolution image 322 with priority on the processing speed. Even in the case of image editing where the image quality is not important, if a medium resolution image exists in the HDD 172, the image editing is executed on the medium resolution image.

  In step 620, CPU 170 determines whether an instruction to end the preview display has been received from the user. If it is determined that an instruction to end the preview display has been received, in step 622, the temporarily generated image, that is, the low resolution image 322, the medium resolution image 324, the medium high resolution image 326, the low resolution preview image 362, and the medium resolution preview. The image 364 and the medium / high resolution preview image 366 are deleted from the HDD 172 and restored, and the process proceeds to step 420 in FIG. Otherwise, it returns without doing anything and moves to step 420 in FIG.

[Modification]
In the above embodiment, in step 400, step 516, and step 532, a program for enlarging / reducing a low resolution image, a medium resolution image, and a medium high resolution image is started, and these processes are executed in parallel. This is possible because the image processing apparatus 100 employs the multi-core CPU 170. Even if the CPU has only one arithmetic processing unit, parallel processing is possible as long as it includes a plurality of hardware (for example, ASIC) that performs enlargement / reduction processing. However, if parallel processing cannot be performed, the low-resolution image is enlarged / reduced, the processed image is displayed, and then a medium-resolution image or a medium-high-resolution image is generated, enlarged / reduced, and the result is displayed. What should I do?

  In the above embodiment, the case where the entire preview image is enlarged / reduced has been described. However, enlargement / reduction can also be designated for a part of the preview image. In that case, using the pixel type information of the pixels in the target area, determine the original type information of the area in the same manner as described above, and use the determined original type information as described above. A medium resolution image may be generated and enlarged or reduced.

In the above embodiment, a medium resolution image is generated when an instruction to enlarge or reduce the preview is given. However, the present invention is not limited to such an embodiment. For example, when an instruction to change the display mode is given, or when an operation mode in which enlargement / reduction is not explicitly specified but an enlargement / reduction is always performed at a later stage is selected, the instruction or When selected, generation of a medium resolution image may be started. As such an operation mode, for example, there is an operation mode in which some processing is generally performed by designating coordinates in the image, such as image trimming, masking, area inside / outside erasing, partial area movement or copying. The user may be allowed to set whether or not to generate a medium resolution image. In addition, the user may specify in advance an instruction to generate a medium resolution image.

  In the above-described embodiment, when the user repeatedly changes the enlargement / reduction ratio to display a preview image and confirms the finish (from step 424 in FIG. 8 to step 412), the medium-resolution image or the medium-high-resolution image is displayed. However, it is efficient to use the already generated medium resolution image or medium high resolution image 326. For this purpose, for example, in step 512, step 514, and step 528, it is determined whether or not the image to be generated exists in the HDD 172, and the image is generated only when it does not exist.

  Further, while the enlargement / reduction is repeated for one image, unless the original type information is changed by the user, the medium resolution image may be used if it exists. However, even if enlargement / reduction processing is performed on the same image, if the document type information is changed by the user (step 508 in FIG. 9), even if an intermediate resolution image exists, it cannot be used. Therefore, a process for determining whether or not the document type information to be processed has been changed is added, and when the medium resolution image exists and the document type information is not changed, the existing medium resolution image is used. You can do it. Otherwise, even if a medium resolution image exists, a new medium resolution image is generated from the high resolution image or the low resolution image 322 according to the changed document type information.

  When accepting the designation of the document type in step 508, the designation may be accepted by presenting the automatically determined pixel type information on the screen.

  Moreover, although the case where the document type information of the designated area is determined from the pixel type information in step 506 has been described, the present invention is not limited to this. For example, if the document type information for the entire original page is determined from the pixel type information determined at the time of image reading, and the enlargement / reduction process for the entire original is specified, step 506 is not executed and the determination has been made. The determination in step 510 may be executed using the document type information.

  The method for determining the document type information is not limited to the method using the average value and the mode value. Any method may be used as long as the resolution of the original image used when generating the medium resolution image can be appropriately determined according to the document.

  In addition, although high resolution, medium high resolution, medium resolution, and low resolution have been described as 600 dpi, 300 dpi, 150 dpi, and 75 dpi, respectively, the present invention is not limited to this. For example, the maximum resolution at the time of document reading is set to high resolution, the low resolution is determined in consideration of the resolution of the display device, and the medium high resolution and medium resolution are determined to satisfy high resolution> medium high resolution> medium resolution> low resolution. do it.

  The document type is not limited to characters, characters / printed photographs, characters / photographic paper photographs, printed photographs, photographic paper photographs, maps, and light originals.

  The present invention has been described above by describing the embodiment. However, the above-described embodiment is an exemplification, and the present invention is not limited to the above-described embodiment, and is implemented with various modifications. be able to.

DESCRIPTION OF SYMBOLS 100 Image processing apparatus 102 Document reading part 104 Image forming part 120 Operation unit 130 Touch panel display 140 Operation key part 170 Multi-core CPU
172 Hard disk (HDD)
310 Display image processing unit 320 High resolution image 322 Low resolution image 324 Medium resolution image 326 Medium high resolution image 340 Low resolution image generation unit 342 Medium resolution image generation unit 344 Medium high resolution image generation unit 350 Image processing unit 352 Output processing unit 354 Preview image Generation unit 356 Low resolution preview image generation unit 358 Medium resolution preview image generation unit 360 Medium high resolution preview image generation unit 362 Low resolution preview image 364 Medium resolution preview image 366 Medium high resolution preview image 380 Control unit 384 Selector 386 Display processing unit

Claims (5)

An image processing apparatus that generates a first preview image from an image read from an original,
Preview display means for displaying the first preview image on a display device;
Operation detecting means for detecting a user input operation;
A generation unit configured to generate a second preview image at a different resolution according to a document type when the operation detection unit detects that image processing is designated for the first preview image;
The image processing apparatus, wherein the preview display unit displays the second preview image generated by the generation unit on the display device instead of the first preview image.   When it is detected that the document type is automatically determined by the operation means, the document type is automatically determined based on the characteristic amount obtained for each pixel in the effective area when the document is read. The image processing apparatus according to claim 1, further comprising a document type determination unit that performs the operation.   The image processing apparatus according to claim 1, wherein the second preview image is generated from a high resolution image or a low resolution image generated when the original is read. An image processing program executed by an image processing apparatus that generates a first preview image from an image read from an original,
In the processor of the image processing apparatus,
A preview display step of displaying the first preview image on a display device;
An operation detection step for detecting a user input operation;
When it is detected in the operation detection step that image processing has been designated for the first preview image, a generation step for generating a second preview image with a different resolution according to the document type is executed.
The preview display step displays the second preview image generated in the generation step on the display device instead of the first preview image. An image processing method of an image processing apparatus for generating a first preview image from an image read from an original,
(A) displaying the first preview image on a display device;
(B) detecting a user input operation;
(C) including a step of generating a second preview image with a different resolution according to the document type when it is detected that image processing is designated for the first preview image in the step (b). ,
In the image processing method, the step (a) displays the second preview image generated in the step (b) on the display device instead of the first preview image.

Images