JP2021064100A - Image processing apparatus - Google Patents

Abstract

To provide an image processing apparatus which can prevent a print in an unwanted state from being outputted due to proceeding with an image quality adjustment operation with an erroneously selected image quality adjustment function.SOLUTION: In the image processing apparatus being an MFP, a function reference table 106T indicates functions to be used as image quality adjustment functions, in association with typical types of areas included in image data. When image data to be printed out is given, an image analysis unit 103 specifies an area being an internal area of the given image data and matching a type indicated by the function reference table 106T and assigns an image quality adjustment function indicated by the function reference table 106T to the area matching the type. When a preview image of the image data is displayed thereafter, an interaction control unit 105 executes interactive processing while presenting the image quality adjustment function assigned to the internal area of the image data.SELECTED DRAWING: Figure 2

Description

The present invention relates to an image processing apparatus that executes an image processing function for image data provided for print output or the like, and relates to an improvement in a case where image processing is interactively executed while a preview image is displayed.

When printing out a document containing characters and photographs, the quality of the image formed on the paper is different from that displayed on the display, which may cause disappointment for the user. In order to prevent such discouragement, there has been an image processing device that executes a preview display when printing and outputting image data. The image processing apparatus of Patent Document 1 which is further advanced accepts the selection of an arbitrary position in the preview image from the user while the preview image is displayed. Then, when an arbitrary position is selected, the setting screen of the density adjustment function is displayed, and the density adjustment operation of each color of cyan (C), magenta (M), and yellow (Y) is accepted.

Japanese Unexamined Patent Publication No. 2012-239018 Japanese Unexamined Patent Publication No. 2010-041063 JP-A-2007-133675

In the prior art described in Patent Document 1, the density adjustment function of the color selected by the user can be adjusted by activating the density adjustment function during the preview display, but the selection of the density adjustment function itself may not be appropriate. Specifically, the density adjustment function thins the dense portion, but does not change the originally light portion. Therefore, when it is desired to adjust the intermediate gradation of a photograph or when it is desired to adjust the readability of characters, it cannot be said that the selection of the density adjustment function itself is appropriate.

In the first place, there are various image quality adjustment functions such as skipping the background and adjusting the brightness. Image printing experts understand the characteristics of these image quality adjustment functions, select the image quality adjustment function, and print as intended. Make adjustments to the image data to obtain output. In contrast, beginners of image printing and the like stumble at the first function selection scene and repeat image quality adjustment under inappropriate function selection. If you stumble at the first function selection scene, the printed matter will not be as good as you want, no matter how many image quality adjustments are repeated, and you will give up on the way and execute print output in an unwilling state. is there. Although the image quality adjustment function at the time of print output has been described, the problem of proceeding with the work while making a mistake in selecting the above function does not occur only in the image quality adjustment function. This is a universal problem that can occur when some function is selected and work is performed prior to print output.

An object of the present disclosure is to provide an image processing apparatus capable of preventing improper print output that may occur under improper function selection.

The above object is an image processing device that displays image data including a partial area corresponding to any of the types of characters, photographs, and figures as a preview image on a display panel, and is a type of a partial area of characters, photographs, and figures. When a storage means for storing the image processing function in association with each other and a preview image are displayed and a user operation is performed by designating one partial area, the partial area where the user operation is performed is stored in the storage means. The problem is solved by an image processing device characterized by having a control means for selecting an image processing function to be applied to a partial area according to which of the stored types it corresponds to and displaying it on a display panel.

Here, the user operation for designating the partial area is the contact of the user's finger on the display panel, and the display of the image processing function is the image processing associated with the type of the partial area in which the user's finger is in contact. The function may be displayed on the setting screen.

Further, the control means accepts a change input of the function setting when executing the image processing function through the setting screen, and when the image processing is executed on the image data based on the change input, the preview image is displayed again. You may create it and display it on the display panel again.

Among the types stored by the storage means, there are multifunctional types associated with two or more image processing functions, and the control means can be operated by a user who specifies a partial area corresponding to the multifunctional type. When this is done, a list of function names of two or more image processing functions associated with the multifunction type may be displayed on the display panel.

The type stored by the storage means includes a multifunctional type associated with two or more image processing functions, and the control means is operated by a user who specifies a partial area corresponding to the multifunctional type. In this case, one of the function names of the two or more image processing functions associated with the multifunction type is displayed on the display panel, and two or more image processing is performed according to the switching operation for the area of the multifunction type. The rest of the functions may be displayed on the display panel.

The control means further receives an operation requesting confirmation of an image processing function suitable for image processing of each partial area from the user prior to accepting a user operation on the partial area, and in response to the operation requesting confirmation, each of the above-mentioned control means. The function name of the image processing function associated with the type is superimposed on the partial area corresponding to the type and displayed on the display panel, and the user operation is performed by designating the partial area on which the function name is superimposed. It may be.

The operation on the partial area is an operation in which the user draws a closed area with a finger on the screen of the display panel on which the preview image is displayed, and the control means is an operation in which the closed area is drawn by the user with the finger. The setting screen of the image processing function corresponding to the type of the partial area including the above may be displayed on the display panel.

When the closed area drawn by the user straddles two or more partial areas, the control means sets the image processing function setting screen associated with the type of the partial areas including the center of gravity of the closed area. May be displayed on the display panel.

When the center of gravity of the closed area drawn by the user with a finger is located in the background area corresponding to the background of the document, the control means is a partial area adjacent to the background area and is associated with a type other than the background area. The setting screen of the image processing function may be displayed on the display panel.

The control means is an image process to be displayed on the display panel depending on whether a user operation of touching a partial area of the preview image with a finger is performed or a user operation of drawing a closed area with the finger is performed. You may switch the function setting screen.

Each image processing function shown in the function reference table has an index of an information system in which the above-mentioned type is the main classification and the brightness of the pixel in the image data is classified according to the high / low and / or the high / low of the saturation. The control means is given, and when a user operation is performed on a partial area, the type of the partial area where the user operation is performed, the high and low brightness in the partial area where the user operation is performed, and / or By searching the storage means using a keyword that combines high and low saturation, an image processing function to which an index matching the keyword is assigned may be obtained.

The image processing device further includes a recognition means for recognizing a subject in a region of a type of photograph, and the control means displays a setting screen of an image processing function according to the subject recognized by the subject recognition on a display panel. It may be displayed.

When the subject recognized from the photographic area by the recognition means is a portrait, the brightness adjustment function or the adjustment function of a color element that is insufficient for the skin expression of the person appearing in the portrait may be assigned to the photographic area. ..

When the subject recognized from the photographic area by the recognition means is a landscape, the allocating means may display the saturation adjustment function on the display panel as an image processing function to be used for the photographic area.

The image data is scanned image data obtained by scanning a document according to the setting of the document image quality mode, and each image processing function stored in the storage means includes a region included in the image data. An index of an information system is assigned in which a typical type is the main classification and each of the document image quality modes that can be set in the own device is classified according to the classification, and the control means is operated on a partial area. By searching the storage means using a keyword that combines the type of the partial area for which the operation has been performed and the current document image quality mode setting in the own device, an index matching the keyword is assigned. The image processing function may be obtained.

The original image quality mode that can be set in the own device includes a character image quality mode that reads the original as a character image, a photographic image quality mode that reads the original as a photographic image, and a mixed image quality mode that reads the original as a mixed image of characters and photographs. Good.

The image data further includes a composite area in which the additional data is combined, and the control means further sets an image processing function for synthesizing the additional data when a user's operation on the composite area is detected. The screen may be displayed on the display panel.

The image processing function that synthesizes the additional data synthesizes additional data such as date, time, page number, stamp, header, footer, watermark, watermark for duplication prevention, tint block, and overlay image with the image data. May be good.

The image processing device is a printing device, and the preview display may include a process of converting image data converted into a print output format into a display format.

The image processing device may be an image reading device.

When an operation is performed on the internal area of the preview image by the user, the image to be applied to the partial area depending on which of the types stored in the storage means corresponds to the partial area on which the user operation is performed. Since the processing function is selected and displayed on the display panel, there is no mistake in selecting the function which image processing function should be selected for adjusting the image quality of each area. By repeating the image quality adjustment after selecting the correct image processing function, even a beginner user can print out the image data with the quality that he / she wants.

It is a figure which shows the appearance of the image processing apparatus 1000 which is an MFP. It is a figure which shows the internal structure of the image processing apparatus 1000. It is a flowchart which shows the processing procedure by the image analysis unit 103, and the dialogue control unit 105 of an image forming apparatus 1000. FIG. 4A shows image data to be processed in the first operation example. FIG. 4B shows the analysis result of the image data by the image analysis unit 103. FIG. 4C is an example of the area layout table 103T generated for the image data of FIG. 4A. FIG. 5A shows an example of the function reference table 106T. FIG. 5B shows an area layout table 103T to which the function assignment column 103C is added. It is explanatory drawing which shows an example of the processing flow when the photograph 302 is touched. FIG. 7A shows the configuration of the function reference table 106T according to the second operation example. FIG. 7B shows the area layout table 102T according to the second operation example. It is a flowchart which shows the detail of the function assignment processing by the image analysis unit 103. FIG. 9A shows a closed region 1001C drawn by the user. FIG. 9B shows a situation in which the circular closed area 109C drawn by the user on the preview image 1001P straddles the photographic area and the character area. An example of displaying the function name of the image quality adjustment function according to the pressing of the setting value confirmation button 400 is shown. The function list 1001L displayed overlaid on the preview image is shown. 12 (a) and 12 (b) show an example of a directed acyclic graph. 12 (c) and 12 (d) show the process of sequentially switching the function names. FIG. 13A shows a setting screen for accepting the setting of brightness adjustment. FIG. 13B shows a setting screen for accepting the background adjustment setting, and FIG. 13C shows a setting screen for accepting the density adjustment setting. The image data in which the watermark is superimposed on the image data is shown.

Hereinafter, embodiments of the image processing apparatus according to the present disclosure will be described.

[1] Appearance of the Image Processing Device 1000 FIG. 1 is a diagram showing the appearance of the image processing device 1000 which is an MFP. The image processing device 1000 is an MFP (Multi Function Peripheral), and images a toner image on a photoconductor in accordance with a user operation on the touch panel display 1001 and a printing request from a personal computer (PC) 1100. At the same time, the paper set in the paper feed cassettes 1002a, b, c, d and the manual feed tray 1002h is fed out, the toner image on the photoconductor is transferred to the paper, and the paper is discharged to the discharge tray 1003.

When copying handouts in an image processing device, it may be desirable to adjust the image quality of the printed matter that is a copy of the handout. Also, when the handout is created on the PC1100 and printed, it may be desired to check the printed matter on the display and adjust the image quality. In order to meet such a request, the image processing device 1000 displays a preview image on the touch panel display 1001 and accepts an operation for adjusting the image quality from the user in the display state of the preview screen.

[2] Configuration of Image Processing Device 1000 An embodiment of the image processing device 1000 according to the present embodiment will be described with reference to FIG. FIG. 2 is a diagram showing an internal configuration of the image processing device 1000. As shown in this figure, the image processing device 1000 includes a printer description language rendering unit 101, a network interface 101I, a scanned image acquisition unit 102, an image analysis unit 103, a print output conversion unit 104, an dialogue control unit 105, and an image quality adjustment unit 106. , Filter processing unit 107, gamma correction processing unit 108, halftone processing unit 109, print output unit 110 (including developer 111, photoconductor 111D, transfer unit 112, intermediate transfer belt 112N, fixing unit 113). ..

(2-1) Printer description language Rendering unit 101
When a document described using the printer description language is transmitted from the terminal device and printing is requested, the printer description language rendering unit 101 converts the document in the printer description language into characters in accordance with the syntax rules of the printer description language. It is expanded into image data including photographs and figures and written to the display image data memory 101M. The image data thus obtained is image data (referred to as RGB pixel data) in which each pixel is composed of three primary colors of R (red), G (green), and B (blue).

(2-2) Scanned image acquisition unit 102
The scanned image acquisition unit 102 acquires the RGB image data optically read by the scanner 1004 during the copy operation, corrects the spatial frequency characteristics such as MTF (Modulation Transfer Function) processing, and displays the image data for display. Write to memory 102m.

(2-3) Image analysis unit 103
The image analysis unit 103 classifies the image data to be printed out into a base area or an area of figures, characters, and photographs formed on the area. When the image data to be printed out is the image data obtained by rendering the printer description language document, the above classification is performed according to the syntax of the printer description language. When the image data to be printed is the image data read by the scanner 1004, by combining histogram detection, edge extraction, and gradation change extraction, the location and type of the area can be specified, and the character area and the photograph can be specified. Distinguish between areas and graphic areas.

In analyzing the image data, the image analysis unit 103 newly creates the area layout table 103T. Then, a record in which the upper left coordinate of the area, the height, the width, and the type are associated with the ID (area ID) that identifies each area included in the image data is added to the area layout table 103T. The area layout table 103T is completed by adding the records of all the areas included in the image data.

(2-4) Print output converter 104
The print output conversion unit 104 converts the image data created by the rendering process for the document described in the printer description language or the image data created by scanning the original by the scanner 1004 into the image data for print output. In addition, a preview image is created for interactive processing with the user.

Conversion to image data for print output is performed through the following process. That is, by using the profile showing the display characteristics of the touch panel display and the profile showing the print characteristics by the print output unit 110, each pixel constituting the RGB image data is set in the device-independent L * a * b * color space. After conversion, the printer is further mapped to the C (cyan), M (magenta), Y (yellow), and K (black) color spaces of the printer, and each pixel of the image data is expressed in the CMYK color space.

The conversion to the preview image for confirming the print output is performed through the following process. That is, each pixel of the image data (YMCK image data) composed of pixels represented in the CMYK color space is converted into a device-independent L * a * b * color space, and finally, an RGB space for preview display. By performing the color space conversion to, the preview image data, which is the RGB image data, is obtained.

(2-5) Dialogue control unit 105
Prior to printing the image data, the dialogue control unit 105 displays the preview image data (preview display) and executes the dialogue process accompanied by the preview display. Specifically, when the touch of the user's finger on the touch panel display 1001 is detected, the dialogue control unit 105 identifies the area of the image data that includes the contact position. Then, when the area including the finger contact position is specified, the image quality adjustment function assigned to the area is called. When the corresponding image quality adjustment function is activated by such a call, the setting screen description database 105D is accessed to create a setting screen for the called image quality adjustment function, and the display is displayed on the LCD 1001L of the touch panel display 1001. The setting screen displayed in this way displays the current value of the setting parameter when executing the image quality adjustment function, and at the same time, accepts the change input of the setting parameter.

(2-6) Image quality adjustment unit 106
The image quality adjustment unit 106 includes a filter processing unit 107, a gamma correction processing unit 108, and a halftone processing unit 109. When a function is called by the dialogue control unit 105, the image quality adjustment unit 106 has a density adjustment function and a background adjustment function. , Contrast adjustment function, brightness adjustment function, and other various image quality adjustment functions are selectively executed.

(2-7) Filter processing unit 107
The filter processing unit 107 performs a filter processing including a product-sum calculation on the CMYK image data by using a filter coefficient according to the setting content of the pixel correction function. As a result, the output CMYK image data is sharpened and smoothed.

(2-8) Gamma correction processing unit 108
The gamma correction processing unit 108 corrects the density characteristic by using a one-dimensional LUT according to the setting content of the pixel correction function.

(2-9) Midtone processing unit 109
The halftone processing unit 109 converts the CMYK color pixels into image data having a pseudo halftone expression by using a dither matrix according to the setting contents of the pixel correction function.

(2-10) Print output unit 110
The print output unit 110 controls the developing unit 111, the transfer unit 112, and the fixing unit 113 to use the image data for printing. By this control, the developer 111 forms a toner image on the photoconductor 111D. Further, the transfer unit 112 first transfers the toner image formed on the photoconductor 111D to the intermediate transfer belt 112N, and then transfers the toner image to the paper. The fixing unit 113 heat-fixes the toner image transferred to the paper.

[3] First Operation Example of Image Processing Device 1000 The operation of the image processing device 1000 configured as described above will be described.

(3-1) Area Classification of Image Data Read from Manuscript FIG. 3 is a flowchart showing a processing procedure by the image analysis unit 103 and the dialogue control unit 105 of the image forming apparatus 1000. In the flowchart, first wait for the image data to be input from the scanner 1004 or the PC1100 (wait in step S101), and when the image data is input (Yes in step S101), the area attribute described in the printer description language exists. It is determined whether or not to do so (step S102). When the area attribute described in the printer description language exists (Yes in step S102), the area layout table 103T is newly created, and the location and type of the area are specified based on the area attribute described in the printer description language. Then, a record in which the upper left coordinate of the area, the height, the width, and the type are associated with the ID of the area is added to the area layout table 103T (step S104).

When the area attribute described in the printer description language does not exist (No in step S102), the area layout table 103T is newly created, and the image analysis unit 103 targets the image data for histogram detection, edge extraction, and floor. The area discrimination process combined with the tone change extraction is performed. Specifically, first, the histogram detection is performed on the image data obtained by scanning the original, and the color histogram of the entire original is created. In the histogram created in this way, the color having the highest frequency is used as the base color, and the portion of the image data that forms the base color is used as the base area.

Subsequently, the quadratic differentiation of the image data is performed, and the line segment extraction of the image data is performed to specify the area frame surrounding the character area, the graphic area, and the photographic area. The gradation change inside these area frames is extracted. By extracting this gradation change, the type of pixel surrounded by the area frame becomes clear. Specifically, the character area is composed of pixels of 2 to 4 colors of characters and a background, and has little gradation change. On the other hand, the graphic area is drawn by a drawing application and is often composed of pixels of 4 to 255 colors. Although the number of colors is larger than that of the pixels in the character area, there are many parts where the same color is continuous and the gradation does not change so much. The photographic area is taken by a digital camera such as a CCD, and is composed of pixels of about 4096 colors. The number of colors is larger than the pixels in the character area and the graphic area, and the colors are different for each pixel, so that the gradation change is large.

Since it is empirically known that there is such a difference, the image analysis unit 103 determines whether the inside of the area frame is a photographic area or a graphic area based on the number of colors and gradation changes of the image in the area frame. Clarify the distinction between existence and character area. In this way, when each type of the area included in the image data is clarified, the area layout table 103T is newly created as in the case where the area attribute exists, and includes the upper left coordinate, height, width, and type of the area. A record is added to the area layout table 103T (step S103).

As shown in FIG. 4A, it is assumed that image data including photographs 301, 302, graphic 303, and text 304 is provided as a processing target. In this case, when the image analysis unit 103 performs the analysis as described above, the area layout of the image shown in FIG. 4A becomes clear, and as shown in FIG. 4B, the areas 1, 2, 3 and Upper left coordinates of 4 and 5 (x1, y1), (x2, y2), (x3, y3) ..., height H1, H2, H3 ... width W1, W2, W3 ... become clear .. In addition, the types of regions 1, 2, 3, 4, and 5 will be clarified. Through the above processing, the area layout table 103T as shown in FIG. 4C is generated. The area layout table 103T of FIG. 4C corresponds to the area IDs (ID = 1, 2, 3, 4, 5) of each area, and the upper left coordinates (x1, y1), (x2, y2) of each area. ), (X3, y3) ..., Height H1, H2, H3 ..., Width W1, W2, W3 ..., The types of each region are shown. Then, when the area layout table 103T is created, the function reference table 106T is searched using the type of each area in the image data as a keyword, an image quality adjustment function matching each type is obtained, and the area layout table 103T is assigned to each area. (Step S105).

An example of the function reference table 106T is shown in FIG. 5 (a). The function reference table 106T in this figure is composed of a plurality of records, and each record has a configuration in which an index is associated with an image quality adjustment function to be called. In the first operation example, the area type in the area layout table 103T is used as an index.

The function assignment in the function reference table 106T shown in FIG. 5A is to make appropriate adjustments to the pixels included in the area according to the characteristics of each type. Specifically, the brightness adjustment function associated with the photographic area reduces the density of the area as a whole, changes the density of the intermediate gradation in particular, and appropriately expresses the intermediate gradation portion of the photograph.

Further, the base adjustment function assigned to the base region has a characteristic that the low density portion is further thinned, but the dark portion is hardly changed.

On the other hand, the density adjustment function, which is a typical image quality adjustment function, lightly changes a dark portion in a document, and is assigned to a graphic area, a light black character area, and a light color character area in the function reference table 106T. This is because these are suitable for image quality adjustment when the dark part is made thinner. Even if the selection of the density adjustment function is allowed, the assignment of the density adjustment is limited to some types, so that the image quality adjustment function used for adjusting the preview image may be biased only to the density adjustment. Absent.

Using the area type from ID = 1 to ID = 6 shown in the area layout table 103T as a keyword, the function reference table 106T is searched, and the image quality adjustment function to be used for the area from ID = 1 to ID = 6 is obtained. Read from the function reference table 106T. Then, the image quality adjustment function is assigned to the areas from ID = 1 to ID = 6 shown in the area layout table 103T. As a result of such allocation, the function allocation column 103C is added to the area layout table 103T as shown in FIG. 5 (b).

Through the above process, when functional allocation is made to each area shown in the area layout table 103T, the image data is converted to the YMCK print format, and the preview image is obtained by reverse conversion from the YMCK format to RGB. Eh (step S106). After that, the preview image is displayed (step S107), and the process proceeds to a loop including steps S108 and S109. This loop determines whether or not any area has been touched (step S109) and whether or not the preview display end operation has been performed (step S108). When any of the areas is touched (Yes in step S109), the setting screen of the image quality adjustment function assigned to the touched area is displayed (step S110), and the loops of steps S111 and S112 are executed. In this loop, it is repeated whether or not the operation on the setting screen has been performed (step S111) and whether or not the image quality adjustment function has been completed (step S112). When an operation on the setting screen is performed (Yes in step S111), the image quality adjustment function is executed based on the setting on the setting screen (step S113), and the process returns to the loop of steps S111 and S112. When the image quality adjustment function is completed (Yes in step S112), the process proceeds to step S107 to redisplay the image data after the image quality adjustment function is performed.

(3-3) Dialogue Operation by User With reference to FIG. 6, the flow of processing when Photo 302 is touched will be described. _{Assuming that the coordinates (XT} , Y _T ) are output from the touch panel display 1001 by the user touching the photo 302 of the preview image, the dialogue control unit 105 _{searches for the coordinates (XT} , Y _T ) and searches for the coordinates (XT, Y T). The region X including the coordinates ( _XT , Y _{T) is searched.}

When the photo area 302 with ID = 2 is searched as the area X, the brightness adjustment function assigned to the photo area 302 with ID = 2 is read from the area layout table 103T, and as shown in FIG. 6, the brightness adjustment function is read. The setting screen 105S of is displayed. When the user makes a setting on the setting screen, the image quality adjusting unit 106 is made to execute the brightness adjusting function according to the setting. When the image quality of the image data stored in the print output image data memory 104m is adjusted by executing the brightness adjustment function, the dialogue control unit 105 displays the touch panel display 1001 based on the image data for which the brightness has been adjusted. Redisplay the contents.

[4] Second Operation Example of Image Processing Device 1000 (4-1) Function Reference Table 106T of Second Operation Example
In the function reference table 106T of the first operation example, the type and the image quality adjustment function have a one-to-one correspondence relationship. On the other hand, in the second operation example, the type and the image quality adjustment function have a one-to-many correspondence relationship. FIG. 7A shows the configuration of the function reference table 106T according to the second operation example. As shown in this figure, the type of the photographic area in the function reference table 106T is assigned density adjustment, background adjustment, contrast adjustment, brightness adjustment, and sharpness adjustment for each combination of high / low brightness and high / low saturation.

In addition to photographs, the function reference table 106T assigns image quality adjustment functions such as background adjustment and color balance according to differences in lightness and saturation of single-color figures, multi-color figures, black characters, and colored characters.

(4-2) Allocation of Image Quality Adjustment Function to Area The function allocation process by the image analysis unit 103 can be expanded to the subroutine of FIG. FIG. 8 is a flowchart showing details of the function assignment process by the image analysis unit 103. The variable i in this flowchart is a variable that specifies an individual area in the area layout table 103T. Further, ADR1, 2, and 3 in this flowchart are arguments when calling API (DataTableAPI) for area allocation.

Initialize the variable i (step S201). The following steps S202 to S208 define a loop structure in which the variable i is a control variable. First, the type of the area i is set in the argument ADR1 (step S202), the average value of the brightness of the area i is set in the argument ADR2 (step S203), and the average value of the saturation of the area i is set in the argument ADR3 (step S203). Step S204).

Using these arguments ADR1 to ADR3, the DataTable API defined for function assignment is called (step S205).

When the DataTable API is called, the image quality adjustment unit 106 calculates the brightness and saturation high and low selected as arguments. In the present embodiment, the lightness and saturation can take values from 0 to 255. Of these, for example, 220 or more is defined as high brightness, 32 or less is defined as low brightness, and the level of brightness is determined. Regarding the saturation, for example, 128 or more is high saturation, and 32 or less is low saturation. A keyword is obtained by combining the high / low brightness, the high / low saturation, and the type of the area determined in this way, and the function name matching this keyword is read out from the function reference table 106T. The image analysis unit 103 receives this function name as a return value of the DataTable API and adds it to the record of the area i of the area layout table 103T (step S206). Step S207 defines that the variable i is below the maximum value as a loop continuation requirement. When the variable i falls below the maximum value, the variable i is incremented (step S208), and the process returns to step S202. By repeating the above processing, an image quality adjustment function is added to each record of the area layout table 103T.

[5] Summary As described above, according to the present embodiment, the internal area of the image data to be printed out is classified into types such as photographs, single-color figures, multi-color figures, and black characters, and the types and their internal areas are classified. Since the image quality adjustment function that matches the combination of brightness and saturation is read from the area layout table 103T, even if the user does not have knowledge about print output, an appropriate image quality adjustment function is selected and image quality adjustment is performed. be able to. The quality of printed matter can be improved even when a plurality of copies of the distributed material are copied or when a plurality of copies of the distributed material are output by PC printing.

[6] Modified Examples Although the invention has been described based on the embodiments, the present invention is not limited to the above-described embodiments, and the following modified examples can be considered.

(1) The dialogue control unit 105 of the above embodiment accepts an operation of drawing a closed area inside an image data area, and may be a target of an image quality adjustment function of pixels surrounded by the closed area. Specifically, when the user moves the fingertip so as to draw a circle or a rectangle, the dialogue control unit 105 detects the fingertip at each sampling cycle. If the same coordinates are detected over multiple sampling cycles, it is treated as if the coordinates were touched. When different coordinates are detected in a plurality of sampling cycles, the coordinates over the plurality of sampling cycles are connected by line segments assuming that the fingertip is moving, and a closed region 1001C is drawn as shown in FIG. 9 (a). .. Then, the pixel group included in the closed region is defined as the processing target. Similar to the above embodiment, the setting screen 105S of the image quality adjustment function is displayed and the user setting for the setting screen is accepted depending on whether the closed area specified in the range belongs to the photo area, the graphic area, or the character area.

However, when the closed area drawn with the fingertip to specify such a range straddles the boundary between the photo area, the graphic area, and the character area, it is assigned to any area because it is a processing target surrounded by the closed area. It is not possible to specify whether the specified setting screen should be displayed. Therefore, the image quality adjustment function to be presented when drawing the closed area is determined from the position of the center of gravity of the closed area. For example, as shown in FIG. 9B, it is assumed that the user draws a circle on the preview image 1001P with a finger, and the circular closed area thus drawn straddles the photographic area and the character area. In this case, since the center 1001G of the circle is the center of gravity of the closed region, the setting screen of one of the image quality adjustment functions (for example, background adjustment) assigned to the photographic area to which the center of gravity belongs is displayed. By doing so, it is possible to make the user perform appropriate image quality adjustment when processing the pixel group specified by the closed area drawing in the photographic area. The drawing of the closed area may specify a combination (patch) of two or more colors included in a figure, a photograph, and a character. In this case, the image quality adjustment function for each patch can be executed.

(2) In the above embodiment, the setting screen of the pixel correction function corresponding to the touch and the closed area of the touch panel display is displayed, but this is not the case. As shown in FIG. 10, the set value confirmation button 400 is arranged on the touch panel display 1001, and the function name of the image quality adjustment function assigned to each area in the image data is displayed on the preview screen in response to the pressing of the set value confirmation button. It may be superimposed on and displayed. In an example of FIG. 10, a set value confirmation button 400 is arranged at the upper right of the screen. When this button is touched, the dialogue control unit 105 has the function name 411, which is a typical image quality adjustment function assigned to the photo area 301, the photo area 302, the graphic area 303, the black character area 304, and the color character area 305. 412, 413, 414, and 415 are superimposed and displayed on each area. Since the name of the image quality adjustment function assigned to each area of the image data being displayed in the preview is displayed at once, what kind of image quality adjustment function is used for the graphic area and what kind of image quality adjustment function is used for the photo area. The understanding of whether to use is promoted.

(3) In the photographic area, the graphic area, etc., the image quality adjustment function is presented according to the combination of saturation and lightness, but the present invention is not limited to this. When an area to which multiple image quality adjustment functions are assigned is touched by the user, a list of multiple image quality adjustment functions available for image quality adjustment is displayed, and the image quality for the photo area and graphic area is displayed according to the user's selection in this list. Adjustments may be performed. For example, in the function reference table 106T of FIG. 7A, image quality adjustment functions such as density adjustment, background adjustment, contrast adjustment, brightness adjustment, and sharpness adjustment are assigned to the types of photographs. When the photo area is touched in the preview image of FIG. 11, a function list 1001L showing a list of these five image quality adjustment functions is displayed. When any of the image quality adjustment functions displayed in the list is touched in the function list 1001L, the setting screen corresponding to the touched image quality adjustment function is displayed and the setting for the setting screen is accepted.

(4) In the photographic area, the graphic area, etc., the image quality adjustment function is presented according to the combination of saturation and brightness, but the present invention is not limited to this. When an area to which a plurality of image quality adjustment functions are assigned is touched by the user, the plurality of image quality adjustment functions assigned to the area may be displayed cyclically. In this modified example, a plurality of functions assigned to the internal area of the image data are managed by a directed acyclic graph. The directed acyclic graph is a data structure in which a plurality of image quality adjustment functions assigned to one internal area are combined by a one-way link and patrolled. FIG. 12A shows an example of a directed acyclic graph. The directed acyclic graph 105G in this figure manages the five image quality adjustment functions assigned to the photographic area in the order of density adjustment 501> background adjustment 502> contrast adjustment 503> brightness adjustment 504> sharpness adjustment 505. One of these functions (contrast adjustment) is selected as the selection target.

When the user touches the photo area, the density adjustment function 501, which is an image quality adjustment function managed by the directed acyclic graph 105G and is a pixel correction function currently selected, is shown in FIG. 12 (c). As shown, it is used for display. When the photographic area is touched again, the function to be selected is moved up in the directed acyclic graph 105G, and the function name of the next-order groundwork adjustment 502 is displayed as shown in FIG. 12 (d). To serve. Hereinafter, each time a photographic area is created, the contrast adjustment 503, the brightness adjustment 504, and the sharpness adjustment 505 are selected as selection targets, and their function names are displayed.

(5) For the area recognized as the photographic area, further classification may be realized by using deep learning or the like. Specifically, the classification of whether it is a portrait photograph or a landscape photograph may be performed. Since brightness is an important factor in portrait photography, a brightness adjustment function may be assigned. In addition, when it is possible to determine race, not just distinguishing portrait photographs, a pixel correction function that adjusts elements (brightness, saturation) that are not enough to express skin color is assigned to the portrait photo area. May be good.

When the photographic area is classified as a landscape photograph, the vividness of the three primary colors such as red, blue, and green is important in the landscape photograph, so the saturation adjustment function is assigned. If it is classified as containing many low-saturation objects such as buildings, the contrast adjustment function is assigned.

(6) In this modification, the dialogue control unit 105 displays a setting screen including a graph and accepts an operation on the setting screen.

FIG. 13A shows a setting screen for accepting the setting of brightness adjustment. The diagonal line L11 in this figure indicates that the relationship between the brightness of the input document and the brightness of the printed matter is set to be linear. When the user touches and drags the diagonal line, the diagonal line L11 changes to curves L12 and L13 according to the drag. The curve L12 indicates that the brightness of the printed matter is changed in an undershoot shape with respect to the brightness of the input document. The curve L13 indicates that the brightness of the printed matter is changed in an overshoot shape with respect to the brightness of the input document. The image quality adjustment unit 106 adjusts the image quality according to the changes shown in the curves L12 and L13, thereby adjusting the brightness of the region.

FIG. 13B shows a setting screen for accepting the background adjustment setting, and FIG. 13C shows a setting screen for accepting the density adjustment setting. The diagonal line L21 in FIG. 13B indicates that the relationship between the background brightness in the input document and the background brightness in the printed matter is set to be linear, and the diagonal line L31 in FIG. 13C indicates that the relationship is set linearly. It indicates that the relationship between the darkness of characters and the like in the input document and the darkness of the characters and the like in the printed matter is set to be linear. When the user touches and drags these diagonal lines, the diagonal lines L21 and L31 change to diagonal lines L22 and L23 and diagonal lines L32 and L33 according to the drag. The image quality adjusting unit 106 adjusts the background and density in response to such a curve change to adjust the background and density of the region.

(7) In the above embodiment, the image quality adjustment function is executed according to the operation for the preview image, but the present invention is not limited to this. The watermark setting screen may be displayed according to the operation for the watermark synthesized in the preview image. An image processing device installed at a business establishment or the like may be preset to synthesize a watermark on printed matter. Such watermarks synthesized on paper may not be what the user wants, and the printed matter obtained may deviate from the user's ideals. In this modification, in order to prevent the situation where an undesired image is synthesized by the automatic composition by the image processing device, the area where the automatic composition is performed such as the watermark is specified, and the watermark composition function is assigned to such a function.

FIG. 14 shows image data in which a watermark is superimposed on the image data. As shown in FIG. 14, it is assumed that the character string "Draft" is synthesized as a watermark in the pattern portion of the image data. When the user touches the watermark composite area 1001W, the watermark setting screen 1001V is displayed on the touch panel display 1001. The setting screen 1001V accepts selection of character strings that can be selected as watermarks, such as copy, copy, invalid, confidential, confidential, and handling precautions.

(8) In the above modification, the watermark is combined with the image data for print output, but the present invention is not limited to this, and other composition functions may be used. For example, when an image processing device installed in a certain business establishment or the like is set to synthesize a date / time, a page number, and a stamp with image data for print output, the image analysis unit 103 sets the date / time. , The location of the combined area such as the page number is clarified, and the area layout table 103T indicating that these are the combined areas of the date / time, the page number, and the stamp is created. After the above processing, when the image data is previewed and touched by the user, the date / time setting screen, page number setting screen, and stamp setting screen are displayed on the touch panel display, and the date / time is set. , Prompt to change page number etc. Further, the overlay function and the registered image overlay function may be assigned to the area where the overlay of the image and the overlay of the registered image are not limited to the date / time and the page number.

Further, it may be a copy-prevention watermark incorporated in the pattern portion of the image to prevent unauthorized copying, or a tint block incorporated in the image to prevent unauthorized printing.

(9) In the above embodiment, the image quality adjustment function is assigned to each of the combination of the area type, the brightness level, and the saturation level, but the present invention is not limited to this. You may execute the assignment of the image quality adjustment function giving priority to the setting of the document image quality mode. Here, if the document image quality mode is the character mode, the image quality adjustment function to be assigned to each area is determined according to the presence / absence of color and the darkness / lightness of the characters. Specifically, character reproduction adjustment is assigned to the dark black character area. This is because it is necessary to change the method of distinguishing between the character area and the photo area. A density adjustment function is assigned to the black character area of light characters. Color balance adjustment is assigned to the type of dark color character area. A density adjustment function is assigned to the light-colored character area.

If the original image quality mode is the photo mode, only the brightness adjustment function is assigned regardless of the presence or absence of the character area.

If the original image quality mode is the character / photo mode, the image quality adjustment function is assigned according to the distinction between the photo area and the character area. That is, the brightness adjustment function is assigned to the photographic area, and if it is the character area, the image quality adjustment function to be assigned to each area is determined according to the presence or absence of color and the darkness / lightness of the character.

(10) With respect to the photographic area of the image data, the brightness and saturation change for each pixel. On the other hand, in the graphic area, pixels of the same color are continuous for a long time. The image quality adjustment function to be applied may be changed depending on whether the user touches one point of the same color pixel group or draws a closed area so as to straddle the multicolor pixel group. When the user touches one point of the same color pixel group, the most appropriate image quality adjustment is to balance the color of the contact points. Therefore, in this case, the color balance function is applied to the same color pixel group including the contact point among the plurality of image quality adjustment functions assigned to the same color pixel group.

When a closed area is drawn to enclose a multicolor pixel group, it is desirable to adjust these multicolor pixel groups collectively. Therefore, in this case, the density adjustment function is activated, the setting screen of the density adjustment function is displayed, the operation for the setting screen is accepted, and the density adjustment function is applied to the multicolor graphic area surrounded by the closed area.

(11) The image processing device 1000 performs a preview display of the touch panel display 1001 and accepts the function selection, but the present invention is not limited to this. The PC 1100 that requests printing from the image processing device 1000 performs preview display, processes the image analysis unit 103, the print output conversion unit 104, and the dialogue control unit 105 of the above embodiment, and accepts the selection of the image quality adjustment function. May be good. The PC 1100 in this modification includes an area layout table 103T, a print output conversion unit 104, an interactive control unit 105, and an image quality adjustment unit 106. In the area layout table 103T, the upper left coordinates, vertical width, and horizontal width of the area including the coordinates touched by the user or the coordinates specified by the pointing device are read from the area layout table 103T, and the range surrounded by the upper left coordinates, vertical width, and horizontal width is set. , Performs an image quality adjustment function based on the settings set on the above setting screen.

(12) The image processing device 1000 of the above embodiment is assumed to be an MFP, but the present invention is not limited to this. It may be provided in a production printing device. Further, the image processing device 1000 may be a single-function peripheral device (printer) of a personal computer, or may be a label printing machine, a postcard printing machine, or a ticket issuing machine.

INDUSTRIAL APPLICABILITY The present invention can suitably perform an image quality adjustment function of image data to be printed out, and includes industrial fields of OA equipment and information equipment, as well as retail, leasing, real estate, advertising, and transportation industries. It may be used in various industrial fields such as the publishing industry.

101 Printer description language Rendering unit 101M Display image data memory 102 Read image acquisition unit 102M Display image data memory 103 Image analysis unit 103T Area layout table 104 Print output conversion unit 104M Image data memory for print output 105 Dialogue control unit 1000 Image processing Device 1001 Touch panel display 1001C Closed area 1001L Function list 1001P Preview image 1002a Paper feed cassette 1003 Ejection tray 1004 Scanner 1100 PC

Claims (20)

An image processing device that displays image data including a partial area corresponding to any of the types of characters, photographs, and figures as a preview image on a display panel.
A storage means for associating and storing image processing functions for each type of subregion of characters, photographs, and figures,
When a preview image is displayed and a user operation is performed by designating one partial area, the partial area to which the user operation is performed is applied to the partial area depending on which of the types stored in the storage means corresponds to. An image processing device characterized in that it is provided with a control means for selecting an image processing function to be output and displaying it on a display panel. The user operation for designating the partial area is the contact of the user's finger on the display panel.
The image processing apparatus according to claim 1, wherein the display of the image processing function is to display the image processing function associated with the type of the partial area in contact with the user's finger on the setting screen. The control means
When the change input of the function setting when executing the image processing function is accepted through the setting screen and the image processing is executed for the image data based on the change input, the preview image is recreated and the display panel is displayed again. The image processing apparatus according to claim 2, wherein the image is displayed on the screen. Among the types stored by the storage means, there are multifunctional types associated with two or more image processing functions.
When a user operation is performed by designating a partial area corresponding to the multifunctional type, the control means causes the display panel to display a list of function names of two or more image processing functions associated with the multifunctional type. The image processing apparatus according to claim 1. The types stored by the storage means include multifunctional types associated with two or more image processing functions.
When a user operation is performed by designating a partial area corresponding to the multifunctional type, the control means displays one of the function names of two or more image processing functions associated with the multifunctional type on the display panel. The image processing apparatus according to any one of claims 1 to 3, wherein the rest of two or more image processing functions are displayed on a display panel in response to a switching operation for the multifunctional type area. .. The control means further receives an operation requesting confirmation of an image processing function suitable for image processing of each partial area from the user prior to accepting a user operation on the partial area, and in response to the operation requesting confirmation, each of the above-mentioned control means. The function name of the image processing function associated with the type is superimposed on the partial area corresponding to the type and displayed on the display panel.
The image processing apparatus according to any one of claims 1 to 3, wherein the user operation is performed by designating a partial area in which the function names are superimposed. The operation for the partial area is an operation in which the user draws a closed area with a finger on the screen of the display panel on which the preview image is displayed.
The control means according to claim 1, wherein when the user draws a closed area with a finger, a setting screen of an image processing function corresponding to a type of a partial area including the closed area is displayed on a display panel. Image processing equipment. When the closed area drawn by the user straddles two or more partial areas, the control means sets the image processing function setting screen associated with the type of the partial areas including the center of gravity of the closed area. The image processing apparatus according to claim 7, wherein the image processing apparatus is displayed on a display panel. When the center of gravity of the closed area drawn by the user with a finger is located in the background area corresponding to the background of the document, the control means is a partial area adjacent to the background area and is associated with a type other than the background area. The image processing apparatus according to claim 7, wherein the setting screen of the image processing function is displayed on the display panel. The control means is an image process that should be displayed on the display panel depending on whether a user operation of touching a partial area of the preview image with a finger is performed or a user operation of drawing a closed area with the finger is performed. The image processing apparatus according to claim 1, wherein the function setting screen is switched. Each image processing function shown in the function reference table has an index of an information system whose main classification is the above-mentioned type and whose classification is based on the high / low brightness of pixels in the image data and / or the high / low saturation. Has been granted and
When the user operation is performed on the partial area, the control means has the type of the partial area on which the user operation has been performed, the high / low brightness in the partial area on which the user operation has been performed, and / or the high / low saturation. The image according to any one of claims 1 to 10, wherein an image processing function having an index matching the keyword is obtained by searching the storage means using a keyword in combination with the above. Processing equipment The image processing device further includes a recognition means for recognizing a subject in a region of a type of photograph.
The image processing apparatus according to any one of claims 1 to 3, wherein the control means displays a setting screen of an image processing function according to a subject recognized by subject recognition on a display panel. When the subject recognized from the photographic area by the recognition means is a portrait, the brightness adjustment function or the adjustment function of a color element that is insufficient for the skin expression of the person appearing in the portrait is assigned to the photographic area. The image processing apparatus according to claim 12. 12. When the subject recognized from the photographic area by the recognition means is a landscape, the allocating means displays a saturation adjustment function on a display panel as an image processing function to be used for the photographic area. The image processing apparatus according to. The image data is scanned image data obtained by scanning a document according to the setting of the document image quality mode.
For each image processing function stored in the storage means, the typical type of the area included in the image data is mainly classified, and each of the document image quality modes that can be set in the own device is classified accordingly. The information system is indexed,
When the operation is performed on the partial area, the control means uses a keyword that combines the type of the partial area on which the operation is performed and the setting of the current document image quality mode in the own device to store the storage means. The image processing apparatus according to any one of claims 1 to 10, wherein an image processing function to which an index matching the keyword is assigned is obtained by searching. The original image quality modes that can be set in the own device include a character image quality mode that reads the original as a character image, a photographic image quality mode that reads the original as a photographic image, and a mixed image quality mode that reads the original as a mixed image of characters and photographs. The image processing apparatus according to claim 15. The image data further includes a composite region in which the additional data is synthesized.
Claims 1 to 3 further include the control means, which is an image processing function and displays a setting screen for synthesizing additional data on a display panel when a user's operation on the synthesis area is detected. The image processing apparatus according to any one of. The image processing function that synthesizes the additional data is
The image according to claim 17, wherein additional data such as a date, a time, a page number, a stamp, a header, a footer, a watermark, a watermark for duplication prevention, a tint block, and an overlay image are combined with the image data. Processing equipment. The image processing device is a printing device.
The image processing apparatus according to any one of claims 1 to 18, wherein the preview display includes a process of converting image data converted into a print output format into a display format. The image processing device according to any one of 1 to 18, wherein the image processing device is an image reading device.

Images