JP2006094116A - Image processing apparatus and method, and program thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing system for facilitating settings of color adjustment processing carried out by each image region. <P>SOLUTION: The image processing system 1 displays a preview image on the basis of image data after the RIP, receives selection of a color adjustment region being an object of color adjustment and of a color conversion coefficient corresponding to desired color adjustment, generates a color adjustment layer for specifying the color adjustment processing, and applies color adjustment to the image data in response to a generated color adjustment layer. Further, the image processing system 1 stores the generated color adjustment layer as a template corresponding to the attribute (image feature quantity or the like) of the image data, extracts a template corresponding to the attribute of the image data when the color adjustment layer is set to newly received image data and uses the extracted template to generate the color adjustment layer. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing apparatus that performs image color adjustment.

For example, Patent Document 1 refers to print data to determine the type (graphic, character, photograph) of each object, selects a color correction table corresponding to the determined object type, and selects the selected color correction table. A color printing apparatus for performing color correction on the print data of this object based on this is disclosed.
Patent Document 2 discloses a method of creating color conversion performed on a sample image as a multidimensional color conversion table and incorporating the data into color conversion means.
Further, Patent Document 3 extracts a plurality of feature amounts from a processing target image, refers to information on past correction processing held in a database using the extracted feature amounts, and performs processing on the processing target image. An image processing system for determining a correction method and correction parameters for correction processing is disclosed.
Japanese Patent Laid-Open No. 9-193477 JP 2002-077659 A JP 2003-187215 A

  The present invention has been made from the above-described background, and an object thereof is to provide an image processing apparatus capable of performing color adjustment processing on an image for each region.

[Image processing device]
In order to achieve the above object, an image processing apparatus according to the present invention stores setting information including adjustment content specifying information for specifying the contents of color adjustment processing in association with attributes of image data. And setting information selection means for selecting at least one setting information from the setting information stored in the setting information storage means based on the attribute of the image data to be processed, and the setting information selection means Color adjustment means for performing color adjustment in accordance with the image area on the image data to be processed based on the selected setting information.

  Preferably, the attribute of the image data includes an image feature amount indicating a feature of the image data, and further includes feature amount extraction means for extracting an image feature amount based on the image data to be processed, and the setting information The selection unit selects at least one setting information based on the image feature amount extracted by the feature amount extraction unit.

  Preferably, the attribute of the image data is at least one of creator identification information indicating the creator of the image data, document classification information indicating the classification of the image, or element classification information indicating the classification of the image element included in the image. And attribute determination means for determining at least one of author identification information, document classification information, or element classification information of the image data to be processed, and the setting information selection means includes the attribute determination means At least one setting information is selected based on the determined author identification information, document classification information, or element classification information.

  Preferably, the setting information selection unit extracts a plurality of setting information from the stored setting information based on the attribute of the image data to be processed, and from the extracted setting information, At least one piece of setting information is selected according to the user's selection operation.

  Preferably, setting information applied to the image data to be processed is created by setting adjustment content designation information of the setting information selected by the setting information selection unit in an image area in accordance with a user operation. The image forming apparatus further includes setting information creating means, and the color adjusting means performs color adjustment on the image data to be processed according to the setting information created by the setting information creating means.

  Preferably, the apparatus further includes setting information creating means for creating one setting information based on a plurality of setting information selected by the setting information selecting means, and the color adjusting means is created by the setting information creating means. Based on the set information, color adjustment is performed on the image data to be processed.

  Preferably, the setting information further includes element classification information indicating a classification of an image element to be subjected to color adjustment, and the setting information storage means is a setting in which adjustment content designation information and element classification information are associated with each other. Information is stored, the setting information creation means sets adjustment content designation information and element classification information corresponding to the selected setting information in an image area included in the image data to be processed, and the color adjustment means Based on the setting information including the element classification information, color adjustment corresponding to the classification of the image elements is performed in each image area.

  Preferably, the setting information storage unit stores the setting information applied in the color adjustment processing for each image data in association with the attribute of each image data.

[Image processing method]
The image processing method according to the present invention also includes image data to be processed from a database that stores setting information including adjustment content specifying information for specifying the content of color adjustment processing in association with attributes of the image data. Setting information including area designation information for specifying an image area to be color-adjusted based on the selected setting information, and adjustment content designation information based on the selected setting information. And color adjustment according to the image area is performed on the image data to be processed based on the created setting information.

[program]
A program according to the present invention is an image processing apparatus including a computer that stores setting information including adjustment content specifying information for specifying the content of color adjustment processing in association with image data attributes. A step of selecting at least one setting information based on an attribute of image data to be processed, an area specifying information for specifying an image area to be subjected to color adjustment based on the selected setting information, and adjustment The computer of the image processing apparatus includes a step of creating setting information including content designation information and a step of performing color adjustment according to an image area on the image data to be processed based on the created setting information. Let it run.

  According to the image processing apparatus of the present invention, it is possible to easily set the color adjustment processing performed for each image region.

[System configuration]
First, the overall configuration of the image processing system 1 to which the present invention is applied will be described.
FIG. 1 is a diagram illustrating the overall configuration of the image processing system 1.
As illustrated in FIG. 1, the image processing system 1 includes a client PC 4 and a printer device 10. The client PC 4 and the printer apparatus 10 are connected to each other via a network configured by a LAN or WAN.
The client PC 4 is a general-purpose computer used by a user for image processing and the like, and is installed with DTP software for editing image data and the like, a printer driver for controlling printing processing by the printer device 10, and the like.

[Printer]
Next, the printer apparatus 10 to which the present invention is applied will be described.
FIG. 2 is a diagram illustrating a configuration of the tandem type printer apparatus 10.
As shown in FIG. 2, the printer device 10 includes an image reading unit 12, an image forming unit 14, an intermediate transfer belt 16, a paper tray 17, a paper conveyance path 18, a fixing device 19, and an image processing device 20. The printer apparatus 10 is a composite having a function as a full-color copying machine using the image reading apparatus 12 and a function as a facsimile in addition to a printer function for printing image data received from the client PC 4 (FIG. 1). It may be a machine.

First, the outline of the printer apparatus 10 will be described. An image reading apparatus 12 and an image processing apparatus 20 are disposed above the printer apparatus 10 and function as image data input means. The image reading device 12 reads an image displayed on the document and outputs it to the image processing device 20. The image processing apparatus 20 performs color conversion, gradation correction, and image conversion on image data input from the image reading apparatus 12 or image data input from the client PC 4 or the like via a network such as a LAN (FIG. 1). Image processing such as resolution correction is performed and output to the image forming unit 14.
Below the image reading device 12, a plurality of image forming units 14 are arranged corresponding to the colors constituting the color image. In this example, the first image forming unit 14K, the second image forming unit 14Y, and the third image forming corresponding to each color of black (K), yellow (Y), magenta (M), and cyan (C). The unit 14M and the fourth image forming unit 14C are arranged horizontally along the intermediate transfer belt 16 with a certain interval. The intermediate transfer belt 16 rotates as an intermediate transfer member in the direction of an arrow A in the figure, and these four image forming units 14K, 14Y, 14M, and 14C are configured based on the image data input from the image processing apparatus 20. The toner images are sequentially formed, and transferred (primary transfer) to the intermediate transfer belt 16 at a timing at which the plurality of toner images are superimposed on each other. The order of the colors of the image forming units 14K, 14Y, 14M, and 14C is not limited to the order of black (K), yellow (Y), magenta (M), and cyan (C). ), Magenta (M), cyan (C), black (K), and the like.

  The sheet conveyance path 18 is disposed below the intermediate transfer belt 16. The recording paper 32 supplied from the paper tray 17 is transported on the paper transport path 18, and the toner images of each color transferred onto the intermediate transfer belt 16 are collectively transferred (secondary transfer). The transferred toner image is fixed by the fixing device 19 and discharged to the outside along the arrow B.

Next, each configuration of the printer device 10 will be described in more detail.
As shown in FIG. 2, the image reading unit 12 reads a platen glass 124 on which a document is placed, a platen cover 122 that presses the document onto the platen glass 124, and an image of the document placed on the platen glass 124. And an image reading device 130. The image reading apparatus 130 illuminates a document placed on the platen glass 124 with a light source 132, and reflects a reflected light image from the document into a full-rate mirror 134, a first half-rate mirror 135, and a second half-rate mirror. Scanning exposure is performed on an image reading element 138 made of a CCD or the like via a reduction optical system consisting of 136 and an imaging lens 137, and the color material reflected light image of the original 30 is given a predetermined dot density (by this image reading element 138. For example, it is configured to read at 16 dots / mm).

  The image processing apparatus 20 performs predetermined image processing such as shading correction, document position shift correction, brightness / color space conversion, gamma correction, frame deletion, color / moving editing, and the like on the image data read by the image reading unit 12. Apply processing. The color material reflected light image of the original read by the image reading unit 12 is, for example, original reflectance data of three colors of red (R), green (G), and blue (B) (each 8 bits), By the image processing by the image processing apparatus 20, it is converted into original color material gradation data of four colors of yellow (Y), magenta (M), cyan (C), and black (K) (each 8 bits).

The first image forming unit 14K, the second image forming unit 14Y, the third image forming unit 14M, and the fourth image forming unit 14C (image forming means) are arranged in parallel at regular intervals in the horizontal direction. The arrangement is almost the same except that the color of the image to be formed is different. Accordingly, the first image forming unit 14K will be described below. The configuration of each image forming unit 14 is distinguished by adding K, Y, M, or C.
The image forming unit 14K forms an electrostatic latent image by an optical scanning device 140K that scans a laser beam in accordance with image data input from the image processing device 20, and a laser beam scanned by the optical scanning device 140K. And an image forming apparatus 150K.

The optical scanning device 140K modulates the semiconductor laser 142K according to the black (K) image data, and emits the laser light LB (K) from the semiconductor laser 142K according to the image data. The laser beam LB (K) emitted from the semiconductor laser 142K is applied to the rotary polygon mirror 146K via the first reflection mirror 143K and the second reflection mirror 144K, and is deflected and scanned by the rotation polygon mirror 146K. The light is irradiated onto the photosensitive drum 152K of the image forming apparatus 150K through the second reflecting mirror 144K, the third reflecting mirror 148K, and the fourth reflecting mirror 149K.
The image forming apparatus 150K includes a photosensitive drum 152K as an image carrier that rotates at a predetermined rotational speed in the direction of arrow A, and primary charging as a charging unit that uniformly charges the surface of the photosensitive drum 152K. And a developing device 156K for developing the electrostatic latent image formed on the photosensitive drum 154K, and a cleaning device 158K. The photosensitive drum 152K is uniformly charged by the scorotron 154K, and an electrostatic latent image is formed by the laser beam LB (K) irradiated by the optical scanning device 140K. The electrostatic latent image formed on the photosensitive drum 152K is developed with black (K) toner by the developing device 156K and transferred to the intermediate transfer belt 16. Residual toner, paper dust, and the like adhering to the photosensitive drum 152K after the toner image transfer process are removed by the cleaning device 158K.
The other image forming units 14Y, 14M, and 14C also form yellow (Y), magenta (M), and cyan (C) toner images in the same manner as described above, and intermediately transfer the formed toner images of the respective colors. Transfer to belt 16.

The intermediate transfer belt 16 has a constant tension between the drive roll 164, the first idle roll 165, the steering roll 166, the second idle roll 167, the backup roll 168, and the third idle roll 169. The drive roll 164 is rotationally driven by a drive motor (not shown), and is circulated at a predetermined speed in the direction of arrow A. The intermediate transfer belt 16 is formed into an endless belt by, for example, forming a flexible synthetic resin film such as polyimide in a belt shape and connecting both ends of the synthetic resin film formed in a belt shape by welding or the like. It has been done.
Further, the intermediate transfer belt 16 includes a first primary transfer roll 162K, a second primary transfer roll 162Y, a third primary transfer roll 162M, and a position facing the image forming units 14K, 14Y, 14M, and 14C, respectively. A fourth primary transfer roll 162C is provided, and the toner images of the respective colors formed on the photosensitive drums 152K, 152Y, 152M, and 152C are transferred onto the intermediate transfer belt 16 in a multiple manner by these primary transfer rolls 162. The The residual toner adhering to the intermediate transfer belt 16 is removed by a cleaning blade or brush of a belt cleaning device 189 provided downstream of the secondary transfer position.

In the paper transport path 18, a paper feed roller 181 for taking out the recording paper 32 from the paper tray 17, a first roller pair 182, a second roller pair 183 and a third roller pair 184 for paper transport, and a recording paper A registration roll 185 is provided which conveys 32 to the secondary transfer position at a predetermined timing.
In addition, a secondary transfer roll 185 that is in pressure contact with the backup roll 168 is disposed at the secondary transfer position on the paper transport path 18, and each color toner image transferred onto the intermediate transfer belt 16 is Secondary transfer is performed on the recording paper 32 by the pressing force and electrostatic force of the secondary transfer roll 185. The recording paper 32 onto which the toner image of each color is transferred is conveyed to the fixing device 19 by the first conveyance belt 186 and the second conveyance belt 187.
The fixing device 19 melts and fixes the toner to the recording paper 32 by performing heat treatment and pressure treatment on the recording paper 32 to which the toner images of the respective colors are transferred.

[Client PC]
Next, the client PC 4 to which the present invention is applied will be described.
FIG. 3 is a diagram illustrating the hardware configuration of the client PC 4 to which the image processing method according to the present invention is applied, centering on the control device 40.
As illustrated in FIG. 3, the client PC 4 includes a control device 40 including a CPU 402 and a memory 404, a communication device 42, a recording device 44 such as an HDD / CD device, an LCD display device or a CRT display device, and a keyboard / touch panel. The user interface device (UI device) 46 including the above.

[background]
For example, Japanese Patent Application Laid-Open No. 9-193477 discloses a method of determining an object such as a figure, a character, a photograph, and the like, switching a color correction function of a printer for each object, performing color conversion, and printing.
As a result, when the user visually recognizes the printed matter and determines that color correction is required, the user does not need to return to DTP software or other applications and perform color correction for each object.

However, in this method, the color correction coefficient applied to each object is fixed. Therefore, for example, when a plurality of photographic objects exist on the same image, the same color adjustment is performed on these photographic objects, and the color adjustment of each photographic image cannot be optimally performed. .
Therefore, when performing separate color adjustment for each photographic image, it is necessary to return to applications such as DTP software and image processing software again.
In addition, when color adjustment is performed by an application such as DTP software or image processing software, it is difficult to perform intended adjustment without knowledge of color adjustment by the application. Therefore, in a case where a photographic image, a character image, a computer graphics image (CG image), and the like are mixed in an image to be printed, an application for photographic adjustment is used for color adjustment of a portion corresponding to the photographic image. Since it is necessary to return, knowledge of the photo adjustment application is required, and in order to adjust the color corresponding to the CG image, it is necessary to return to the application for drawing the CG image, and knowledge of the application for CG image is required. . That is, since it is necessary to return to a plurality of applications, knowledge of color adjustment in a plurality of applications is required.
Further, it is a troublesome task to set the color adjustment every time the input image is changed (for example, when the object is changed or the layout image is changed).

  Therefore, the image processing system 1 according to the present embodiment uses color adjustment setting information (color adjustment contents and the like) as a template, and stores the template in association with attributes of image data. When image data to be processed is newly input, the image processing system 1 selects a template based on the attribute of the image data, and creates setting information for color adjustment processing using the selected template.

[Image processing program]
4 illustrates the functional configuration of the print request program 5 executed by the client PC 4 (FIGS. 1 and 3) and the functional configuration of the print program 6 executed by the printer apparatus 10 (FIGS. 1 and 2). FIG.
As illustrated in FIG. 4, the print request program 5 includes a print instruction unit 510, a layout display unit 520, and a color adjustment layout creation unit 530. The color adjustment layout creation unit 530 includes an adjustment area selection unit 532, a conversion coefficient selection unit 534, and a color adjustment setting unit 536. The print request program 5 is installed in the client PC 4.
The print program 6 includes a print control unit 610, a drawing development unit 620, an attribute determination unit 630, a color conversion layout storage unit 640, a conversion coefficient storage unit 650, a color conversion unit 660, and a color conversion layout selection unit 670. . The attribute determination unit 630 includes a feature amount extraction unit 632 and an object determination unit 634. The print program 6 is installed in the image processing device 20 of the printer device 10.
The print request program 5 and the print program 6 of this example are realized by software, but a part or all of them may be realized by hardware such as an ASIC. The configurations of the print request program 5 and the print program 6 may be arranged in either the client PC 4 or the printer device 10.

  In the print request program 5, the print instruction unit 510 creates print request data in accordance with a user operation, and outputs the created print request data to the print control unit 610. The print request data includes image data of an input image to be printed, data specifying a printing condition such as the number of prints, and the like. Moreover, the image data of the input image is, for example, a PDL file including a plurality of objects.

The layout display unit 520 displays a layout image generated based on the image data of the input image on the UI device 46 (FIG. 3). The layout image is, for example, an image in which a plurality of objects are arranged according to a drawing command, and is, for example, a raster image generated based on a PDL file (an image in which pixel groups are arranged by rasterization).
More specifically, the layout display unit 520 is input from the image data of the layout image that has been subjected to color compression processing according to the image output characteristics of the image output device (the printer device 10 in this example) (from the drawing development unit 620). Image data in the Lab color space) is converted into image data in the output color space of the UI device 46 using the ICC profile of the UI device 46 and displayed.
The user selects an image area (color adjustment area) to be subjected to color adjustment from the layout image displayed by the layout display unit 520.
The layout display unit 520 displays image data that has been subjected to color adjustment processing by applying a color adjustment layer (described later).

The color adjustment layout creation unit 530 creates data of the color adjustment layer 710 illustrated in FIG. 5 in accordance with a user operation, and outputs the created data of the color adjustment layer 710 to the color conversion layout storage unit 640.
FIG. 5 is a diagram for explaining color conversion processing using the color adjustment layer 710.
As illustrated in FIG. 5, the color adjustment layer 710 associates the adjustment content information that defines the content of the color adjustment process with the area information that defines the target area (color adjustment area 712) of the color adjustment process. It is the data that is included in the state. As illustrated in FIG. 5, the color adjustment layer 710 is schematically represented as a layer that overlaps an input image (image layer 700) that is a target of color adjustment processing. When the image layer 700 and the color adjustment layer 710 are input to the image output apparatus (printer apparatus 10), the image layer 700 is subjected to color adjustment processing based on the color adjustment layer 710 and output as an output image 720. .
In addition, the color adjustment layout creating unit 530 changes or combines the color adjustment layer 710 stored as a template in the color conversion layout storage unit 640 to thereby apply the color adjustment layer 710 to be applied to the image data to be processed. May be created.

The color adjustment layout creation unit 530 will be described more specifically.
The adjustment area selection unit 532 selects a color adjustment target area (color adjustment area) according to a user operation, and notifies the attribute determination unit 630 of the selected color adjustment area. The adjustment area selection unit 532 of this example selects a color adjustment area from the layout image displayed by the layout display unit 520.

  The conversion coefficient selection unit 534 selects a color conversion coefficient to be applied to the color adjustment region selected by the adjustment region selection unit 532 according to a user operation, and associates the selected color conversion coefficient with the color adjustment region. The color adjustment layer 710 (FIG. 5). The conversion coefficient selection unit 534 of this example selects a color conversion coefficient for each attribute of the object included in the selected color adjustment area. The color conversion coefficient is a coefficient that defines color conversion processing (in this example, color conversion processing for converting image data in Lab space into image data in output color space (CMYK color space) of the printer device). These are a plurality of ICC profiles (a plurality of profiles having different color reproduction) provided in the printer apparatus 10.

  The color adjustment setting unit 536 sets color adjustment processing for the color adjustment region selected by the adjustment region selection unit 532 according to a user operation, and associates the contents of the set color adjustment processing with the color adjustment region. The color adjustment layer 710 (FIG. 5) is assumed. The color adjustment setting unit 536 of this example sets the content of the color adjustment process for each attribute of the object included in the selected color adjustment area. The color adjustment process is a process for changing brightness, saturation, contrast, color balance, or the like.

  In the print program 6, the print control unit 610 controls each component of the print program 6 in accordance with the print request data input from the print instruction unit 510, creates image data for printing (CMYK image), The generated printing image data (C image, M image, Y image, and K image) is output to each image forming unit 14 (FIG. 2).

The drawing development unit 620 interprets the image data (PDL file) of the input image under the control of the print control unit 610 and generates raster data. The generated raster data is, for example, image data in the Lab color space.
In addition, the drawing development unit 620 converts the generated raster data into image data corresponding to the color gamut of the printer device 10 (image data subjected to at least color compression processing) using the ICC profile of the printer device 10. And output to the layout display unit 520.

The attribute determination unit 630 determines the attribute of the image data of the input image (that is, the image data to be processed), and outputs the determination result to the color adjustment layout creation unit 530 and the color conversion layout storage unit 640. The attribute of the image data includes, for example, an image feature amount indicating characteristics as an image, and a file attribute indicating the creator and creation date and time of the image data. The image feature amount includes, for example, hue, saturation, lightness, presence / absence of gradation, attribute of an object (image element) included in the image (type of image element such as character image, CG image, natural image), edge amount, and the like. is there. The file attributes are, for example, the creator of the image data, the creation date and time, the type of the entire image (office document, catalog, etc.), the type of application used for creation, the amount of data, and the like.
More specifically, the feature amount extraction unit 632 extracts the image feature amount (hue, saturation, brightness, presence / absence of gradation, etc.) of the color adjustment region selected by the adjustment region selection unit 532, and extracts the extracted image. The feature amount is output to the color conversion layout storage unit 640 or the like.
The object determination unit 634 determines an object (a character image, a photographic image, a CG image, or the like) included in the color adjustment region selected by the adjustment region selection unit 532, and outputs the determination result to the conversion coefficient selection unit 534 or the like. In this case, the feature amount extraction unit 632 extracts an image feature amount for each object determined by the object determination unit 634.

The color conversion layout storage unit 640 stores the color adjustment layer 710 (FIG. 5) input from the color adjustment layout creation unit 530 in association with the image layer 700 to be subjected to color adjustment. In addition, the color conversion layout storage unit 640 converts the input color adjustment layer 710 into the attribute of the image data (image layer 700) to which the color adjustment layer 710 is applied (the image feature amount input from the attribute determination unit 630, etc. ) And stored as a template.
In this example, a mode in which the color conversion layout storage unit 640 is provided on the printer apparatus side (print program 6) will be described as a specific example. However, the present invention is not limited to this. The color conversion layout storage unit 640 may be provided in the print request program 5), and the color adjustment layer 710 may be stored on the client PC side.

FIG. 6 is a diagram illustrating a color adjustment layer (color adjustment layout data) stored in the color conversion layout storage unit 640. FIG. 6A shows a color adjustment layer 710 applied to input image data. For example, FIG. 6B illustrates template data generated based on the color adjustment layer 710.
As illustrated in FIG. 6A, when the color adjustment layer storage unit 640 receives the color adjustment layer 710 from the color adjustment layout creation unit 530, the color conversion layout storage unit 640 displays a color adjustment region that constitutes the input color adjustment layer 710. Image data (image layer ID) to which this color adjustment layer 710 is applied, indicating area information (coordinate information such as “area A”) and a color conversion coefficient (or color adjustment content) applied to each object attribute Is stored in association with.
Further, the color conversion layout storage unit 640 includes a color adjustment layer 710 input from the color adjustment layout creation unit 530 and an attribute of image data input from the attribute determination unit 630 (image data to which the color adjustment layer 710 is applied). Based on the color conversion coefficient (or color adjustment content) and the image data (or object) attribute to which the color conversion coefficient (or color adjustment content) is applied to generate template data. Then, the generated template data is registered in the color adjustment layout database (color adjustment layout DB) 642.
In the color adjustment layout DB 642 of this example, as illustrated in FIG. 6B, color conversion coefficients are associated with document types (types of image data), object attributes, and color areas. A color area is an example of an image feature amount related to color, and is composed of hue, saturation, and brightness.
In this example, since it is assumed that the layout of each object constituting the image data is frequently changed, the template data does not include information on the color adjustment area. If there is a relatively small amount of information, information regarding the color adjustment area may be added to the template data. That is, in the color adjustment layout DB 642, the position information (relative position in the entire image) of each color adjustment area and the color conversion coefficients applied to these color adjustment areas are stored in association with each other, so that Similar color adjustments can be made in the same region (same layout position).

FIG. 7 is a diagram illustrating color regions.
As illustrated in FIG. 7, each color region includes a hue division (“Red”, “Yellow”, etc.), a saturation division (“Saturation 1”, “Saturation 2”, etc.), and a lightness division. ("Lightness 1", "lightness 2", etc.).
The feature amount extraction unit 632 of this example calculates the average values of hue, saturation, and lightness for each object, and based on the calculated average values of hue, saturation, and lightness, the color area of each object is calculated. judge. Then, the color adjustment layout creating unit 530 of this example stores the color conversion coefficient applied to each object in association with the color area of these objects as a template.

  Returning to the description of FIG. The conversion coefficient storage unit 650 stores the color conversion coefficient determined based on the color adjustment layer 710 (FIG. 5). The stored color conversion coefficient is associated with an input image to be subjected to color conversion, a target region to be subjected to color conversion, and an attribute of an object to be subjected to color conversion.

  The color conversion unit 660 uses the color conversion coefficient stored in the conversion coefficient storage unit 650 to convert the image data of the input image (Lab data space image data in this example) into the color space (CMYK) of the printer device 10. Color space) image data. More specifically, the color conversion unit 660 uses the color conversion coefficient associated with the target area (color adjustment area or the like) and the object attribute, and calculates the color conversion coefficient according to the target area and object attribute. Perform color conversion while switching. As a result, an output image 720 (FIG. 5) that has been subjected to color adjustment processing according to the color adjustment layer 710 is generated.

  The color conversion layout selection unit 670 selects and selects at least one template from a plurality of templates (data of the color adjustment layer 710) stored in the color conversion layout storage unit 640 in response to a user request. The processed template is output to the color adjustment layout creation unit 530. The color conversion layout selection unit 670 of this example, when at least one of the attributes (document type, object attribute, or color area) of the image data illustrated in FIG. 6B is specified by the user (or processing target) When the attribute of the image data is determined for the image data, the conversion coefficient corresponding to the attribute of the designated image data (or the attribute of the image data determined for the image data to be processed) is selected as a template. Further, when there are a plurality of color conversion coefficients corresponding to the designated image data attribute, the color conversion layout selection unit 670 prompts the user for selection by presenting them as template candidates, and the user's selection operation Accordingly, at least one color conversion coefficient is selected as a template and output to the color adjustment layout creating unit 530.

[input screen]
Next, an input screen displayed on the client PC 4 will be described.
FIG. 8 is a diagram illustrating a top screen 800 displayed on the UI device 46.
As illustrated in FIG. 8, on the top screen 800, a preview area 810 on which an input image 700 or the like is displayed, a color adjustment area addition button 820 for performing a color adjustment area selection process, and setting of a color conversion coefficient. A color conversion coefficient setting button 830 for performing processing, a color adjustment setting button 840 for performing color adjustment setting processing, a print start button 850 for instructing printing start, and reading of the color adjustment layer 710 A layout read button 860 for performing the operation and a layout storage button 870 for storing the created color adjustment layer 710 are provided.
The preview area 810 is an area displayed by the layout display unit 520 (FIG. 4), and a layout image corresponding to the input image 700 (an input image that has been subjected to color gamut compression in accordance with the color gamut of the printer device 10). Is displayed. When a color adjustment area is selected in this layout image, an area display 812 indicating the selected color adjustment area is displayed on the layout image. In this example, since two color adjustment areas are selected, two area displays 812 are displayed.
When the storage of the color adjustment layer 710 is instructed, the input image 700 that has been color adjusted based on the color adjustment layer 710 is displayed in the preview area 810. More specifically, when the save layout button 870 is clicked, the print program 6 saves the color adjustment layer 710 and performs color conversion processing on the input image 700 based on the color adjustment layer 710 (that is, A color adjustment process corresponding to the color adjustment layer 710), and the input image 700 (CMYK image) subjected to the color conversion process is converted into image data (Lab image) in a color space independent of the apparatus, and a print request program 5 to the layout display section 520. Based on the image data, the layout display unit 520 displays the input image 700 on which color adjustment processing has been performed in the preview area 810.

  The color adjustment area addition button 820 is an operation area displayed by the adjustment area selection unit 532 and accepts a request for adding a color adjustment area. When this color adjustment area addition button 820 is clicked, an area selection operation can be performed in the preview area 810, and the adjustment area selection unit 532 detects the area selection operation and selects a color adjustment area according to the detection result. to add.

  The color conversion coefficient setting button 830 is an operation area displayed by the conversion coefficient selection unit 534, and accepts a color conversion coefficient setting request. When the color conversion coefficient setting button 830 is clicked, the conversion coefficient setting unit 534 displays a color conversion coefficient selection screen 802 (described later).

  The color adjustment setting button 840 is an operation area displayed by the color adjustment setting unit 536 and accepts a color adjustment setting request. When this color adjustment setting button 840 is clicked, the color adjustment setting unit 536 displays a color conversion coefficient selection screen 802 (described later).

The print start button 850 receives a print start instruction.
The layout read button 860 is an operation area displayed by the color adjustment layout creation unit 530 and accepts a read request for the color adjustment layer 710 stored in the color conversion layout storage unit 640. When this layout read button 860 is clicked, the color adjustment layout creation unit 530 reads out data of a desired color adjustment layer 710 from the color conversion layout storage unit 640 and displays the read color adjustment layer 710 as a template. To do.
When the layout read button 860 is clicked in a state where the area display 812 is selected, the color conversion layout selection unit 670 displays the color conversion layout storage unit based on the image feature amount of the image area corresponding to the area display 812. The data of at least one color adjustment layer 710 is selected from 640, and the data of the selected color adjustment layer 710 is output as a template to the color adjustment layout creation unit 530. The color adjustment layout creation unit 530 is a color conversion layout selection unit. The color adjustment layer 710 selected by 670 is displayed as a template.

  The layout save button 870 is an operation area displayed by the color adjustment layout creation unit 530 and accepts a data save request for the color adjustment layer 710. When the save layout button 870 is clicked, the color adjustment layout creation unit 530 causes the color conversion layout storage unit 640 to store the created data of the color adjustment layer 710.

FIG. 9 is a diagram for explaining a method of creating a new color conversion layer 710 using one template (a color conversion layer stored in the color adjustment layout storage unit 640).
When the layout read button 860 (FIG. 8) is clicked, the color adjustment layer 710a stored in the color adjustment layout storage unit 640 is read and displayed as illustrated in FIG. 9A. In the color adjustment layer 710a of this example, two color adjustment areas (color adjustment area A and color adjustment area B) are set, and the contents of the color adjustment processing corresponding to each color adjustment area include color conversion coefficients. It can be browsed by clicking the setting button 830 or the color adjustment setting button 840.
The user can change the position, shape, and size of the color adjustment area included in the template by dragging the area display 812 corresponding to the color adjustment area. In this example, as illustrated in FIG. 9B, the color adjustment area B included in the template is changed to the color adjustment area B ′. In response to this, the color adjustment layout creation unit 530 updates the position, shape, and size of the color adjustment region of the template (color adjustment layer) read from the color change layout storage unit 640. Further, the contents (color conversion coefficient, etc.) of the color adjustment process set in each color adjustment area can be changed by clicking the color conversion coefficient setting button 830 or the color adjustment setting button 840.
The user can add a new color adjustment area (in this example, color adjustment area C) to this template by clicking a color adjustment area addition button 820.

FIG. 10 is a diagram illustrating a method for creating a new color conversion layer 710 using a plurality of templates (a plurality of color conversion layers stored in the color adjustment layout storage unit 640).
For example, when two color adjustment layers 710 (color adjustment layer a and color adjustment layer c) are designated by clicking the layout read button 860 (FIG. 8), the color adjustment is performed as illustrated in FIG. 10A. Two color adjustment layers 710 (color adjustment layer a and color adjustment layer c) stored in the layout storage unit 640 are read and displayed as templates in different windows.
When the user instructs synthesis of these templates (color adjustment layer 710), the color adjustment layout creation unit 530 obtains a union of color adjustment areas included in these templates and creates a new color adjustment layer 710d. . In this example, as illustrated in FIG. 10B, the color adjustment area A and the color adjustment area B included in the first color adjustment layer 710a and the color adjustment area A included in the second color adjustment layer 710c. And the color adjustment area D are combined to generate a color adjustment layer 710d including the color adjustment area A, the color adjustment area B, and the color adjustment area D. Note that the color adjustment layout creation unit 530 may create a color adjustment layer 710 including overlapping portions (product sets) of the color adjustment regions 710 based on a plurality of templates.

FIG. 11A illustrates a color conversion coefficient selection screen 802, and FIG. 11B illustrates a color adjustment setting screen 804.
When the color conversion coefficient setting button 830 is clicked in a state where any one of the area displays 812 is active (selected) in the preview area 810 (FIG. 8), as illustrated in FIG. 11A. A color conversion coefficient selection screen 802 for setting a color conversion coefficient for the color adjustment area corresponding to the area display 812 is displayed. The color conversion coefficient selection screen 802 includes a check box 832 for selecting an object attribute (character image, natural image (photo image), CG image, etc.), and a color conversion coefficient to be applied to each object attribute. A coefficient selection area 834 to be selected is provided. When the user checks a check box 832 corresponding to a desired object attribute, a coefficient selection area 834 for selecting a color conversion coefficient of the object attribute becomes active, and a color conversion coefficient can be selected. In this example, since the check box 832c corresponding to “natural image” is checked, a coefficient selection area 834c for selecting a color conversion coefficient to be applied to the natural image is active, and this coefficient selection area In 834c, a color conversion coefficient can be selected.
The conversion coefficient selection unit 534 detects an operation on the check box 832 and the coefficient selection area 834 and selects a color conversion coefficient for each color adjustment area.

When the color adjustment setting button 840 is clicked in a state where any one of the area displays 812 is active (selected) in the preview area 810 (FIG. 8), as illustrated in FIG. 11B, A color adjustment setting screen 804 for setting the color adjustment content for the color adjustment area corresponding to the area display 812 is displayed. The color adjustment setting screen 804 includes a check box 842 for designating whether or not to select an object attribute, an attribute selection area 844 that accepts selection of an object attribute, and change amounts such as brightness, saturation, and contrast. A slider bar 846 for designating is provided.
When the check box 842 is checked, it is possible to select object attributes in the attribute selection area 844. When the check box of the chuck box 844 is unchecked, all object attributes included in the selected color adjustment area are selected. It becomes the state. That is, when the check box 844 is unchecked, the object attribute determined by the object determination unit 634 is selected in the attribute selection area 844. In this example, since the character image and the CG image are included in the color adjustment area, “character image” and “CG image” are active in the attribute selection area 844, and the color adjustment amount for the character image and the CG image. Can be specified.
Each slider bar 846 corresponding to lightness, saturation, and contrast receives designation of a color adjustment amount for the selected object attribute in the selected color adjustment region.
The color adjustment setting unit 536 sets an adjustment amount of lightness, saturation, or contrast for each object attribute included in the color adjustment area in accordance with a user operation on the color adjustment setting screen 804. In this example, brightness, saturation, and contrast are described as specific examples of the contents of the color adjustment processing, but the present invention is not limited to this, and image quality adjustment based on image analysis such as human skin or blue sky It may be.

[Overall operation]
Next, operations of the print request program 5 and the print program 6 will be described.
FIG. 12 is a flowchart illustrating the printing process (S10) in the image processing system 1.
As shown in FIG. 12, in step 100 (S100), the print instruction unit 510 of the print request program 5 (FIG. 4) sends the print request data including the PDL file (input image) to the print control unit of the print program 6. Output to 610.
The print control unit 610 transfers the PDL file to the drawing development unit 620 and instructs generation of a preview image.
The drawing development unit 620 interprets the PDL file transferred from the print control unit 610, generates raster data of the input image, and uses the generated raster data as the print control unit 610, the attribute determination unit 630, and the color conversion layout storage. Output to the unit 640. Also, the drawing development unit 620 performs color compression processing on the generated raster data of the input image according to the color gamut of the printer device 10 and lays out the image data subjected to the color compression processing as a preview. The data is output to the display unit 520.
The layout display unit 520 (FIG. 4) creates preview display image data using the ICC profile of the UI device 46 for the raster data of the input image input from the drawing development unit 620, and displays the preview area 810. (FIG. 8).

In step 105 (S105), the user clicks the color adjustment area addition button 820 (FIG. 8), and then selects the range of the color adjustment area in the preview area 810.
The adjustment area selection unit 532 detects this user operation, selects a color adjustment area, and outputs the selected color adjustment area to the attribute determination unit 630.

In step 110 (S110), the attribute determination unit 630 determines the document type or the like of the image data based on the image data of the input image input from the drawing development unit 620, and determines the determination result as the color conversion layout storage unit 640. Output to.
The object determination unit 634 determines the attribute of the object included in the color adjustment region selected by the adjustment region selection unit 532 based on the image data of the input image input from the drawing development unit 620, and determines the attribute. The result is output to the color adjustment layout creation unit 530, the drawing development unit 620, and the color conversion layout storage unit 640. Note that the object attribute determination result output to the drawing development unit 620 is input to the color conversion unit 660 via the print control unit 610 and is used to specify the attribute of the object in the color conversion process, and the color conversion layout storage unit The determination result of the object attribute output to 640 is used as the attribute of the object included in the input image (that is, as key information for searching a template for color adjustment of the input image), and is registered in the color adjustment layout DB 642. Used as an object attribute (that is, as key information when a color adjustment layer applied to the input image is registered as a template).

  In step 115 (S115), the feature amount extraction unit 632 calculates the average values of the hue, saturation, and brightness of each object determined by the object determination unit 634, and calculates the calculated hue, saturation, and brightness values. Based on the average value, a color area (FIG. 7) is specified, and the specified color area is output to the color conversion layout storage unit 640 as an image feature amount.

  In step 120 (S120), when the image feature amount of any object is output by the feature amount extraction unit 632, the color conversion layout selection unit 670 outputs the image feature amount, the object attribute of the object, and the object. Is selected from the color adjustment layout DB 642 (FIG. 6B) of the color conversion layout storage unit 640 based on the document type of the image data including the image data, and the selected template is selected. The data is output to the color adjustment layout creation unit 530.

In step 125 (S125), the color adjustment layout creation unit 530 displays the template (color conversion coefficient or color adjustment content included in the color adjustment layer) input from the color conversion layout selection unit 670, and edits the template. Do.
For example, when the color conversion coefficient setting button 830 (FIG. 8) is clicked, the conversion coefficient selection unit 534 displays the color conversion coefficient selection screen 802 (FIG. 11A) and includes the color conversion coefficient of the template. A selection of a color conversion coefficient to be applied is received from a plurality of color conversion coefficients, and the selected color conversion coefficient is associated with the color adjustment region and the object attribute.
When the color adjustment setting button 840 (FIG. 8) is clicked, the color adjustment setting unit 536 displays the color adjustment content of the template on the color adjustment setting screen 804 (FIG. 11B), and this color adjustment. Changes in the processing contents (lightness change, saturation change, contrast change) are accepted, and the changed color adjustment process contents are associated with the color adjustment area and the object attribute.

  In step 130 (S130), the color adjustment layout creating unit 530 waits until the save layout button 870 (FIG. 8) is clicked or the color adjustment area addition button 820 (FIG. 8) is clicked. When the layout save button 870 is clicked, the color adjustment layout creation unit 530 proceeds to the process of S135, and when the color adjustment area addition button 820 is clicked, returns to the process of S105.

In step 135 (S135), the color adjustment layout creating unit 530 creates the color adjustment layer 710 (FIG. 5) based on the color conversion coefficient or the color adjustment processing content associated with the color adjustment area and the object attribute, The created color adjustment layer 710 data is stored in the color conversion layout storage unit 640.
As illustrated in FIG. 6A, the color conversion layout storage unit 640 is applied to the color conversion layer 710 (color adjustment layer ID, color adjustment region, and each object attribute) input from the color adjustment layout creation unit 530. Color conversion coefficients and the like) are stored in association with the image data (image layer ID) of the input image.
Further, as illustrated in FIG. 6B, the color conversion layout storage unit 640 generates template data based on the color conversion layer 710 input from the color adjustment layout creation unit 530, and the generated template data (Color conversion coefficient and color conversion processing content) are registered in the color adjustment layout DB 642 in association with the color area of the object to which each template data is applied, the attribute of the object, and the document type of the input image.
At least one color adjustment area (area designation information) is set in one color adjustment layer, and for each color adjustment area, a color conversion coefficient (“conversion coefficient” corresponding to an object attribute (image element attribute) is set. 1 ”or the like, or color adjustment processing content (such as“ L value + 2 ”) is set.

In step 140 (S140), the color conversion unit 660 reads the color adjustment layer 710 corresponding to the input image to be processed from the color conversion layout storage unit 640, and based on the read color adjustment layer 710, The color conversion coefficient is determined, and the determined color conversion coefficient is stored in the conversion coefficient storage unit 650.
The color conversion unit 660 refers to the color conversion coefficient (corresponding to the color adjustment area and the object attribute) stored in the conversion coefficient storage unit 650, and uses the color conversion coefficient corresponding to the image area and the object attribute. The image data of the input image is converted into image data for printing (CMYK image).
The print control unit 610 converts the image data (CMYK image) color-converted by the color conversion unit 660 into image data (Lab image) in a color space independent of the device using the ICC profile of the printer device 10. Image data (Lab image) is output to the layout display unit 520.
The layout display unit 520 converts the image data (Lab image reversely converted from the CMYK image) into display image data (RGB image) using the ICC profile of the UI device 46, and displays a preview image (color adjustment processing). Is displayed as an image).

  In step 145 (S145), the print request program 5 waits until the user clicks the print start button 850 (FIG. 8) or the color adjustment area addition button 820. The print request program 5 proceeds to the process of S150 when the print start button 850 is clicked, and returns to the process of S105 when the color adjustment area addition button 820 is clicked.

In step 150 (S150), the print instruction unit 510 instructs the print control unit 610 to start printing.
The print control unit 610 transfers the image data (CMYK image) color-converted by the color conversion unit 660 to the image forming unit 14. As a result, the color-adjusted image data is printed on the recording paper.

As described above, the image processing system 1 in the present embodiment extracts the template (data included in the color adjustment layer) corresponding to the attributes of the image data (file attribute and image feature amount) from the color adjustment layout DB 642, Present to the user. As a result, setting information (color conversion coefficient, etc.) that can perform similar color adjustments for image areas or objects having similar attributes is presented, and the same color adjustment setting operation is repeated. Therefore, the setting operation of the color adjustment process can be easily performed. Further, even a person who does not have color adjustment technology can perform good color adjustment by using the color adjustment layout DB 642 incorporating the color adjustment method. That is, even a person who has no knowledge of color adjustment in an application such as DTP software performs the same color adjustment as a person who has knowledge of color adjustment by using a template stored in the color adjustment layout DB 642. It is possible.
The image processing system 1 can perform color adjustment for each image area included in the document by performing color adjustment on image data after layout (after RIP). Thereby, even when there is a color similar to a different place in the same document (input image), it is possible to adjust the color of only the target object without shifting the color.
Further, the present image processing system 1 designates a color adjustment area to be subjected to color adjustment for the preview image, so that the object of the image data after the layout is also returned without returning to the DTP software. Color adjustment can be performed.

1 is a diagram illustrating an overall configuration of an image processing system 1. FIG. 1 is a diagram illustrating a configuration of a tandem type printer device 10. FIG. FIG. 2 is a diagram illustrating a hardware configuration of a client PC 4 to which an image processing method according to the present invention is applied, centering on a control device 40; 3 is a diagram illustrating a functional configuration of a print request program 5 executed by a client PC 4 (FIGS. 1 and 3) and a functional configuration of a print program 6 executed by a printer device 10 (FIGS. 1 and 2). FIG. FIG. 10 is a diagram illustrating color conversion processing using a color adjustment layer 710. It is a figure which illustrates the color adjustment layer (color adjustment layout data) memorize | stored in the color conversion layout memory | storage part 640, (A) illustrates the color adjustment layer 710 applied to the input image data, (B) Exemplifies template data generated based on the color adjustment layer 710. It is a figure which illustrates a color area. 5 is a diagram illustrating a top screen 800 displayed on the UI device 46. FIG. 10 is a diagram illustrating a method for creating a new color conversion layer 710 using one template (a color conversion layer stored in a color adjustment layout storage unit 640). FIG. It is a figure explaining the method of creating the new color conversion layer 710 using a some template (The several color conversion layer memorize | stored in the color adjustment layout memory | storage part 640). (A) illustrates a color conversion coefficient selection screen 802, and (B) illustrates a color adjustment setting screen 804. 4 is a flowchart for explaining a printing process (S10) in the image processing system 1.

Explanation of symbols

4 ... Client PC
DESCRIPTION OF SYMBOLS 5 ... Print request program 510 ... Print instruction part 520 ... Layout display part 530 ... Color adjustment layout creation part 532 ... Adjustment area selection part 534 ... Conversion coefficient selection part 536 ... Color adjustment setting unit 10 ... Printer device 6 ... Print program 610 ... Print control unit 620 ... Drawing development unit 630 ... Attribute determination unit 632 ... Feature quantity extraction unit 634 ... Object Determination unit 640 ... color conversion layout storage unit 650 ... conversion coefficient storage unit 660 ... color conversion unit 670 ... color conversion layout selection unit

Claims (10)

Setting information storage means for storing setting information including adjustment content specifying information for specifying the content of color adjustment processing in association with attributes of image data;
Setting information selection means for selecting at least one setting information from the setting information stored in the setting information storage means based on the attribute of the image data to be processed;
An image processing apparatus comprising: color adjustment means for performing color adjustment in accordance with an image area on image data to be processed based on setting information selected by the setting information selection means. The attribute of the image data includes an image feature amount indicating the feature of the image data,
A feature amount extracting means for extracting an image feature amount based on the image data to be processed;
The image processing apparatus according to claim 1, wherein the setting information selection unit selects at least one setting information based on the image feature amount extracted by the feature amount extraction unit. The attribute of the image data includes at least one of creator identification information indicating the creator of the image data, document classification information indicating the classification of the image, or element classification information indicating the classification of the image element included in the image,
Attribute determination means for determining at least one of author identification information, document classification information, or element classification information of image data to be processed;
The image processing apparatus according to claim 1, wherein the setting information selection unit selects at least one setting information based on author identification information, document classification information, or element classification information determined by the attribute determination unit. The setting information selection means extracts a plurality of setting information from the stored setting information based on the attribute of the image data to be processed, and a user's selection operation from the extracted setting information The image processing apparatus according to claim 1, wherein at least one piece of setting information is selected according to the information. Setting information creation means for creating setting information applied to image data to be processed by setting adjustment content designation information of the setting information selected by the setting information selection means in an image area in accordance with a user operation. Further comprising
The image processing apparatus according to claim 1, wherein the color adjustment unit performs color adjustment on image data to be processed in accordance with setting information created by the setting information creation unit. Setting information creating means for creating one setting information based on a plurality of setting information selected by the setting information selecting means;
The image processing apparatus according to claim 1, wherein the color adjustment unit performs color adjustment on image data to be processed based on the setting information created by the setting information creation unit. The setting information further includes element classification information indicating a classification of an image element to be subjected to color adjustment,
The setting information storage means stores setting information in which adjustment content designation information and element classification information are associated with each other,
The setting information creation means sets adjustment content designation information and element classification information corresponding to the selected setting information in an image area included in the image data to be processed,
The image processing apparatus according to claim 5, wherein the color adjustment unit performs color adjustment corresponding to the classification of the image element in each image region based on setting information including the element classification information. The image processing apparatus according to claim 1, wherein the setting information storage unit stores setting information applied in color adjustment processing for each image data in association with an attribute of each image data. At least one setting information based on the attribute of the image data to be processed from the database that stores the setting information including the adjustment content specifying information for specifying the content of the color adjustment process in association with the attribute of the image data Select
Based on the selected setting information, create area specifying information for specifying an image area to be subjected to color adjustment, and setting information including adjustment content specifying information,
An image processing method for performing color adjustment in accordance with an image area on image data to be processed based on created setting information. In an image processing apparatus including a computer,
At least one setting information based on the attribute of the image data to be processed from the database that stores the setting information including the adjustment content specifying information for specifying the content of the color adjustment process in association with the attribute of the image data A step of selecting
Creating area setting information for specifying an image area to be subjected to color adjustment based on the selected setting information, and setting information including adjustment content specifying information;
A program for causing a computer of the image processing apparatus to execute a step of performing color adjustment according to an image area on image data to be processed based on the created setting information.

Images