JP2021062603A - Image processing apparatus, method of controlling image processing apparatus, and program - Google Patents

Abstract

To appropriately perform color matching processing.SOLUTION: An image processing apparatus that performs color matching processing adapted to color reproducibility of a target device comprises: printing means for performing printing; reading means capable of reading a first color characteristic chart printed by the target device and a second color characteristic chart printed by the printing means; and processing means for performing the color matching processing based on first scan image data obtained by reading the first color characteristic chart by the reading means and second scan image data obtained by reading the second color characteristic chart by the reading means.SELECTED DRAWING: Figure 2

Description

The present invention relates to an image processing technique for matching colors.

There is a technique for matching the color reproducibility of the first image processing device (referred to as the adjustment target device) with the color reproducibility of the second image processing device (referred to as the target device) different from the first image processing device.

In the color matching process of Patent Document 1, the target device prints a color characteristic chart using special paper having an opening. On the other hand, the adjustment target device prints the color characteristic chart on paper having no openings. Then, by placing the color characteristic chart printed by the target device on the color characteristic chart printed by the adjustment target device, the difference in color characteristics between the adjustment target device and the target device can be confirmed for each patch through the opening. Is possible. Patent Document 1 discloses a technique in which the color values of the device to be adjusted and the target device are measured for each patch, and the color matching process is performed from the difference between the measured color values.

International Publication No. 2005/036869

In Patent Document 1, it is necessary to print using a special paper having an opening when color matching is performed. Here, when the characteristics of the whiteness of the special paper are different from the characteristics of the whiteness of the paper used by the user, the color printed by the patch may be different from the color desired by the user. Therefore, even if the color matching process is performed, the color characteristics are not desired by the user, and the color matching process may not be performed properly.

The image processing device according to one aspect of the present invention is an image processing device that performs color matching processing according to the color reproduction characteristics of the target device, and is a printing means for printing and a first color printed by the target device. A reading means capable of reading the characteristic chart and the second color characteristic chart printed by the printing means, and first scan image data obtained by reading the first color characteristic chart by the reading means. It is characterized by having a processing means for performing the color matching process based on the second scan image data obtained by reading the second color characteristic chart by the reading means.

According to the present invention, the color matching process can be appropriately performed.

A block diagram showing an example of a system configuration. The figure which shows the whole sequence of a color matching process. The figure which shows the example of the screen of a web browser. The figure which shows the example of the image data of the color characteristic chart printed on the paper. The figure which shows the example of the initial screen displayed on the display of the device to be adjusted. The figure which shows the example of the UI displayed in the adjustment target device. The figure which shows the example of the change of the UI of a printer driver. The figure which shows the example of the change of the UI in the adjustment target device. A flowchart showing an example of color matching processing. The figure which shows the example of the flowchart which shows the detail of the patch signal value acquisition processing. The figure which shows an example of the notification method to a user. The flowchart which shows the detail of the patch area derivation process. The figure which shows the end coordinate of a color characteristic chart and the example which derives the 1st derivative signal value. A flowchart showing the details of the analysis process of the shrinking factor. A flowchart showing the details of the analysis process of the expansion factor. The flowchart which shows the process of acquiring the RGB value of each patch of the adjustment target device. The figure which shows the whole sequence of a color matching process. The figure which shows the example of the UI displayed in the adjustment target device. A flowchart showing a color matching process. The figure which shows the whole sequence of a color matching process. The figure which shows the whole sequence of a color matching process. The figure which shows the example of the UI displayed on the target device. The figure which shows the whole sequence of a color matching process. The figure which shows the example of the UI displayed in the adjustment target device. The figure which shows the example of the UI for setting the notification method to notify a user.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. However, the components described in this embodiment are merely examples, and are not intended to limit the scope of the present invention to them.

<< First Embodiment >>
In this embodiment, an example of matching the color reproducibility in the first image processing device with the color reproducibility in the second image processing device will be described. For example, when replacing an image processing device from an old model whose durability has expired to a new model, or when purchasing an additional new image processing device due to changes in the office scale, processing is performed to match the color reproducibility. .. At the time of such replacement or additional purchase, there is a user need to inherit the color of the image processing device before replacement or the image processing device owned by the new image processing device to the new image processing device. That is, the user can make sure that the color reproduced by the new first image processing device (also referred to as the adjustment target device) is the same as the color reproduced by the second image processing device (also referred to as the target device) before replacement. I have a request.

In order to express the color expressed by the target device requested by the user on the adjustment target device, it is required to correctly measure the color reproduction characteristics currently expressed by the target device. The color reproduction characteristic currently expressed by the target device is the color characteristic expressed by printing on the target device after including the contents set at the time of printing regarding color such as density adjustment. In the present embodiment, the color reproduction characteristics of the device to be adjusted and the color reproduction characteristics of the target device are measured. Then, a process of creating a Look Up Table (hereinafter referred to as LUT) is performed so that the input value input to the adjustment target device is converted into the output value reproduced by the target device. Hereinafter, the process of creating this LUT is referred to as a color matching process. Then, by applying the conversion LUT created by the color matching process to the Color Management System (hereinafter referred to as CMS), the device to be adjusted can reproduce the color of the target device.

In the present embodiment, the color matching process is realized by using the scanner mounted on the image processing device. For example, a color characteristic chart is printed on the target device to confirm the color reproduction characteristics of the target device. The color characteristic chart is also printed on the device to be adjusted. Then, the scanned image data of each printed color characteristic chart is acquired by using the scanner of the device to be adjusted. Then, in the acquired scanned image, an image region having the same color value is detected in a rectangular region called a patch, and a process of adjusting the color reproduction characteristic is performed based on the signal value in the region. Details will be described later.

Further, for example, when the color characteristic chart is printed in 2in1 corresponding to the page layout change on the target device, the entire chart is reduced to 67% or less. As a result, the originally desired patch reading area cannot be secured, and an accurate signal value may not be obtained. In addition to changing the page layout, for example, when printing with settings such as "Print to fit paper", the size of the chart is different from the originally desired size, so the deformed chart is printed. It may be done. When such a deformed chart is printed on the target device, the color matching process is not performed properly due to the inability to obtain accurate signal values. Therefore, the color matching process is stopped. In the present embodiment, an example of notifying the user of the cause of stopping the color matching process and the corresponding response when the color matching process is not properly performed will also be described.

<System configuration>
FIG. 1 is a block diagram showing an example of a system configuration according to the present embodiment. The system of this embodiment includes an image processing device 100 (hereinafter referred to as an adjustment target device 100) and an image processing device 150 (hereinafter referred to as a target device 150). Then, a process is performed to match the color reproduction characteristics of the adjustment target device 100 with the color reproduction characteristics of the target device 150. Although FIG. 1 shows an example in which the adjustment target device 100 and the target device 150 are connected via the network 101, they may not be connected to the network.

First, the configuration of the adjustment target device 100, which is an image processing device, will be described. The adjustment target device 100 includes a device control unit 102, an image output unit 110, a user interface 104, an image reading unit 108, a display 109, a paper feeding unit 112, and a paper ejection unit 113. The device control unit 102 includes an image processing unit 103, a CPU 105, a RAM 106, and a storage unit 107. The image output unit 110 includes a CPU 111 and a RAM 114. In this embodiment, the user interface is referred to as a UI.

The UI 104 is composed of, for example, a keyboard, a mouse, or other input / output device, and various setting values or specified values can be input.

The device control unit 102 is composed of a controller board, and each device of the CPU 105, the RAM 106, the storage unit 107, and the image processing unit 103 is mounted on the device control unit 102. The CPU 105 reads the main program from the storage unit 107 and stores it in the RAM 106 according to the initial program in the storage unit 107. The RAM 106 is used as a main memory for storing a program or for a work. The CPU 105 controls the device control unit 102 according to the main program stored in the RAM 106.

The image processing unit 103 is composed of an ASIC that processes image data, and performs image processing on the print data transmitted from the printer driver of the PC via the network 101 or the image data acquired by the image reading unit 108. .. The details of the image processing unit 103 will be described later.

The image reading unit 108 irradiates a bundled or single original image with a light source (not shown), and forms a reflected image of the original on a solid-state image sensor such as a CCD (Charge Coupled Device) sensor with a lens. Then, the image reading signal obtained from the solid-state image sensor is obtained as image data. The adjustment target device 100 is also provided with an auto document feeder (hereinafter referred to as ADF) (hereinafter referred to as ADF) for collectively acquiring image data when the original is on a plurality of pages.

The storage unit 107 stores the image data processed by the image processing unit 103, the print data transmitted from the printer driver of the PC, and the like. The display 109 displays various UI screens.

The image output unit 110 is connected to the device control unit 102, and the image data processed by the image processing unit 103 can be converted into cyan, magenta, yellow, black (hereinafter referred to as C, M, Y, K) or the like. This is a printer unit that forms output data on paper using colored toner. The image output unit 110 is print-controlled by the device control unit 102. The image output unit 110 is composed of a controller board, and each device of the CPU 111 and the RAM 114 is mounted on the image output unit 110. The image output unit 110 is controlled by the CPU 111 and is connected to a paper feed unit 112 that feeds paper and a paper discharge unit 113 that discharges paper on which output data is formed.

The target device 150 includes a device control unit 152, an image output unit 160, a UI 154, an image reading unit 158, a display 159, a paper feeding unit 162, and a paper ejection unit 163. The device control unit 152 includes an image processing unit 153, a CPU 155, a RAM 156, and a storage unit 157. The image output unit 160 has a CPU 161 and a RAM 164. Since each configuration of the target device is the same as that of the device 100 to be adjusted, the description thereof will be omitted.

The image processing device of the adjustment target device 100 and the target device 150 described above is an example, and is not limited to this example. Further, some functions of these image processing devices may be executed by the external processing device 120 by communicating with each other via a network.

The external processing device 120 may be mounted on a computer device such as a server, or may be mounted on a cloud server on the Internet. The external processing device 120 has a device control unit 121, and the device control unit 121 has a CPU 123, a RAM 124, and a storage unit 125. Since each of these configurations is the same as that of the device 100 to be adjusted, the description thereof will be omitted. Further, if necessary, other configurations may be provided.

The PC 130 is an information processing device used by the user, and has a CPU 131, a RAM 132, a storage unit 133, and a printer driver 134. The PC 130 can communicate with the adjustment target device 100, the target device 150, and the Web server 140 via the network 101.

The CPU 131 reads the main program from the storage unit 133 and stores it in the RAM 132 according to the initial program in the storage unit 133. The RAM 132 is used as a main memory for storing a program or for a work. The CPU 131 controls the application or printer driver 134 used by the user according to the main program.

The printer driver 134 transmits the image data developed by the application used by the user and the print settings set by the user at the time of printing to the adjustment target device 100 or the target device 150 as print data.

The Web server 140 includes a CPU 141, a RAM 142, and a storage unit 143, and is a server that transmits data corresponding to information requested from a web browser of a PC 130 on the client side via a network 101.

The CPU 141 reads the main program from the storage unit 143 and stores it in the RAM 142 according to the initial program in the storage unit 143. The RAM 142 is used as a main memory for storing a program or for a work. The CPU 141 interprets the request from the PC 130 used by the user according to the main program, confirms the information corresponding to the request, and controls to respond to the PC 130.

When the Web server 140 is requested to download a file such as image data in the information requested from the web browser, the Web server 140 can communicate with the DB server 170 described later to acquire the file.

The DB server 170 has a storage unit 173 and is a server that communicates with the Web server 140 via a network. When there is a request for downloading an image file from the Web server 140, the DB server 170 can transmit the corresponding file stored in advance in the storage unit 173 to the Web server 140.

<Color matching process>
FIG. 2 is a diagram showing an entire sequence of color matching processing in the present embodiment. Using FIG. 2, the user acquires a color characteristic chart using the PC 130, prints the acquired color characteristic chart on the target device 150, and performs color matching processing on the adjustment target device 100 using the printed color characteristic chart. The sequence to be performed will be described.

Each process of FIG. 2 is executed in each device in response to the operation of the PC 130, the target device 150, and the adjustment target device 100 by the user 201. The processing of the PC 130 is executed by the CPU 131 after the program code stored in the storage unit 133 is expanded into the RAM 132. The processing of the adjustment target device 100 is executed by expanding the program code stored in the storage unit 107 into the RAM 106 and controlling the device control unit 102 by the CPU 105. The processing of the target device 150 is executed by expanding the program code stored in the storage unit 157 into the RAM 156 and controlling the device control unit 152 by the CPU 155. Further, in the overall sequence diagram, for convenience of explanation, the operation by the user 201 is also included in the process (step sequence (SQ)) (hereinafter, the same applies to the various sequence diagrams in the present specification).

First, in SQ210, the PC 130 is operated by the user 201 to acquire a color characteristic chart. Then, in SQ211 the PC 130 requests the Web server 140 to request the image data of the corresponding color characteristic chart. The operation of acquiring the image data of the color characteristic chart by the user in the present embodiment is performed via the web browser as shown in FIG.

FIG. 3 is a diagram showing an example of a screen of the web browser 300 started by the PC 130. The web browser 300 displays a page for downloading the color characteristic chart to the PC 130. This page is a page held by the Web server 140. In the screen of FIG. 3, a product information web page for the adjustment target device 100 is shown, and the page is displayed so that the color characteristic chart can be downloaded. Labels 301 and 302 are UI components that are pressed by the user 201 when downloading the image data of the color characteristic chart. The Web server 140 requests the DB server 170 for the printer driver or the color characteristic chart data corresponding to each label. The web browser 300 in the present embodiment is configured as shown in FIG. 3, but the screen configuration may be changed depending on the type of display device or web browser. Further, the image data of the color characteristic chart in this embodiment is TIFF (Tagged Image File Format) or PDF (Portable Image Format). However, processing may be performed using an image data format other than TIFF and PDF. The image data of the color characteristic chart in this embodiment is multi-valued image data of red, green, and blue (hereinafter referred to as R, G, and B).

FIG. 4 is a diagram showing an example of image data 400 of a color characteristic chart printed on paper for confirming the color characteristics in the present embodiment. As shown in FIG. 4, the image data 400 of the color characteristic chart is image data having a configuration in which the number of images in a rectangular region called a patch is arranged in M rows and N columns. A patch is an image having the same RGB value in a rectangular area. It is assumed that the signal value of the patch of the color characteristic chart in the present embodiment is represented by the signal value sampled at equal intervals in the sRGB color space, which is one of the color spaces independent of the color space of the device. It is assumed that the image data of the color characteristic chart in this embodiment is stored as a file in the image data format. As a result, the image data of the color characteristic chart can be printed by the application (not shown) used by the user and the printer driver 134 of the PC 130, and the color setting to be inherited by the user's adjustment target device can be used. .. The image data in the present embodiment is TIFF, but any file in the image data format that can be read by the application used by the user may be used.

This color characteristic chart will be printed by the target device 150 and scanned by the adjustment target device 100, as will be described later. That is, the color characteristic chart is obtained by printing and outputting the image data 400 of the patch represented by the signal values sampled at equal intervals in the sRGB color space by the target device 150. In this color characteristic chart, the target device 150 performs color conversion processing on the image data of the color characteristic chart using the color setting desired to be expressed by the user, and the image output unit 160 of the target device 150 uses the image data after the color conversion. It was printed in. The color setting to be expressed in this embodiment is a setting related to color such as a setting of a color profile matching method that determines the color reproduction characteristic of the device at the time of driver output, but if it is a setting that can adjust the color. It can be anything. The sRGB color space is an international standard for color spaces established by the IEC (International Electrotechnical Commission), and is a color space defined to ensure color reproducibility between different environments such as input / output devices. Is. The color characteristic chart printed by the target device 150 is scanned using the image data that has undergone the color conversion process using the color settings used in the target device 150 in this way, and the color matching is performed using the scanned image data. Processing will be performed. Details will be described later.

The above-mentioned "signal value sampled at equal intervals in the sRGB color space" in the present embodiment is a signal value in which each of R, G, and B is represented by 8 bits and the interval between signal values is 32. ..

Returning to the description of the sequence of FIG. Next, in SQ212, the Web server 140 requests the image data of the corresponding color characteristic chart from the DB server 170. Next, in SQ213, the DB server 170 acquires the image data of the color characteristic chart requested in SQ212 from the storage unit 173. Next, in SQ214, the DB server 170 transmits the image data of the color characteristic chart acquired in SQ213 to the Web server 140.

Next, in SQ215, the Web server 140 transmits the image data of the color characteristic chart transmitted from the DB server 170 in SQ214 to the PC 130.

Next, in SQ216, when the reception of the image data of the color characteristic chart from the Web server 140 in SQ215 is completed, the PC 130 notifies the user 201 of the completion of acquisition of the image data of the color characteristic chart via the Web browser. The method of notifying the user of the completion of acquisition in the present embodiment is a pop-up display, but any method can be used as long as it can notify the user.

Next, in the SQ 220, the PC 130 receives the operation of the print instruction of the image data of the color characteristic chart acquired in the SQ 216 from the user 201. Then, in SQ221, the PC 130 develops the image data of the color characteristic chart by the corresponding application.

Next, in SQ222, the PC 130 sends a print instruction including image data of the color characteristic chart developed in SQ221 and setting information regarding colors that can be set by the printer driver 134 to the target device 150 via the printer driver 134. Send. The setting information that can be set by the printer driver 134 in this embodiment is print settings related to color processing such as density adjustment or color mode. Here, it is assumed that the print settings related to the color processing that the user usually uses when printing with the target device 150 are reflected.

Next, in SQ223, the target device 150 performs color conversion processing on the image data of the color characteristic chart received in SQ222 according to the color setting information received from PC 130 in SQ222, and the image output unit 160 performs color characteristics. Print the chart. Next, in SQ224, the target device 150 notifies the PC 130 that the printing of the color characteristic chart is completed in SQ223.

Next, in SQ225, when the PC 130 receives the print completion notification from the target device 150 in SQ224, the PC 130 notifies the user 201 of the print completion via the application.

The application and printer driver that develops the image data of the color characteristic chart in the present embodiment are the application and printer driver 134 that the user is using when printing on the target device 150. By executing SQ220 to SQ223, it becomes possible to print the tint currently expressed by the target device 150 on the color characteristic chart.

Next, in the SQ 230, the adjustment target device 100 receives an operation of an execution instruction of the color matching process from the user 201. FIG. 5 is a diagram showing an example of an initial screen displayed on the display 109 of the device 100 to be adjusted. The execution instruction of the color matching process by the user 201 is input to the adjustment target device 100 through the UI 500 shown in FIG.

In the UI 500 of FIG. 5, the buttons 501 to 506 are buttons that are pressed when each function of the adjustment target device 100, which is an MPF, is executed by the user. The function corresponding to the pressed button is executed according to the program. In this example, the timing for executing the color matching process is when the button 506 is pressed by the user. In the present embodiment, the execution instruction of the function of each image processing device is given in the form of a button, but each function may be displayed in a list structure.

Next, in SQ231, the adjustment target device 100 scans the color characteristic chart printed by the target device 150 in SQ223 using an ADF (not shown) provided in the image reading unit 108.

FIG. 6 shows an example of the UI displayed on the adjustment target device 100. FIG. 6A shows the UI 600 displayed on the display 109 when the button 506 is pressed by the user. The UI 600 shows an example of instructing the user 201 to have the color characteristic chart printed by the target device 150 placed on the ADF provided in the image reading unit 108. The button 601 is a button pressed by the user after the printed color characteristic chart is placed on the ADF provided in the image reading unit 108. When the button 601 is pressed by the user, the adjustment target device 100 issues an execution command for scanning processing to the image reading unit 108. When the button 601 is pressed by the user while the printed color characteristic chart is not placed on the ADF provided in the image reading unit 108, the adjustment target device 100 instructs the image reading unit 108 to execute the scanning process. It may be configured not to. Button 602 is a button pressed by the user when the scanning process of SQ231 is stopped. When the button 602 is pressed by the user, the adjustment target device 100 stops performing the color matching process and transitions to the initial screen of the UI 500 of FIG.

Next, in SQ232, the adjustment target device 100 prints on the image output unit 110 using the image data of the color characteristic chart stored in advance. The details of printing will be described later, but by printing the image data of the print characteristic chart on the adjustment target device 100 with SQ232, it is possible to confirm the color characteristics of the adjustment target device 100.

FIG. 6B shows an example of the UI 610 for instructing the user 201 to set the paper in the paper feed stage in order to print the image data of the color characteristic chart. The UI 610 of FIG. 6 shows the UI 610 instructing printing in SQ232. In the UI 610, the button 611 is a button pressed by the user when printing the image data of the color characteristic chart using the paper set in the paper feed unit 112. When the button 611 is pressed by the user, the adjustment target device 100 issues a print processing execution command to the image output unit 110 using the paper set in the paper feed unit 112. When the button 611 is pressed by the user when printable paper is not loaded in any of the paper feed stages (not shown) of the paper feed unit 112, the adjustment target device 100 prints on the image output unit 110. It may be configured not to instruct execution. Button 612 is a button pressed by the user when the printing process of SQ232 is stopped. When the button 612 is pressed by the user, the adjustment target device 100 stops the printing process, returns to SQ231, and transitions to the UI600 screen. When the button 612 is pressed, the color matching process may be stopped and the screen may change to the initial screen of the UI 500 shown in FIG.

The text 613 in the UI 610 is a text that displays the setting of the paper feed stage of the paper feed unit 112 used when printing the image data of the color characteristic chart. The printable paper size in this embodiment is A4 or A3, and the text 613 indicates a paper feed stage in which printable paper is set. When there are a plurality of paper feed stages in which printable paper is loaded, the initial value is set to the uppermost paper feed stage. If no printable paper is loaded in any of the paper feed stages, "None" is displayed. The button 614 is a button pressed by the user 201 when changing the paper feed stage displayed in the text 613. When the user presses the button 614, the UI transitions to a UI that allows the user to select a paper feed stage from among the paper feed stages in which printable paper is loaded, and it is possible to change the paper feed stage used for printing. Become.

Next, in SQ233, the adjustment target device 100 scans the color characteristic chart printed by the adjustment target device 100 in SQ232 using the image reading unit 108. FIG. 6C shows an example of the UI 620 for instructing the user 201 to place the color characteristic chart printed by the adjustment target device 100 on the ADF provided in the image reading unit 108. The UI 620 of FIG. 6 (c) shows a UI for instructing a scan in SQ233. The button 621 is a button pressed by the user after placing the printed color characteristic chart on the ADF provided in the image reading unit 108. When the button 621 is pressed by the user, the adjustment target device 100 issues an execution command for scanning processing to the image reading unit 108. When the button 621 is pressed by the user when the printed color characteristic chart is not placed on the ADF, the adjustment target device 100 is configured not to instruct the image reading unit 108 to execute the scanning process. Good. Button 622 is a button pressed by the user when the scanning process of SQ233 is stopped. When the button 622 is pressed by the user, the adjustment target device 100 stops performing the color matching process and transitions to the initial screen of the UI 500 of FIG.

Next, in SQ234, the adjustment target device 100 executes a color matching process for the adjustment target device 100 to express the color characteristics of the target device 150 by using the color characteristic charts scanned in SQ231 and SQ233. In the present embodiment, the color matching process of SQ234 creates a conversion look-up table (LUT) as color adjustment information for the adjustment target device 100 to express colors in the same color as the target device 150. In the present embodiment, the conversion LUT created by the color matching process of SQ234 is referred to as a color adjustment LUT. The color adjustment LUT is composed of a table showing the relationship between the input values sampled at equal intervals in the sRGB color space and the output values in the RGB color space depending on the adjustment target device corresponding to each input value. There is. The RGB color space depending on the device to be adjusted in the present embodiment is referred to as a devRGB color space. The color adjustment LUT shall be stored in a format applicable to the CMS. Details regarding the color matching process of SQ234 will be described later.

In the present embodiment, the name of the color adjustment LUT created by the color matching process of SQ234 can be set by the user. FIG. 6D shows the UI of the device 100 to be adjusted, and shows an example of the UI for instructing the input of the name of the setting at the time of saving. The UI 650 of FIG. 6 (d) is a UI displayed when the processing of SQ234 is completed. In the UI 650, the text box 651 is a text box for inputting and displaying a name for storing the created color adjustment LUT. When the text box 651 is pressed by the user 201, the screen transitions to a UI screen (not shown) for inputting the name of the created color adjustment LUT. The name input method in the present embodiment is a method in which a software keyboard is displayed on the UI for input, but the name may be input using an external input device.

Button 652 is a button pressed by the user after the user 201 completes the input of the name at the time of saving. When the button 652 is pressed by the user, the adjustment target device 100 saves the created color adjustment LUT according to the setting name described in the text box 651. Button 653 is a button pressed by the user when the color matching process of SQ234 is stopped. When the button 653 is pressed by the user, the adjustment target device 100 stops performing the color matching process and transitions to the initial screen of the UI 500 of FIG.

Next, upon receiving the notification of the completion of the color matching process in SQ234, the adjustment target device 100 notifies the user 201 of the completion of the color matching process using the display 109 in SQ235.

The above is the description of the overall flow of the color matching process by the adjustment target device 100 in the present embodiment. As a result, a color adjustment LUT expressing the color characteristics of the target device 150 is created, and the color characteristics of the target device 150 can be reproduced by the adjustment target device 100.

FIG. 7 is a diagram showing an example of changes in the UI of the printer driver 134 of the PC 130 before and after the color matching process in the present embodiment. The UI 701 of FIG. 7A is an entire UI for setting print quality related to print quality by the printer driver 134, and is before the color matching process. On the other hand, the UI 711 of FIG. 7B is an entire UI for setting print quality related to the printer driver 134, and is after the color matching process. It is assumed that the UI 711 after the color matching process of the present embodiment has the latest information on the print settings acquired by the printer driver 134 from the device to be adjusted. Note that there is a method in which the printer driver 134 acquires the latest setting information after the user 201 receives an instruction for the printer driver 134 to acquire the latest setting information, but the present invention is not limited to this. The latest setting information of the device 100 to be adjusted, such as a method acquired by the printer driver 134 each time the printer driver 134 is used, or a method acquired after a predetermined period has passed, without relying on the user's instruction. Any method can be used as long as it can be obtained.

The list box 702 and the list box 712 are list boxes for setting the printing purpose, and are for collectively setting related print items corresponding to the items selected for the printing purpose.

The list box 703 and the list box 713 are list boxes for setting the color mode at the time of printing, and the image processing in the printer driver and the image processing device is switched according to the set color mode. When selected by the user, setting items (not shown) are expanded and each setting item can be selected.

The list box 704 and the list box 714 are list boxes for setting a color adjustment LUT or a color profile to be applied by the CMS at the time of printing. Then, the color adjustment LUT or the color profile applied at the time of color conversion by the CMS is switched according to the set matching method. When the color matching process is performed in SQ234, the saved name is displayed as in the list box 714 and can be selected. When "Panel priority" is selected, the item selected in the adjustment target device 100 described later is applied.

Buttons 705 and 715 are buttons that are pressed when the setting regarding the print setting of the printer driver 134 is completed and the user instructs the print process on the adjustment target device 100. When the button 705 and the button 715 are pressed by the user, the display of the UI 701 and the UI 711 ends. Then, the adjustment target device 100 applies the setting items related to each printing and executes a process for printing. Buttons 706 and 716 are buttons that are pressed by the user when printing of the adjustment target device 100 is stopped. When the button 706 and the button 716 are pressed by the user, the display of the UI 701 and the UI 711 ends.

Regarding the list box 702 and the list box 712, and the list box 704 and the list box 714, the setting items applied at the time of printing in the present embodiment are assumed to have a gray background color (indicated by hatching). .. Further, regarding the list box 703 and the list box 713, the setting items applied at the time of printing in the present embodiment are the items that have been set by the user and are displayed in the closed state.

FIG. 8 is a diagram showing an example of changes in the UI for setting a profile applied to the CMS in the adjustment target device 100 before and after the color matching process in the present embodiment. The UI 801 of FIG. 8A is the entire UI for setting the color adjustment LUT or the color profile applied to the CMS in the adjustment target device 100, and is the one before the color matching process. On the other hand, the UI 811 of FIG. 8B is an entire UI for setting the color adjustment LUT or the color profile applied to the CMS in the adjustment target device 100, and is after the color matching process. UI801 and UI811 are UIs displayed on the display 109 when the user is instructed to set a color adjustment LUT or a color profile to be applied to the CMS in the adjustment target device 100.

The list box 802 and the list box 812 are list boxes for setting a profile to be applied by the CMS at the time of printing. Then, the color adjustment LUT or the color profile applied at the time of color conversion by the CMS is switched according to the matching method set in the list box. When the color matching process is performed by SQ234, the saved name is displayed and can be selected as in the list box 714 of the printer driver 134.

Regarding the list box 802 and the list box 812, it is assumed that the background color of the setting items applied at the time of printing in the present embodiment is gray (hatching).

Buttons 803 and 814 are buttons that are pressed when the setting of the color adjustment LUT or the color profile applied to the CMS is completed and the item set by the user is applied. When the button 803 and the button 814 are pressed by the user, the display of the UI 801 and the UI 811 ends, and the setting items related to each printing are applied to the adjustment target device 100.

Buttons 804 and 814 are buttons pressed by the user when canceling a color adjustment LUT or color profile setting applied to the CMS. When the button 804 and the button 814 are pressed by the user, the display of the UI 801 and the UI 811 ends, and the items before the setting are applied.

<Flowchart of color matching process of adjustment target device>
FIG. 9 is a flowchart showing an example of the color matching process in the adjustment target device 100 of the present embodiment. FIG. 9 is a flow chart showing the entire color matching process executed when the user instructs the color matching process to be the process in the adjustment target device 100. The process according to the flowchart shown in FIG. 9 is executed by expanding the program code stored in the storage unit 107 into the RAM 106 and controlling the device control unit 102 by the CPU 105. The data created during the processing shall be temporarily stored in the storage unit 107. In addition, the symbol "S" in the description of each process means that it is a step in the flowchart (hereinafter, the same applies in the present specification).

In S901, the device control unit 102 scans the color characteristic chart printed by the image output unit 160 of the target device 150 by the image reading unit 108, and acquires the scanned image data. That is, the image reading unit 108 of the adjustment target device 100 scans the color characteristic chart printed by the target device 150. The scanned image data in this embodiment is RGB multi-valued image data. The process of S901 is the same as the process performed in SQ231 of FIG. That is, the adjustment target device 100 scans the color characteristic chart printed and output by the target device 150 using the image data 400 of the color characteristic chart as shown in FIG. That is, the color characteristic chart is obtained by printing and outputting the image data of the patch represented by the signal values sampled at equal intervals in the sRGB color space by the target device 150. That is, in this color characteristic chart, the target device 150 performs color conversion processing on the image data of the color characteristic chart using the color setting desired to be expressed by the user, and outputs the image of the target device 150 using the image data after the color conversion. It is printed in part 160.

Next, in S902, the device control unit 102 performs a process of acquiring the RGB values of each patch in the color characteristic chart using the scanned image data acquired in S901. Details of the patch signal value acquisition process of the color characteristic chart of S902 will be described later. In S902, not only the process of acquiring the RGB values of each patch but also the color matching process is stopped due to the fact that the chart deformed by the target device 150 is printed (S911 described later). The factor is analyzed and the process of notifying the user is performed. Details will be described later.

Next, in S903, the device control unit 102 determines whether the patch signal value acquisition process of the color characteristic chart of the target device performed in S902 has been completed as usual. If the patch signal value acquisition process is completed normally in S903, the process proceeds to S904, and if not, the process proceeds to S911.

In S904, the device control unit 102 prints the image data of the color characteristic chart held in advance by using the image output unit 110 of the adjustment target device 100. The image data of the color characteristic chart used for printing in S904 may be the same as the image data of the color characteristic chart which is the source of the scanned image data of the target device acquired in S901, or may be different color characteristic chart data. .. In any case, the signal value of the patch in the image data of the color characteristic chart of the device to be adjusted is also a signal value sampled at equal intervals in the sRGB color space, which is one of the color spaces independent of the color space of the device. It shall be expressed.

The purpose of printing the color characteristic chart in S904 is to measure the color reproduction characteristic of the image output unit 110 of the device to be adjusted. Therefore, in S904, printing is performed based on the RGB values of each patch of the image data of the color characteristic chart without performing the color conversion processing by CMS. Since printing is performed based on the RGB values of each patch in the image data of the color characteristic chart without performing color conversion by CMS, the printed state is in the devRGB color space depending on the device to be adjusted. In the present embodiment, the printing of the image data of the color characteristic chart using the image output unit 110 of the device 100 to be adjusted, which is performed in S904, is performed according to a predetermined print setting. That is, it is assumed that the page layout setting or the print setting such as the variable magnification is fixedly performed with a given setting. The process of S904 is the same as the process performed in SQ232 of FIG.

If the patch signal value acquisition process is not completed normally in S903, the device control unit 102 cancels the color matching process in S911. When the patch signal value acquisition process is not completed normally in S903, the user is notified of the factor analysis result in the process of S902 before that, as will be described later. The process of notifying the user of the factor analysis result and the process of canceling the color matching process may be performed first, or both may be performed in parallel.

In S905, the device control unit 102 causes the image reading unit 108 to scan the color characteristic chart printed by the image output unit 110 of the device 100 to be adjusted in S904, and acquires the scanned image data. The process of S905 is the same as the process performed in SQ233 of FIG.

In S906, the device control unit 102 performs a process of acquiring the RGB values of each patch in the color characteristic chart by using the scanned image data of the adjustment target device 100 acquired in S905. The details of the patch signal value acquisition process of the color characteristic chart of S906 will be described later, but not only the RGB value of the patch is acquired, but also the color characteristic chart printed by the adjustment target device is correctly scanned and the process ends normally. You will be notified if you have done so.

In S907, the device control unit 102 determines whether the patch signal value acquisition process of the color characteristic chart of the adjustment target device performed in S906 has been completed as usual. If it is determined in S907 that the patch signal value acquisition process has not been completed as usual, the process returns to S905. If it is completed as usual, the process proceeds to S908. In the present embodiment, even if the patch signal value acquisition process of the color characteristic chart of the device to be adjusted is not completed normally, the color characteristic chart already printed in S904 is reprinted without printing again. The color matching process can be restarted by scanning. Unlike the example of the target device 150 described later, in the printing process of the color characteristic chart in the adjustment target device 100 performed in S904, the page layout setting or the printing setting such as the variable magnification is fixedly performed with a given setting. Is. Further, as will be described later, in the process in S906, the user is notified to redo the scan. Therefore, it can be expected that the user will redo the scan again. Therefore, if the patch signal value acquisition process of the color characteristic chart of the device to be adjusted is not completed normally, the device control unit 102 returns to S905 and performs a process of acquiring scanned image data again.

Subsequent processing of S908 to S910 corresponds to the color matching processing performed in SQ234 of FIG. In S908, the device control unit 102 creates a LUT (second LUT described later) for converting the sRGB signal value, which is the source of the patch signal value, into an L * a * b * value in consideration of the characteristics of the target device 150. .. The device control unit 102 creates the second LUT using the color characteristic patch signal value of the target device 150 acquired in S902. The L * a * b * value is a value on the L * a * b * color space, which is one of the device-independent color spaces created by the CIE (Commission Internationale de l'Eclairage). The L * a * b * color space is a color space that is visually equal in consideration of human visual characteristics, and is a device-independent three-dimensional color space. The color characteristic patch signal value (RGB signal value) acquired in S902 is a value that reflects the color characteristic in the target device 150. By converting this color characteristic patch signal value (RGB signal value) into an L * a * b * value, an L * a * b * value considering the characteristics of the target device 150 can be obtained.

As a method of converting the RGB signal value to the L * a * b * value in the present embodiment, when the RGB signal value read by the image reading unit 108 of the adjustment target device is input, the L * corresponding to the input value is used. There is a method of using a LUT (called a first LUT) that outputs an a * b * value. The device control unit 102 holds the first LUT in advance, and performs color conversion by the holding first LUT. That is, the L * a * b * value corresponding to the color characteristic patch signal value (RGB value) printed by the target device 150 acquired in S902 is obtained by using the first LUT held in advance. As a result, it is possible to obtain a data group of L * a * b * values indicating the color reproduction characteristics of the target device 150 to be inherited. The L * a * b * value data group indicating the color reproduction characteristic of the target device 150 to be expressed corresponds to the output value in the second LUT described later.

Here, each patch of the image data of the color characteristic chart used for printing on the target device 150 is composed of "signal values sampled at equal intervals in the sRGB color space". That is, the input value (sRGB value) used when printing each patch of the color characteristic chart on the target device 150 is a known value. The device control unit 102 refers to the first LUT and obtains, for example, an L * a * b * value corresponding to the color characteristic patch signal value (RGB value) of the first patch. The device control unit 102 sets the obtained L * a * b * value as the first output value of the second LUT. On the other hand, the device control unit 102 sets the sRGB value of the image data used for printing the first patch to the first input value corresponding to the first output value in the second LUT. Such processing is performed for all patches. As a result, a LUT (second LUT) showing the relationship between the input value of the sRGB color space and the L * a * b * value obtained by converting the RGB value output by the target device according to the input value is created. Will be done.

Next, in S909, the device control unit 102 sets the color characteristic patch signal value (RGB signal value) of each patch of the adjustment target device acquired in S906 to L * a * b * in consideration of the characteristics of the adjustment target device. Create a LUT (third LUT) to convert to a value. As the method of converting the RGB signal value to the L * a * b * value in the present embodiment, a method of converting using the same LUT (first LUT) as in S908 can be used. As a result, it is possible to obtain a data group of L * a * b * values indicating the color reproduction characteristics of the adjustment target device when the color characteristic chart is printed using the adjustment target device.

As described above, the color characteristic chart of the device to be adjusted is printed without performing the color conversion process by CMS. Therefore, the color characteristic patch signal value of each patch of the adjustment target device acquired in S906 becomes a signal value in RGB space depending on the adjustment target device, that is, a devRGB value. By converting all patches of the color characteristic chart of the adjustment target device to L * a * b * values, the input value of the devRGB color space and the L * a * output by the adjustment target device corresponding to the input value. A LUT (third LUT) showing the relationship between the b * values is created.

Next, in S910, the device control unit 102 creates a color adjustment LUT (fourth LUT) which is a conversion LUT such that the adjustment target device is reproduced in the same color as the target device. The color adjustment LUT is composed of a table showing the relationship between the input values sampled at equal intervals on the sRGB color space and the output values of the devRGB color space depending on the adjustment target device corresponding to each input value.

The process of creating the color adjustment LUT of S910 in the present embodiment will be described. The color adjustment LUT is created by using the second LUT created in S908 and the third LUT created in S909. First, using the second LUT that converts the sRGB signal value into the L * a * b * value that reflects the color characteristics of the target device 150, the target that is output corresponding to the first RGB value that is the input point of the second LUT. A first L * a * b * value that reflects the color characteristics of the device 150 is derived.

Next, a process using a LUT (third LUT) that converts a devRGB signal value reflecting the color characteristics of the device to be adjusted into an L * a * b * value is performed. The device control unit 102 is the closest to the first L * a * b * value that reflects the color characteristics of the target device among the L * a * b * values output for all the input values in the third LUT. Find the L * a * b * value (second L * a * b * value) of the device to be adjusted. Next, the devRGB signal value (first devRGB value) of the input value when the second L * a * b * value of the closest adjustment target device found is output is specified from the third LUT. Then, when the first RGB value (sRGB value) of the second LUT is input, the color adjustment LUT (fourth LUT) is created so that the first devRGB value is output.

These processes are repeated for the number of inputs of the second LUT that converts the sRGB signal value created in S908 into the L * a * b * value that reflects the color characteristics of the target device. By repeating this process, a color adjustment LUT (fourth LUT) for converting the sRGB value, which is an input value of the target device, into the devRGB color space of the adjustment target device is created. Then, by using this color adjustment LUT (fourth LUT) in the CMS at the time of printing, the color reproduction characteristic of the adjustment target device can be approximated to the color reproduction characteristic of the target device.

The method of creating the color adjustment LUT in the present embodiment has been described above, but the method is not limited to this example, and the RGB signal values of the color characteristic charts of the target device and the adjustment target device are used to approximate the color reproduction characteristics of the target device. Any method can be used as long as it can be performed. The above is the description of the overall flow of the color matching process in the present embodiment.

<Color characteristic patch signal value acquisition process of target device>
FIG. 10 is a diagram showing an example of a flowchart showing details of the patch signal value acquisition process of the color characteristic chart of S902. The processing of FIG. 10 is performed by the image processing unit 103. Alternatively, the program code stored in the storage unit 107 may be expanded in the RAM 106 and executed by controlling the device control unit 102 by the CPU 105. The data created during the processing shall be temporarily stored in the storage unit 107.

In S1001, the device control unit 102 performs the patch area derivation process. First, the apparatus control unit 102 detects an area of the color characteristic chart from the scanned image data using the scanned image data acquired in S901, and determines the enlargement ratio or reduction ratio (hereinafter referred to as variable magnification) of the chart. Derived. Furthermore, the patch area is detected from the chart area, and the size and number of patches are derived. The details of these processes will be described later.

Next, in S1002, the device control unit 102 determines whether the number of patches derived in S1001 is equal to or greater than the number of predetermined threshold values. The predetermined threshold value of S1002 in the present embodiment is M × N, which is the number of patches in the image data of the color characteristic chart. If it is determined in S1002 that the number of derived patches is equal to or greater than the number of predetermined threshold values, the process proceeds to S1003, and if not, the process proceeds to S1004.

In S1003, the device control unit 102 derives a patch readable area (hereinafter, referred to as a patch reading area) from the patch size derived in S1001. The patch reading area in the present embodiment is a part of each area in which each patch is printed. The reading area of the patch of interest when the patch to be processed is the patch of interest will be described. The reading area of the patch of interest is an area excluding the area affected by scattered light or the like from the peripheral patches of the patch of interest. For example, in the area of the patch of interest, the remaining area excluding the area corresponding to 7 mm adjacent to the peripheral patch is defined as the reading area. However, not limited to this example, a reading region may be derived according to the characteristics of the image reading unit 108.

On the other hand, when it is determined in S1002 that the number of the derived patches is less than the number of the predetermined threshold value, in S1004, the device control unit 102 sets an expansion factor from the number of patches derived in S1001. Perform the process of analysis. If the number of patches is less than a given number, it is highly possible that the scanned image data acquired in S901 scanned the enlarged color characteristic chart. Therefore, in S1004, the expansion factor analysis process is performed. The details of the process for analyzing the expansion factor of S1004 will be described later, but if the number of derived patches is less than the predetermined threshold value, the color characteristic chart printed by the target device is enlarged, which is originally acquired. It is thought that the cause is that the number of patches is less than the number of patches you want. The cause is analyzed from the number of patches, and processing is performed to make it possible to notify the correct print settings corresponding to the analysis results. When the processing of S1004 is completed, the process proceeds to S1008.

In S1008, the device control unit 102 performs a process of notifying the user of the factor analysis result. In the process of S1008 performed after S1004, the user is notified of the print settings corresponding to the result of the analysis in the enlargement factor analysis process of S1004. Note that S1008 is also executed after the reduction factor analysis process of S1006 described later. When S1008 is executed after S1006, in S1008, the user is notified of the print setting corresponding to the result of analysis in the reduction factor analysis process of S1006.

FIG. 11 is a diagram showing an example of a notification method to the user executed in S1008. As a method of notifying the user, as shown in FIG. 11, a method of displaying by a UI using the display 109 can be mentioned. The UI 1101 of FIG. 11A is an example of a UI using the display 109. In UI1101, since the color characteristic chart printed by the target device 150 is deformed and printed, the wording to stop the color matching process is displayed in S911 of FIG. Further, the UI 1101 displays the enlargement factor corresponding to the content analyzed in S1004 and the correct print setting. The enlargement factor displayed on the UI 1101 of FIG. 11A includes an item of "print settings related to page layout". For example, it is assumed that the page layout is printed with settings that allow it to be enlarged (for example, poster settings). As described above, since the item of "print setting related to page layout" is assumed as an enlargement factor, a message prompting confirmation that the page layout setting is set to 1in1 is displayed as the correct print setting. Further, in this example, in the "print setting related to magnification", it is assumed that the print magnification setting is set to 100% or more and the print is enlarged and printed. Therefore, a message prompting the user to confirm the print magnification setting is also displayed on the UI 1101. The button 1102 is a button pressed by the user when the notification display of the UI 1101 is terminated.

The explanation will be continued by returning to FIG. When the patch reading area is derived in S1003, the process proceeds to S1005. In S1005, the device control unit 102 determines whether the patch reading area derived in S1003 is a region equal to or larger than a predetermined threshold value. The region of the predetermined threshold value of S1005 in the present embodiment is a region having a size that allows a stable value to be acquired when the signal value of the patch is acquired. For example, the region of the predetermined threshold value in the present embodiment is a region of 1 mm × 1 mm, but any value may be used as long as a stable value can be obtained. If it is determined in S1005 that the patch reading area is a region equal to or larger than a predetermined threshold value, the process proceeds to S1007, and if not, the process proceeds to S1006.

Proceeding to S1007 means that the number of patches is equal to or greater than the threshold value and the patch reading area has a size capable of acquiring a stable value. That is, the patch signal value can be appropriately acquired using the scanned image data acquired in S901. Therefore, in S1007, the device control unit 102 acquires the signal value of each patch from the scanned image data acquired in S901. At this time, the method for deriving the RGB value, which is the signal value of the patch, is derived from the average value of each RGB value in the patch reading area from each patch area detected in S1001. In the present embodiment, the method of deriving each RGB value of the patch from the average value in the region has been described, but any method may be used as long as each RGB value of the patch can be derived. After that, the process proceeds to S1009.

In S1009, the image processing unit 103 of the device control unit 102 ends the patch signal value acquisition process by notifying the CPU 105 that the patch signal value acquisition process of the color characteristic chart of S902 has ended normally.

When the readable area of the patch is determined in S1005 to be smaller than the predetermined threshold value, the device control unit 102 in S1006 reduces the patch based on the number of patches derived in S1001 and the scaling factor of the chart. Perform factor analysis processing. The details of the analysis process of the reduction factor of S1006 will be described later, but as a factor that makes the patch readable area smaller than the predetermined threshold value, there is a case where the print setting related to the page layout is set to 2in1. Can be mentioned. After that, the process proceeds to S1008, and as described above, the process of notifying the user of the factor analysis result is performed, and the patch signal value acquisition process is completed.

FIG. 11B is a diagram showing an example of notifying the result of the reduction factor analysis process. The UI 1103 of FIG. 11B is an example of a UI using the display 109. In UI1103, since the color characteristic chart printed by the target device is deformed and printed, the wording to stop the color matching process is displayed in S911 of FIG. Further, the UI 1103 displays the reduction factor corresponding to the content analyzed in S1005 and the correct print setting. The reduction factor displayed in UI 1103 of FIG. 11B includes the item of "print setting related to page layout". For example, it is assumed that the page layout is printed with a reduced display setting (for example, a 2in1 setting). As described above, since the item of "print setting related to page layout" is assumed as a reduction factor, a message prompting confirmation that the page layout setting is set to 1in1 is displayed as the correct print setting. Further, in this example, "print setting related to paper orientation" is also assumed as a reduction factor. If the print settings related to the paper orientation are different from the originally desired paper orientation, the pages will be printed in the same state as when the settings related to the page layout are 2in1, so the fact that they were printed in reduced size is also displayed as a reduction factor. There is. Therefore, the UI 1103 also displays a message prompting the confirmation of the "print setting regarding the paper orientation" as well as the page layout. Further, in this example, in the "print setting related to magnification", it is assumed that the print magnification setting is set to be smaller than 100% and the print is reduced and printed. Therefore, as with the page layout, a message prompting the user to confirm the print magnification setting is also displayed. The button 1104 is a button pressed by the user when the notification display of the UI 1103 is terminated.

In this way, when the color characteristic chart printed by the target device 150 is read by the adjustment target device 100 and there is a risk that the patch cannot be read properly, processing is performed as shown in S911 of FIG. Is canceled. At this time, if no notification is given, the user may not know why the color matching process was stopped or how the color matching process can be performed properly. .. In the present embodiment, by giving the notification as shown in FIG. 11, the user can grasp the coping method for performing an appropriate color matching process. Therefore, the user may print the color characteristic chart on the target device 150 again with appropriate print settings and have the adjusted device 100 read the printed color characteristic chart to perform an appropriate color matching process. It will be possible.

Next, the details of the patch area derivation process of the color characteristic chart of S1001 will be described. FIG. 12 is a flowchart showing details of the patch region derivation process of the color characteristic chart of S1001 of FIG. The processing according to the flowchart shown in FIG. 12 is performed by the image processing unit 103. Alternatively, the program code stored in the storage unit 107 may be expanded in the RAM 106 and executed by controlling the device control unit 102 by the CPU 105. The data created during the processing shall be temporarily stored in the storage unit 107.

In S1201, the device control unit 102 filters the scanned image data using the scanned image data acquired in S901. The filter processing is a filter processing using a smoothing filter that eliminates halftone dots composed of the color characteristic chart printed by the target device 150. By performing the filtering process, it is possible to confirm the difference between the RGB values between adjacent patches without being affected by the halftone dots.

In S1202, the apparatus control unit 102 detects the coordinates at the upper and lower ends of the color characteristic chart using the scanned image data filtered in S1201. Although the vertical end of the paper surface is described as an example here for convenience, it may be read as one end and the other end in a predetermined direction.

FIG. 13A is a diagram showing an example of detecting the coordinates of the upper and lower ends of the color characteristic chart. FIG. 13A has a configuration in which patches are arranged side by side, similar to the image data of the color characteristic chart shown in FIG. In FIG. 13A, the x-axis direction is defined as the left-right direction and the y-axis direction is defined as the vertical direction. In S1202, the device control unit 102 shall detect four of y1, y2, y3, and y4 in FIG. 13A as the coordinates of the upper and lower end portions. When detecting the coordinates of the upper and lower ends, the difference between the coordinates of interest and the coordinates in the vicinity thereof is derived for each RGB value so that edge detection is performed in the y-axis direction, and attention is paid when the value is equal to or greater than a predetermined value. A method of detecting the coordinates as one of the upper and lower coordinates can be mentioned.

In S1203, the device control unit 102 detects the coordinates at the left and right ends of the color characteristic chart using the scanned image data filtered in S1201. In S1203, the device control unit 102 detects the four coordinates x1, x2, x3, and x4 in FIG. 13A as the coordinates of the left and right ends. When detecting the coordinates of the left and right ends, the difference between the coordinates of interest and the coordinates in the vicinity thereof is derived for each RGB value so that edge detection is performed in the x-axis direction, and attention is paid when the value is equal to or greater than a predetermined value. A method of detecting that the coordinates are the coordinates of either the left or right end can be mentioned. The method for deriving the coordinates of the upper and lower end portions and the left and right end portions in the present embodiment is detected from the difference between the coordinates of interest and the coordinates in the vicinity thereof, but any method may be used as long as the end coordinates can be detected. Absent.

In S1204, the device control unit 102 derives the apex coordinates of the chart area by using the upper, lower, left, and right end coordinates derived in S1202 and S1203. In S1204, the device control unit 102 shall detect the four e1, e2, e3, and e4 in FIG. 13A as the coordinates of the vertices of the chart area of the color characteristic chart. When detecting the vertices of the chart area, the intersection coordinates of the straight line passing through y1 and y2 and the straight line passing through x1 and x2 are derived as e1 which is the vertex coordinates of the chart area. In the same manner, the coordinates of the intersection of the straight line passing through y3 and y4 and the straight line passing through x1 and x2 are derived as e2. The coordinates of the intersection of the straight line passing through y1 and y2 and the straight line passing through x3 and x4 are derived as e3. The coordinates of the intersection of the straight line passing through y3 and y4 and the straight line passing through x3 and x4 are derived as e4.

In S1205, the apparatus control unit 102 extracts the signal value in the y-axis direction, which is the vertical direction in the chart area, using the scanned image data filtered in S1201, and extracts the first-order differential signal value from the extracted signal. Derived.

FIG. 13B is a diagram showing an example of deriving the first derivative signal value in the present embodiment. FIG. 13B has the same configuration as the image data of the color characteristic chart of FIG. The x-axis direction is defined as the left-right direction, and the y-axis direction is defined as the vertical direction. The first-order differential signal derived in S1205 is a signal value derived by first-order differentiating the extracted signal from top to bottom in the y direction as shown by arrow 1301 in FIG. 13 (b). is there. As a result, the amount of change in the first-order differential signal value becomes large near the edge of each patch, so that the edge coordinates of each patch can be detected.

Next, in S1206, the apparatus control unit 102 extracts the signal value in the x-axis direction, which is the left-right direction in the chart area, using the scanned image data filtered in S1201, and first-order differentials from the extracted signal. Derived the signal value. The first-order differential signal derived in S1206 is a signal value derived by first-order differentiating the extracted signal from left to right in the x direction as shown by arrow 1302 in FIG. 13 (b). is there. Since the amount of change in the first-order differential signal value becomes large near the edge of each patch, it is possible to detect the edge coordinates of each patch.

In S1207, the device control unit 102 extracts the periodic component of the signal value using the first derivative signal value derived in S1205 and S1206. The extraction of the periodic component of the signal value in the present embodiment is performed by performing autocorrelation analysis on the first-order differential signal values derived in S1205 and S1206 and deriving the autocorrelation signal data. Specifically, the periodic component of the signal value is derived using the _{autocorrelation function R x} shown in Eq. (1).

Here, x is the first-order differential signal data, N is the number of first-order differential signal data, and τ is the amount of deviation. _{Furthermore, the autocorrelation coefficient data φ x} shown in Eq. (2) is derived using the derived autocorrelation function R _x .

By the autocorrelation analysis, it is possible to confirm the consistency of the signal x with the signal shifted by the deviation amount τ of the signal x, and in the autocorrelation coefficient data, τ, which is a value having a large correlation coefficient, is It shows the periodicity of the signal. That is, by extracting the deviation amount τ in which the correlation coefficient becomes large in the autocorrelation coefficient data φ _{x, it is possible to extract the periodic component including the patch size.} Here, in the autocorrelation coefficient data φ _x , the deviation amount τ that becomes the local maximum value that exceeds a predetermined threshold value is extracted. When R _x (0) becomes 0, the autocorrelation coefficient data cannot be derived, so the autocorrelation coefficient data φ _x is set to 0. Further, the predetermined threshold value in the present embodiment is set to 0.3, which can be judged to be statistically correlated.

In S1208, the device control unit 102 derives the patch size in the x-axis direction and the y-axis direction by using the periodic component of the signal value extracted in S1207. In deriving the patch size in the present embodiment, among the periodic components of the signal value extracted in S1207, the patch size is defined as the value when multiplied by an integer is included in the periodic component. Since the autocorrelation coefficient data, which is a periodic component, increases with every integral multiple of the patch size, the patch size is the one whose periodic component contains the value when multiplied by an integer.

In S1209, the device control unit 102 derives the number of patches by using the size of the patches in the x-axis direction and the y-axis direction derived in S1208 and the vertex coordinates of the chart derived in S1204. First, the area of the chart area is derived from the coordinates of the vertices of the chart area. Next, the patch area is derived from the patch sizes in the x-axis direction and the y-axis direction. The number of patches in the chart area can be derived by dividing the patch area from the area of the chart area.

In S1210, the apparatus control unit 102 derives the scaling factor of the scanned color characteristic chart by using the patch sizes in the x-axis direction and the y-axis direction derived in S1208. For example, the area of the patch area derived from the size of the patch in the x-axis direction and the y-axis direction derived in S1208, and the area of the area of the color characteristic chart scanned with the setting that the color characteristic chart is not deformed at all. The scaling factor of the color characteristic chart is derived from the rate of change with. It is assumed that the area of the area of the color characteristic chart scanned in the setting in which the color characteristic chart in the present embodiment is not deformed is prepared in advance in the storage unit 107.

The above is the description of the flow of the patch area derivation process of the color characteristic chart in S1001 in the present embodiment. By this process, the patch size, the number of patches, and the variable magnification of the color characteristic chart in the scanned image data acquired in S901 are derived. Not limited to the example described above, any method can be used as long as the chart area of the color characteristic chart can be derived and the patch size, the number of patches, and the variable magnification of the color characteristic chart can be derived. Good.

Next, the details of the analysis process of the shrinking factor of the color characteristic chart of S1006 will be described. FIG. 14 is a flowchart showing the details of the analysis process of the shrinking factor of the color characteristic chart of S1006. Multiple events may correspond to one factor as a shrinking factor. In the process of FIG. 14, each event is determined, and if the event is matched, the corresponding factor is added as a reduction factor. The process according to the flowchart shown in FIG. 14 is executed by expanding the program code stored in the storage unit 107 into the RAM 106 and controlling the device control unit 102 by the CPU 105. The data created during the processing shall be temporarily stored in the storage unit 107.

In S1401, the apparatus control unit 102 determines whether the number of patches of the scanned chart derived in S1209 is equal to the threshold value of the predetermined number of patches. This threshold value is the same value as the threshold value used for the determination in S1002 of FIG. That is, the fact that the process is proceeding to the reduction factor analysis process (S1006 in FIG. 10) described with reference to FIG. 14 is a case where it is determined in S1002 that the number of patches is equal to or greater than the threshold value. In that state, in this S1401, it is determined whether the number of patches is equal to the threshold value.

As described above, this threshold value is M × N, which is the number of patches in the image data of the color characteristic chart. That is, if it is equal to the number of patches that should be originally included (detected), it is considered that the patches have not been reduced, and the process proceeds to S1403. On the other hand, if the number of patches is not equal to the number of patches, that is, if the number of patches is larger than the number of patches that should be originally included, the process proceeds to S1402. When the number of patches of the chart scanned in S1401 is not equal to the threshold value (that is, when there are many patches in this example), in S1402, the device control unit 102 determines that the reduction factor is the print setting related to the page layout. And add that factor to the analysis results. Then, the process proceeds to S1403.

The page layout setting in this embodiment is a setting such as 2in1. When there are multiple color characteristic charts, in the 2in1 setting, since multiple print characteristic charts are printed in one scanned image, the number of patches derived is the number of patches of the original color characteristic chart. It will increase more. Therefore, if the number of patches in the scanned chart is not equal to the number of patches in the original color characteristic chart, the setting related to the page layout may be considered as a reduction factor.

On the other hand, if the number of patches on the chart scanned in S1401 is equal to the threshold value, the process proceeds to S1403. In S1403, the apparatus control unit 102 acquires the paper size of the color characteristic chart scanned by the image reading unit 108.

In S1404, the device control unit 102 determines whether the scanned paper size acquired in S1403 is a predetermined paper size. If it is determined in S1404 that the scanned paper size is not the predetermined paper size, the process proceeds to S1405, and if not, the process proceeds to S1406. The predetermined paper size can be, for example, a paper size in which the color characteristic chart is not deformed. When a common color characteristic chart is used between the target device 150 and the adjustment target device 100, the adjustment target device 100 holds information on the paper size on which the color characteristic chart should be printed. Therefore, the determination of S1404 is performed by comparing the paper size of the read color characteristic chart with the information held. Alternatively, the adjustment target device 100 may obtain information on the paper size on which the color characteristic chart should be printed on the target device 150 by another method. If the scanned paper size is not the specified paper size, the color characteristic chart is originally set to a size other than the paper size that is not deformed, and the paper is reduced to fit the set paper size and printed. It will be. If the print is reduced to fit the set paper size, it will be smaller than the patch reading area determined by S1005. Therefore, in S1405, the device control unit 102 determines that the reduction factor is a setting related to the paper size, and the setting related to the paper size is added as the reduction factor. Then, the process proceeds to S1406.

In S1406, the apparatus control unit 102 determines whether the scaling factor (enlargement / reduction ratio) of the color characteristic chart derived in S1010 is larger than a predetermined value (for example, 67%). If it is determined in S1406 that the scaling factor of the chart is larger than 67%, the process proceeds to S1408, and if not, the process proceeds to S1407. When the 2in1 setting is performed, or when the orientation of the paper is set differently, the variable magnification is 67% or less. Therefore, in S1406, it is determined whether the variable magnification is larger than 67%.

In S1408, the device control unit 102 adds the paper size setting and the manual magnification setting to the analysis result of the reduction factor as the reduction factor. It is possible that the reduction factor has already been set in the processing so far. For example, the paper size setting may have already been set in S1405. This process is a process for obtaining a reduction factor from a viewpoint different from that of S1405 (that is, the scaling factor of the color characteristic chart). When the setting related to the page layout is 2in1, the scaling factor of the color characteristic chart is 67% or less. Therefore, when the scaling factor of the color characteristic chart is larger than 67%, the setting related to the page layout is excluded from the reduction factor. If the paper orientation setting is different from the originally desired paper orientation, printing is performed in the same state as when the page layout setting is 2in1. Therefore, in S1408, the setting related to the paper orientation is also excluded from the reduction factors. If the print setting for the paper size having a variable magnification larger than 67% and the print setting for the manual magnification are set, there is a possibility that the printing is performed in a state where the printing is smaller than the patch reading area determined in S1005. Therefore, in S1408, the print setting of the paper size and the print setting related to the manual magnification are added to the analysis result of the reduction factor. Then, the process proceeds to S1411.

On the other hand, if it is determined in S1406 that the variability of the color characteristic chart is not greater than 67%, that is, if it is determined that the variability of the color characteristic chart is 67% or less, the process proceeds to S1407. In S1407, the device control unit 102 determines whether or not the variable magnification of the color characteristic chart is 67%. If it is determined in S1408 that the variable magnification of the color characteristic chart is 67%, the process proceeds to S1409, and if not, the process proceeds to S1410.

In S1409, the device control unit 102 adds the manual magnification setting, the paper orientation setting, and the page layout setting to the analysis result of the reduction factor. If the paper orientation setting is different from the originally desired paper orientation, the page layout setting will be the same as when the 2in1 setting is used, and the color characteristic chart will be printed at a magnification of 67%. Therefore, in S1409, the setting related to the page layout and the setting related to the paper orientation are added as reduction factors. In addition, the setting of the manual magnification can be considered as a reduction factor, so it is added to the reduction factor. Then, the process proceeds to S1411.

If it is determined in S1408 that the variability of the color characteristic chart is not 67%, that is, if the variability of the color characteristic chart is smaller than 67%, the process proceeds to S1410. In S1410, the device control unit 102 adds the manual magnification setting and the page layout setting to the analysis result of the reduction factor. When the scaling factor of the color characteristic chart is smaller than 67%, it is considered that the setting related to the page layout is the number of impositions (for example, 4in1) larger than 2in1 as a reduction factor. Therefore, the page layout setting and the manual magnification setting are added to the analysis result of the reduction factor. Then, the process proceeds to S1411.

In S1411, the apparatus control unit 102 acquires information on the print setting to be reviewed corresponding to each factor by using the analysis result of the reduction factor added so far. For example, when the setting related to the page layout becomes a reduction factor, the corresponding method is to set the print setting of the layout to 1in1. Similarly, when the setting related to the paper size becomes a reduction factor, the corresponding method is to set the paper size to a predetermined size (for example, A4 or LTR) or to set it to the "actual size". Similarly, when the setting regarding the orientation of the paper becomes a shrinking factor, the corresponding method is to set the orientation of the paper in the direction corresponding to the large number when there are M × N color characteristic charts. Similarly, if the setting related to manual scaling is a factor of reduction, setting the scaling factor to 100% is a countermeasure. It is assumed that the information regarding these corresponding methods is stored in the storage unit 107 in advance, for example. The above is the description of the analysis process of the shrinking factor of the color characteristic chart of S1006 in the present embodiment. The factors obtained from the analysis will be notified to the user as the cause of the shrinkage.

FIG. 15 is a flowchart showing the details of the analysis process of the enlargement factor of the color characteristic chart of S1004. The process according to the flowchart shown in FIG. 15 is executed by expanding the program code stored in the storage unit 107 into the RAM 106 and controlling the device control unit 102 by the CPU 105. The data created during the processing shall be temporarily stored in the storage unit 107.

In S1501, the apparatus control unit 102 determines whether the number of patches in the scanned color characteristic chart derived in S1209 is more than half the number of patches in the original color characteristic chart. If it is determined in S1501 that the number of patches in the scanned color characteristic chart is more than half the number of patches in the original color characteristic chart, the process proceeds to S1502, and if not, the process proceeds to S1503.

In S1502, the device control unit 102 adds a setting related to the manual magnification to the analysis result of the expansion factor. As a result of setting the manual magnification, for example, the edge of the color characteristic chart area to be printed may not be printed. That is, since the original color characteristic chart area is not completely printed, the number of patches in the original color characteristic chart is smaller than the number of patches, which is considered to be an expansion factor. Therefore, the setting related to the manual magnification is added as an expansion factor. Then, the process proceeds to S1504.

On the other hand, the number of patches on the color characteristic chart is not more than half the number of patches on the original color characteristic chart, and the process proceeds to S1503. That is, when it is determined that the number of patches in the original color characteristic chart is half or less, the device control unit 102 in S1503 adds the page layout setting and the manual magnification setting to the analysis result of the enlargement factor. As a setting related to the page layout, it is assumed that a print setting such as poster printing is set. In this case, one color characteristic chart is divided into a plurality of areas and printed. Since the chart area is divided into a plurality of areas, the number of patches in the original color characteristic chart is less than half. Therefore, the setting related to the page layout is added as an enlargement factor in addition to the setting related to the manual magnification. Then, the process proceeds to S1504.

In S1504, the apparatus control unit 102 acquires information on the print setting to be reviewed corresponding to each factor by using the expanded factor analysis result added so far. When the setting related to the page layout becomes an enlargement factor, the countermeasure method is to set the print setting of the layout to 1in1, that is, to confirm that the setting is not the poster setting. Similarly, if the setting related to manual scaling is an expansion factor, setting the scaling factor to 100% is a countermeasure. The above is the description of the flow of the analysis process of the expansion factor of the color characteristic chart of S1004. The factors obtained from the analysis will be notified to the user as the cause of the expansion.

<Color characteristic patch signal value acquisition process of the device to be adjusted>
FIG. 16 is a flowchart showing the details of the process of acquiring the RGB values of each patch in the color characteristic chart using the scanned image data of the color characteristic chart printed by the adjustment target device 100 in S906. The processing according to the flowchart shown in FIG. 16 is performed by the image processing unit 103. Alternatively, the program code stored in the storage unit 107 may be expanded in the RAM 106 and executed by controlling the device control unit 102 by the CPU 105. The data created during the processing shall be temporarily stored in the storage unit 107.

In S1601, the device control unit 102 detects the area of the color characteristic chart from the scanned image data by using the scanned image data of the device 100 to be adjusted acquired in S905, and determines the scaling factor of the chart, the patch size, and the like. And derive the number of patches. Since the processing of S1601 in the present embodiment is the same as that of S1001, the description thereof will be omitted.

Next, in S1602, the device control unit 102 determines whether the number of patches derived in S1601 is equal to a predetermined threshold value. The predetermined threshold value of S1602 in the present embodiment is M × N, which is the number of patches in the color characteristic chart. If it is determined that the number of derived patches is equal to the predetermined threshold value, the process proceeds to S1603, and if not, the process proceeds to S1606.

If it is determined in S1602 that the number of the derived patches is not equal to the predetermined threshold value, the device control unit 102 in S1606 has not normally completed the patch area derivation process of the color characteristic chart of S1601. Is determined. Then, the re-scanning of the color characteristic chart printed by the adjustment target device 100 is notified. As described above, in this example, in the case of the color characteristic chart printed in S904, the print setting that deforms the chart is not performed. Therefore, the originally desired color characteristic chart is not scanned. Therefore, a process of notifying the user of re-scanning the color characteristic chart of the adjustment target device 100 is performed.

When it is determined that the number of patches derived in S1602 is equal to a predetermined threshold value, the device control unit 102 in S1603 determines whether or not the scaling factor of the color characteristic chart of S1601 is 100%. If the variable magnification is 100%, the process proceeds to S1604, and if not, the process proceeds to S1606.

When it is determined in S1603 that the variable magnification of the color characteristic chart is not 100%, in S1606, the device control unit 102 determines that the patch area derivation process of the color characteristic chart in S1601 has not been normally completed. .. Then, the re-scanning of the color characteristic chart printed by the adjustment target device 100 is notified. As described above, in this example, in the case of the color characteristic chart printed in S904, the print setting that deforms the chart is not performed. Therefore, if the variable magnification is not 100%, it means that the originally desired color characteristic chart has not been scanned. Therefore, a process of notifying the user of re-scanning the color characteristic chart of the adjustment target device 100 is performed.

When it is determined in S1603 that the variable magnification of the color characteristic chart is 100%, in S1604, the device control unit 102 acquires the signal value of each patch of the adjustment target device from the scanned image data acquired in S905. ..

Next, in S1604, the image processing unit 103 of the device control unit 102 notifies the CPU 105 that the patch signal value acquisition process of the color characteristic chart of S1601 has been completed normally, so that the patch signal value acquisition process of the device to be adjusted is performed. To finish. The above is the description of the process of acquiring the RGB values of each patch in the color characteristic chart of the device to be adjusted in S906 in the present embodiment.

As described above, according to the processing of the present embodiment, the color matching processing can be realized by using the scanner mounted on the image processing apparatus. Therefore, in the color matching process, it is not necessary to use a colorimeter that measures the color value of the printed color characteristic chart. Therefore, the process for operating the colorimeter and the process for moving the printed color characteristic chart can be eliminated, so that the process for the user's color matching process can be simplified. In addition, the user can print the color characteristic chart in the state of the target device currently used by the user without preparing special paper having an opening. Further, since the color matching process is performed using the color characteristic expressed by the target device desired by the user, the color characteristic printed by the adjustment target device using the color adjustment LUT created by the color matching process is the user. Will have the desired color characteristics.

Further, according to the process of the present embodiment, when the deformed chart is printed on the target device 150 without being noticed by the user, the color matching process is stopped. According to the present embodiment, when the color matching process is stopped due to printing on the target device 150 without the user noticing the deformed chart, the cause of stopping the color matching process and the corresponding method are provided to the user. It is also possible to notify. Therefore, the user can confirm the cause of the cancellation of the color matching process and take appropriate measures.

In this embodiment, an example in which the Web server 140 is connected to the PC 130 via the network 101 has been described. However, the same configuration as the Web server 140 may be provided inside the adjustment target device 100, and the PC 130 may acquire a color characteristic chart from the adjustment target device 100. In this case, when the PC 130 communicates with the adjustment target device 100 via the network 101, the PC 130 displays a web browser as shown in FIG. Alternatively, any method may be used as long as the color characteristic chart previously held in the adjustment target device 100 can be acquired using the PC 130. Further, in the present embodiment, the color characteristic chart is printed on the target device 150 by using the PC 130, but the color characteristic chart is acquired and the printing instruction is given to the target device 150 by using an information device such as a smartphone. You may.

<< Second Embodiment >>
In the first embodiment, an example has been described in which the color characteristic chart printed by the target device 150 is scanned by the adjustment target device 100, and then the color characteristic chart is printed and scanned by the adjustment target device 100. In the present embodiment, an example of scanning the color characteristic chart printed by the target device 150 and the color characteristic chart printed by the adjustment target device 100 together will be described. Hereinafter, the parts different from those of the first embodiment will be mainly described.

FIG. 17 is a diagram showing an entire sequence of color matching processing in the present embodiment. Since the flow from SQ1710 to SQ1730 is the same as that of SQ210 to SQ230 of the first embodiment, the description thereof will be omitted. Further, since SQ1731 is the same as SQ232 of the first embodiment, the description thereof will be omitted.

Next, in SQ1732, the adjustment target device 100 uses the image reading unit 108 to display a color characteristic chart printed by the target device 150 in SQ1723 and a color characteristic chart printed by the adjustment target device 100 in SQ1731. to scan. Specifically, the user 1701 sets each color characteristic chart in the ADF so that the color characteristic chart printed by the adjustment target device 100 is placed on the color characteristic chart printed by the target device 150. Then, the adjustment target device 100 starts scanning and saves it as image data of a plurality of pages.

FIG. 18 shows an example of the UI displayed on the display 109 of the device 100 to be adjusted when the printed color characteristic charts are collectively scanned. The UI 1800 shows a UI that instructs the user 1701 to scan when the printed color characteristic charts are collectively scanned. That is, it is a UI displayed on the adjustment target device 100 after the processing of SQ1731. The UI 1800 includes a sentence explaining how to place the color characteristic chart when scanning the printed color characteristic charts collectively. In this example, the explanation of only the text is included, but the explanation of the illustration may be included. When the button 1801 is pressed, the adjustment target device 100 shall issue an execution command for scanning processing to the image reading unit 108. When the button 1801 is pressed by the user when the color characteristic chart is not placed on the ADF, the adjustment target device 100 may not execute the scan process on the image reading unit 108. Button 1802 is a button pressed by the user when the scanning process is stopped. When the button 1802 is pressed by the user, the adjustment target device 100 stops performing the color matching process and transitions to the initial screen of the UI 500 of FIG.

Next, in SQ1733, the adjustment target device 100 divides the image data of a plurality of pages scanned by SQ1732 into pages. That is, the adjustment target device 100 pages the read image data so as to be divided into the image data of the color characteristic chart printed by the target device 150 and the image data of the color characteristic chart printed by the adjustment target device 100. To divide.

When the color characteristic chart to be printed is one page and the color characteristic chart printed by the adjustment target device 100 is scanned while being placed on the color characteristic chart printed by the target device 150, the page break method. Is as follows. When multi-page reading by ADF is executed, the manuscript arranged above is read first. Therefore, the original on the first page becomes the color characteristic chart printed by the adjustment target device 100, and the original on the second page becomes the color characteristic chart printed by the target device 150. Therefore, the adjustment target device 100 assigns the scanned image on the first page to the image data of the adjustment target device 100 and the scanned image on the second page to the image data of the target device 150. In this way, pages can be assigned to the image data of the adjustment target device 100 and the image data of the target device 150 from the order of the read pages according to the number of pages of the color characteristic chart to be printed.

Other methods will be described. As described above, the color characteristic chart printed by the adjustment target device 100 does not perform the color conversion process by the CMS, so that the change in the patch signal can be grasped in advance in the adjustment target device 100. Therefore, an image including the scanned signal value within the range of change in the patch signal value of the color characteristic chart printed by the adjustment target device 100 may be assigned as the scan image of the adjustment target device 100.

Yet another method will be described. The color characteristic chart printed by the adjustment target device 100 may be configured to be printed including a mark (not shown). Then, it may be determined which device the scanned image is printed by the presence or absence of the mark. Any method may be used as long as the images scanned collectively can be divided into pages according to the characteristics.

Since SQ1734 and SQ1735 are the same as SQ234 and SQ235 of the first embodiment, the description thereof will be omitted.

FIG. 19 is a flowchart showing a color matching process performed on the adjustment target device 100 in the present embodiment. First, in S1901, the device control unit 102 prints the color characteristic chart data held in advance by using the image output unit 110 of the adjustment target device 100. Since S1901 is the same as S904 of the first embodiment, detailed description thereof will be omitted.

Next, in S1902, the device control unit 102 scans the color characteristic chart printed by the target device 150 and the color characteristic chart printed by the adjustment target device 100 in S1901 by the ADF of the image reading unit 108. Then, the scanned image data of the scanned plurality of pages is acquired.

Next, in S1912, the device control unit 102 divides the scanned image data scanned in S1902 into pages and allocates the scanned image data to the image data of the adjustment target device 100 and the image data of the target device 150. Since the page division method is the same as that of SQ1733, the description thereof will be omitted.

Next, in S1913, the device control unit 102 determines whether or not the page division process in S1912 was correctly divided, and if it is determined that the page division was correctly performed, the device control unit 102 performs the process of S1903. If it is determined in S1913 that the page cannot be divided, the device control unit 102 rescans the color characteristic chart printed by the target device 150 and the color characteristic chart printed by the adjustment target device 100 in S1901 in S1914. .. The scanning method and the like are the same as in S1902. In addition, as the case where the page break cannot be performed correctly, the case where only one sheet is scanned and the case where the method of dividing by SQ1733 does not correspond (for example, the case where the mark cannot be detected when the page is divided by the mark) are assumed. Will be done.

Since S1903 and S1904, and S1905 and S1906 are the same as S902 and S903 and S906 and S907 of the first embodiment, the description thereof will be omitted.

When it is determined in S1906 that the patch signal processing of the adjustment target device 100 is not normally completed, in S1907, the device control unit 102 rescans the color characteristic chart printed using the adjustment target device 100. I do. In S1901, the color characteristic chart printed using the target device 150 and the color characteristic chart printed using the adjustment target device 100 are collectively scanned. However, in S1907, only the color characteristic chart printed by the adjustment target device 100 is scanned. Since the UI of S1907 is the same as the UI 620 of FIG. 6 (c) in the first embodiment, the description thereof will be omitted.

Subsequent S1908 to S1911 are the same as S908 to S911 of the first embodiment, and thus the description thereof will be omitted.

As described above, according to the present embodiment, the user's operability can be improved by scanning the color characteristic chart printed by the target device 150 and the color characteristic chart printed by the adjustment target device together. ..

<< Third Embodiment >>
In the first embodiment, an example in which the PC 130 prints the color characteristic chart on the target device 150 using the image data of the color characteristic chart acquired from the Web server 140 has been described. In this embodiment, an example in which the image data of the color characteristic chart stored in a storage medium such as a USB memory is read by the PC 130 and the read image data is printed by the target device 150 will be described. The storage medium in the present embodiment is a USB memory, but any medium such as an SD card, a CD, or a DVD can be connected to a PC or the like and can transfer stored data. But it may be. Hereinafter, the parts different from the first embodiment will be described.

FIG. 20 is a diagram showing the entire sequence of color matching processing in the present embodiment. First, in SQ2010, the PC 130 is operated by the user to acquire a color characteristic chart stored in advance in the storage medium 2000. In response to this operation, in SQ2011, the PC 130 requests the storage medium 2000 to request the image data of the corresponding color characteristic chart. Next, in SQ2012, the storage medium 2000 acquires a file corresponding to the image data of the color characteristic chart requested in SQ2011. Next, in SQ2013, the storage medium 2000 outputs the color characteristic chart data acquired in SQ2012 to the PC 130.

Next, in SQ2014, the PC 130 notifies the user 2001 of the completion of acquisition when the acquisition of the image data of the color characteristic chart is completed in SQ2013.

Subsequent SQ2020 to SQ2035 are the same as SQ220 to SQ235 of the first embodiment, and thus the description thereof will be omitted.

As described above, according to the present embodiment, it is possible to perform the color matching process even when the image data of the color characteristic chart stored in the storage medium is read by the PC. Therefore, even if a PC 130 that is not connected to the web server is used, the color matching process can be performed.

The interface that can be connected to the storage medium 2000 of the external device in this embodiment is connected by USB (Universal Serial Bus), but may be connected to an external device other than that.

<< Fourth Embodiment >>
In the first embodiment, a printing environment in which print data is transmitted from the PC 130 to the image processing device has been described as an example. In the present embodiment, an example will be described in which the printing environment in which the user's image processing device is used executes printing directly from the storage medium connected to the image processing device.

FIG. 21 is a diagram showing the entire sequence of color matching processing in the present embodiment. First, in SQ2110, the target device 150 is operated by the user to print a color characteristic chart pre-stored in the storage medium 2100. Then, in SQ2111, the target device 150 requests the storage medium 2100 to request the image data of the corresponding color characteristic chart.

See FIG. 5 again. In the present embodiment, FIG. 5 is a diagram showing an example of a UI for instructing the user 2101 to print the image data of the color characteristic chart using the storage medium 2100 on the target device 150. In the present embodiment, the timing for printing the image data using the storage medium 2100 is when the button 505 is pressed by the user 2101. Button 505 is a button for instructing the execution of direct printing. Direct printing is a printing method for directly printing image data stored in a storage medium. In addition, each function may be displayed in a list structure instead of the button format.

FIG. 22 is a diagram showing an example of UI 2200 displayed on the target device 150 when the button 505 is pressed by the user 2101. When the button 505 is pressed, the target device 150 displays a UI 2200 for selecting an image file to print from the connected storage medium 2100. In the UI 2200, the list box 2203 is a list box that displays an image file or the like that can be printed in the connected storage medium 2100. The image file to be printed is switched according to the selected image file. It is assumed that the background color of the item selected as the image file to be printed in this embodiment is gray (hatching). Button 2204 is a button that is pressed when the user 2101 prints an image file and makes print settings such as printing paper, color mode, and density adjustment. When the button 2204 is pressed by the user, it is assumed that the UI shifts to a UI (not shown) for setting print settings.

Button 2201 is a button that is pressed when the user 2101 finishes selecting an image file to be printed. When the button 2201 is pressed by the user 2101, the display of the UI 2200 is terminated, and printing is started according to the print settings set by the user. Button 2202 is a button pressed by the user when canceling the selection of the image file to be printed by the user 2101. When the button 2202 is pressed by the user, the display of the UI 2200 ends and the screen shifts to the UI 500 screen.

Returning to the description of the sequence diagram of FIG. 21. Next, in SQ2112, the storage medium 2100 acquires a file corresponding to the image data of the color characteristic chart requested in SQ2111 from its own storage area. Next, in SQ2113, the storage medium 2100 outputs the color characteristic chart data acquired in SQ2112 to the target device 150.

Next, in SQ2114, the target device 150 performs color conversion processing on the image data of the color characteristic chart acquired in SQ2113 according to the print setting used by the user, and prints on the image output unit 160. Next, in SQ2115, the target device 150 notifies the user 2101 of the completion of printing when the printing of the image data of the color characteristic chart is completed.

Subsequent SQ2120 to SQ2125 are the same as SQ230 to SQ235 of the first embodiment, and thus description thereof will be omitted.

As described above, in the present embodiment, even when the printing environment in which the user uses the image processing device directly acquires the image data from the storage medium and prints the image data, the color matching process can be performed. It becomes.

<< Fifth Embodiment >>
In the first embodiment, an example of printing a color characteristic chart on the target device, printing the color characteristic chart on the adjustment target device, and scanning each color characteristic chart has been described. In the present embodiment, when performing the color matching process, first, the registration process including printing and scanning of the color characteristic chart is executed on the device to be adjusted. After that, an example in which a creation process for creating a color adjustment LUT using the color characteristic chart printed by the target device and the registered data is performed will be described. Hereinafter, the parts different from those of the first embodiment will be mainly described.

FIG. 23 is a diagram showing the entire sequence of color matching processing in the present embodiment. First, in SQ2305, the adjustment target device 100 is operated by the user 2301 to execute the registration process in the color matching process. The registration process in the color matching process in the present embodiment is a process including a process of printing the color characteristic chart on the adjustment target device 100 and a process of scanning the color characteristic chart printed on the adjustment target device 100.

FIG. 24 is a diagram showing an example of the UI 2400 displayed on the adjustment target device 100 when the color matching process is executed in the present embodiment. The UI 2400 includes a button 2401 on which the registration process is executed and a button 2402 on which the creation process is executed. When the button 2401 is pressed by the user 2301, the adjustment target device 100 executes the registration process in the color matching process. In the present embodiment, the date and time when the registration process is performed is displayed, but information such as which paper the color characteristic chart is printed on may be displayed.

On the other hand, when the button 2402 is pressed by the user 2301, the adjustment target device 100 executes the creation process in the color matching process. The creation process in the color matching process of the present embodiment is a process including a process of scanning the color characteristic chart printed by the target device 150 and a process of creating a color adjustment LUT. It should be noted that the button 2402 may be configured to be able to be pressed when the registration process of the color matching process is being performed in advance.

Returning to the description of FIG. 23. Next, in SQ2306, the adjustment target device 100 executes printing in the image output unit 110 using the image data of the color characteristic chart stored in advance. Since the detailed processing of SQ2306 is the same as that of SQ232 in the first embodiment, the description thereof will be omitted.

Next, in SQ2307, the adjustment target device 100 scans the color characteristic chart printed by the adjustment target device 100 in SQ2306 using the image reading unit 108. Since the detailed processing of SQ2307 is the same as that of SQ233 in the first embodiment, the description thereof will be omitted.

Next, in SQ2308, when the adjustment target device 100 receives the notification of the completion of scanning the color characteristic chart of the SQ2307, the user 2301 is notified of the completion of the registration process of the color matching process by using the display 109.

Since the flow from SQ2310 to SQ2325 is the same as that of SQ210 to SQ225 of the first embodiment, the description thereof will be omitted.

Next, in SQ2330, the adjustment target device 100 is operated by the user 2301 to execute the creation process in the color matching process. Next, in the SQ2331, the adjustment target device 100 scans the color characteristic chart printed by the target device 150 by the SQ2323 using the image reading unit 108. Since the detailed processing of SQ2331 is the same as that of SQ231 in the first embodiment, the description thereof will be omitted.

Next, in SQ2332, the adjustment target device 100 executes the color matching process using the color characteristic chart scanned by SQ2307 and the color characteristic chart scanned by SQ2331. Since the detailed processing of SQ2332 is the same as that of SQ234 in the first embodiment, the description thereof will be omitted.

Next, in SQ2333, when the adjustment target device 100 receives the notification of the completion of the color matching process in SQ2332, the user 2301 is notified of the completion of the color matching process using the display 109.

The above is the overall flow until the color matching process is performed on the device to be adjusted. Next, the flow of the registration process and the flow of the creation process performed on the adjustment target device 100 will be described. Since the basic individual processes are the same as the processes described in the first embodiment, they will be described with reference to the flowchart of FIG.

In the registration process, the process starts from the process of S904, and ends when the process of S907 determines YES. Next, the flow of the creation process will be described. In the creation process, the processes from S901 to S903 are performed, and when YES in S903, the processes from S908 to S910 are performed. If NO in S903, the process of S911 is performed.

As described above, according to the present embodiment, the color characteristic chart printed by the target device and the color characteristic chart printed by the adjustment target device can be scanned at each timing.

<< 6th Embodiment >>
In the first embodiment, an example of notifying the user by displaying the cause of stopping the color matching process and the corresponding method on the display 109 of the adjustment target device 100 has also been described. In the present embodiment, an example of switching the notification method of the cause of stopping the color matching process and the corresponding method will be described. Hereinafter, the parts different from those of the first embodiment will be mainly described.

FIG. 25 is a diagram showing an example of a UI for setting a notification method for notifying the user of the cause of stopping the color matching process of S1008 and the corresponding method. The UI 2501 of FIG. 25 is an example of a UI using the display 109. In UI2501, a wording instructing the user to select a notification method is displayed. The UI 2501 is a UI whose display is controlled when the user sets the cause of stopping the color matching process and the notification method of switching the corresponding method.

The button 2502 of FIG. 25 is pressed when the administrator of the device 100 to be adjusted is set to notify the user of the cause of stopping the color matching process and the corresponding method for the email address registered in advance. Button. When the notification method using e-mail is set for the administrator, the background color of the button is inverted and displayed so that the user can recognize that e-mail transmission is set. ..

The button 2503 of FIG. 25 is pressed when the user is set to notify the e-mail address corresponding to the logged-in user who is logged in to the adjustment target device 100 of the cause of stopping the color matching process and the corresponding method. Button. If a notification method using e-mail is set for the logged-in user, the background color of the button is inverted and displayed so that the user can recognize that e-mail transmission is set. ing.

The button 2504 in FIG. 25 is a button that is pressed when setting to notify the user by printing a report of the cause of stopping the color matching process and the corresponding method by using the image output unit 110. .. When the report print notification method is set, the background color of the button is inverted so that the user can recognize that the report print is set.

The button 2505 of FIG. 25 is a button that is pressed when setting to notify the user of the cause of stopping the color matching process and the corresponding method by displaying the UI using the display 109. When the UI display is set, the background color of the button is inverted and displayed so that the user can recognize the setting.

In the present embodiment, a plurality of settings (simultaneous setting) of the button 2502, the button 2503, the button 2504, and the button 2505 are possible, but only the setting corresponding to the button last pressed by the user may be enabled. .. Further, in the present embodiment, it is assumed that the UI 2501 of FIG. 25 is in a state of being set on the initial screen, and that the notification method of report printing of the button 2504 and the UI display of the button 2505 are initially set.

The button 2506 in FIG. 25 is a button pressed by the user when canceling the notification method switching setting of the UI 2501. When the button 2506 of FIG. 25 is pressed, the state before the user selects the notification method is maintained, and the display of the UI 2501 is terminated.

The button 2507 of FIG. 25 is a button pressed by the user when the setting of switching the notification method of the UI 2501 is reflected and the set notification method is held. When the button 2507 of FIG. 25 is pressed, the settings of the button 2502, the button 2503, the button 2504, and the button 2505 are maintained, and the display of the UI 2501 is terminated.

The example shown in FIG. 25 is only an example, and other notification methods may be used. For example, by outputting a predetermined voice message, the user may be notified of the cause of stopping the color matching process and the corresponding method. Further, another information processing terminal connected to the adjustment target device 100 may be notified of the cause of stopping the color matching process and the corresponding method. These notification methods may be further added to the UI of FIG. Further, although the UI 1201 of FIG. 25 shows an example of being displayed on the display 109 of the adjustment target device 100, it may be displayed on the screen of another information processing terminal connected to the adjustment target device 100.

As described above, according to the present embodiment, it is possible to switch the notification method for notifying the user of the cause of stopping the color matching process and the corresponding method.

<< Other Embodiments >>
In the above-described embodiment, as a method of deriving the patch size in the scanned color characteristic chart, an example of detecting from the periodicity from the autocorrelation analysis has been described, but any method can be used as long as the patch size can be derived. Good. For example, an edge detection filter such as a first-order differential filter or a second-order differential filter may be applied to the scanned image, and the patch size may be derived from the distance between the detected edges.

Further, in the above-described embodiment, the adjustment target device 100 prints the color characteristic chart with a predetermined print setting. Therefore, if the patch signal value is not normally acquired in S907, the scan is performed again. Explained an example of letting the user do. However, even in the print setting of the color characteristic chart in the adjustment target device 100, there may be a mode in which the user arbitrarily changes the print setting. In such a case, if the signal value of the patch of the color characteristic chart printed by the adjustment target device 100 is not normally acquired, a notification prompting the printing of the color characteristic chart again may be given. Further, the user may be notified of the cause of the failure and the method for dealing with the failure by the same method as in the above-described embodiment.

Further, in the above-described embodiment, an example in which the patch size, the number of patches, and the variable magnification of the patches are all derived and detailed analysis is performed from the derived results has been described, but the present invention is not limited to this example. For example, based on the number of patches, the user may be informed of the cause of the expansion and possible remedies. In addition, the user may be notified of the cause of the reduction based on the size of the patch and the possible countermeasures.

In addition, various combinations of the above-described embodiments may be used. For example, the second embodiment may be combined with any of the third to sixth embodiments. Further, the fifth embodiment and the sixth embodiment may be combined.

The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Claims (26)

An image processing device that performs color matching processing according to the color reproduction characteristics of the target device.
Printing means for printing and
A reading means capable of reading the first color characteristic chart printed by the target device and the second color characteristic chart printed by the printing means.
The color is based on the first scan image data obtained by reading the first color characteristic chart by the reading means and the second scan image data obtained by reading the second color characteristic chart by the reading means. Processing means to perform matching processing and
An image processing device characterized by having. The first color characteristic chart is printed by the target device according to the color characteristics to be reproduced based on the image data of the color space independent of the device, and the second color characteristic chart does not perform color conversion. The image processing apparatus according to claim 1, wherein the image processing apparatus is printed by the printing means. The first color characteristic chart is obtained by transmitting a print instruction to the target device by the information processing device using an image file stored in a server connected to the information processing device via a network. The image processing apparatus according to claim 1 or 2, wherein the image processing apparatus is printed in. The first color characteristic chart is printed on the target device by the information processing device transmitting a print instruction to the target device using an image file stored in a storage medium connected to the information processing device. The image processing apparatus according to claim 1 or 2, wherein the image processing apparatus is characterized by the above. The first color characteristic chart according to claim 1 or 2, wherein the first color characteristic chart is printed by the target device using an image file stored in a storage medium connected to the target device. Image processing device. The reading means includes an auto document feeder (ADF), and the ADF is used to collectively read the first color characteristic chart and the second color characteristic chart.
Any one of claims 1 to 5, wherein the processing means acquires the first scan image data and the second scan image data by dividing the image read by the ADF into pages. The image processing apparatus according to the section. The processing means is configured to execute a registration process and a creation process.
The registration process includes a process of printing the second color characteristic chart by the printing means and reading the printed second color characteristic chart by the reading means to acquire the second scan image data.
The creation process includes a process of reading the first color characteristic chart by the reading means to acquire the first scan image data, and the acquired first scan image data and the second scan image acquired by the registration process. The image processing apparatus according to any one of claims 1 to 6, further comprising a process of performing the color matching process using data. The color matching process is characterized by including a process of creating a table showing a signal value in a color space independent of the device and a signal value in a color space corresponding to the signal value depending on the device of the image processing apparatus. The image processing apparatus according to any one of claims 1 to 7. As a result of analyzing the scan image indicated by the first scan image data, when the signal value of the patch included in the scan image cannot be acquired, the result of analyzing the factor that the signal value of the patch cannot be acquired based on the scan image is obtained. Analytical means to output and
A notification means for notifying the user of the analysis result according to the result output from the analysis means, and
The image processing apparatus according to any one of claims 1 to 8, further comprising. The analysis means derives at least one of the patch size, the number of patches, and the variation of the patch contained in the scanned image, and cannot acquire the signal value of the patch based on the derived result. The image processing apparatus according to claim 9, wherein a factor is determined. The analysis means is characterized in that, when the number of the derived patches is not equal to or more than the first threshold value, the first color characteristic chart is enlarged and printed by the print setting of the target device as the factor. The image processing apparatus according to claim 10. When the number of the derived patches is not equal to or greater than the first threshold value and is more than half the number of patches in the original first color characteristic chart, the analysis means determines the setting regarding the manual magnification as the factor. The image processing apparatus according to claim 11. When the number of the derived patches is not equal to or more than the first threshold value and is less than half the number of patches in the original first color characteristic chart, the analysis means sets the manual magnification and the page layout. The image processing apparatus according to claim 11, wherein the image processing apparatus is determined as the above-mentioned factor. The analysis means derives a reading region for reading the signal value of the patch based on the size of the derived patch, and when the reading region is not a region having a size equal to or larger than the second threshold value, the first color characteristic. The image processing apparatus according to claim 10, wherein the chart is determined to be reduced and printed according to the print setting of the target device as the factor. The image processing apparatus according to claim 14, wherein the analysis means determines the setting of the page layout as the factor when the number of the derived patches is equal to the first threshold value. When the paper size when the first color characteristic chart is read is different from the original size of the paper on which the first color characteristic chart should be printed, the analysis means determines the setting of the paper size as the factor. The image processing apparatus according to claim 14. Any of claims 14 to 16, wherein the analysis means determines a manual magnification setting, a paper orientation setting, and a page layout setting as the factors when the variable magnification is 67%. The image processing apparatus according to claim 1. The image according to any one of claims 14 to 16, wherein when the variable magnification is larger than 67%, the analysis means determines the setting of the manual magnification and the setting of the paper size as the factors. Processing equipment. The image according to any one of claims 14 to 16, wherein when the variable magnification is smaller than 67%, the analysis means determines the setting of the manual magnification and the setting of the page layout as the factors. Processing equipment. The analysis means includes the method of dealing with the determined factor in the result and outputs the result.
The image processing apparatus according to any one of claims 10 to 19, wherein the notification means notifies the cause according to the factor and the countermeasure method as the analysis result. The notification means is characterized in that the analysis result is notified by at least one notification method of display on a display means, sending an e-mail to an administrator, sending an e-mail to a logged-in user, or printing a report. The image processing apparatus according to claim 20. The image processing apparatus according to claim 20, further comprising a display control means for causing the display means to display a screen for setting a notification method by the notification means. The analysis means determines whether or not the signal value of the patch in the scan image indicated by the first scan image data can be acquired based on the scan image.
When the result of the determination in the analysis means indicates that the signal value of the patch in the scan image indicated by the first scan image data can be acquired, the print control means for causing the printing means to print the second color characteristic chart.
The image processing apparatus according to any one of claims 9 to 22, further comprising. 23. The image processing according to claim 23, wherein the processing means cancels the color matching process when the result of the determination in the analysis means indicates that the signal value of the patch in the scanned image cannot be obtained. apparatus. It is a control method of an image processing device having a printing means and a reading means and performing color matching processing according to the color reproduction characteristics of the target device.
By reading the first color characteristic chart printed by the target device with the reading means to acquire the first scan image data and by reading the second color characteristic chart printed by the printing means with the reading means. Steps to acquire the obtained second scan image data,
A step of performing the color matching process based on the first scan image data and the second scan image data, and
A method for controlling an image processing apparatus, which comprises. A program for causing a computer to execute the control method of the image processing device according to claim 25.

Images