JP2020052483A - Image processing device and program - Google Patents

Abstract

To enable acquisition of correspondence relation about information affecting texture by a simple calculation for a short time, as compared with a method of measuring a BRDF (Bidirectional Reflectance Distribution Function) of much color patches.SOLUTION: An image processing device has: a first image acquisition unit which acquires a diffuse reflection image on the surface of a printed matter; a second image acquisition unit which acquires a regular reflection image on the surface of the printed matter; a difference image generation unit which generates a difference image between the diffuse reflection image and the regular reflection image; and a correspondence relation generation unit which associates information affecting texture on the surface of the printed matter with the information on the diffuse reflection image and the information on the difference image.SELECTED DRAWING: Figure 10

Description

  The present invention relates to an image processing device and a program.

  In order to easily reproduce the texture (glossiness, unevenness, etc.) of the object surface with three-dimensional CG, a bidirectional reflectance distribution function (BRDF) is acquired, and a BRDF model is added to the acquired value. To determine the coefficients of the BRDF model such as the diffuse reflection coefficient and the specular reflection coefficient.

JP 2010-152533 A

  For each color patch of the color chart printed on the recording medium, the ratio of the intensity of the reflected light to the light incident on each surface (BRDF) is measured in all directions of the hemisphere, and the parameters of the BRDF model are derived from the measured results. In the method of creating a look-up table representing the correspondence between print data values and BRDF parameter values, it takes an enormous amount of time to measure BRDF for a large number of color patches.

  An object of the present invention is to make it possible to acquire a correspondence relationship of information affecting the texture with a short and simple calculation as compared with a method of measuring the BRDF of a large number of color patches.

The first aspect of the present invention provides a first image acquisition unit that acquires a diffuse reflection image of the surface of a printed matter, a second image acquisition unit that acquires a regular reflection image of the surface of the printed matter, and the diffuse reflection image. And a difference image generation unit that generates a difference image of the specular reflection image, and information that affects the texture of the surface of the printed material specified when forming the printed material, information of the diffuse reflection image and information of the difference image. And a correspondence generation unit that associates the information with the information.
The invention according to claim 2 is the image processing apparatus according to claim 1, wherein the information affecting the texture of the surface of the printed matter includes information on a recording medium included in the printed matter.
The invention according to claim 3 is the image processing apparatus according to claim 2, wherein the information affecting the texture of the surface of the printed matter includes the type and amount of a material used for printing an image.
The invention according to claim 4 is the image processing apparatus according to claim 2, wherein the information affecting the texture of the surface of the printed material includes a printing method used for generating the printed material.
The invention according to claim 5 is the image processing apparatus according to claim 2, wherein the information affecting the texture of the surface of the printed matter includes information relating to surface processing.
The invention according to claim 6, wherein the correspondence generation unit is configured to calculate an average pixel value of the diffuse reflection image corresponding to the sample pattern formed on the printed matter and an average pixel value of the difference image corresponding to the sample pattern. The image processing apparatus according to claim 1, wherein a look-up table is generated in which the lookup table is associated with information that affects the texture of the printed matter corresponding to the sample pattern.
The invention according to claim 7, wherein the correspondence relation generation unit further associates the difference image or a grayscale image of the difference image with information that affects the texture of the printed matter corresponding to the sample pattern. An image processing apparatus according to (1).
The invention according to claim 8, wherein the correspondence generation unit is configured to include information that affects a texture of the printed matter corresponding to the sample pattern formed on the printed matter, and the difference image or the gray scale corresponding to the sample pattern. The image processing apparatus according to claim 1, wherein a correspondence relationship with an image is stored.
The invention according to claim 9 is based on the information of the diffuse reflection image and the difference image corresponding to the sample pattern formed on the printed matter, and based on information of any print data or image data including information affecting texture. The image processing device according to claim 1, further comprising an image display control unit that generates a simulation image representing an output result corresponding to the processed data.
The invention according to claim 10 simulates an output result of arbitrary print data or image data or processed data based on information of the diffuse reflection image and the difference image corresponding to a sample pattern formed on the printed matter. The image processing apparatus according to claim 1, further comprising an image editing unit that displays an image and receives editing of the print data or the image data or the processed data.
The invention according to claim 11 provides a computer with a function of acquiring a diffuse reflection image of the surface of a printed matter, a function of acquiring a regular reflection image of the surface of the printed matter, and a difference between the diffuse reflection image and the regular reflection image. A function of generating an image and a function of associating the information on the diffuse reflection image and the information on the difference image with information specified when forming the printed matter and affecting the texture of the surface of the printed matter are executed. It is a program.

According to the first aspect of the present invention, it is possible to acquire the correspondence relation of information affecting the texture with a short and simple calculation as compared with the method of measuring the BRDF of a large number of color patches.
According to the second aspect of the present invention, it is possible to acquire the correspondence relation between the recording media in a short time and with a simple calculation.
According to the third aspect of the present invention, it is possible to acquire the correspondence relationship between the type and the amount of the material used for printing in a short time and with a simple calculation.
According to the fourth aspect of the present invention, it is possible to acquire a correspondence relationship regarding a difference in a printing method in a short time and with a simple calculation.
According to the fifth aspect of the present invention, it is possible to acquire a correspondence relationship regarding a difference in surface processing by a short and simple calculation.
According to the sixth aspect of the present invention, it is possible to obtain a look-up table in which a sample pattern formed on a printed matter is associated with information that affects a texture by a short and simple calculation.
According to the seventh aspect of the present invention, it is possible to generate data that can reproduce the texture even if the storage area is small.
According to the eighth aspect of the invention, it is possible to reproduce the texture even if the storage area is small.
According to the ninth aspect, it is possible to easily simulate the texture of the output result corresponding to any print data, image data, or processed data.
According to the tenth aspect, print data, image data, or processed data can be easily edited so as to obtain a desired texture.
According to the eleventh aspect of the present invention, it is possible to acquire the correspondence relation of the information affecting the texture with a short and simple calculation as compared with the method of measuring the BRDF of a large number of color patches.

1 is a diagram illustrating an example of the overall configuration of an information processing system used in Embodiment 1. FIG. FIG. 3 is a diagram illustrating a configuration example of a hardware configuration of a texture information acquisition device. FIG. 3 is a diagram illustrating an example of a reflection image acquired by a texture information acquisition device. (A) is an example of a diffuse reflection image, (b) is an example of a specular reflection image, and (c) is an example of a difference image between the diffuse reflection image and the specular reflection image. FIG. 4 is a diagram illustrating an example of a functional configuration of a texture information acquiring unit according to the first embodiment. FIG. 5 is a diagram showing an example of a look-up table recorded in a correspondence database according to the first embodiment. FIG. 3 is a diagram illustrating a functional configuration example of a simulation device according to the first embodiment. FIG. 9 is a diagram illustrating an example of a work screen for generating printing plate data as print data # 2. FIG. 6 is a diagram illustrating a relationship between an incident angle, an angle γ formed by a specular reflection direction, and a line-of-sight direction. FIG. 4 is a diagram illustrating a relationship between a three-dimensional model displayed on a display device by a display control unit and a two-dimensional image corresponding to printing plate data. (A) is an example of a two-dimensional image corresponding to printing plate data, and (b) is an example of a CG image showing the two-dimensional image inclined in a virtual three-dimensional space. FIG. 14 is a diagram illustrating an example of a functional configuration of a texture information acquiring unit according to Embodiment 2. FIG. 15 is a diagram showing an example of a look-up table recorded in a correspondence database in the second embodiment. FIG. 9 is a diagram illustrating a functional configuration example of a simulation device according to a second embodiment. FIG. 9 is a diagram illustrating an example of a work screen used for specifying a color using a special color palette. FIG. 4 is a diagram illustrating a relationship between a three-dimensional model displayed on a display device by a display control unit and a two-dimensional image corresponding to printing plate data. (A) is an example of a two-dimensional image corresponding to printing plate data, and (b) is an example of a CG image showing the two-dimensional image inclined in a virtual three-dimensional space. FIG. 13 is a diagram illustrating an example of an overall configuration of an information processing system used in a third embodiment. FIG. 13 is a diagram illustrating a functional configuration example of a texture information acquiring device according to a third embodiment. FIG. 14 is a diagram illustrating an example of a look-up table recorded in a correspondence database according to the third embodiment. FIG. 14 is a diagram illustrating a functional configuration example of a simulation device according to a third embodiment. It is a figure explaining the example of the work screen used for designating the area which performs decoration processing using a decoration palette. FIG. 4 is a diagram illustrating a relationship between a three-dimensional model displayed on a display device by a display control unit and a two-dimensional image corresponding to printing plate data. (A) is an example of a two-dimensional image corresponding to printing plate data, and (b) is an example of a CG image showing the two-dimensional image inclined in a virtual three-dimensional space. FIG. 15 is a diagram illustrating an example of a functional configuration of a texture information acquiring unit according to Embodiment 4. FIG. 4 is a diagram illustrating an internal configuration of a deviation image generation unit. FIG. 17 is a diagram illustrating an example of a lookup table and a deviation image recorded in a correspondence + deviation image database according to the fourth embodiment. FIG. 14 is a diagram illustrating a functional configuration example of a simulation device according to a fourth embodiment. FIG. 15 is a diagram illustrating an operation example of a conversion unit according to Embodiment 4. FIG. 4 is a diagram illustrating a three-dimensional model displayed on a display device by a display control unit. FIG. 21 is a diagram illustrating an example of the overall configuration of an information processing system used in a fifth embodiment. FIG. 21 is a diagram illustrating an example of a functional configuration of an information processing device and a texture information acquiring unit according to Embodiment 5. FIG. 15 is a diagram illustrating a functional configuration example of a simulation device according to a fifth embodiment. FIG. 15 is a diagram illustrating a functional configuration example of a simulation device according to a sixth embodiment. FIG. 17 is a diagram illustrating a relationship between a three-dimensional model displayed on a display device by a display control unit and a two-dimensional image corresponding to printing plate data according to a sixth embodiment. (A) is an example of a two-dimensional image corresponding to printing plate data, and (b) is an example of a CG image obtained by printing the two-dimensional image on a three-dimensional object. FIG. 11 is a diagram illustrating an example of an overall configuration of an information processing system according to another embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
<First Embodiment>
<System configuration>
FIG. 1 is a diagram illustrating an overall configuration example of an information processing system 1 used in the first embodiment.
The information processing system 1 in FIG. 1 includes a first printing device 10, an image processing device 30, and a second printing device 60.
The first printing device 10 in FIG. 1 is a device that generates a printed matter 20 in which an image specified as first print data (hereinafter, referred to as “print data # 1”) is printed on a recording medium.
The print data # 1 is given by information designating the color of each pixel constituting the image. Note that the second print data (hereinafter, referred to as “print data # 2”) also includes the same information.

The recording medium is a medium on which an image is recorded, and is, for example, paper, film, wood, or metal. For example, even if the color information of each pixel is the same, if the recording medium is different, the degree of gloss and the texture of the surface of the printed matter 20 will be different. Therefore, the information that specifies the type of the recording medium is an example of information that affects the texture of the surface of the printed matter 20.
In the case of the present embodiment, “texture” is mainly used to mean the degree of gloss of the surface of an object perceived visually. The texture is, for example, a change in a gloss component caused by a pattern such as a pattern that is a combination of color components, a change in a gloss component caused by a surface structure such as unevenness, a change in a gloss component due to a glitter material, a change in a gloss component due to a film material, and the like. It is caused by a combination or the like.

Color materials used for printing an image on a recording medium include, for example, ink and toner. The colors of ink or toner installed in the printing apparatus 10 are basically four colors of cyan (C), magenta (M), yellow (Y), and black (K).
However, even with the same color, the degree of gloss of the surface of the printed matter 20 may change depending on the type and amount. Therefore, the color material used for printing is also an example of information that affects the texture of the surface of the printed matter 20. Colors that greatly affect the degree of gloss include silver, gold, and clear. In the present embodiment, these colors having a large influence on the degree of gloss are distinguished from the basic colors and are referred to as “special colors”. In the present embodiment, using a special color for printing means using one or more of the three colors exemplified above for printing.

Note that, even if the color information specifying each pixel is the same, if the printing method is different, the degree of gloss of the surface of the printed matter 20 may be different. Therefore, the information that specifies the printing method is also an example of information that affects the texture of the surface of the printed matter 20.
In the present embodiment, the print data # 1 is mainly described in the meaning of information for designating the color of each pixel. However, as described above, the print medium # 1, the type and amount of the color material, and the print data # 1 are used in the printing apparatus 10. The printing method may be included in the print data # 1. The print data # 1 is generated according to a user setting on a print setting screen opened on an operation screen of a computer terminal (not shown).

The image processing device 30 in FIG. 1 optically acquires texture information appearing on the surface of the printed matter 20, and generates a texture data acquisition device 40 corresponding to the print data # 1 corresponding to the printed matter 20, and a print data # 2. And a simulation device 50 that reproduces the texture of a printed matter obtained when printing based on the computer graphics is performed by computer graphics (hereinafter referred to as “CG”).
The texture information acquisition device 40 and the simulation device 50 here are also examples of an image processing device.
Further, the simulation device 50 uses the correspondence acquired by the texture information acquisition device 40 to reproduce a texture such as glossiness of a printed matter obtained by executing printing based on the print data # 2 as a CG image. Is an example of an image display control unit.
Arbitrary print data # 2 is input to the simulation device 50 in the present embodiment. However, the print data # 2 may be the same as the print data # 1.

The second printing device 60 may be physically the same as the first printing device 10, or may be another printing device having the same printing method.
If the relationship between the reproduction characteristics of the texture by the printing method of the first printing device 10 and the reproduction characteristics of the texture by the printing method of the second printing device 60 is given in advance, the second printing device 60 The printing method may be different from the printing method of the first printing device 10.
As described above, the texture such as gloss changes depending on the recording medium on which the image is printed, the color, type and amount of the color material used for recording the image, the combination of the printing methods, and the like.
Therefore, in order to increase the accuracy of the simulation result by the simulation device 50, it is desirable to acquire the correspondence between these combinations and the texture. However, not all of the correspondences need to be acquired.
The degree of influence on the texture is not the same between the elements of the combination. Therefore, even in the case of the correspondence relationship of some elements that provide a combination, it is possible to obtain a simulation result that can be put to practical use if a combination of elements having a large influence is given. For any combination, one or more elements that have a large effect on the texture, such as gloss, are elements that have a high effect on the texture in a reinforcement learning method that gives a high reward when a simulation result with high reproducibility is obtained, for example. May be machine-learned.

<Hardware configuration of texture information acquisition device 40>
FIG. 2 is a diagram illustrating a configuration example of a hardware configuration of the texture information acquisition device 40. Hereinafter, the texture information acquisition device 40 is also referred to as a texture scanner.
The texture information acquiring device 40 optically reads the surface of the printed matter 20, and acquires two types of image data as the reading result.
One of the image data is an image of a light component diffusely reflected on the surface of the print 20 (hereinafter, referred to as a “diffuse reflection image”), and the other is an image of a light component specularly reflected on the surface of the print 20. An image (hereinafter, referred to as a “specular reflection image”).
Specular reflection is reflection in which the incident angle and the reflection angle of light are the same angle with respect to the reflection surface, and is also called specular reflection. Therefore, the specular reflection image is the same as the specular reflection image.

The texture information acquisition device 40 illustrated in FIG. 2 includes a platen glass 41 on which the printed matter 20 is arranged, a carriage 42 having a built-in optical system for reading, a correspondence generation unit 43, and a correspondence database 44. I have.
The carriage 42 moves along the surface of the flat platen glass 41. The carriage 42 shown in FIG. 2 is provided with light sources 42A, 42B, 42C, an imaging optical system 42D, and an imaging sensor 42E. The carriage 42 is moved by a drive mechanism (not shown). Known technology is used for a drive mechanism (not shown) and a control system thereof.
Incidentally, the platen glass 41 is attached to a housing (not shown). The casing (not shown) accommodates the carriage 42, the correspondence generation unit 43, and the correspondence database 44.

Each part of the carriage 42 shown in FIG. 2 has a predetermined length in a direction perpendicular to the paper surface. The direction perpendicular to the paper corresponds to the main scanning direction of the carriage 42. On the other hand, the direction indicated by the arrow corresponds to the sub-scanning direction of the carriage 42.
When reading information on the surface of the printed matter 20, the carriage 42 moves in the direction of the arrow. Hereinafter, the direction in which the carriage 42 moves is referred to as a front (front) side, and the opposite side is referred to as a rear (rear) side.
The platen glass 41 is a glass plate that supports a surface to be read among the surfaces of the printed matter 20. The platen glass 41 may be a transparent member, for example, an acrylic plate.
When the surface of the printed matter 20 is optically read, the periphery of the printed matter 20 may be covered with a light-shielding cover member, and the outside light may be blocked so that the outside light does not enter the inside of the carriage 42.
The carriage 42 is driven to move in the sub-scanning direction at a predetermined speed when reading the printed matter 20.

The light source 42 </ b> A is a light source disposed on the front side with respect to the reading position of the printed matter 20, and emits light at an angle of, for example, 45 degrees with respect to the normal direction of the printed matter 20. The light source 42A is used for reading a diffuse reflection image of the printed matter 20.
The light source 42 </ b> B is a light source disposed on the rear side with respect to the reading position of the printed matter 20, and emits light at an angle of, for example, 45 degrees with respect to the normal direction of the printed matter 20. The light source 42B is also used for reading a diffuse reflection image of the printed matter 20.
Since both the light source 42A and the light source 42B are for reading the diffuse reflection image, only one of them may be used.
The light source 42C is a light source disposed on the rear side with respect to the reading position of the printed matter 20, and emits light at an angle of, for example, 10 degrees with respect to the normal direction of the printed matter 20. The light source 42C is provided at a position that does not block the principal ray of the reflected light. However, the light source 42C may be disposed on the front side with respect to the reading position of the printed matter 20. The angle at which the light emitted from the light source 42C is incident on the printed matter 20 may be, for example, 5 degrees to 10 degrees. The light source 42C is used for reading a specular reflection image of the printed matter 20.

It is desirable that the width or angle of the light beam emitted from the light source 42C to the surface of the printed matter 20 be narrow. Therefore, when the width or angle of the light beam emitted from the light source 42C is wide, a means is provided for limiting the width or angle of the light beam irradiating the surface of the printed matter 20 to be narrow. As the means here, a cover or an aperture for reducing the width or angle of the light beam by blocking a part of the light beam, a lens for condensing the light beam, and the like are used.
It is desirable that the light emitted from the light source 42C has a uniform and continuous luminance value in the main scanning direction as compared with the light sources 42A and 42B. This is because the light emitted from the light source 42C is used for reading gloss information on the surface of the printed matter 20. Light sources that satisfy this requirement include, for example, fluorescent lamps and rare gas fluorescent lamps (such as xenon fluorescent lamps).
The light source 42C may be an aggregate of a plurality of light sources. For example, the light source 42C diffuses light emitted from the plurality of white LEDs (Light Emitting Diodes) arranged in the main scanning direction and the plurality of white LEDs so that the luminance distribution of the reading position in the main scanning direction becomes uniform. You may comprise a diffusion plate etc.
In the case of FIG. 2, three light sources 42A, 42B, and 42C are arranged on the carriage 42, but the light emitted from one light source is branched into a plurality of lights, and the light path of the branched light is reflected. The light may be incident on the reading position at a different angle.

The carriage 42 has an imaging optical system 42D and an imaging sensor 42E.
The imaging optical system 42D includes, for example, a reflection mirror or an imaging lens, and forms a component of diffuse reflection light and a component of specular reflection light reflected in the normal direction from the surface of the printed matter 20 on the light receiving surface of the imaging sensor 42E. Image.
The imaging sensor 42E outputs the intensity of the diffuse reflection light and the specular reflection light imaged on the light receiving surface as an image signal. As the imaging sensor 42E, for example, a light receiving element such as a CCD (Charge Coupled Device) linear image sensor or a CMOS (Complementary MOS) image sensor is used.
A color filter (not shown) is disposed on the surface of the imaging sensor 42E. Therefore, the imaging sensor 42E outputs a color image signal representing the color of the reading position of the printed matter 20 for each of the diffuse reflection image and the specular reflection image. The color image signal is given by three color component values of red (R), green (G), and blue (B).

FIG. 3 is a diagram illustrating an example of a reflection image acquired by the texture information acquisition device 40 (see FIG. 2). (A) is an example of a diffuse reflection image, (b) is an example of a specular reflection image, and (c) is an example of a difference image between the diffuse reflection image and the specular reflection image.
The reflection image shown in FIG. 3 is obtained when a color chart in which 16 color patches (hereinafter, also referred to as “patches”) having different combinations of colors and densities are arranged in a matrix on the surface of the printed matter 20 is printed. Is done. The color patches constituting the color chart are an example of a sample pattern.
The horizontal axis of the color chart corresponds to four colors having different combinations of hue and gloss, and the vertical axis corresponds to the coverage corresponding to the amount of color material used when printing the printed matter 20. The lower the coverage, the smaller the amount of color material per unit area and the lower the color density. On the other hand, the higher the coverage, the greater the amount of color material per unit area, and the higher the color density.

In the case of FIG. 3, a printed matter 20 printed by an electrophotographic method using a printing apparatus 10 (see FIG. 1) capable of printing silver, which is one of the special colors, is assumed.
In the case of FIG. 3, the four colors forming the color chart include a mixed color of cyan and silver (hereinafter also referred to as “cyan + silver color”), a mixed color of magenta and silver (hereinafter also referred to as “magenta + silver color”), magenta, It is cyan.
The color chart shown in FIG. 3 includes color patches in which the coverage is changed in four stages for each color. Each of the color patches shown in FIG. 3 has the same shape. Specifically, the color patches are square.

As described above, the specular reflection image shown in (b) is an image in which the metallic gloss component on the surface of the printed matter 20 is mainly acquired, but also includes a diffusion component. Here, the metallic luster corresponds to the metallic color expressed by the silver toner.
(C) is a difference image expressing the metallic luster included in the specular reflection image. The difference image is generated by calculating a difference between the diffuse reflection image and the specular reflection image.
Since the metallic luster is basically generated by the silver toner, in the difference image, a gloss component appears in two rows of a color patch corresponding to the cyan + silver color and a color patch corresponding to the magenta + silver color including the silver toner. I have. Further, the difference in the coverage also appears in the difference in the reflectance of the metallic luster. That is, the higher the coverage, the brighter the color patch looks.

Returning to the description of FIG.
In the case of the carriage 42 used in the present embodiment, the relationship between the incident angle of irradiation light and the light receiving angle received by the imaging sensor 42E is kept constant over the entire surface of the printed matter 20. This relationship cannot be realized by imaging with an imaging camera or the like.
Therefore, by calculating the difference between the diffuse reflection image acquired under the diffuse reflection condition (incident angle is 45 degrees) and the specular reflection image acquired under the specular reflection condition (incident angle is 10 degrees), It is possible to accurately extract information on metallic luster. This means that the region of metallic luster and the reflectance (mirror reflectance of a two-dimensional plane) can be obtained at once by a simple difference calculation.
The diffuse reflection condition (incident angle of 45 degrees) and the specular reflection condition (incident angle of 10 degrees) are calibrated by the same white calibration plate.

The correspondence generation unit 43 included in the texture information acquisition device 40 generates the above-described difference image from the diffuse reflection image and the specular reflection image, and also associates the correspondence between the set of the diffusion image and the difference image and the print data # 1. It is a functional unit that records in the relation database 44.
The correspondence generation unit 43 is realized, for example, through execution of a program by a computer. The computer includes a CPU (Central Processing Unit) that provides various management functions through the execution of the program, a ROM (Read Only Memory) as a storage area for storing a BIOS (Basic Input Output System), and a program execution area. And a RAM (Random Access Memory) to be used.
Further, the computer has a hard disk or other storage device that stores an application program or a correspondence database 44 for realizing a correspondence generation function described later, and a communication interface used for communication with the outside. However, the correspondence generation unit 43 may be configured as a circuit device specialized in the processing of generating the correspondence.
Further, the correspondence generation unit 43 and the correspondence database 44 may be housed in a housing other than the housing (not shown) in which the platen glass 41 and the carriage 42 are housed.

<Hardware configuration of simulation device 50>
Returning to the description of FIG.
The simulation device 50 is configured by, for example, a computer. The configuration of the computer has been described as the configuration of the correspondence generation unit 43 (see FIG. 2), and will not be described. Note that a computer used as the simulation device 50 is connected to a display device for displaying an operation screen and a simulation result and an input device for the operation screen. The input device is, for example, a keyboard, a mouse, a stylus pen, or the like.
The program for realizing the function as the simulation device 50 may be a dedicated program or a part of the function of design editing software.

<Functional Configuration of Image Processing Apparatus 30>
FIG. 4 is a diagram illustrating an example of a functional configuration of the texture information acquisition device 40 according to the first embodiment.
In FIG. 4, the portions corresponding to those in FIG.
In FIG. 4, as a specific example of the print data # 1, patch data corresponding to a single color patch is given.
In the case of FIG. 4, the patch data includes five colors of cyan (C), magenta (M), yellow (Y), black (K), and special colors. However, information such as the type of the recording medium, the type and amount of the color material, and the printing method may be included as part of the patch data or the attached or associated setting data.
In the case of FIG. 4, the patch data includes only the component values of the color materials. As an example, (C, M, Y, K, special color) = (0, 20, 0, 0, 80) is illustrated.

The spot colors include silver, gold, clear, and the like. In the example of FIG. 4, one of these colors is used. For example, gold is used.
In the case of FIG. 4, the patch data has a magenta component value of 20, a special color component value of 80, and cyan, yellow, and black component values of 0.
The printing apparatus 10 that has received the patch data prints the color patches on the recording medium specified by the user, and outputs them as printed matter 20. As the recording medium, for example, coated paper is used.
The printed matter 20 is placed on the upper surface of the platen glass 41 (see FIG. 2) with the printed surface facing down.

The carriage 42 in the present embodiment functions as a diffuse reflection image acquisition unit 42F and a specular reflection image acquisition unit 42G. Here, the diffuse reflection image acquisition unit 42F is an example of a first image acquisition unit, and the specular reflection image acquisition unit 42G is an example of a second image acquisition unit.
The diffuse reflection image acquisition unit 42F receives the reflection light of the light emitted from the light sources 42A and 42B (see FIG. 2) by the imaging sensor 42E (see FIG. 2) and outputs the light as a diffuse reflection image. The diffuse reflection image corresponds to a color component.
The specular reflection image acquisition unit 42G receives the reflection light of the light emitted from the light source 42C (see FIG. 2) by the imaging sensor 42E, and outputs it as a specular reflection image. The specular reflection image corresponds to the gloss component.
Switching between the period in which the light sources 42A and 42B emit light and the period in which the light source 42C emits light is controlled.

The correspondence generation unit 43 has functions as a difference image acquisition unit 43A, average value calculation units 43B and 43C, and a correspondence recording unit 43D.
As described above, the difference image acquisition unit 43A has a function of calculating a difference between a diffuse reflection image and a specular reflection image for each pixel to acquire a difference image. There are two methods for obtaining the difference image, a method for obtaining the difference image by subtracting the diffuse reflection image from the specular reflection image, and a method for obtaining the difference image by subtracting the specular reflection image from the diffuse reflection image. The difference image acquisition unit 43A calculates the difference image by one or both methods. The difference image acquisition unit 43A is an example of a difference image generation unit.

The average value calculation unit 43B calculates an average RGB value of the diffuse reflection image corresponding to the color patch. When a color chart is printed on the printed matter 20, the average value calculation unit 43B calculates an average RGB value for each color patch. In the case of FIG. 4, the average RGB value is (R, G, B) = (185, 151, 95). The average RGB value is an example of an average pixel value.
The average value calculation unit 43C calculates an average RGB value of the difference image corresponding to the color patch. Of course, when the color chart is printed on the printed matter 20, the average value calculation unit 43C calculates the average RGB value for each color patch. In the present embodiment, the average RGB value of the difference image is represented by an average ΔRΔGΔB value for distinction. Δ represents a difference. The average ΔRΔGΔB value is an example of an average pixel value.
In the case of FIG. 4, the average ΔRΔGΔB value is expressed by (ΔR, ΔG, ΔB) = (69, 88, 88).
The correspondence recording unit 43D records the correspondence between the average RGB value and the average ΔRΔGΔB value calculated for the patch data input as the print data # 1 in the correspondence database 44. The correspondence recording unit 43D here is an example of a correspondence generation unit.

FIG. 5 is a diagram illustrating an example of a look-up table recorded in the correspondence database 44 according to the first embodiment. The left column of the lookup table is the patch data, and the right column is the average RGB value and the average ΔRΔGΔB value acquired from the color patch corresponding to the patch data. The corresponding patch data, the average RGB value, and the average ΔRΔGΔB value are arranged in the same row.
FIG. 4 illustrates an example in which a set of average RGB values and average ΔRΔGΔB values are acquired for one patch data for convenience of description. However, when print data # 1 is given by a color chart, it A plurality of correspondences are recorded in a look-up table. Of course, the number of color patches constituting the color chart is not limited to four rows and four columns.
When the color chart is printed on the printed matter 20, a plurality of correspondences regarding the texture information are acquired by scanning the printed matter 20 twice. This means that the time required to acquire the texture information can be reduced as compared to the BRDF measurement method. Further, the acquisition of the texture information may be a difference operation, and the load on the calculation resources can be reduced.

FIG. 6 is a diagram illustrating a functional configuration example of the simulation device 50 according to the first embodiment.
In FIG. 6, parts corresponding to those in FIG. 2 are denoted by the same reference numerals.
The printing apparatus data is given to the simulation device 50 shown in FIG. 6 as print data # 2 by the user.
FIG. 6 also shows an image example of the printing plate data. The image example shown in FIG. 6 relates to a package printed matter. In the case of FIG. 6, the user directly specifies the color of each part of the image to be printed by numerical values. For example, on a work screen (not shown), the user designates a package printed matter portion, designates a magenta component value of 20, a special color component value of 80, and cyan, yellow, and black component values of 0. In the case of the present embodiment, the special color is gold.

FIG. 7 is a diagram illustrating an example of a work screen 71 for generating printing plate data as print data # 2.
The work screen 71 is displayed as a window on the display screen of the display device 70. The display device 70 is, for example, a liquid crystal display or an organic EL (Electro Luminescence) display.
On a work screen 71 shown in FIG. 7, an image 72 to be printed, a three-dimensional (3D) preview button 73, and a print button 74 are arranged.
FIG. 7 also shows a setting screen 76 that is opened when the print button 74 is clicked with the mouse pointer 75. In the setting screen 76 shown in FIG. 7, a recording medium is further designated, and a detailed setting screen 77 is opened. On the detailed setting screen 77, coated paper is selected. Note that plain paper, film, and the like can be designated as the recording medium. In the setting screen 76, it is also possible to set the color material, the printing method, the decoration, and the like.
In the present embodiment, the user inputs numerical values of the colors of each part of the image 72 to be printed on the work screen 71.

Returning to the description of FIG.
The simulation apparatus 50 includes a determination unit 50A that determines whether or not to execute a 3D preview, a conversion unit 50B that converts printing plate data expressed by CMYK special colors into average RGB and average ΔRΔGΔB, and calculates a reflectance distribution function. Function as a reflectance distribution function calculating unit 50C, a rendering unit 50D that generates a three-dimensional preview image corresponding to printing plate data, and a display control unit 50E that displays the three-dimensional preview image on the display device 70 (see FIG. 7). Have.

The determination unit 50A outputs the printing plate data to the printing device 60 when there is no three-dimensional preview. The case without the three-dimensional preview is a case where the print button 74 (see FIG. 7) is operated.
In this case, the printing device 60 generates a print output sample in which an image corresponding to the printing plate data is printed on a recording medium in accordance with a user setting.
When there is a three-dimensional preview, the determination unit 50A provides the printing plate data to the conversion unit 50B. The case where there is a three-dimensional preview is a case where the 3D preview button 73 (see FIG. 7) is operated.
In this case, the conversion unit 50B searches the correspondence database 44 using the CMYK spot color specified by the printing plate data as a search key, and reads out the average RGB value and the average ΔRΔGΔB value corresponding to the specified CMYK spot color.

If the CMYK spot color specified by the printing plate data is not recorded in the correspondence relation database 44, the conversion unit 50B may read the average RGB value and the average ΔRΔGΔB value corresponding to the color similar to the specified CMYK spot color. Good. Here, the similar color refers to, for example, a color whose distance in a color space is the closest, or a color within a predetermined distance.
The conversion unit 50B may read a plurality of sets of average RGB values and average ΔRΔGΔB values for a plurality of similar colors, and calculate an estimated value of the average RGB value and the average ΔRΔGΔB value from those values.

The reflectance distribution function calculation unit 50C calculates a reflectance distribution function corresponding to the appearance at the time of printing from the read values. For example, the reflectance distribution function calculating unit 50C calculates the reflectance distribution function as the following equation according to the Phong reflection model.
I = I _i ｛{w _d・ RGB ・ cos θ _i ｝ + I _i ｛{w _s・ ΔRΔGΔB ・ cos ⁿ γ｝
Here, I is the reflected light intensity.
Of the first term _{{w d · RGB · cosθ i} } is the diffuse reflectance distribution function. Here, _{w d} is the diffuse reflection weighting factor, RGB is the average RGB value of the diffuse reflection image. θ _i is the angle of incidence.
Of second term ^{_{{w s · ΔRΔGΔB · cos n}} γ} is the specular reflectance distribution function. Here, w _s is the specular reflection weighting factor, DerutaaruderutajiderutaB is the average RGB value of the difference image of a specular reflection image and a diffuse reflection image. γ is the angle between the specular reflection direction and the viewing direction, and n is the specular reflection index.
FIG. 8 is a diagram illustrating the relationship between the incident angle θ _i and the angle γ between the specular reflection direction and the line-of-sight direction. Here, the vector N indicates a normal vector. Vector L indicates a light source direction vector, and vector R indicates a reflection vector. The vector V indicates a line-of-sight direction vector.
The vector R here corresponds to the specular reflection direction, and the vector V corresponds to the line-of-sight direction.

The rendering unit 50D generates a CG image reproducing the texture information included in the printing plate data. In other words, the rendering unit 50D arranges the three-dimensional model corresponding to the printing plate data on the virtual screen in the virtual three-dimensional space, and calculates the RGB values of each pixel constituting the surface by using the reflectance distribution function calculating unit 50C. Is determined based on the reflectance distribution function calculated by The rendering processing is known, and for example, a radiosity method or a ray tracing method in consideration of the mutual reflection may be used.
The display control unit 50E displays an image of the three-dimensional model generated by the rendering on the display device 70. This three-dimensional model is an example of a simulation image of an output result corresponding to printing plate data.
FIG. 9 is a diagram illustrating the relationship between the three-dimensional model displayed on the display device 70 (see FIG. 7) by the display control unit 50E and the two-dimensional image corresponding to the printing plate data. (A) is an example of a two-dimensional image corresponding to printing plate data, and (b) is an example of a CG image showing the two-dimensional image inclined in a virtual three-dimensional space. The tilt angle can be freely changed by the user.
As shown in (b), the metallic luster due to the gold component designated as the spot color is reproduced.

<Embodiment 2>
Also in the case of the present embodiment, the information processing system 1 shown in FIG. 1 is assumed.
Therefore, the basic device configuration is the same as in the first embodiment. The difference is the functional configuration of the image processing device 30.
FIG. 10 is a diagram illustrating an example of a functional configuration of the texture information acquiring apparatus 40 according to the second embodiment. In FIG. 10, the portions corresponding to those in FIG.
The texture information acquisition device 40 shown in FIG. 10 is different in that the average value calculation units 43B and 43C are not provided. That is, in the present embodiment, the obtained diffuse reflection image and specular reflection image are not averaged and used as they are. For this reason, information on a subtle change in gloss in the area where the color patch is printed is also stored.

FIG. 11 is a diagram showing an example of a look-up table recorded in the correspondence database 44 in the second embodiment. The left column of the lookup table is patch data, and the right column is a diffuse reflection image (= RGB image) and a difference image (= ΔRΔGΔB image) acquired from a color patch corresponding to the patch data. The patch data, the diffuse reflection image, and the difference image that have a corresponding relationship are arranged in the same row.
Of course, when the print data # 1 is given in a color chart as shown in FIG. 3, a plurality of correspondences are recorded in the lookup table at a time. Of course, the number of color patches constituting the color chart is not limited to four rows and four columns.
When the color chart is printed on the printed matter 20, a plurality of correspondences regarding the texture information are acquired by scanning the printed matter 20 twice. This means that the time required to acquire the texture information can be reduced as compared to the BRDF measurement method. Further, the acquisition of the texture information may be a difference operation, and the load on the calculation resources can be reduced.

FIG. 12 is a diagram illustrating a functional configuration example of a simulation device 50 according to the second embodiment. In FIG. 12, parts corresponding to those in FIG. 6 are denoted by the same reference numerals.
The functional configuration of the simulation device 50 is basically the same as that of the first embodiment.
However, in the case of FIG. 12, printing plate data is generated by selection on a color palette (hereinafter, referred to as “special color palette”) in which color samples defined by combinations of basic colors and special colors are arranged.
FIG. 13 is a diagram illustrating an example of a work screen 71 used for specifying a color using a special color palette.
In FIG. 13, parts corresponding to those in FIG. 7 are denoted by the same reference numerals.
In FIG. 13, a special color palette 78 is displayed on the display screen of the display device 70 on the right side of the work screen 71. The special color palette 78 may be prepared simply from the viewpoint of color alone, or may be prepared for a combination of a recording medium, a coloring material, a printing method, decoration, and the like.

In FIG. 13, only one spot color palette 78 is displayed, but a plurality of spot color palettes 78 may be displayed.
In the case of the work screen 71 shown in FIG. 13, the user specifies, for example, a part of the image 72 to be printed which the user wants to specify a color of, and then selects one of a plurality of color samples constituting the spot color palette 78. Select Further, for example, the user drags the color sample (patch) selected on the special color palette 78 and drops it at a desired position in the image 72 to be printed.
In the case of FIG. 13, the user does not need to input a numerical value specifying the color. In the color sample selected in FIG. 13, 20 is recorded as the component value of magenta, 80 as the component value of the special color, and 0 as the component values of cyan, yellow, and black.
In the present embodiment, as in the first embodiment, the user may specify the color of each area as printing plate data by numerical values.

Returning to the description of FIG.
Also in the case of the present embodiment, the determination unit 50A outputs the printing plate data to the printing device 60 when there is no three-dimensional preview. The case without the three-dimensional preview is a case where the print button 74 (see FIG. 7) is operated.
In this case, the printing device 60 outputs a printed matter 20 on which an image corresponding to the printing plate data is printed on a recording medium in accordance with a user setting.
On the other hand, when there is a three-dimensional preview, the determination unit 50A provides the printing plate data to the conversion unit 50B. The case where there is a three-dimensional preview is a case where the 3D preview button 73 (see FIG. 7) is operated.

The conversion unit 50B searches the correspondence database 44 using the CMYK spot color specified by the printing plate data as a search key, and obtains a diffuse reflection image (= RGB image) and a difference image (= ΔRΔGΔB image) corresponding to the specified CMYK spot color. Is read. The difference from the first embodiment is that the associated information is not an average value but an image acquired from a color patch. As described above, in the difference image calculated as the difference between the diffuse reflection image and the specular reflection image, a change in gloss within the printing surface is stored, and information of a texture that is more realistic is stored.
If the conversion unit 50B according to the present embodiment does not record the CMYK spot color specified in the printing plate data, the conversion unit 50B may read the diffuse reflection image and the difference image corresponding to the similar color, The diffuse reflection image and the difference image corresponding to the CMYK special color specified by the printing plate data may be estimated.

The reflectance distribution function calculating unit 50C in the present embodiment calculates the reflectance distribution function corresponding to the appearance at the time of printing using the read image. For example, the reflectance distribution function calculating unit 50C calculates the reflectance distribution function as the following equation according to the Phong reflection model.
I (x, y) = I i · {w d · G d (x, y) · cosθ i} + I i · {w s · {G s (x, y) -G d (x, y)}・ Cos ⁿ γ｝
Here, I (x, y) is the reflected light intensity on a two-dimensional plane.
Of the first term on the right-hand side, {w _d · G _d (x, y) · cos θ _i } is a diffuse reflectance distribution function. Here, w _d is a diffuse reflection weighting coefficient, and G _d (x, y) is a diffuse reflection image. θ _i is the angle of incidence.
Right side of the second term _{{w s · {G s (} x, y) -G d (x, y)} · cos n γ} is the specular reflectance distribution function. Here, w _s is a specular reflection weight coefficient, and G _s (x, y) is a specular reflection image. _{Also, G s (x, y)} -G d (x, y) is the difference image of the specular reflection image and a diffuse reflection image. γ is the angle between the specular reflection direction and the viewing direction, and n is the specular reflection index.

The rendering unit 50D and the display control unit 50E are the same as in the first embodiment. However, the generation of the CG image by the rendering unit 50D uses the reflected light intensity I (x, y) of the two-dimensional plane on which the diffuse reflection image and the difference image are reflected.
FIG. 14 is a diagram illustrating the relationship between the three-dimensional model displayed on the display device 70 (see FIG. 13) by the display control unit 50E and the two-dimensional image corresponding to the printing plate data. (A) is an example of a two-dimensional image corresponding to printing plate data, and (b) is an example of a CG image showing the two-dimensional image inclined in a virtual three-dimensional space. The tilt angle can be freely changed by the user.
As shown in (b), in addition to the reproduction of the metallic luster due to the gold component designated as the spot color, a change in the luster due to the difference in the position of the printing surface is also displayed as shown by enlarging a part of the surface. . Realistic texture is expressed by this change in gloss.

<Embodiment 3>
FIG. 15 is a diagram illustrating an overall configuration example of an information processing system 1A used in the third embodiment. In FIG. 15, parts corresponding to those in FIG. 1 are denoted by reference numerals.
In the information processing system 1 </ b> A illustrated in FIG. 15, the first decoration device 80 is disposed instead of the first printing device 10, and the second processing for processing the printed matter 20 output from the second printing device 60 is performed. The difference is that the decorating device 90 is arranged and that the type of decorating is specified by the number of the decorating pallet. Decorating is an example of surface processing for decorating the surface.
However, this does not mean that the first printing device 10 is not necessary, and merely does not draw the first printing device 10 by drawing a contract.
The first decorating device 80 processes the surface of a printed matter output from a printing device (not shown) to generate a decorated printed matter 20A.
This relationship is the same as the relationship between the second printing device 60 and the second decorating device 90.
In this embodiment, for the sake of simplicity, it is assumed that the change in gloss is caused solely by the difference in decoration.

<Functional Configuration of Texture Information Acquisition Device 40>
FIG. 16 is a diagram illustrating an example of a functional configuration of the texture information acquiring apparatus 40 according to the third embodiment. In FIG. 16, the parts corresponding to those in FIG.
Therefore, also in the texture information acquisition device 40 in the present embodiment, the correspondence generation unit 43 uses the diffuse reflection image and the difference image as one information of the correspondence.
In the case of the present embodiment, the decorating device 80 gives the printed material a surface treatment in accordance with the given decorative pallet number, and outputs it as a decorated printed material 20A.
In the example of FIG. 16, as an example of the decoration, a foil stamping process of transferring a gold foil or the like to a printed material by heat and pressure is assumed. However, the foil used for the foil stamping process is not limited to a gold foil, but may be a silver foil, a pigment foil, a white foil, a transparent foil, or the like. Further, the foil stamping process includes types such as gloss, mat, and hologram. The decorative pallet number is information for specifying one of these multiple types.
Note that the decoration is not limited to the foil stamping process, but also includes a film process and an embossing process.

The texture information acquiring apparatus 40 in the present embodiment scans the carriage 42 (see FIG. 2) in one direction with the decorated printed matter 20A arranged on the platen glass 41 (see FIG. 2), and prints the decorated printed matter 20A. To obtain a diffuse reflection image and a specular reflection image of.
The acquired diffuse reflection image and specular reflection image are provided to the correspondence generation unit 43.
As described above, the functional configuration of the texture information acquiring device 40 is basically the same as that of the second embodiment (see FIG. 10).
However, in the case of the present embodiment, the correspondence recording unit 43D records the correspondence between the diffuse reflection image (= RGB image), the difference image (= ΔRΔGΔB image), and the decorative pallet number in the correspondence database 44.
FIG. 17 is a diagram illustrating an example of a look-up table recorded in the correspondence database 44 according to the third embodiment. The left column of the lookup table is a decorative pallet number, and the right column is a diffuse reflection image and a difference image obtained from the decorative printed matter 20A. The decorative pallet number, the diffuse reflection image, and the difference image that have a corresponding relationship are arranged on the same line. The diffuse reflection image and the difference image here correspond to a sample pattern image formed on the surface of the printed matter 20.

FIG. 17 illustrates an example in which a set of a diffuse reflection image (= RGB value) and a difference image (= ΔRΔGΔB image) is acquired for one decoration pallet number for convenience of description. If different decorative pallet numbers are assigned to the area, a plurality of correspondences are recorded in the look-up table at one time. This is the same concept as the color charts of the first and second embodiments.
When a plurality of types of decorating processes are performed on the decorated printed matter 20A, a plurality of correspondences regarding the texture information are acquired by two scans of the decorated printed matter 20A. This means that the time required to acquire the texture information can be reduced as compared to the BRDF measurement method. Further, the acquisition of the texture information may be a difference operation, and the load on the calculation resources can be reduced.

FIG. 18 is a diagram illustrating an example of a functional configuration of a simulation device 50 according to the third embodiment. In FIG. 18, portions corresponding to those in FIG. 12 are denoted by reference numerals.
The functional configuration of the simulation device 50 is basically the same as that of the second embodiment.
However, in the case of FIG. 18, printing plate data with a decoration pallet number is generated by selection on a decoration pallet in which decoration samples are arranged.
FIG. 19 is a diagram illustrating an example of a work screen 71 used to specify an area to which a decoration process is to be performed using a decoration pallet.
19, the parts corresponding to those in FIG. 7 are denoted by the same reference numerals.
In FIG. 19, a decoration pallet 79 is displayed on the display screen of the display device 70 on the right side of the work screen 71. A plurality of decorative samples are arranged on the decorative pallet 79. The decorating pallet 79 may be prepared simply from the viewpoint of the type of decorating process, or may be prepared for combinations of colors, recording media, coloring materials, printing methods, and the like.

In FIG. 19, only one decoration pallet 79 is displayed, but a plurality of decoration pallets 79 may be displayed.
In the case of the work screen 71 shown in FIG. 19, the user specifies, for example, an area 72 </ b> A to which decoration processing is to be applied in the image 72 to be printed, and thereafter, a plurality of decoration samples (patches) constituting the decoration pallet 79. ), Select the desired one. In addition, for example, the user drags the decoration sample selected on the decoration palette 79 and drops the decoration sample 72 in the image 72 to be printed on the area 72A where the decoration processing is to be performed. The area 72A to which the decoration processing is applied may be given as an independent pattern.
In the case of FIG. 19, the user does not need to input a numerical value specifying the type of the decoration processing. Note that the decorative sample selected in FIG. 19 is provided with the decorative palette number 2.

Returning to the description of FIG.
Also in the case of the present embodiment, the determination unit 50A outputs the printing plate data to the printing device 60 when there is no three-dimensional preview. The case without the three-dimensional preview is a case where the print button 74 (see FIG. 7) is operated.
In this case, the printing device 60 outputs a printed matter 20 on which an image corresponding to the printing plate data is printed on a recording medium in accordance with a user setting. Thereafter, the decoration device 90 applies a decoration process designated by the decoration pallet number to the printed matter 20. The decorating device 90 outputs a decorated printed matter 20A obtained by performing a decorating process on the printed matter 20.
On the other hand, when there is a three-dimensional preview, the determination unit 50A gives the printing plate data and the decorative pallet number to the conversion unit 50B. The case where there is a three-dimensional preview is a case where the 3D preview button 73 (see FIG. 19) is operated.

The conversion unit 50B in the present embodiment searches the correspondence database 44 using the decorative pallet number as a search key, and detects a diffuse reflection image (= RGB image) and a difference image (= ΔRΔGΔB) corresponding to the specified decorative pallet number. Image). The difference from the second embodiment is that the information used as the search key is not a CMYK special color but a decorative pallet number. As described above, in the difference image calculated as the difference between the diffuse reflection image and the specular reflection image, the change in gloss in the area to which the decoration processing is applied is stored, and information of a texture that is more realistic is stored. Has been saved.
In the case where the designated decoration pallet number is not recorded in the conversion unit 50B in the present embodiment, the conversion unit 50B also determines the diffuse reflection image and the difference image corresponding to the decoration pallet number having similar decoration processing contents. May be read out, or the diffuse reflection image and the difference image corresponding to the designated decorative pallet number may be estimated.

The reflectance distribution function calculating unit 50C in the present embodiment calculates the reflectance distribution function corresponding to the appearance at the time of printing using the read image. For example, the reflectance distribution function calculating unit 50C calculates the reflectance distribution function as the following equation according to the Phong reflection model.
I (x, y) = I i · {w d · G d (x, y) · cosθ i} + I i · {w s · {G s (x, y) -G d (x, y)}・ Cos ⁿ γ｝
Here, I (x, y) is the reflected light intensity on a two-dimensional plane.
Of the first term on the right-hand side, {w _d · G _d (x, y) · cos θ _i } is a diffuse reflectance distribution function. Here, w _d is a diffuse reflection weighting coefficient, and G _d (x, y) is an image obtained by superimposing a diffuse reflection image on printing plate data. θ _i is the angle of incidence.
Right side of the second term _{{w s · {G s (} x, y) -G d (x, y)} · cos n γ} is the specular reflectance distribution function. Here, w _s is a specular reflection weight coefficient, and G _s (x, y) is a specular reflection image. _{Also, G s (x, y)} -G d (x, y) is an image superimposed on the printing plate data a difference image of the specular reflection image and a diffuse reflection image. γ is the angle between the specular reflection direction and the viewing direction, and n is the specular reflection index.

The rendering unit 50D and the display control unit 50E are the same as in the first embodiment. However, the generation of the CG image by the rendering unit 50D uses the two-dimensional plane reflected light intensity I (x, y) reflecting the printing plate data, the diffuse reflection image, and the difference image.
FIG. 20 is a diagram illustrating the relationship between the three-dimensional model displayed on the display device 70 (see FIG. 19) by the display control unit 50E and the two-dimensional image corresponding to the printing plate data. (A) is an example of a two-dimensional image corresponding to printing plate data, and (b) is an example of a CG image showing the two-dimensional image inclined in a virtual three-dimensional space. The tilt angle can be freely changed by the user.
The three-dimensional model here is an example of a simulation image of an output result corresponding to the decorative pallet number.
As shown in (b), the metallic luster generated by the decoration process specified by the decoration pallet number is reproduced in the designated area 72A. Realistic texture is expressed by this change in gloss.

<Embodiment 4>
In the system configuration shown in the second and third embodiments, the diffuse reflection image and the difference image are recorded in the correspondence database 44 to give a realistic texture to the CG image created by the simulation. The required storage capacity increases. Therefore, in the present embodiment, a system configuration capable of reducing the storage capacity required for the correspondence database 44 will be described.

Also in the case of the present embodiment, the information processing system 1 shown in FIG. 1 is assumed.
Therefore, the basic device configuration is the same as in the first embodiment. The difference is the functional configuration of the image processing device 30.
FIG. 21 is a diagram illustrating a functional configuration example of the texture information acquiring device 40 according to the fourth embodiment. In FIG. 21, the parts corresponding to those in FIG.
The texture information acquisition device 40 shown in FIG. 21 differs from the first embodiment in that a deviation image generation unit 45 is added and that a correspondence + deviation image database 44A is used.

FIG. 22 is a diagram illustrating the internal configuration of the deviation image generation unit 45.
The deviation image generation unit 45 includes a deviation diffusion reflection image calculation unit 45A that generates a deviation diffusion reflection image by uniformly subtracting the average RGB value that is the average value from the pixel values of the diffusion reflection image, and It has a function as a deviation difference image calculation unit 45B that generates a deviation difference image by uniformly subtracting the average ΔRΔGΔB value that is the average value.
Hereinafter, the deviation diffuse reflection image and the deviation difference image are collectively referred to as a deviation image. The deviation image is a deviation component that is lost due to averaging, but has little correlation with the color to be scanned. For this reason, the deviation image generation unit 45 in the present embodiment does not generate a deviation image for each color patch, but generates a set of the deviation diffuse reflection image and the deviation difference image generated for any one color patch. Output as a representative value.
Note that the deviation diffuse reflection image and the deviation difference image in the present embodiment are both generated as grayscale images. The data amount of the grayscale image is smaller than that of the color image.
The generated deviation diffuse reflection image and deviation difference image are recorded in the correspondence + deviation image database 44A together with the correspondence in the first embodiment.

FIG. 23 is a diagram illustrating an example of a lookup table and a deviation image recorded in the correspondence + deviation image database 44A according to the fourth embodiment.
The left column of the lookup table is the patch data, and the right column is the average RGB value and the average ΔRΔGΔB value acquired from the color patch corresponding to the patch data.
As described above, only one set of the deviation diffuse reflection image and the deviation difference image is recorded in association with the lookup table recording the correspondence acquired for each color.
In the present embodiment, the correspondence relationship for each color is recorded in a look-up table. However, when a lookup table for recording the correspondence relationship for each recording medium is generated, a typical deviation diffusion is also used. Only one set of the reflection image and the deviation difference image needs to be recorded. The same applies to the case where a lookup table for recording the correspondence for each color material is generated and the case where the lookup table for recording the correspondence for each printing method is generated.
In the case of the present embodiment, even if the number of correspondences recorded in the lookup table increases, only one set of deviation images is recorded, so that the storage capacity of the lookup table can be reduced.

FIG. 24 is a diagram illustrating a functional configuration example of a simulation device 50 according to the fourth embodiment. 24, reference numerals corresponding to those corresponding to FIG. 6 are attached.
In the simulation device 50 shown in FIG. 24, printing plate data is given as printing data # 2 by the user.
The difference between the simulation device 50 shown in FIG. 24 and the simulation device 50 shown in FIG. 6 is that the correspondence + deviation image database 44A is used as the database and that the conversion unit 50B corresponds to the CMYK spot color given as print data. The point is that information of the deviation image is added when the image is converted into RGB.

FIG. 25 is a diagram illustrating an operation example of the conversion unit 50B according to Embodiment 4.
Also in the case of the present embodiment, the conversion unit 50B searches the correspondence + deviation image database 44A using the CMYK spot color given as the printing plate data as a search key, and obtains an average RGB value and an average corresponding to the designated CMYK spot color. The ΔRΔGΔB values are read out, and RGB values corresponding to the deviation images are added to the values and output.
For example, the conversion unit 50B reads (R, G, B) = (185, 151, 95) as basic color components, and further adds and outputs RGB values corresponding to the deviation diffuse reflection image. The conversion unit 50B reads (R, G, B) = (69, 88, 88) as the gloss component, and further adds and outputs the RGB values according to the difference image. By this processing, it is possible to reproduce a deviation component due to a difference between pixels that has been lost during averaging.

The reflectance distribution function calculating unit 50C in the present embodiment calculates the reflectance distribution function corresponding to the appearance at the time of printing using the read image. For example, the reflectance distribution function calculating unit 50C calculates the reflectance distribution function as the following equation according to the Phong reflection model.
I (x, y)
_{= I i · {w d ·} {RGB + T d (x, y)} · cosθ i} + I i · {w s · {ΔRΔGΔB + T s-d (x, y)} · cos n γ}
Here, I (x, y) is the reflected light intensity on a two-dimensional plane.
Right _{{w d · {RGB + T} d (x, y)} · cosθ i} of the first term is the diffuse reflectance distribution function. Here, _{w d} is the diffuse reflection weighting factor, RGB is the average RGB value of the diffuse reflection _image, T d _(x, y) is the difference image of the diffuse reflection image. θ _i is the angle of incidence.
Right _{{w s · {ΔRΔGΔB + T} s-d (x, y)} · cos n γ} of the second term is the specular reflectance distribution function. Here, w _s is a specular reflection weighting coefficient, ΔRΔGΔB is an average RGB value of a difference image between the specular reflection image and the diffuse reflection image, and T _s−d (x, y) is a deviation image of the difference image. is there. γ is the angle between the specular reflection direction and the viewing direction, and n is the specular reflection index.

The rendering unit 50D and the display control unit 50E are the same as in the first embodiment.
FIG. 26 is a diagram illustrating a three-dimensional model displayed on the display device 70 (see FIG. 7) by the display control unit 50E (see FIG. 24). As shown in FIG. 26, in the case of the first embodiment, the change in gloss due to the difference in the position of the print surface that has been lost is reflected. Therefore, a more realistic texture can be reproduced as compared with the first embodiment.

<Embodiment 5>
In the above embodiment, it is assumed that the image data given by the user is CMYK special color data, but in the present embodiment, the case where the image data given by the user is RGB data will be described.
FIG. 27 is a diagram illustrating an example of the overall configuration of an information processing system 1B used in the fifth embodiment. 27, parts corresponding to those in FIG. 1 are denoted by reference numerals.
In the information processing system 1B shown in FIG. 27, the information processing apparatus 100 that converts the first RGB special color image data (hereinafter referred to as “RGB special color image data # 1”) given by the user into the CMYK special color format print data # 1 is used. Deploy.

In the present embodiment, the RGB special color image data is used in the meaning of image data represented by four colors obtained by adding a special color to red (R), green (G), and blue (B). The information processing apparatus 100 is, for example, a computer, and functions as an RGB special color → CMYK special color conversion unit 100A that converts image data into print data.
Further, in the present embodiment, the second RGB special color image data (hereinafter referred to as “RGB special color image data # 2”) is provided to the simulation device 50, and the simulation device 50 sends the CMYK special color format print data # to the printing device 60. 2 is output.

FIG. 28 is a diagram illustrating a functional configuration example of the information processing device 100 and the texture information acquiring device 40 according to the fifth embodiment. 28, the parts corresponding to those in FIG. 4 are denoted by the same reference numerals.
The difference between the functional configuration illustrated in FIG. 28 and the functional configuration illustrated in FIG. 4 is a conversion function of the information processing apparatus 100.
In the case of FIG. 28, the information processing apparatus 100 is provided with RGB special color patch data. In the case of this example, the RGB special color patch data is (R, G, B, special color) = (225, 220, 233, 80).

The RGB special color → CMYK special color conversion unit 100A of the information processing device 100 converts RGB format data into CMYK format data using a known color conversion profile. It is not necessary to convert the spot color.
In the case of FIG. 28, the RGB special color → CMYK special color conversion unit 100A expresses the input RGB special color patch data as (C, M, Y, K, special color) = (0, 20, 0, 0, 80). To CMYK special color patch data.
Subsequent processing is the same as in the first embodiment.

FIG. 29 is a diagram illustrating a functional configuration example of a simulation device 50 according to the fifth embodiment. 29, parts corresponding to those in FIG. 6 are denoted by reference numerals.
The simulation device 50 shown in FIG. 29 differs from the simulation device 50 shown in FIG. 6 in that an RGB spot color → CMYK spot color conversion unit 50F for converting image data in the RGB spot color format into print data in the CMYK spot color format is provided. .
Other points are the same as the first embodiment.
In the case of the present embodiment, even when an image data file expressed in three primary colors of light is provided from the user or application software operated by the user, a CG image in which gloss is reproduced is displayed on the operation screen.

<Embodiment 6>
In the above-described embodiment, it is assumed that both the image of the input print data and the printed matter output from the printing device 60 are flat, but in the present embodiment, the input print data A case in which a data image is printed on the surface of a developed view in which a three-dimensional object is developed will be described.
In the present embodiment, the information processing system 1 shown in FIG. 1 is assumed. 4 is assumed as the texture information acquisition device 40 (see FIG. 1).
FIG. 30 is a diagram illustrating an example of a functional configuration of a simulation device 50 according to the sixth embodiment. In FIG. 30, the portions corresponding to those in FIG.
The simulation device 50 shown in FIG. 30 is different from the simulation device 50 shown in FIG. 6 in that a shape information setting unit 50G for setting shape information of a target object on which an image corresponding to printing plate data is printed in the rendering unit 50D is provided. Is a point.
The example of FIG. 30 is an example in which an image to be subjected to the 3D preview is printed on a development view.

FIG. 31 illustrates the relationship between the three-dimensional model displayed on the display device 70 (see FIG. 7) by the display control unit 50E (see FIG. 30) and the two-dimensional image corresponding to the printing plate data in the sixth embodiment. FIG. (A) is an example of a two-dimensional image corresponding to printing plate data, and (b) is an example of a CG image obtained by printing the two-dimensional image on a three-dimensional object. The inclination of the three-dimensional object can be freely changed by the user.
In the case of the present embodiment, it is possible to observe the CG image in which the metallic luster due to the gold component designated as the spot color is reproduced while being attached to the three-dimensional object actually used. Therefore, the texture can be easily grasped without actually printing on the three-dimensional object.
Further, if the texture can be easily grasped before printing, editing of printing plate data and image data can be realized by changing a numerical value that defines a spot color on a work screen or changing a sample to be specified.

<Other embodiments>
Although the embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is apparent from the description of the appended claims that various modifications or improvements to the above-described embodiment are included in the technical scope of the present invention.

(1) In the above-described embodiment, the case where the image processing device 30 (see FIG. 1) and the printing device 60 (see FIG. 1) are directly connected has been described, but these may be connected via a network. Good.
FIG. 32 is a diagram illustrating an example of an overall configuration of an information processing system 200 according to another embodiment. The device shown in FIG. 32 is the device described in the above embodiment.
In the case of the information processing system 200 shown in FIG. 32, the printing apparatus 10 or 60, the texture information acquiring apparatus 40, the simulation apparatus 50, the decorating apparatus 90, and the image editing apparatus 210 are connected to the network 201. I have. Here, the image editing device 210 is an example of an image editing unit.
The network 201 here may be a LAN (Local Area Network), the Internet, or a cloud network.

In the case of FIG. 32, the texture information acquisition device 40 and the simulation device 50 are connected to the network 201 as independent devices, but may be incorporated in the image processing device 30 as in the above-described embodiment. The texture information acquisition device 40 may be divided into a scanner device that outputs a diffuse reflection image and a specular reflection image, and a correspondence generation unit 43 that generates a correspondence, and each may be connected to the network 201.
The image editing device 210 shown in FIG. 32 is an editing terminal including a display device on which a work screen 71 (see FIG. 7) is displayed. The image editing device 210 is configured by a computer, and executes, for example, a design editing program.
In the example of FIG. 32, the functions of the information processing apparatus 100 described in the fifth embodiment are incorporated in the image editing apparatus 210. Note that the image editing device 210 may have the function of the simulation device 50 built-in.
In any case, the image editing apparatus 210 can perform the editing work while checking the gloss of the CG image on the work screen 71, the change of the element affecting the texture, and the effect of the change. .

(2) In the above-described embodiment, a three-dimensional CG image is generated and displayed on the assumption that print data and image data are provided. However, a three-dimensional CG image when only a decorative pallet number is specified is displayed. A CG image may be generated, or a three-dimensional CG image when only the special color pallet number is designated may be generated.
(3) In the above-described embodiment, the case where the specular reflection index n is the same for each pixel on the two-dimensional plane has been described, but it may be changed according to each pixel.
For example, it may be expressed by the following equation.
I (x, y)
= I _i ｛w _d GG _d (x, y) ・ cos θ _i ｝ + I _i ｛w _s {{G _s (x, y) -G _d (x, y)} ・ cos ^{n (x, y)} γ｝
Incidentally, n (x, y) may be defined function of the difference image of the specular reflection image and a diffuse reflection image, i.e. _{f (G s (x, y} ) -G d (x, y)) and. For example, the value of the specular reflection index n may be set to increase as the luminance of the difference image increases.

(4) In the embodiment described above, the Phong reflection model is used, but a Torrance-Sparrow reflection model or a Cook-Torrence reflection model may be used.
(5) In the above-described embodiment, the diffuse reflection weight coefficient w _d and the specular reflection weight coefficient w _s are described as fixed values, but they may be adjusted on the work screen.
(6) In the above-described embodiment, the lookup table in which the correspondence relationship with the print data (CMYK spot color) including the designation of the spot color is generated, but the lookup table with the image data (RGB spot color) including the designation of the spot color is generated. A lookup table in which the correspondence is recorded may be generated and used.
(7) In the above-described embodiment, the printing device 10, the texture information acquiring device 40, and the printing device 60 have been described as separate devices, but the printing device 10, the texture information acquiring device 40, and the printing device 60 are one device. The printing device 10 and the texture information acquisition device 40 may be configured as one device, or the texture information acquisition device 40 and the printing device 60 may be configured as one device.

1, 1A, 1B, 200 Information processing system, 10, 60 Printing device, 20 Printed material, 20A Printed material with decoration, 30 Image processing device, 40 Texture information acquisition device, 42F Diffuse reflection image acquisition unit , 42G: mirror reflection image acquisition unit, 43: correspondence generation unit, 43A: difference image acquisition unit, 43B, 43C: average value calculation unit, 43D: correspondence recording unit, 44: correspondence database, 44A: correspondence + Deviation image database, 45: deviation image generation unit, 45A: deviation diffuse reflection image calculation unit, 45B: deviation difference image calculation unit, 50: simulation device, 73: 3D preview button, 78: special color palette, 79: decorative palette, 80, 90: decoration device, 100: information processing device, 210: image editing device

Claims (11)

A first image acquisition unit that acquires a diffuse reflection image of the surface of the printed matter;
A second image acquisition unit that acquires a regular reflection image of the surface of the printed matter,
A difference image generation unit that generates a difference image between the diffuse reflection image and the regular reflection image,
A correspondence generation unit that associates information that affects the texture of the surface of the printed material specified when forming the printed material with information on the diffuse reflection image and information on the difference image,
An image processing apparatus having:   The image processing apparatus according to claim 1, wherein the information affecting the texture of the surface of the printed matter includes information of a recording medium included in the printed matter.   The image processing apparatus according to claim 2, wherein the information affecting the texture of the surface of the printed matter includes a type and an amount of a material used for printing an image.   The image processing apparatus according to claim 2, wherein the information affecting the texture of the surface of the printed matter includes a printing method used for generating the printed matter.   The image processing apparatus according to claim 2, wherein the information affecting the texture of the surface of the printed matter includes information related to surface processing.   The correspondence relation generating unit is configured to calculate an average pixel value of the diffuse reflection image corresponding to the sample pattern formed on the printed matter, an average pixel value of the difference image corresponding to the sample pattern, and the average pixel value corresponding to the sample pattern. The image processing device according to claim 1, wherein a look-up table that associates information that affects the texture of the printed matter is generated.   The image processing apparatus according to claim 6, wherein the correspondence generation unit further associates the difference image or a grayscale image of the difference image with information affecting the texture of the printed matter corresponding to the sample pattern.   The correspondence generation unit stores information that affects the texture of the printed matter corresponding to the sample pattern formed on the printed matter, and stores the correspondence between the difference image or the grayscale image corresponding to the sample pattern. The image processing device according to claim 1.   Based on the information on the diffuse reflection image and the difference image corresponding to the sample pattern formed on the printed matter, an output result corresponding to any print data or image data or processed data including information that affects texture is represented. The image processing device according to claim 1, further comprising an image display control unit that generates a simulation image.   Based on the diffuse reflection image and the information on the difference image corresponding to the sample pattern formed on the printed matter, an image simulating the output result of any print data or image data or processed data is displayed, and the print data or The image processing apparatus according to claim 1, further comprising an image editing unit that receives editing of the image data or the processed data. On the computer,
A function of acquiring a diffuse reflection image of the surface of the printed matter,
A function of acquiring a regular reflection image of the surface of the printed matter,
A function of generating a difference image between the diffuse reflection image and the regular reflection image,
A function for associating the information on the diffuse reflection image and the information on the difference image with information affecting the texture of the surface of the printed material specified when forming the printed material,
A program that executes