JP6973214B2 - Information processing equipment, information processing methods, programs and 3D modeling systems - Google Patents

Description

The present invention relates to an information processing apparatus, an information processing method, a program, and a three-dimensional modeling system.

There is a three-dimensional modeling technique for forming unevenness or the like on a flat surface by using a photocurable ink that is cured by irradiating with light such as ultraviolet rays. By using the three-dimensional modeling technique, it is possible to model a replica of a three-dimensional object. For example, by duplicating an oil painting using a three-dimensional modeling technique, it is possible to reproduce the colors represented in the painting and also to reproduce the uneven shape of the paint formed on the surface of the painting.

Conventionally, as a method for reproducing a color, a technique has been proposed in which an image of an art object such as a painting is optically read and the color before or after the discoloration is estimated from the creator or the production age of the art object. (See Patent Document 1).

By the way, when modeling a duplicate using the three-dimensional modeling technique, it is important to reproduce not only the color and uneven shape but also the glossiness (glossy / non-glossy) of the surface. For example, in an oil painting, varnish may be applied to the surface, and the glossiness differs depending on the state of application of varnish (presence or absence of varnish, etc.). Therefore, in order to create a more accurate reproduction, it is required to reproduce not only the color and the uneven shape but also the glossiness of the surface.

In the above three-dimensional modeling technology, it is possible to form a layer with transparent ink on the layer representing color, and by setting the formation conditions according to the varnish application state, it is the same as the painting of the reproduction source. It is possible to reproduce the glossiness of.

However, since paintings of high value in works or classically are generally managed in facilities such as museums, it is not possible to easily confirm the state of application of varnish. Therefore, when duplicating such a painting, the duplicate is modeled using an image of the original painting, but it is difficult to visually determine the varnished state from the image. It may not be possible to properly set the conditions for forming a glossy feeling. It should be noted that the conventional technique does not consider the state of application of the varnish at all, so that the above problem cannot be solved.

The present invention has been made in view of the above, and provides an information processing apparatus, an information processing method, a program, and a three-dimensional modeling system capable of determining formation conditions for forming a glossy feeling of an object to be reproduced. The purpose is to provide.

In order to solve the above-mentioned problems and achieve the object, one embodiment of the present invention is an image data acquisition unit that acquires image data representing an object to be duplicated, and detects a white portion from the image data. white portion detecting unit for an information acquisition unit for acquiring elapsed years information the object showed the number of years elapsed since the production, on the basis of the detection result and the number of years elapsed information of the white region, the target It is characterized by comprising a condition determining unit for determining the application state of the varnish on the surface of the object and determining the forming conditions for forming the glossiness of the varnish on the surface of the object.

According to the present invention, it is possible to determine the formation conditions for forming the glossiness of the object to be reproduced.

FIG. 1 is an external view of a three-dimensional modeling system according to an embodiment. FIG. 2 is a plan view of the three-dimensional modeling apparatus according to the embodiment. FIG. 3 is a side view of the three-dimensional modeling apparatus according to the embodiment. FIG. 4 is a front view of the three-dimensional modeling apparatus according to the embodiment. FIG. 5 is a hardware configuration diagram related to the control of the three-dimensional modeling apparatus. FIG. 6 is a hardware configuration diagram of a computer according to an embodiment. FIG. 7 is a diagram schematically showing a cross section of laminated modeling formed by a three-dimensional modeling device. FIG. 8 is a diagram for explaining a method of forming the clear layer described with reference to FIG. 7. FIG. 9 is a diagram for explaining the method of forming the clear layer described with reference to FIG. 7. FIG. 10 is a diagram for explaining a method of creating modeling data used in a three-dimensional modeling apparatus. FIG. 11 is a functional configuration diagram of a computer according to an embodiment. FIG. 12 is a diagram showing an example of color data according to an embodiment. FIG. 13 is a flowchart showing a modeling data generation process executed by the computer according to the embodiment.

Hereinafter, embodiments of an information processing apparatus, an information processing method, a program, and a three-dimensional modeling system will be described in detail with reference to the attached drawings. The present invention is not limited to the following embodiments, and the components in the following embodiments include those easily conceived by those skilled in the art, substantially the same, and so-called equal ranges. .. Various omissions, substitutions, changes, and combinations of components can be made without departing from the gist of the following embodiments.

<Three-dimensional modeling system>
A three-dimensional modeling system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is an external view of a three-dimensional modeling system according to an embodiment. The three-dimensional modeling system 1 includes a three-dimensional modeling device 50 and a computer 10.

The computer 10 is, for example, a PC (Personal Computer), a general-purpose information processing device such as a tablet, or an information processing device dedicated to the three-dimensional modeling device 50. The computer 10 may be built in the three-dimensional modeling apparatus 50. The computer 10 may be connected to the three-dimensional modeling apparatus 50 by a cable. Further, the computer 10 may be a server device that communicates with the three-dimensional modeling device via a network such as the Internet or an intranet. The computer 10 transmits the data of the modeled object to be reproduced to the three-dimensional modeling device 50 by the above connection or communication.

The three-dimensional modeling device 50 is an inkjet modeling device. The three-dimensional modeling apparatus 50 includes a modeling unit 570 that discharges a liquid modeling agent I to the medium P on the modeling stage 595 based on the data of the modeled object to be reproduced. Further, the modeling unit 570 has a curing means 572 that irradiates the modeling agent I discharged to the medium P with light and cures to form the modeling layer L. Further, the three-dimensional modeling apparatus 50 obtains a three-dimensional model by repeating a process of discharging the modeling agent I onto the modeling layer L and curing the modeling agent I.

As the modeling agent I, a material that can be discharged by the three-dimensional modeling apparatus 50, has shape stability, and is cured by the light emitted by the curing means 572 is used. For example, when the curing means 572 is a UV (Ultra Violet) irradiation device, UV curing ink is used as the modeling agent I.

As the medium P, any material on which the discharged modeling agent I is fixed is used. The medium P is, for example, paper such as recording paper, cloth such as canvas, or plastic such as a sheet.

<Three-dimensional modeling device>
FIG. 2 is a plan view of the three-dimensional modeling apparatus according to the embodiment. FIG. 3 is a side view of the three-dimensional modeling apparatus according to the embodiment. FIG. 4 is a front view of the three-dimensional modeling apparatus according to the embodiment. In order to represent the internal structure, the upper surface of the housing of the three-dimensional modeling apparatus 50 is not shown in FIG. 2, the side surface of the housing is not shown in FIG. 3, and the front surface of the housing is not shown in FIG.

Guide members 591 are held on the side surfaces 590 on both sides of the housing of the three-dimensional modeling apparatus 50. The carriage 593 is movably held by the guide member 591. The carriage 593 is reciprocally conveyed by a motor via a pulley and a belt in the direction of arrow X in FIGS. 2 and 4 (hereinafter, simply referred to as “X direction”; the same applies to Y and Z). The X direction is referred to as a main scanning direction.

A modeling unit 570 is held in the carriage 593 so as to be movable in the Z direction of FIGS. 3 and 4 by a motor. In the modeling unit 570, six liquid discharge heads 571a, 571b, 571c, 571d, 571e, and 571f for discharging each of the six types of modeling agents are arranged in order in the X direction. Hereinafter, the liquid discharge head is simply referred to as a “head”. Further, any head among the heads 571a, 571b, 571c, 571d, 571e, and 571f is referred to as a head 571. The number of heads 571 is not limited to six, and any number of one or more may be arranged depending on the number of modeling agents I.

The three-dimensional modeling apparatus 50 is provided with a tank mounting portion 560. The tank mounting portion 560 contains a plurality of tanks containing each of a first modeling agent, a second modeling agent, a third modeling agent, a fourth modeling agent, a fifth modeling agent, and a sixth modeling agent. 561 is attached. Each shaping agent is supplied to each head 571 via six supply tubes 562. Each head 571 has a nozzle or a nozzle row, and discharges the modeling agent supplied from the tank 561. In one embodiment, the heads 571a, 571b, 571c, 571d, 571e, 571f are, from the nozzle, a first modeling agent, a second modeling agent, a third modeling agent, a fourth modeling agent, and a fifth. Discharge the modeling agent and the sixth modeling agent.

Hardening means 572 are arranged on both sides of the six heads 571 in the modeling unit 570. The curing means 572 cures the modeling agent discharged from the head 571 to the medium P. The curing means 572 is not particularly limited as long as it can cure the modeling agent I, and examples thereof include a lamp such as an ultraviolet (UV) irradiation lamp and an electron beam irradiation lamp. Examples of the type of lamp include a high-pressure mercury lamp, an ultra-high pressure mercury lamp, and a metal halide lamp. An ultra-high pressure mercury lamp is a point light source, but a UV lamp with high light utilization efficiency in combination with an optical system can irradiate in a short wavelength region. Metal halides are effective because they have a wide wavelength range. For the metal halide, a halide of a metal such as Pb, Sn, or Fe is used depending on the absorption spectrum of the photoinitiator contained in the modeling agent. It is preferable that the curing means 572 is provided with a mechanism for removing ozone generated by irradiation with ultraviolet rays or the like. The number of the curing means 572 is not limited to two, and any number may be provided depending on, for example, whether the modeling unit 570 is reciprocated for modeling. Further, only one of the two curing means 572 may be operated.

In the three-dimensional modeling apparatus 50, a maintenance mechanism 580 for maintaining and recovering the head 571 is arranged on one side in the X direction. The maintenance mechanism 580 has a cap 582 and a wiper 583. The cap 582 is in close contact with the nozzle surface (the surface on which the nozzle is formed) of the head 571. In this state, the maintenance mechanism 580 sucks the modeling agent I in the nozzle, so that the high-viscosity modeling agent I clogged in the nozzle is discharged. After that, the nozzle surface is wiped with a wiper 583 to form a meniscus of the nozzle. Further, the maintenance mechanism 580 covers the nozzle surface of the head 571 with a cap 582 when the modeling agent I is not discharged, and prevents the modeling agent I from drying.

The modeling stage 595 has a slider portion movably held by two guide members 592. As a result, the modeling stage 595 is reciprocated by a motor in the Y direction (sub-scanning direction) orthogonal to the X direction via the pulley and the belt.

<Shaping liquid>
In the present embodiment, the first modeling agent is black UV curing ink (K) as a key plate, the second modeling agent is cyan UV curing ink (C), and the third modeling agent is magenta UV. The curing ink (M), the fourth modeling agent is a yellow UV curing ink (Y), the fifth modeling agent is a clear UV curing ink (CL), and the sixth modeling agent is a white UV curing ink (W). Is. The number of modeling agents is not limited to six, and any number of one or more may be used depending on the type of color required for image reproduction. If the number of modeling agents is 7 or more, an additional head 571 may be provided in the three-dimensional modeling apparatus 50, and if the number of modeling agents is 5 or less, one of the heads 571 may not be operated or provided. It doesn't have to be.

<Control unit>
Next, the hardware configuration related to the control of the three-dimensional modeling apparatus 50 will be described with reference to FIG. FIG. 5 is a hardware configuration diagram of the three-dimensional modeling apparatus 50.

The three-dimensional modeling device 50 has a control unit 500 for controlling the processing and operation of the three-dimensional modeling device 50. The control unit 500 includes a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, an NVRAM (Non-Volatile Random Access Memory) 504, an ASIC (Application Specific Integrated Circuit) 505, and I. It has / F (Interface) 506 and I / O (Input / Output) 507.

The CPU 501 controls the entire processing and operation of the three-dimensional modeling apparatus 50. The ROM 502 stores a program for controlling the three-dimensional modeling operation and other fixed data in the CPU 501. The RAM 503 temporarily stores data and the like of the modeled object to be reproduced. The CPU 501, ROM 502, and RAM 503 construct a main control unit 500A that executes processing according to the above program.

The NVRAM 504 retains data even while the power of the three-dimensional modeling apparatus 50 is cut off. The ASIC 505 processes image processing that performs various signal processing and the like on the data of the modeled object, and other input / output signals for controlling the entire three-dimensional modeling device 50.

The I / F 506 is connected to an external computer 10 and transmits / receives data and signals to / from the computer 10. The data sent from the computer 10 includes the data of the modeled object to be reproduced. The I / F 506 may be connected to a network such as the Internet or an intranet instead of being directly connected to the external computer 10.

The I / O 507 is connected to various sensors 525 and inputs a detection signal from the sensor 525.

Further, an operation panel 524 for inputting and displaying information necessary for the three-dimensional modeling apparatus 50 is connected to the control unit 500.

Further, the control unit 500 includes a head drive unit 511, a motor drive unit 512, and a maintenance drive unit 513 that are operated by commands of the CPU 501 or the ASIC 505.

The head drive unit 511 controls the discharge of the modeling agent I by the head 571 by outputting an image signal and a driving voltage to the head 571 of the modeling unit 570. In this case, the head drive unit 511 outputs a drive voltage to, for example, a mechanism for forming a negative pressure of a sub tank for storing the modeling agent I in the head 571 and a mechanism for controlling the pressing. A substrate is also mounted on the head 571, and the drive signal may be generated by masking the drive voltage with an image signal or the like on this substrate.

The motor drive unit 512 drives the motor by outputting a drive signal to the motor of the X-direction scanning mechanism 596 that moves the carriage 593 of the modeling unit 570 in the X direction (main scanning direction). Further, the motor drive unit 512 drives the motor by outputting a drive voltage to the motor of the Y-direction scanning mechanism 597 that moves the modeling stage 595 in the Y direction (sub-scanning direction). Further, the motor drive unit 512 drives the motor by outputting a drive voltage to the motor of the Z-direction scanning mechanism 598 that moves the modeling unit 570 in the Z direction.

The maintenance drive unit 513 drives the maintenance mechanism 580 by outputting a drive signal to the maintenance mechanism 580. The above parts are electrically connected to each other by an address bus, a data bus, or the like.

<Information processing device>
Next, the hardware configuration related to the control of the computer 10 which is the information processing apparatus of the present embodiment will be described with reference to FIG. FIG. 6 is a hardware configuration diagram of the computer 10 according to the embodiment.

The computer 10 has a CPU 101, a ROM 102, a RAM 103, a storage unit 104, a display unit 105, an operation unit 106, and an I / F 107. The above parts are electrically connected to each other by an address bus, a data bus, or the like.

The CPU 101 controls the entire processing and operation of the computer 10. The ROM 102 stores a program for execution by the CPU 101 and other fixed data. The RAM 103 is the main storage device of the computer 10 and functions as a workspace of the CPU 101. The storage unit 104 is an auxiliary storage device such as an HDD (Hard Disk Drive) or SSD (Solid State Drive), and stores an operating system of the computer 10, a program for execution by the CPU 101, and other fixed data.

The display unit 105 is composed of a display device such as an LCD (Liquid Crystal Display), and displays various information based on a display signal from the CPU 101. The operation unit 106 is composed of an input device such as a keyboard and a mouse, and accepts user operations.

The I / F 107 is connected to an external device such as the three-dimensional modeling device 50, and transmits / receives data and signals to / from the external device. The I / F 107 may be connected to a network such as the Internet or an intranet instead of being directly connected to the three-dimensional modeling apparatus 50.

The computer 10 of the present embodiment inputs the modeling data to be described later, which represents the object to be duplicated, into the three-dimensional modeling apparatus 50, thereby causing the three-dimensional modeling apparatus 50 to model the modeled object imitating the object. In the following, an example in which the object to be reproduced is an oil painting will be described.

<Laminate modeling>
Next, the laminated modeling formed by the three-dimensional modeling apparatus 50 will be described with reference to FIG. 7. FIG. 7 is a diagram schematically showing a cross section of laminated modeling formed by the three-dimensional modeling device 50.

As shown in FIG. 7, the laminated molding is formed on the base L1. The base L1 is, for example, a paper such as a recording paper, a cloth such as a canvas, or a flat plate such as a resin plate, and corresponds to the medium P shown in FIG. It is preferable that the base L1 has good adhesion to the UV curable ink and has rigidity that does not deform.

The three-dimensional modeling apparatus 50 repeatedly performs plane printing in which UV curing ink K1 is ejected from the head 571 to form a laminated modeling (laminated structure) on the base L1. The three-dimensional modeling apparatus 50 forms a layer having a thickness of about several μm to 30 μm per layer, although it depends on the amount of droplets of the UV curable ink K1 to be ejected.

When the base L1 is included as the lowermost layer, the laminated structure is divided into five layers of a modeling layer L2, a white base layer L3, a colored layer L4, and a clear layer L5 (outermost layer). The modeling layer L2 is a layer representing the uneven shape itself formed by repeated plane printing, and is the thickest layer. The three-dimensional modeling apparatus 50 repeatedly performs plane printing to form a modeling layer L2 that matches the uneven shape of the three-dimensional data. The three-dimensional modeling apparatus 50 reproduces the swelling of ink characteristic of oil painting painting by adjusting the number of layers of the modeling layer L2. Since the modeling layer L2 is basically not exposed to the surface, any color of UV curable ink K1 such as white or transparent may be used. Further, when the modeling layer L2 is formed of the white UV curable ink K1, the modeling layer L2 may also serve as the white base layer L3.

The white base layer L3 is a layer formed to eliminate the influence of the tint of the modeling layer L2. Specifically, the white base layer L3 is formed of the white UV curable ink K1 that does not affect the color development of the colored layer L4. Thereby, the color development of the colored layer L4 can be emphasized. In addition, in order to erase the color of the modeling layer L2, any number of white base layers L3 may be stacked as needed.

The colored layer L4 is a layer for expressing the color of the painting. The colored layer L4 is an original using UV curable ink K1 in which various special colors (light cyan, light magenta, gray, orange, green, violet, etc.) are mixed with the four primary colors of CMYK, as in the case of two-dimensional full-color printing. It is formed so that the color is similar to that of. The colored layer L4 is not limited to a single layer and may be a multilayer layer. By using multiple layers, various blends can be made in the thickness direction as well, so that not only the above-mentioned special colors but also various expressions using white or transparent UV curable ink are possible.

The clear layer L5 is a layer for expressing a glossy feeling. By forming the clear layer L5 using the transparent UV curable ink K1, it is possible to give a glossy feeling to the surface of the duplicated model. Further, by changing the formation conditions of the clear layer L5, the glossiness of the surface of the modeled object can be changed.

<Clear layer>
Next, a method of forming the clear layer L5 will be described with reference to FIGS. 8 and 9. 8 and 9 are diagrams for explaining the method of forming the clear layer L5 described with reference to FIG. 7.

In FIGS. 8 and 9, the layer L14 is a simplified representation of the above-mentioned base L1, the modeling layer L2, the white base layer L3, and the colored layer L4. The UV curable ink K1 has a higher viscosity than a general inkjet ink for planar printing (water-based, oil-based). When the UV curable ink K1 is ejected from the head 571, the viscosity is once lowered by heating and then ejected, but the heat is taken away by air cooling during flight and contact with the recorded object (layer L14), and the ink is dropped. After that, due to its high viscosity and surface tension, it does not spread on the layer L14 and remains in a dome-shaped raised shape.

For example, as shown in FIG. 8A, when the UV curable ink K1 is ejected from the head 571 with small droplets (for example, 2 to 3 pixels) having a dome diameter close to the recording resolution, adjacent droplets (UV curable ink) are ejected. K1) do not adhere to each other, and as shown in FIG. 8 (b), they are cured while leaving irregularities on the surface. The UV curable ink K1 after the coin forms the clear layer L5. If the surface of the clear layer L5 has fine irregularities, the incident light is diffusely reflected on the surface, resulting in a surface state with a low glossiness.

On the other hand, as shown in FIG. 9A, when the UV curable ink K1 is ejected from the head 571 with a droplet (for example, 10 pixels or more) sufficiently large for the recording resolution, the adjacent droplet positions are also formed. It will be a large dome to embrace. For this reason, adjacent droplets (UV curable ink K1) are likely to adhere to each other, and it is easy to form a thick and uniform adhesion-bonded surface. Since this adhesion coalescence progresses with time, a smooth clear layer L5 can be formed as shown in FIG. 9B by taking a long time (leveling time) for the droplets to become familiar with each other. .. The smooth clear layer L5 has a large specular reflection component, and a high glossiness can be obtained.

<Creation of modeling data>
Next, a method of creating modeling data used in the three-dimensional modeling apparatus 50 will be described with reference to FIG. FIG. 10 is a diagram for explaining a method of creating modeling data used in the three-dimensional modeling apparatus 50.

When modeling a modeled object with the three-dimensional modeling device 50, modeling data representing the object (oil painting painting) of the modeling source (reproduction source) is required. The modeling data is composed of color data indicating the color of the object and three-dimensional data indicating the uneven shape of the object.

FIG. 10A is a diagram showing an example of color data. The color data is obtained by mapping color values to each position (pixel position) of image data obtained by photographing or scanning a modeled object in a plane. The color value is a data value that defines a color in a color space such as RGB or CIELAB (CIE 1976 L * a * b *), and is represented by, for example, an RGB value or an L * a * b * value. FIG. 10A shows an example in which the color value at position P1 is represented using an 8-bit RGB value. In addition, instead of the color data, color image data obtained by capturing or scanning an object may be used.

FIG. 10B is a diagram showing an example of three-dimensional data. The three-dimensional data maps height information indicating the height from the reference plane (canvas surface of the painting) to each position of the image data. For the three-dimensional data, for example, the first method of actually measuring the uneven state of the surface of the modeled object using a dedicated measuring instrument such as a 3D scanner or a laser length measuring machine, and the uneven state of the surface are estimated from the two-dimensional color data. It can be obtained by using any of the second methods. Note that FIG. 10 (b) shows the height information (z) of the position P1 (x, y) shown in FIG. 10 (a).

Further, when duplicating an object, it is important to reproduce not only the above-mentioned colors and uneven shapes but also the glossiness (glossy / non-glossy) of the surface of the object. For example, in an oil painting, varnish may be applied to the surface, and the glossiness differs depending on the state of application of varnish (presence or absence of varnish, etc.). The application of varnish is generally performed for the purpose of preservability rather than ingenuity in expression. By applying varnish to the surface of a painting, it is possible to prevent the paint from cracking due to mold growth and drying. Therefore, paintings with higher work or classical value are often varnished.

The state of varnish application (whether or not varnish is applied, whether it is applied thickly or thinly, etc.) should be measured, for example, by using a dedicated gloss measuring device that combines a deflection light source and a deflection filter. Can be done. In this case, by appropriately setting the formation conditions for forming the glossiness, that is, the formation conditions of the clear layer L5 based on the measurement result obtained by the gloss measuring instrument, the glossiness of the surface of the painting of the reproduction source is obtained. Can be reproduced.

However, since paintings of high value in works or classically are generally managed in facilities such as museums, it is not possible to easily confirm the state of application of varnish. Further, it is difficult to acquire three-dimensional data by using the above-mentioned first method. Therefore, when duplicating such a painting, the duplicate is modeled using an image (image data) of the original painting, but the varnish application state is visually determined from the image data. Is difficult, and it may not be possible to properly set the conditions for forming a glossy feeling.

Therefore, the three-dimensional modeling system 1 (computer 10) of the present embodiment has a configuration in which the conditions for forming the glossiness can be appropriately set even when the original measured value cannot be acquired. Hereinafter, such a configuration will be described.

<Functional configuration of information processing device>
FIG. 11 is a functional configuration diagram of the computer 10 according to the embodiment. As shown in FIG. 11, the computer 10 includes a modeling data generation unit 111, a white portion detection unit 112, an information acquisition unit 113, and a condition determination unit 114. These functional units are realized, for example, by the CPU 101 of the computer 10, more specifically, by the CPU 101 of the computer 10 reading and executing a program stored in the ROM 102 or the storage unit 104.

The modeling data generation unit 111 generates modeling data (color data, stereoscopic data) by performing predetermined image processing on the image data representing the object (painting) of the reproduction source. Here, the image data is acquired by, for example, a digital camera, a scanner device, or the like, and is image data representing the painting of the reproduction source.

Specifically, the modeling data generation unit 111 generates color data by mapping the color values to each position (pixel position) of the image data. Further, the modeling data generation unit 111 generates three-dimensional data by mapping height information estimated based on the color tone, light / dark state, etc. of the position to each position (pixel position) of the image data. If the uneven state of the object can be measured using a measuring instrument such as a 3D scanner, the modeling data generation unit 111 may generate three-dimensional data based on the measurement result of the measuring instrument. Further, when the image data is a distance image including depth information (height information), the modeling data generation unit 111 may generate stereoscopic data based on the depth information.

The white part detection unit 112 detects a high white part from the color data generated by the modeling data generation unit 111, and outputs the detection result to the condition determination unit 114. Hereinafter, the operation of the white portion detection unit 112 will be described with reference to FIG.

FIG. 12 is a diagram showing an example of color data according to an embodiment. FIG. 12 (a) shows color data obtained from image data obtained by photographing a non-glossy painting, and FIG. 12 (b) shows color data obtained from image data obtained by photographing a glossy painting. Shows.

In the case of image data captured by a digital camera or the like, the ideal white color is R = 255, G = 255, B = 255 (in the case of an 8-bit RGB value). However, in the image data obtained by photographing a non-glossy painting, the R, G, and B colors are about 240 or less, no matter how much the white part is searched, and the upper limit of 255 is not reached. This is because the ideal white color (R = 255, G = 255, B = 255) is set according to the surrounding light source by the white balance adjustment that is automatically performed when the painting is photographed. As a result, in a non-glossy painting in which light is diffused / absorbed on the surface of the painting, the reflected light that finally enters the digital camera is also weakened, and even the whitest part does not reach the ideal white color. It will be taken as "white". Therefore, as shown in FIG. 12A, white (R = 255, G = 255, B = 255) parts (white parts) are present in the color data obtained from the image data obtained by photographing the non-glossy painting. do not.

On the other hand, when a painting having a high gloss with a thick varnish applied is photographed, a white portion W1 due to total reflection of the light source appears on any of the images as shown in FIG. 12 (b). The white part W1 is imaged as the highest level of white, regardless of the color in which the original painting was originally drawn. That is, when a white part is present on the color data, it can be estimated that the varnish is thickly applied to the surface of the original painting.

Therefore, the white portion detection unit 112 detects the white portion from the color data and outputs the detection result to the condition determination unit 114. Thereby, the condition determination unit 114 can determine whether or not the painting to be reproduced is thickly coated with the varnish based on the detection result of the white portion detection unit 112.

In the present embodiment, the white region has a white (ideal white) color value (for example, R = 255, G = 255, B = 255) in the color space that defines the color of the image data (color data). Although it is assumed to be a portion, a portion having a color value near white (R, G, B values are 241 to 254) may be included in the white region. In this case, it is assumed that the allowable range as the neighborhood value is a value higher than the whitest color value obtained from the image data obtained by photographing the non-glossy painting. Further, the index representing the color value is not limited to 8-bit RGB, and may be represented by using other color space indexes such as 16-bit, 32-bit, and L * a * b * values.

By the way, if the white part is not detected by the white part detection unit 112, it can be determined that the varnish is not applied "thickly" to the painting of the reproduction source, but the varnish is applied "thinly" or the varnish itself is applied. It is difficult to determine whether or not it has been applied. Therefore, in order to further determine the varnish coating state, the information acquisition unit 113 acquires the elapsed years information indicating the elapsed years since the original painting was produced.

Specifically, the information acquisition unit 113 acquires the elapsed years input via the operation unit 106 and the like as the elapsed years information. The information acquisition unit 113 may be configured to prompt the user to input by displaying the user interface for inputting the elapsed years on the display unit 105. Further, in this case, the information acquisition unit 113 may be configured to display the user interface on condition that the white portion is not detected by the white portion detection unit 112.

Here, the reason why the elapsed years are used as a discriminating material is as follows. Generally, the lifespan of canvas, oil paint (ink), and varnish (protective varnish) that make up an oil painting is said to be 100 years for canvas, 300 to 500 years for ink, and 10 years for protective varnish. Paintings that are not coated with protective varnish are prone to mold and cracks due to surface drying, and older paintings are more severely deteriorated. Paintings that have been in good condition for many years are considered to have been given the appropriate protective treatment, i.e., protective varnish. Therefore, it is possible to estimate whether or not the protective varnish is applied by using the elapsed years as an index. For example, if the number of years elapsed since the painting was made is a predetermined value or more (for example, 10 years or more), it can be estimated that the protective varnish is applied. Then, by adding the detection result of the white portion detection unit 112 to this estimation result, it is possible to determine whether the varnish is "thinly" applied or not.

If the number of years that have passed since the product was produced is unknown, it may be set as "no information". Further, instead of the number of years since the painting was produced, the number of years since the painting was obtained (for example, the number of years since it was housed in a facility such as a museum) may be acquired. Since it is considered that the number of years elapsed after acquisition has the same tendency as described above, it can be used as a discriminating material in the same manner as the number of years elapsed after production tp.

The condition determination unit 114 determines the varnish application state based on the detection result by the white portion detection unit 112 and the aging information acquired by the information acquisition unit 113. Then, the condition determination unit 114 determines the formation conditions of the clear layer L5 that reproduces the glossiness of the surface of the object to be duplicated, based on the determined application state of the varnish.

Specifically, the condition determination unit 114 determines the varnish application state corresponding to the conditions of the detection result of the white portion and the aging information with reference to the discrimination table shown in Table 1. Here, Table 1 is table data showing the relationship between the presence / absence of a white portion, the age condition, and the varnish application state.

For example, when the detection result of the white portion detection unit 112 indicates “presence” of the white portion, the condition determination unit 114 determines that the varnish is thickly applied based on the discrimination table of Table 1. Further, for example, when the detection result of the white portion detection unit 112 indicates “none” of the white portion and the aged information acquired by the information acquisition unit 113 indicates a value of 10 years or more, the condition determination unit 114 is shown in Table 1. It is judged that the varnish is thinly applied based on the discrimination table of. Further, for example, when the detection result of the white portion detection unit 112 indicates “none” of the white portion and the aged information acquired by the information acquisition unit 113 indicates a value of less than 10 years, the condition determination unit 114 is shown in Table 1. It is judged that the varnish is not applied based on the discrimination table of.

Then, the condition determination unit 114 determines the conditions related to the formation of the clear layer L5 based on the varnish application state determined (determined) based on the determination table in Table 1. For example, when the condition determination unit 114 determines that the varnish is thickly applied, the ejection amount of the UV curable ink forming the clear layer L5 is sufficiently large with respect to the recording resolution (state in FIG. 9). The conditions for forming the clear layer L5 are determined so as to be. Further, for example, when the condition determination unit 114 determines that the varnish is thinly applied, the ejection amount of the UV curable ink forming the clear layer L5 is a small drop (state of FIG. 8) at the limit of the recording resolution. The formation conditions of the clear layer L5 are determined so as to be. Further, for example, when the condition determination unit 114 determines that the varnish is not applied, it determines that the clear layer L5 is not formed as a condition for forming the clear layer L5.

The formation conditions determined by the condition determination unit 114 are transmitted to the three-dimensional modeling apparatus 50 together with the modeling data under the control of the CPU 101. When the control unit 500 of the three-dimensional modeling apparatus 50 receives the modeling data and the forming conditions, the control unit 500 controls the modeling unit 570 and the like to model the modeled object according to the modeling data. Then, the control unit 500 of the three-dimensional modeling apparatus 50 forms the clear layer L5 on the surface of the modeled object based on the received formation conditions, so that the color, uneven shape, and gloss of the object (painting) that is the reproduction source are reproduced. Reproduce the feeling.

The modeling layers L2 to the colored layers L4 are formed under the control of the control unit 500 (main control unit 500A) of the three-dimensional modeling apparatus 50, but the formation conditions of these layers are also transmitted from the computer 10. It may be configured to be used. When the glossiness of the painting surface can be actually measured by the gloss measuring instrument, the condition determining unit 114 determines the state of varnishing based on the measured glossiness (gloss information), and forms the clear layer L5. The conditions shall be determined.

<Explanation of operation of information processing device>
Next, the operation of the computer 10 will be described with reference to FIG. FIG. 13 is a flowchart showing a modeling data generation process executed by the computer 10 according to the embodiment. In this process, an example of generating modeling data from two-dimensional image data representing an object to be copied (painting of an oil painting) will be described.

First, image data representing an object (painting) to be reproduced, which is acquired by a digital camera or a scanner device, is input to the computer 10 via I / F 107 or the like (step S11). The modeling data generation unit 111 generates color data and three-dimensional data from the input image data (step S12, step S13).

The white part detection unit 112 detects a white part from the color data generated in step S12 (step S14). Further, the information acquisition unit 113 acquires the elapsed years information indicating the elapsed years since the object to be reproduced was produced or obtained via the operation unit 106 or the like (step S15). If a white portion is detected in step S14, the configuration may be such that step S15 is skipped and the process proceeds to step S16.

Subsequently, the condition determination unit 114 determines the varnish application state of the object to be duplicated based on the conditions of the detection result of the white portion and the elapsed years information and the determination table of Table 1. When the detection result of the white portion detection unit 112 indicates the presence of the white portion (step S16; Yes), the condition determination unit 114 determines that the varnish is thickly applied (step S17), and proceeds to step S21.

Further, in step S16, when the detection result of the white portion detection unit 112 indicates that the white portion does not exist (step S16; No), in the condition determination unit 114, the elapsed years indicated by the elapsed years information is a predetermined value (for example,). It is determined whether or not it is 10 years or more (step S18). Here, when the elapsed years are equal to or greater than a predetermined value (step S18; Yes), the condition determination unit 114 determines that the varnish is thinly applied (step S19), and proceeds to step S21. If the number of years elapsed is less than the predetermined value (step S18; No), the condition determination unit 114 determines that the varnish has not been applied (step S20), and proceeds to step S21.

Subsequently, the condition determination unit 114 determines the formation conditions of the clear layer L5 based on the determination results of steps S17, S19 or S20 (step S21). Then, the CPU 101 of the computer 10 outputs the modeling data (color data and three-dimensional data) generated in steps S12 and S13 and the formation conditions determined in step S21 to the three-dimensional modeling apparatus 50 (step S22). End the process.

As described above, according to the three-dimensional modeling system 1 (computer 10), it is based on the detection result of the white part detected from the image data obtained by capturing the image of the object to be duplicated and the number of years since the object was produced. To determine the state of application of varnish on the surface of the object. Then, the three-dimensional modeling system 1 (computer 10) determines the formation conditions of the clear layer L5 based on the determined varnish application state. As a result, in the three-dimensional modeling system 1 (computer 10), the formation conditions suitable for the varnish application state can be determined, so that the glossiness of the object (painting) to be reproduced can be reproduced.

Although the embodiments of the present invention have been described above, the above embodiments are presented as examples and are not intended to limit the scope of the invention. This novel embodiment can be implemented in various other embodiments, and various omissions, replacements, changes, and combinations can be made without departing from the gist of the invention. This embodiment and its modifications are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and the equivalent scope thereof.

For example, in the above embodiment, the computer 10 is used as an information processing device, but the present invention is not limited to this, and the control unit 500 (main control unit 500A) of the three-dimensional modeling device 50 may be used as an information processing device. In this case, the three-dimensional modeling device 50 functions as an information processing device, and the functional configuration of the modeling data generation unit 111, the white portion detection unit 112, the information acquisition unit 113, and the condition determination unit 114 is the control unit 500 (main control unit 500A). ).

1 3D modeling system 10 Computer 50 3D modeling device 101 CPU
102 ROM
103 RAM
104 Storage unit 105 Display unit 106 Operation unit 107 I / F
111 Modeling data generation unit 112 White part detection unit 113 Information acquisition unit 114 Condition determination unit

Japanese Unexamined Patent Publication No. 2007-142953

Claims (6)

An image data acquisition unit that acquires image data representing an object to be duplicated, and an image data acquisition unit.
A white part detection unit that detects a white part from the image data,
The information acquisition unit that acquires the elapsed years information indicating the elapsed years since the object was created, and the information acquisition unit.
Based on the detection result of the white portion and the elapsed years information, the state of application of the varnish on the surface of the object is determined, and the formation conditions for forming the glossiness of the varnish on the surface of the object are determined. Condition determination unit and
Information processing device equipped with. The information processing apparatus according to claim 1, wherein the white portion detecting unit detects a portion having a color value of white or near white in a color space defining the color of the image data as the white portion. The information acquisition unit according to claim 1 or 2, wherein the information acquisition unit acquires the elapsed years information indicating the elapsed years since the object was obtained, instead of the elapsed years since the object was produced. Information processing device. It is an information processing method executed by an information processing device.
The process of acquiring image data representing the object to be duplicated, and
The process of detecting a white part from the image data and
The process of acquiring the elapsed years information indicating the elapsed years since the object was produced, and
Based on the detection result of the white portion and the elapsed years information, the state of application of the varnish on the surface of the object is determined, and the formation conditions for forming the glossiness of the varnish on the surface of the object are determined. And the process to do
Information processing methods including. A function to acquire image data representing an object to be duplicated, and
The function to detect the white part from the image data and
A function to acquire information on the number of years elapsed since the object was created, and
Based on the detection result of the white portion and the elapsed years information, the state of application of the varnish on the surface of the object is determined, and the formation conditions for forming the glossiness of the varnish on the surface of the object are determined. And the function to do
Is a program for making the computer of the information processing device execute. An image data acquisition unit that acquires image data representing an object to be duplicated, and an image data acquisition unit.
A white part detection unit that detects a white part from the image data,
The information acquisition unit that acquires the elapsed years information indicating the elapsed years since the object was created, and the information acquisition unit.
Based on the image data, a modeling unit that models a modeled object that imitates the color and uneven shape of the surface of the object, and
Based on the detection result of the white portion and the elapsed years information, the state of application of the varnish on the surface of the object is determined, and the formation conditions for forming the glossiness of the varnish on the surface of the object are determined. Condition determination unit and
Have,
The modeling unit is a three-dimensional modeling system that performs a process for forming the glossiness of the varnish on the surface of the modeled object based on the forming conditions determined by the condition determining unit.

Images