JP6178938B1 - Painting Appreciation Support System and Painting Appreciation Support Method - Google Patents

Abstract

The present invention provides a technique that allows a user to experience a pseudo change in the appearance of a painting due to the way light strikes it. A painting appreciation support system 1 prints an image P using image data generated using shading data indicating shading caused by unevenness on the surface of a painting and color data indicating the color of the painting. The image forming means 11 for forming the shadow S indicated by the shadow data over the image P on the flat medium 2 and the shadow S formed over the image P maintain the shape of the shadow S. And image control means 12 for controlling to change the display mode of the shadow. [Selection] Figure 1

Description

  The present invention relates to a technology for supporting painting appreciation.

  Patent Document 1 discloses a technique for projecting the same image as a picture onto the picture with a projector in order to emphasize the shade of the picture itself. In Patent Document 1, in order to prevent whitening in a dark part of a picture, image data whose color distribution is adjusted is projected onto the picture.

International Publication No. 13/140456 Specification

  In the technique described in Patent Document 1, since the color distribution of image data is adjusted, that is, changed from the original, the color of the painting is lost from the original. This is no longer a painting appreciation.

  In paintings, especially oil paintings, there are irregularities on the surface. This unevenness is due to various factors such as writing, changing the thickness of the paint, and there is no doubt that it is one of the painting techniques. There are a number of paintings where such surface irregularities have a major impact on expression. For example, Van Gogh's “Rhône River Night” picture of the Rhone River flowing under the starry sky full of the Big Dipper. According to the investigation by the inventors of the present application, Van Gogh paints the night sky in the background while touching it vertically and horizontally like a fabric. Such a complex touch causes irregular reflection of light, giving depth to the surface color. Furthermore, due to the unevenness of the surface, when the position of the light source changes, a phenomenon occurs in which stars drawn in the night sky straddle. In other words, Van Gogh was drawing the starry sky by calculating to the point where the star can be seen straddling due to the fluctuation of sunlight, for example.

  However, until now, attention has not been paid to changes in the appearance of paintings due to the application of light. This is because painting is generally deteriorated by light (especially ultraviolet light and short-wavelength visible light), and it was a law to apply strong light to the painting during appreciation. Even if it is widely known that the appearance of a painting changes depending on the relationship between the light hitting the painting and the surface irregularities, it will promote deterioration as described above, so that the appearance changes in museums etc. It was not possible to provide appreciation for paintings in an environment that was exposed to light.

  By the way, the inventors of the present application have studied the technique of recording the color of the painting, the technique of the artist, and the brush judgment so that the impression caused by the painting can be recorded and reproduced, and is called DTIP (Dynamic Texture Image Processing). Developed technology. This is a technique for recording a three-dimensional painting having surface irregularities as two-dimensional image data. An image printed using this image data is a flat image, but can reproduce a three-dimensional feeling like an oil painting having various irregularities on the surface. The planar images generated in this way were named “Precision Remaster Art” by the inventors of the present application. Precision Remaster Art is certified as an official replica by the Orsay Museum in France.

  Since Precision Remaster Art is a replica to the last, there is no need to worry about deterioration due to light as in the original picture (it does not matter if it deteriorates). Therefore, you can shine various lights during viewing. Therefore, using Precision Remaster Art, it is possible to experience changes in the appearance of paintings due to the application of light. However, Precision Remaster Art is formed as a two-dimensional image to the last, and actually has no surface unevenness like the original image. Regardless of the light on the Precision Remaster Art of “Rhône River's Starry Night” while changing the position of the light source, unfortunately the star cannot be seen again.

  The present invention has been made under such circumstances, and it is possible to experience a pseudo-experience of the change in the appearance of a painting due to how the light hits, using a flat image such as Precision Remaster Art. provide.

  The present invention relates to a flat medium on which an image using image data generated using shading data indicating shading caused by unevenness on the surface of a painting and color data indicating the color of the painting is printed. An image forming unit that forms a shadow indicated by the shadow data, and an image control that changes a display mode of the shadow while the shadow formed to overlap the image maintains a shape of the shadow. A painting appreciation support system having means is provided.

  The image control means may move the shadow within a predetermined range based on the image.

  The image forming unit may include a projection unit that projects an image onto the medium, and the image control unit may control the projection unit to project the shadow.

  The image forming unit may include an electro-optical element formed on a transparent member that protects the medium, and the image control unit may control the electro-optical element so as to form the shadow.

  In addition, the present invention provides a step of preparing a medium on which an image using image data generated by using shadow data indicating shadows caused by unevenness on the surface of a painting and color data indicating colors of the painting is printed; A step of forming a shadow indicated by the shadow data over the image on the medium, and a reference of the image in a state where the shadow formed over the image maintains the shape of the shadow. And a step of controlling to move within a predetermined range.

  According to the present invention, it is possible to experience a pseudo change in the appearance of a painting due to the way light strikes using a plane image.

The figure which illustrates the functional composition of picture appreciation support system 1 concerning one embodiment. The figure which illustrates the hardware constitutions of the painting appreciation support system 1. The flowchart which illustrates operation | movement of the painting appreciation assistance system 1. FIG. FIG. 4 is a diagram illustrating an example of an image projected on the medium 2. 4 is a diagram illustrating an outline of movement of a shadow image S with respect to a print image P. FIG. The figure which illustrates the hardware constitutions concerning the modification 1 of the painting appreciation support system 1. FIG. 4 is a diagram illustrating the relationship between the electro-optical panel 30 and the medium 2

1. Configuration FIG. 1 is a diagram illustrating a functional configuration of a painting appreciation support system 1 according to an embodiment. The painting appreciation support system 1 is a system for experiencing, in a pseudo manner, a change in the appearance of a painting due to the application of light, using, for example, a medium 2 on which a restored image is formed.

  The medium 2 is printed with an image (hereinafter referred to as a “print image P”) using image data generated using the shadow data indicating the shadow due to the unevenness of the surface of the painting and the color data indicating the color of the painting. It is a flat medium. Here, the “painting” refers to a work of art having unevenness on the surface due to a difference in the thickness of the paint such as an oil painting, and an example is an original picture (original oil painting). The “medium on which an image is printed” refers to a medium on which a print image P is formed. Any specific method may be used to form the print image P. For example, the print image P can be formed by printing, electrophotography, or an inkjet method. The “planar medium” refers to a medium that is entirely planar including the print image P before the print image P is formed and after the print image P is formed, for example, paper. “Plane” means that there is less unevenness than the original image and it is flat.

  Here, it supplements about shadow data and color data. The shadow data and the color data are acquired from one picture by different methods. The color data is obtained by photographing a picture with a digital still camera (hereinafter simply referred to as a camera) in a state where light is applied to the picture from a light source arranged at a predetermined position (for example, the front). In order to improve the resolution, it is preferable to shoot a single picture divided into a plurality of regions. Further, in order to fix the viewpoint, the position of the camera is fixed, and the direction of the lens (optical axis) is changed to photograph a plurality of areas. For example, if a picture is divided into nine areas of 3 rows and 3 columns and each area is photographed with a 10 million pixel camera, the picture can be photographed with a resolution of about 90 million pixels. The images of the plurality of regions are subjected to geometric correction such as trapezoidal correction, and then combined in position to obtain color data of a single painting. The shadow data is obtained by taking a picture of the picture with a camera in a state where light is applied to the picture from a light source arranged at a position different from that at the time of obtaining the color data. Photographing is performed while changing the incident angle of the light from the light source to the painting. By photographing shadows formed by light incident at various angles, information on the unevenness of the painting surface can be obtained. By applying predetermined image processing to a plurality of images photographed at a plurality of incident angles, color information is removed, and shadow data of an image showing only a shadow is obtained. Color data and shadow data are combined to obtain image data. The image data itself obtained in this way has a known image data format in which gradation values divided into color components are recorded for each pixel.

  The painting appreciation support system 1 includes an image forming unit 11 and an image control unit 12. The image forming unit 11 forms a shadow (hereinafter referred to as a “shadow image S”) indicated by the shadow data on the medium 2 on which the print image P is formed so as to overlap the print image P. The image control means 12 changes the display mode of the shadow image S while maintaining the shape of the shadow. The display mode of the shadow image S refers to the visual appearance of the shadow image S. The change in the display mode of the shadow image S includes at least one of moving within a predetermined range based on the print image P and changing the brightness of the shadow image S. As an example, the shadow image S periodically moves within a predetermined range. In another example, the shadow image S moves aperiodically or randomly within a predetermined range.

  FIG. 2 is a diagram illustrating a hardware configuration of the painting appreciation support system 1. The painting appreciation support system 1 includes an information processing device 10 and a video projection device 20. The information processing apparatus 10 is a computer apparatus having a CPU 101, a memory 102, a storage 103, a communication IF 104, a display 105, and an input device 106. The CPU 101 executes programs and performs various calculations. The memory 102 is a main storage device and functions as a work area when the CPU 101 executes a program, for example. The storage 103 is an auxiliary storage device and stores various programs and data. The communication IF 104 is an interface for communicating with other devices in accordance with a predetermined communication standard. The display 105 is a device that displays information. The input device 106 is a device for inputting information to the information processing apparatus 10 and includes, for example, at least one of a touch screen, a keyboard, and a mouse.

  In this example, the storage 103 stores a program (hereinafter referred to as “control program”) for causing the computer device to function as the image control means 12 of the painting appreciation support system 1. The CPU 101 executing the control program is an example of the image control unit 12. According to the control program, the information processing apparatus 10 outputs a video signal indicating a video in which the display mode of the shadow changes to the video projection apparatus 20.

  The video projector 20 is a so-called projector that projects video according to an input video signal. The video projection device 20 is an example of the image forming unit 11. In this example, the video projection device 20 projects a video according to the video signal input from the information processing device 10 onto the medium 2. The image projection device 20 is a so-called short focus projector, for example, and is installed above the medium 2. Note that the image projection device 20 may project an image directly onto the medium 2, or may project an image from above the acrylic glass when the medium 2 is protected by acrylic glass or the like.

2. Operation FIG. 3 is a flowchart illustrating the operation of the painting appreciation support system 1. In step S1, the medium 2 is prepared. In step S2, shadow video data corresponding to the medium 2 is specified. The shadow video data is generated in advance using the shadow data of the picture printed on the medium 2 and stored in the storage 103. The shadow image data is specified by, for example, a user of the painting appreciation support system 1. In step S <b> 3, the information processing apparatus 10 starts outputting a shadow video signal according to the shadow video data. Prior to step S3, the image printed on the medium 2 and the image projected by the image projection device 20 are aligned using a known method. After the start of projection, the shadow moves, for example, periodically or aperiodically (step S4).

  FIG. 4 is a diagram illustrating an image projected on the medium 2. FIG. 4A shows a state where a shadow image is not projected, that is, a picture (a part of) a picture printed on the medium 2 itself. FIG. 4B shows the shadow itself indicated by the shadow data of the print image P. Hereinafter, the shadow image is referred to as a “shadow image S”. 4C to 4J are diagrams illustrating the positional relationship between the print image P and the shadow image S at times t0 to t8. At time t0, the shadow image S is displayed at the same position as the shadow in the print image P. This position is referred to as a “reference position”. At times t1 to t7, the shadow image S sequentially moves around the shadow in the print image P. Although illustration is omitted, the shadow image S returns to the reference position (the same position as the time t0) at the time next to the time t8. After that, the shadow image S moves in the same manner as at times t1 to t8. That is, in this example, the shadow image S periodically moves on the print image.

  FIG. 5 is a diagram illustrating an outline of movement of the shadow image S with respect to the print image P. The point P0 indicates a representative point (for example, the center of gravity) of the print image P. The locus St indicates a locus drawn by a representative point (for example, the center of gravity) of the shadow image S as the shadow image S moves. In this example, the shadow image S periodically moves along a locus that draws a circle with a radius d with respect to the representative point of the print image P. It can be understood that the reference position of the shadow (the position at time t0 in FIG. 4C) is on the circle of the locus St.

  By changing the display mode of the shadow image S on the print image P, it is possible to make the user experience the original image while changing the position of the light source. At this time, in the shadow video data, only the position of the shadow changes, and the shape does not change. If the shape of the shadow is changed, the information of the original picture will be destroyed, and it will no longer be a painting appreciation. By changing only the position while maintaining the shape of the shadow, it is possible to make a pseudo-experience while changing the position of the light source without destroying the information of the original image.

  The specific method for changing the display mode of the shadow image S is not limited to the one illustrated in FIGS. 4 and 5. 4 and 5 show an example in which the shadow image S moves periodically, the shadow image S may move aperiodically on the print image. Alternatively, the change in the display mode of the shadow image S may include a change in lightness or saturation instead of or in addition to the movement of the position.

3. Modifications The present invention is not limited to the above-described embodiments, and various modifications can be made. Hereinafter, modified examples will be described. Two or more of the following modifications may be used in combination.

3-1. Modification 1
FIG. 6 is a diagram illustrating a hardware configuration according to Modification 1 of the painting appreciation support system 1. In the first modification, the painting appreciation support system 1 does not include the video projection device 20 but includes the electro-optical panel 30. The electro-optical panel 30 includes an electro-optical element 33 sandwiched between two plate-like transparent members 31 and 32. The transparent members 31 and 32 are made of glass, for example. The electro-optic element 33 has a plurality of pixels arranged in a matrix. The electro-optical element 33 is a liquid crystal element, for example. That is, the electro-optical panel 30 is a transmissive liquid crystal panel. The electro-optical panel 30 includes an input interface 34 and a drive circuit 35. The gradation of each pixel is controlled in accordance with a shadow video signal input from the information processing apparatus 10, and a shadow image is displayed on the electro-optical panel 30. Is displayed. The electro-optical panel 30 is another example of the image forming unit 11. The electro-optical element 33 is not limited to a liquid crystal element, and may be an organic EL element or the like.

  FIG. 7 is a diagram illustrating the relationship between the electro-optical panel 30 and the medium 2. The electro-optic panel 30 is used as a protective device for protecting the medium 2, specifically, as glass constituting the frame 5 for mounting the medium 2. Since the medium 2 is displayed in a state of being framed on the frame 5, the viewer visually recognizes the print image P formed on the medium 2 through the electro-optical panel 30. The electro-optical panel 30 is, for example, a transmissive liquid crystal panel, and has a maximum transmittance (almost transparent) in all pixels when no video signal is input. When the shadow video signal is input, a shadow image S is displayed on the electro-optical panel 30. The viewer appreciates the image in which the shadow image S is superimposed on the print image P. As illustrated in FIG. 4, the display mode of the shadow image S changes with reference to a reference position determined based on the print image P. The reference position is a position where the shadow and the shadow image S in the print image P coincide with each other. By changing the display mode of the shadow image S on the print image P, it is possible to make the user experience the original image while changing the position of the light source.

3-2. Modification 2
In the above-described embodiment, the shadow video data is prepared in advance and stored in the storage 103. However, the shadow image data may move the shadow image S in real time (adaptively or dynamically) according to the environment of the medium 2. The environment of the medium 2 includes, for example, weather information (weather, temperature, or solar radiation) around the building where the medium 2 is installed. Specifically, the shadow image S moves so that the moving range (corresponding to the radius d in FIG. 5) is larger on a clear day than on a cloudy day. Alternatively, the shadow image S moves so that the moving range is larger on a day with strong solar radiation than on a day with weak solar radiation. The environment of the medium 2 may include information regarding a viewer who is viewing the medium 2. The information regarding the viewer includes, for example, the position of a specific viewer. Specifically, when a specific viewer is viewing the medium 2 from the right side, the shadow image S moves only in the region on the left side with respect to the reference position. Referring to the example of FIG. 5, the shaded image does not draw a circle around the representative point P0 of the print image P, but draws a locus that is biased toward the left region with respect to the representative point. Conversely, when a specific viewer is viewing from the left side toward the medium 2, the shadow image S moves only in the region on the right side with respect to the reference position. The information regarding the viewer may include the number of viewers. For example, when the number of viewers is large, the shadow image S moves so that the movement range becomes larger than when the number of viewers is small. Furthermore, the environment of the medium 2 may include the current time. Specifically, the shadow image S may be moved only in an area corresponding to the position of the sun expected from the current time. For example, when it is predicted that the sun is located on the left side toward the medium 2 in the morning time zone, the shadow image S moves only in the region on the right side with respect to the reference position. When the sun is expected to be located above the medium 2 in the daytime time zone, the shadow image S moves only in the region below the reference position. When the sun is expected to be located on the right side of the medium 2 in the evening time zone, the shadow image S moves only in the region on the left side with respect to the reference position. In this way, by moving the shadow image S in real time according to the environment of the medium 2, it is possible to make a pseudo-experience of viewing the original image under the way of light according to the environment of the medium 2.

  In this example, the information processing apparatus 10 acquires information indicating the environment of the medium 2 (hereinafter referred to as “environment information”). The environment of the medium 2 is detected by, for example, a sensor (not shown). In this case, the information processing apparatus 10 acquires information indicating the environment of the medium 2 from this sensor. For example, this method is adopted when the position and the number of viewers of the medium 2 are used as the environmental information of the medium 2. Alternatively, the environmental information of the medium 2 may be acquired from an external server device (not shown) via a network. For example, this method is employed when weather information around a building where the medium 2 is installed is used as environmental information.

  The adaptive movement of the shadow image S according to the environmental information is realized by software processing. In this case, the storage 103 of the information processing apparatus 10 stores a program (hereinafter referred to as “movement control program”) for adaptively moving the shadow image S according to the environment information. By installing the movement control program, the information processing apparatus 10 is provided with a function of adaptively moving the shadow image S according to the environment information.

3-3. Modification 3
The display mode of the shadow image S may change in real time according to the environment of the medium 2. The display mode of the shadow image S refers to elements other than the movement of the shadow image S in the appearance of the shadow image S. The display mode includes, for example, gradation (brightness) or saturation. Specifically, the shadow image S is adjusted so that the gradation of the shadow becomes darker on a clear day than on a cloudy day. Alternatively, the shadow image S is adjusted so that the shade of shade is darker on a day with strong solar radiation than on a day with weak solar radiation. By changing the display mode, it is possible to more realistically experience the appreciation of the original picture under the light exposure according to the environment of the medium 2.

3-4. Other Modifications The hardware configuration of the painting appreciation support system 1 is not limited to that illustrated in FIGS. 2 and 6. The painting appreciation support system 1 may have any hardware configuration as long as the required function can be realized. The movement control program may be provided by a storage medium such as an optical disk, a magnetic disk, or a semiconductor memory, or may be downloaded via a communication line such as the Internet.

DESCRIPTION OF SYMBOLS 1 ... Painting appreciation support system, 2 ... Medium, 10 ... Information processing apparatus, 11 ... Image formation means, 12 ... Image control means, 20 ... Video projection apparatus, 30 ... Electro-optical panel, 101 ... CPU, 102 ... Memory, 103 ... Storage 104 ... Communication IF 105 ... Display 106 ... Input device

Claims (5)

For a flat medium on which an image using image data generated using shading data indicating shading caused by unevenness on the surface of the painting and color data indicating the color of the painting is printed, the image is superimposed on the image, Image forming means for forming a shadow indicated by the shadow data;
An image appreciation support system comprising: an image control unit that changes a display mode of the shadow in a state where the shadow formed to overlap the image maintains the shape of the shadow. The picture appreciation support system according to claim 1, wherein the image control unit moves the shadow within a predetermined range based on the image. The image forming unit includes a projection unit that projects an image on the medium.
The picture appreciation support system according to claim 1, wherein the image control unit controls the projection unit to project the shadow. The image forming unit includes an electro-optic element formed on a transparent member that protects the medium,
The picture appreciation support system according to claim 1, wherein the image control unit controls the electro-optic element so as to form the shadow. Preparing a medium on which an image using image data generated by using the shadow data indicating the shadow due to the unevenness of the surface of the painting and the color data indicating the color of the painting is printed;
Forming a shadow indicated by the shadow data on the medium, overlaid on the image;
A method of supporting painting appreciation, comprising: controlling a shadow formed on the image so as to move within a predetermined range based on the image in a state in which the shape of the shadow is maintained.

Images