JP2019013012A - data structure - Google Patents

Abstract

To cause a person to have a perception that a depth of an arbitrary object is given a change without largely deviating an apparent impression from an original target.SOLUTION: The data structure for projecting or displaying a first differential image and a second difference image superimposed on a target pattern of interest, includes: the first differential image including a first region overlapped with a binocular disparity region for giving a certain binocular parallax to a certain binocular parallax region of a target pattern in a certain time period, which are associated with each other; and a second differential image including a second region overlapped in the vicinity of the binocular parallax region for giving the binocular parallax to the binocular parallax region in the time period.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for causing a subject to perceive a change in depth.

  Various creatures, including humans, have eyes that are separated from each other. For this reason, when a deep space or object is observed, the retinal image shifts between the left and right eyes. This shift is called binocular parallax. Humans can recognize depth from binocular parallax. Recently, various techniques for reproducing a scene with depth on a plane by artificially introducing binocular parallax have become widespread.

  In 3D televisions and 3D projectors, binocular parallax is introduced by adjusting the image so that different image information is input to the left and right eyes when viewed through glasses having a polarizing lens or a liquid crystal shutter, for example.

  In the anaglyph method, images of two different hues (for example, red and blue) are displayed in an overlapping manner, and binocular parallax is introduced by observing with these two hue transmission filters with left and right lenses. It is perceived as having depth.

  In addition, it does not perceive the subject's depth as if it was given a change, but it gives motion to the target grayscale image, and the difference video (video) between the resulting grayscale image and the original grayscale image. A technique for giving an impression of motion to an object by projecting has been proposed (see, for example, Patent Document 1). Since only the luminance is modulated in the target on which the difference video is projected, the color, texture, and texture are not impaired.

International Publication No. WO / 2015/163317

  In conventional 3D televisions and 3D projectors, a target that can be perceived as if the depth of the target has been changed is limited to that displayed or projected. Since the anaglyph method uses a colored transmission filter, the apparent impression of the object is greatly different from the original impression. The technique described in Patent Document 1 assumes that the same image information is input to both eyes, and does not cause a user to perceive a change in depth.

  The subject of this form is making it perceive as the change of the depth of arbitrary objects was given, without making an apparent impression largely deviate from the original object.

  A data structure is provided for performing projection or display in which the first difference image and the second difference image are superimposed on the target pattern of interest. This data structure includes a first region that is associated with each other and is superimposed in the vicinity of the binocular parallax region in order to give a certain binocular parallax to a certain binocular parallax region of a target pattern in a certain time interval. A first difference image and a second difference image including a second region superimposed in the vicinity of the binocular parallax region in order to give the binocular parallax to the binocular parallax region in the time interval; Structure in which one difference image, first region, binocular parallax, and identification information are associated with each other in pairs, and the second difference image, second region, binocular parallax, and identification information are associated in pairs. And stored in a storage device. The first difference image is a first image obtained by moving an original image including a luminance component pattern based on a target still image and a luminance component pattern region corresponding to a binocular parallax region included in the original image in a first direction. It is the image produced | generated based on the difference with a deformation | transformation image. The second difference image includes an original image and a second modified image obtained by moving a luminance component pattern area corresponding to the binocular parallax area included in the original image in a second direction opposite to the first direction. It is the image produced | generated based on the difference of. The sum of the movement amount for moving the region corresponding to the binocular parallax region in the first direction and the movement amount for moving the region corresponding to the binocular parallax region in the second direction corresponds to binocular parallax. This data structure is triggered by the input of control information to the playback processing device, the time interval corresponding to the first difference image, the binocular parallax, the first region, and the time interval corresponding to the second difference image, According to the correspondence relationship between the binocular parallax and the second area, the first section includes the time section, the binocular parallax, and the first area, which are associated with each other, specified by the control information input to the reproduction processing device. The first difference image and the second difference image having the time interval, the binocular parallax, and the second region are read from the storage device into the reproduction processing device, and the first eye and the other eye of the observer respectively In the time interval, the first difference image is output from one channel of the reproduction processing apparatus and projected or displayed on the target pattern so that each of the first difference image and the second difference image can be viewed simultaneously. Difference image is re Output from the other channel of the processing device and projected or displayed on the target pattern, and in the time interval, the first region is superimposed in the vicinity of the binocular parallax region, and the second region is the binocular parallax region. It is used for processing that makes the observer perceive the state superimposed in the vicinity.

  In the present invention, it is possible to perceive a change in the depth of an arbitrary object without greatly deviating the apparent impression from the original object.

FIG. 1 is a block diagram for illustrating a functional configuration of an image generation system according to an embodiment. FIG. 2A is a conceptual diagram for explaining an example of a still image obtained by photographing an object and a grayscale still image derived therefrom. FIG. 2B is a conceptual diagram for explaining an example of a first modified image obtained by modifying a gray-scale still image. FIG. 2C is a conceptual diagram for explaining an example of a second modified image obtained by modifying a grayscale still image. FIG. 2D is a conceptual diagram for explaining an example of the first image. FIG. 2E is a conceptual diagram for explaining an example of the second image. FIG. 3A is a block diagram for illustrating the configuration of the projection system of the embodiment. FIG. 3B is a conceptual diagram for illustrating a state in which an image is superimposed on an object. FIG. 4A is a conceptual diagram for explaining an example of the first image. FIG. 4B is a conceptual diagram for explaining an example of the second image. FIG. 4C is a conceptual diagram for illustrating a state in which an image is superimposed on an object. 5A and 5B are conceptual diagrams for illustrating a state in which an image is superimposed on an object. 6A and BD are conceptual diagrams for illustrating a state in which an image is superimposed on an object. 7A and 7B are conceptual diagrams for illustrating a state in which an image is superimposed on an object. FIG. 7C is a diagram for illustrating a time interval (R) in which an image for the right eye is presented and a time interval (L) in which an image for the left eye is presented. 8A and 8B are block diagrams for illustrating the configuration of the display system of the embodiment.

Embodiments of the present invention will be described below.
[Overview]
First, an outline of the embodiment will be described.
The “object” described below represents “thing” that gives the effect of perceiving a change in depth. You can't have this effect on things that don't have visual patterns. Therefore, “object” is a visual pattern. The “target” may be a pattern including an outline or a pattern not including an outline. For example, “target” is a pattern on a predetermined surface (for example, a screen such as paper, board, wall, screen, electronic paper, a normal display or a transmissive display) ”Or“ projected ”images and photographs, patterns and patterns based on the color of the material constituting the predetermined surface, patterns based on the shape of the predetermined surface, border lines, shading, etc.). The “predetermined surface” may be a flat surface, a surface that can be regarded as a flat surface, a curved surface, or an uneven surface. The “object” is a pattern (eg, “printed”, “drawn”, “displayed” or “projected” on the surface of an object having a three-dimensional shape (eg, vase, ball, model, building, etc.) It may be a photograph, a pattern or pattern based on the color of the material constituting the surface, a pattern based on the shape of the surface, a boundary line, shading, etc.). When the “object” is a plane or a pattern on what can be regarded as a plane, the “object” has no depth. When the “target” is a pattern on a curved surface or an uneven surface, the “target” has a depth. When the “target” is a pattern on the surface of an object having a three-dimensional shape, the “target” often has a depth. However, when the surface of an object having a three-dimensional shape can be regarded as a plane or a plane, and the pattern on the surface is “target”, the “target” may not have a depth. The “target pattern” is a pattern of all or a part of the “target”. In the embodiment, the depth of the “target” is perceived as being changed as follows. A “first image” that includes a “first luminance component pattern” that corresponds to a “target pattern” of “target” and that is visible with only one eye is superimposed on the “target”. Further, a “second image” that includes a “second luminance component pattern” that corresponds to the “target pattern” and is visible only with the other eye is superimposed on the “target”. However, the relative position of the “first luminance component pattern” with respect to the “target pattern” is different from the relative position of the “second luminance component pattern” with respect to the “target pattern”. Note that the “first luminance component pattern” can be visually recognized by one eye as compared with the other eye, and the “second luminance component pattern” can be visually recognized by the other eye as compared with the first eye. There may be.

  By superimposing the “first image” and the “target”, the position of the “target pattern” of the “target” is perceived as being displaced toward the “first luminance component pattern” visible with one eye. . By superimposing the “second image” and the “target”, the position of the “target pattern” of the “target” is perceived as being displaced toward the “second luminance component pattern” visible with the other eye. . Here, the relative position of the “first luminance component pattern” with respect to the “target pattern” is different from the relative position of the “second luminance component pattern” with respect to the “target pattern”. For this reason, the displacement of the “target pattern” perceived by the observer visually recognizing with one eye is different from the displacement of the “target pattern” perceived by visually recognizing with the other eye. The difference is perceived as binocular parallax. Thereby, it can be made to perceive as the change of the depth of "object" was given. In addition, since the “first image” and the “target” may be superimposed and the “second image” and the “target” may be superimposed, not only the displayed or projected “target” but also any “target” It can be perceived as a change in depth. Furthermore, unlike the anaglyph method, binocular parallax is not introduced due to a difference in hue, so that the apparent impression is not greatly deviated from the “target”. “Make the target perceived as if the depth of the object has been changed” means that the “object” without depth is perceived as if the depth is given, or the depth of the “object” with depth has changed. Means to perceive.

  The luminances of the “first image” and the “second image” are not spatially uniform, but include a pattern that is a pattern of luminance components. The “first image” is a single image (one still image) corresponding to the “target”, and a pattern (pattern) composed of luminance components of the entire region or a part of the region is referred to as “first luminance component pattern”. " The “second image” is a single image corresponding to the “target”, and a pattern (pattern) composed of the luminance components of the entire region or a part of the region is called a “second luminance component pattern”. The “first image” and the “second image” may be obtained from a still image obtained by photographing the “object”, or obtained by photographing an image that is the same as or similar to the “object”. It may be obtained from a still image that has been created, or may be obtained from a still image that has been drawn based on a “target”. The “first luminance component pattern” and the “second luminance component pattern” are patterns derived from the “target pattern”. The “first luminance component pattern” and the “second luminance component pattern” may be obtained from a pattern included in a still image obtained by photographing the “target”, or the same as the “target” or It may be obtained from a pattern included in a still image obtained by photographing an approximate image, or may be obtained from a pattern included in a still image drawn based on the “target” Good. The “first image” may be an image including only a luminance component, or may be an image including a luminance component and a color component (color difference component). The “second image” may also be an image made up of only luminance components, or an image made up of luminance components and color components. In order to perceive a change in the depth of the “target” while suppressing changes in the color and texture of the “target”, the luminance components of the “first image” and the “second image” are used as color components. It is desirable that it is perceived as being superior. When the “first image” and the “second image” are images composed only of luminance components, the depth of the “target” was changed without substantially impairing the impression of the color and texture of the “target”. Can be perceived.

  For example, the “first image” is an image based on a difference between a “first still image” derived from the “target” and a “first modified image” obtained by modifying the “first still image”. The “second image” is an image based on a difference between a “second still image” derived from the “object” and a “second modified image” obtained by modifying the “second still image”.

  Examples of the “first still image” derived from the “object” include an image derived from a still image obtained by photographing the “object”, and a still image obtained by photographing an image that is the same as or similar to the “object”. An image derived from an image, or an image derived from a still image obtained by photographing an image that is the same as or close to the “target”. Examples of “an image derived from a still image” are an image obtained by converting a “still image” into a gray scale, and an image obtained by converting a luminance component so as to be perceived as being superior to a color component. The “first modified image” is an image obtained by deforming a part or all of the “first still image”. For example, an image obtained by shifting an image of a part or the whole area of the “first still image” from an original position in the image, or an image of a part or the whole area of the “first still image”. An image obtained by smoothing (for example, smoothing with a smoothing filter such as a Gaussian filter) an image obtained by shifting it from its original position is referred to as a “first modified image”. In the case of smoothing, an image of a part or all of the image can be spatially and smoothly deformed, and a depth impression (such as a curved surface) that smoothly changes to the “target” can be given. . The image may be spatially and smoothly shifted by a function itself used to shift an image of a part or all of the “first still image” from the original position in the image. For example, the “image” may be deformed using a map (map) having a spatially smooth shift amount created by a function having a smooth shape (sine wave or normal distribution). An example of such a map is a relative coordinate in the “image” (coordinate based on a predetermined position of the “image”) and a shift amount (coordinate movement amount) corresponding to the coordinate or relative coordinate. It is a correspondence table with the function which outputs displacement amount. This also makes it possible to give a depth impression as if it were a curved surface to what is actually a flat surface. Note that “shifting an image from its original position in the image” means moving the “image” along a plane in which the image exists. In other words, “shift the image from its original position in the image” means to slide the “image” on the plane where the image exists, that is, to move the coordinates of the “image” parallel to the “plane”. Means. The shift does not need to be uniform throughout the image. For example, a region having a plurality of shift amounts may coexist, such as a place where the image is largely translated and a location where the image is translated slightly. In that case, binocular parallax of various sizes can be set based on each shift amount, and a situation in which a plurality of depth planes exist in the target can be produced perceptually. The “image based on the difference between the first still image and the first modified image” may be a difference image between the “first still image” and the “first modified image”, or the luminance of the difference image is changed. Or an image obtained by processing so that the high spatial frequency component of the difference image is perceived more dominantly than the low spatial frequency component, or the difference image. May be an image obtained by smoothing, or may be an image obtained by subjecting the difference image to a plurality of processes. For example, the luminance of the difference image can be changed by adding an average luminance value (an average luminance value of the “first still image” and / or “first modified image”) to the difference image, or by general pixel value clipping (for example, A value smaller than 0 is 0, a value larger than 255 is fixed to 255), and normalization (for example, a range of pixel values is once modified to fall within the range of 0 to 1, and then multiplied by 255) Etc.). “Processing so that the high spatial frequency component is perceived more preferentially than the low spatial frequency component” in “Image” means suppressing the low spatial frequency component of “Image” with respect to the high spatial frequency component (high spatial frequency component). Frequency filtering) or emphasizing the high spatial frequency component of the “image” over the low spatial frequency component.

  Examples of the “second still image” derived from the “object” include an image derived from a still image obtained by photographing the “object”, and a still image obtained by photographing an image that is the same as or similar to the “object”. An image derived from an image, or an image derived from a still image obtained by photographing an image that is the same as or close to the “target”. Examples of “an image derived from a still image” are an image obtained by converting a “still image” into a gray scale, and an image obtained by converting a luminance component so as to be perceived as being superior to a color component. The “second still image” derived from the “target” may be the same image as the “first still image” described above, or may be a different image. The “second modified image” is an image obtained by deforming part or all of the “second still image”. For example, an image obtained by shifting an image of a part or the whole area of the “second still image” from an original position in the image, or an image of a part or the whole area of the “second still image”. An image obtained by smoothing (for example, smoothing with a smoothing filter such as a Gaussian filter) an image obtained by shifting it from its original position is referred to as a “second modified image”. In the case of smoothing, an image of a part or all of the image can be spatially and smoothly deformed, and a depth impression (such as a curved surface) that smoothly changes to the “target” can be given. . The image may be spatially and smoothly shifted by a function itself used to shift an image of a part or all of the “second still image” from the original position in the image. The “image based on the difference between the second still image and the second modified image” may be a difference image between the “second still image” and the “second modified image”, or the luminance of the difference image is changed. Or an image obtained by processing so that the high spatial frequency component of the difference image is perceived more dominantly than the low spatial frequency component, or the difference image. May be an image obtained by smoothing, or may be an image obtained by subjecting the difference image to a plurality of processes. For example, the luminance of the difference image is changed by adding an average luminance value (an average luminance value of the “second still image” and / or the “second modified image”) to the difference image, general pixel value clipping, and normal It is a change due to at least one of conversion.

  In addition, an image obtained by processing a high spatial frequency component of an “image derived from a still image” to be perceived as being superior to a low spatial frequency component, and transforming all or a part of the obtained image by “ It may be a “first image” or a “second image”. Alternatively, processing may be performed so that the high spatial frequency component of the “first modified image” is perceived more preferentially than the low spatial frequency component, and an image obtained thereby may be referred to as a “first image”. Similarly, processing may be performed so that the high spatial frequency component of the “second modified image” is perceived more preferentially than the low spatial frequency component, and the resulting image may be referred to as a “second image”. That is, at least one of the “first image” and the “second image” may be an image in which the high spatial frequency component is perceived more preferentially than the low spatial frequency component, and the “first luminance component pattern” and “ At least one of the “second luminance component pattern” may be a pattern in which a high spatial frequency component is perceived more preferentially than a low spatial frequency component.

  There is no limitation on the method of superimposing the “first image”, the “second image”, and the “target”. The transparent “first image” and the “second image” may be superimposed on the non-transparent “object”, or the transparent “object” may be displayed as the non-transparent “first image”. And may be displayed over the “second image”, or the transparent “first image” and “second image” may be displayed over the transparent “target”, or may be transparent. The characteristic “object” may be displayed so as to overlap the transparent “first image” and “second image”. For example, a “first image” and a “second image” may be projected onto a “target” printed or drawn by a projector or the like, or a “first image” and a “second image” may be projected onto the projected “target”. ”May be projected, or“ object ”and“ first image ”and“ second image ”may be displayed on the same screen, or may be displayed on a display (non-transmission type or transmission type). The “first image” and the “second image” may be projected on the “object”, and the “object” is displayed on the “first image” and the “second image” displayed on the display (non-transmission type or transmission type). May be projected. Further, for example, a transparent liquid crystal screen such as a transmissive display is installed between the “target” and the observer, and the transparent “first image” and “second image” are displayed on the liquid crystal screen. Good. Also in this case, when viewed from the observer, the “first image” and the “second image” having transparency are superimposed on the “object”. Further, for example, a transparent liquid crystal screen such as a transmissive display is installed between the “first image” and the “second image” and the observer, and a transparent “target” is displayed on the liquid crystal screen. Good. When viewed from the observer, a transparent “object” is superimposed on the “first image” and the “second image”.

  A “first luminance component pattern” and a “second luminance component pattern” are superimposed in the vicinity of the “target pattern”. For example, the contours of “first luminance component pattern” and “second luminance component pattern” or the vicinity thereof may be arranged so as to overlap with the contour of “target pattern”, or “first image” and “second image”. ”Or the vicinity thereof may overlap with the“ target ”outline, or the edge included in the“ first luminance component pattern ”and the“ second luminance component pattern ”or the vicinity thereof may be the“ target pattern ”. You may arrange | position so that it may overlap with the containing edge. The deviation width between the “first luminance component pattern” and the “second luminance component pattern” and the “target pattern” is limited to a range in which they are not apparently separated. For the range that does not appear to be separated, the size of the “first luminance component pattern” and “second luminance component pattern” or “target pattern”, the size when displayed on a screen, the viewing angle from the user, etc. Set in consideration. The “first luminance component pattern” and the “second luminance component pattern” may or may not intersect with each other.

  The “first luminance component pattern” that can be visually recognized by one eye cannot be visually recognized by the other eye, or is almost invisible. On the contrary, the “second luminance component pattern” that can be visually recognized by the other eye cannot be visually recognized by one eye or almost cannot be visually recognized. The “target pattern” is visible with both eyes. There is no limitation on the method of realizing these.

  For example, the polarization direction (first polarization direction) of the “first luminance component pattern” is different from the polarization direction (second polarization direction) of the “second luminance component pattern”. In this case, the observer wears polarized glasses having a “first polarization lens” that passes only light in the “first polarization direction” and a second polarization lens that passes only light in the “second polarization direction”. One eye of the observer passes through the “first polarizing lens” and the other eye passes through the “second polarizing lens”, and the “object”, “first image”, and “second image” are superimposed, respectively. I see. Accordingly, one eye of the observer visually recognizes that the “first luminance component pattern” and the “target pattern” are superimposed, and the other eye is a state where the “second luminance component pattern” and the “target pattern” are superimposed. Is visually recognized (polarized lens method).

  Alternatively, the “first time interval” in which the “target” and the “first image” are superimposed but the “second image” is not superimposed, and the “target” and the “second image” are superimposed, but the “first image” "Second time interval" in which "is not superimposed may be alternately repeated. The “first time interval” in which the “first image” and the “target” are superimposed does not overlap with the “second time interval” in which the “second image” and the “target” are superimposed. The observer is in the transmissive state in the “first time interval” and is in the transmissive state in the “second time interval” and the “first lens” having the liquid crystal shutter that is in the non-transmissive state in the “second time interval”. Wear spectacles with a “second lens” with a liquid crystal shutter that becomes non-transmissive in the “section”. One eye of the observer passes through the “first lens” and the other eye passes through the “second lens”, and “object” and “first image” and “object” and “second image” are superimposed, respectively. See what happened. Thus, one eye of the observer visually recognizes that the “first luminance component pattern” and the “target pattern” are superimposed in the “first time interval”, and the other eye “the second time interval” in the “first time interval”. The state where the “two luminance component pattern” and the “target pattern” are superimposed is visually recognized (liquid crystal shutter method).

  “One eye” and “the other eye” are both eyes of the same observer. When "one eye" is a right eye, "the other eye" is a left eye, and when "one eye" is a left eye, "the other eye" is a right eye.

  At least one of the positional relationship between the “target pattern” and the “first luminance component pattern” and the positional relationship between the “target pattern” and the “second luminance component pattern” changes (with time elapse) May be changed). For example, at least one of “first image” and “second image” to be superimposed on “target”, that is, at least one of “first luminance component pattern” and “second luminance component pattern” to be superimposed on “target pattern”. It may be moved or deformed over time. For example, the “first image” and the “second image”, that is, the “first luminance component pattern” and the “second luminance component pattern” may be different for each frame. At least one of the shift width of the “first luminance component pattern” with respect to the “target pattern” and the shift width of the “second luminance component pattern” with respect to the “target pattern” may be different for each frame. Thereby, the binocular parallax can be perceived to change with the passage of time, and the depth of the “target” can also be perceived to change with the passage of time (Example 1). A “target” that changes (eg, deformation or movement) with the passage of time may be superimposed on a “first image” and a “second image” that change (eg, deformation or movement) with the passage of time. . That is, the “target pattern” that changes with the passage of time may be superimposed on the “first luminance component pattern” and the “second luminance component pattern” that change with the passage of time. Thereby, it can be made to perceive as the change was given to the depth of the "object" to change (example 2). The combination of Examples 1 and 2 may be used. In this case, it can be perceived that the changing depth of the “target” changes with time.

  Change in positional relationship between “target pattern” and “first luminance component pattern”, change in positional relationship between “target pattern” and “second luminance component pattern”, change in “target pattern”, “ At least one of the change of the “first luminance component pattern” and the change of the “second luminance component pattern” may be repetitive or periodic, or may be repetitive or non-periodic. Good. These changes may be continuous changes, intermittent changes, or changes only once. These changes may be made by image processing, or may be made by mechanically moving a mechanism of a device that projects or displays any one of “target”, “first image”, and “second image”. However, the “object” may be moved mechanically. The power of the mechanical movement may be electrical such as an actuator, may be based on human power, or may be based on an environment such as wind force or shaking. You may combine the motion by image processing, and mechanical motion.

[First Embodiment]
Next, a first embodiment will be described with reference to the drawings.
<Configuration of image generation system>
As illustrated in FIG. 1, the image generation system of the present embodiment includes an image generation device 11, a photographing device 12, an installation plate 13, and a target 14. The image generation apparatus 11 includes a photographing processing unit 111, a gray scale conversion unit 112, an image generation unit 114, and a storage unit 115. The image generation apparatus 11 is a general-purpose or dedicated computer including, for example, a processor (hardware processor) such as a central processing unit (CPU) and a memory such as random-access memory (RAM) and read-only memory (ROM). Is an apparatus configured by executing a predetermined program. The computer may include a single processor and memory, or may include a plurality of processors and memory. This program may be installed in a computer, or may be recorded in a ROM or the like in advance. In addition, some or all of the processing units are configured using an electronic circuit that realizes a processing function without using a program, instead of an electronic circuit (circuitry) that realizes a functional configuration by reading a program like a CPU. May be. In addition, an electronic circuit constituting one device may include a plurality of CPUs. The photographing device 12 is a general camera capable of photographing a color still image. The installation plate 13 is a plate having a flat portion 131, and the object 14 is a printed matter fixed to the flat portion 131. The object 14 is not uniform and has a pattern at least partially. That is, the spatial frequency of an image or video obtained by photographing the object 14 is not zero.

<Configuration of projection system>
As illustrated in FIG. 3A, the projection system of the present embodiment includes a projection device 15, projectors 161 and 162, an installation plate 17, and an object 18. The projection device 15 includes a reproduction processing unit 151 and a storage unit 152. The projection device 15 is, for example, a device configured by the above-described computer executing a predetermined program. The installation plate 17 is a plate having a flat portion 171, and the object 18 is a printed matter fixed to the flat portion 171. The target 18 may be the target 14 described above, a duplicate of the target 14, or an analog of the target 14. Examples of the similar object 14 include those in which a part of the color, pattern, brightness, and the like of the object 14 are changed or omitted, and those in which the color, pattern, brightness, etc. are added to the object 14. The projectors 161 and 162 may be general ones.

<Image generation processing>
First, image generation processing will be described. In this process, an image to be superimposed on the target 18 is generated in order to perceive a change in the depth of the target 18. First, under the control of the imaging processing unit 111, the imaging device 12 images the object 14 (FIG. 1). A color still image 140 (FIG. 2A) obtained by shooting is sent to the shooting processing unit 111 and then sent to the grayscale conversion unit 112.

  The grayscale conversion unit 112 converts the still image 140 to grayscale, and includes an image 140 ′ (“first still image derived from the target” and “second derived from the target” including the target pattern 140a ′ that is a luminance component pattern. Corresponding to “still image”) (FIG. 2A). The image 140 'in this example is composed only of luminance components. For example, the gray scale conversion unit 112 uses the NTSC weighted average method (luminance Y = R × 0.298912 + G × 0.586611 + B × 0.114478, where R, G, and B represent the red, green, and blue channel intensities of each pixel, respectively. ) To convert the still image 140 into a grayscale image 140 ′. However, any other method may be used as long as it can be converted to grayscale.

  The image 140 ′ is sent to the image generation unit 114. The image generation unit 114 generates an image 1411 (first image) for the right eye (one eye) and an image 1412 (second image) for the left eye (the other eye) from the image 140 '(FIG. 2C). The image 1411 is a single image that includes the luminance component pattern 1411a that corresponds to the target pattern 18a (FIG. 3B) of the target 18 and that is visible with the right eye. The image 1412 is a single image corresponding to the target pattern 18a and including a luminance component pattern 1412a that can be visually recognized by the left eye (FIG. 3B). The luminance component pattern 1411a and the luminance component pattern 1412a are patterns derived from the target pattern 18a. More specific description will be given below.

  First, the image generation unit 114 generates an image 1401 (first modified image) including the luminance component pattern 1401a and an image 1402 (second modified image) including the luminance component pattern 1402a using the image 140 ′ (FIG. 2A). (FIG. 2B). The luminance component pattern 1401a and the luminance component pattern 1402a are obtained by modifying an area (all or a part of the area) of the target pattern 140a 'of the image 140' where binocular parallax is desired. That is, the luminance component pattern 1401a is obtained by performing “first modification” on the “region where binocular parallax is to be added” of the target pattern 140a ′, and the luminance component pattern 1402a is the “binocular parallax of the target pattern 140a ′. The “second deformation” is performed on the “region to be attached”. However, the “first modification” and the “second modification” are different from each other. In this embodiment, binocular parallax is added to the entire area of the target pattern 140a '. For example, an image 1401 obtained by moving the target pattern 140a ′ in the “first direction” to the luminance component pattern 1401a and the target pattern 140a ′ are moved in the “second direction (the reverse direction of the first direction)”. An image 1402 having a luminance component pattern 1402a as a pattern is generated. In the example of FIG. 2B, an image 1401 including a luminance component pattern 1401a obtained by moving the target pattern 140a ′ leftward is generated, and an image 1402 including a luminance component pattern 1402a obtained by moving the target pattern 140a ′ rightward is generated. Has been. In the case of the example in FIG. 2B, the sum of the movement amount of the luminance component pattern 1401a with respect to the target pattern 140a 'and the movement amount of the luminance component pattern 1402a with respect to the target pattern 140a' corresponds to binocular parallax. Furthermore, an image 1401 may be obtained by smoothing an image after “first deformation”, and an image 1402 may be obtained by smoothing an image after “second deformation”. In the case of smoothing, a depth impression that smoothly changes can be given to the object.

  Next, the image generation unit 114 generates an image 1411 (FIG. 2C) based on the difference between the image 140 ′ (first still image derived from the object) and the image 1401 (first modified image obtained by deforming the first still image). ), And an image 1412 (FIG. 2D) based on the difference between the image 140 ′ (second still image derived from the object) and the image 1402 (second modified image obtained by deforming the second still image). . The image 1411 includes a luminance component pattern 1411a corresponding to the luminance component pattern 1401a, and the image 1412 includes a luminance component pattern 1412a corresponding to the luminance component pattern 1402a. The image 1411 may be based on an image obtained by subtracting the image 1401 from the image 140 ′, or conversely, may be based on an image obtained by subtracting the image 140 ′ from the image 1401. However, when an image obtained by such reduction includes a negative pixel value, the pixel cannot be displayed or projected (that is, processed as black). Therefore, the average luminance (128 in terms of RGB values) of the image 140 ′ or the image 1401 is added to the entire area of the image obtained by such reduction, and the luminance value of the entire area is then set to a normal gray scale value. The image 1411 may be processed so as to be within the range (0 to 255). Processing here refers to general pixel value clipping (for example, processing for fixing a value smaller than 0 to 0 and a value larger than 255 to 255) or normalization (a range of pixel values from 0 to 1 once). The data is transformed so that it falls within the range and multiplied by 255). Similarly, the image 1412 may be based on an image obtained by subtracting the image 1402 from the image 140 ′, or conversely, may be based on an image obtained by subtracting the image 140 ′ from the image 1402. Good. The average luminance of the image 140 ′ or the image 1402 is added to the entire area of the image obtained by the reduction in this way, and then processed so that the luminance value of the entire area falls within the normal gray scale value range. May be the image 1412. The obtained image 1411 and image 1412 are stored in the storage unit 115.

<Projection processing>
As preprocessing, the image 1411 and the image 1412 are stored in the storage unit 152 of the projection device 15 (FIG. 3A). If the storage unit 115 is the same as the storage unit 152, this pre-processing is not necessary. Next, the reproduction processing unit 151 sends the image 1411 to the projector 161, projects the image 1411 from the projector 161 according to the target 18, sends the image 1412 to the projector 162, and projects the image 1412 from the projector 162 to the target 18. To do. At that time, alignment may be performed by appearance, or alignment may be performed by taking a correspondence relationship between the light sources of the projectors 161 and 162 and the imaging device 12 using an existing technique such as a structured light method. . When alignment is performed in appearance, for example, the luminance component pattern 1411a of the image 1411 and the luminance component pattern 1412a (FIG. 2C) of the image 1412 are arranged so as to overlap with the vicinity of the target pattern 18a (FIG. 3B) of the target 18. Is called. For example, the vicinity of the contours of the luminance component patterns 1411a and 1412a may be disposed so as to overlap the contour of the target pattern 18a, or the vicinity of the contours of the images 1411 and 1412 may be disposed to overlap the contour of the target 18. Alternatively, the luminance component patterns 1411a and 1412a may be arranged so that the vicinity of the edge includes the edge included in the target pattern 18a. However, the relative position of the luminance component pattern 1411a with respect to the target pattern 18a and the relative position of the luminance component pattern 1412a with respect to the target pattern 18a are different from each other, and alignment is performed so that the difference becomes binocular parallax. That is, the relative position of the luminance component pattern 1411a with respect to the target pattern 18a is different from the relative position of the luminance component pattern 1412a with respect to the target pattern 18a.

  The projector 161 projects an image 1411 polarized in the first polarization direction (for example, horizontal polarization) according to the target 18, and the projector 162 is polarized (for example, vertical) in a second polarization direction different from the first polarization direction. A polarized image 1412 is projected according to the object 18. The observer wears polarized glasses having a “first polarization lens” that passes only light in the “first polarization direction” and a second polarization lens that passes only light in the “second polarization direction”. The observer's right eye passes through the “first polarizing lens” and the left eye passes through the “second polarizing lens”, and the state in which the object 18, the image 1411, and the image 1412 are superimposed is seen. As a result, the observer's right eye visually recognizes that the luminance component pattern 1411a and the target pattern 18a are superimposed, and the left eye visually recognizes that the luminance component pattern 1402a and the target pattern 18a are superimposed. As a result, the observer perceives that there is a depth that does not originally exist in the entire object 18 or its part.

<Reasons for perception as if the depth of the subject was changed>
The images 1411 and 1412 include edge information made up of luminance components corresponding to the edges of the target 18 to be given depth. When this edge information is superimposed in the vicinity of the target pattern 18 of the target 18, it is perceived (illusion) that the target pattern 18 is displaced to the bright area side of the edge information. Accordingly, when the illusion is made that the target pattern 18 is displaced in a different direction (for example, in the opposite direction) between the images input to the right eye and the left eye, an illusion of binocular parallax occurs, resulting in a sense of depth. .

<Features of this embodiment>
As described above, in this embodiment, the object 18 can be perceived as if a change in depth is given. In this embodiment, the images 1411 and 1412 to be superimposed on the target 18 are images composed only of luminance components. Therefore, a new depth impression can be given without impairing the impression of the color or texture of the object 18. Moreover, there is no restriction | limiting in the object 18, A depth impression can be provided to the arbitrary object 18. FIG. In this way, it is possible to perceive a change in the depth of an arbitrary object without greatly deviating the apparent impression from the original object.

[First Modification of First Embodiment]
In the first embodiment, the entire target pattern 18a of the target 18 is perceived as having a change in depth. It may be perceived that a change in depth is given to only a part of the target pattern 18a. In this case, the image generation unit 114 includes the luminance component pattern 1411a ′ corresponding to only “part of the region (for example, the region of both eyes)” of the target pattern 18a and is visible with the right eye 1411 ′ (FIG. 4A). And the luminance component pattern 1411a ′ corresponding to only the “partial region” of the target pattern 18a, and an image 1411 ′ that can be viewed with the left eye may be generated (FIG. 4B).

  In this case, instead of the image 1401 of the first embodiment, the image generation unit 114 cuts out only a partial region (region of both eyes) of the target pattern 140a ′ and moves it in the “first direction” as a luminance component. An image 1401 ′ included as a pattern 1401a ′ is generated (first modified image), and instead of the image 1402 of the first embodiment, only a partial region (region of both eyes) of the target pattern 140a ′ is cut out to be “second direction” ”Is generated as a luminance component pattern 1402a ′ (second modified image). Next, the image generation unit 114 generates an image 1411 ′ (based on the difference between the image 140 ′ (first still image derived from the object) and the image 1401 ′ (first modified image obtained by deforming the first still image). FIG. 4A) and an image 1412 ′ (FIG. 4B) based on the difference between the image 140 ′ (second still image derived from the object) and the image 1402 ′ (second modified image obtained by deforming the second still image). ) Is generated.

  The reproduction processing unit 151 sends an image 1411 ′ instead of the image 1411 to the projector 161, and projects the image 1411 ′ polarized in the first polarization direction from the projector 161 according to the target 18. Furthermore, the reproduction processing unit 151 sends an image 1412 ′ instead of the image 1412 to the projector 162, and projects the image 1412 ′ polarized in the second polarization direction from the projector 162 according to the target 18 (FIG. 4C). The observer wears the polarized glasses described in the first embodiment and sees the state in which the object 18 is superimposed on the image 1411 ′ and the image 1412 ′. Thereby, the observer perceives that a change in depth is given only to a partial region of the target pattern 18a.

  Alternatively, as in the first embodiment, the images 1411 and 1412 may be projected according to the target 18 and the uniform illumination may be applied to the area where it is not desired to change the depth. By operating so that the brightness of the uniform illumination becomes an intermediate brightness between the edges of the target pattern 18a, a region where it is not desired to change the depth of the projected brightness component patterns 1411a and 1412a apparently disappears. The observer wears the polarized glasses described in the first embodiment, and perceives that a change in depth is given only to a partial region of the target pattern 18a by viewing this state. A similar effect can be obtained by not projecting a region of the luminance component patterns 1411a and 1412a that is not desired to be changed in depth.

[Modification 2 of the first embodiment]
The projection device 15 may further include a filtering unit 113. Instead of the image generation unit 114 generating and outputting the images 1411 and 1412 (FIG. 2C), the images 1401 and 1402 (FIG. 2B) generated by the image generation unit 114 may be sent to the filtering unit 113. The filtering unit 113 performs high spatial frequency filtering on the transmitted images 1401 and 1402 and outputs images obtained by suppressing these low spatial frequency components as images 1411 and 1412 (FIG. 2C). In this way, the image 1411 (first image) and the image 1412 (second image) in which the high spatial frequency component is perceived as being superior to the low spatial frequency component are superimposed on the target 18 (that is, the high spatial frequency component is the low spatial frequency). Even when the first luminance component pattern and the second luminance component pattern that are perceived more preferentially than the components are superimposed on the target), the same effect as in the first embodiment can be obtained. The filter used for the high spatial frequency filtering can extract a high spatial frequency component without changing the phases of the images 1401 and 1402, for example. For example, the same result can be obtained by using an edge detection filter incorporated in existing image editing software such as Adobe Photoshop (registered trademark) or by calculating by convolving a high spatial frequency direction component. it can.

  Alternatively, the image generation unit 114 may obtain the image 140 ″ by performing high spatial frequency filtering on the image 140 ′ (FIG. 2A) output from the grayscale conversion unit 112. The image generation unit 114 may obtain the image 140 ″. An image 1411 (FIG. 2C) including the luminance component pattern 1411a obtained by performing the above-described “first deformation” on all or a part of the pattern (an area where binocular parallax is to be added) is output. The image 1412 (FIG. 2D) including the luminance component pattern 1412 a subjected to “is output. Even if such an image 1411 (first image) and an image 1412 (second image) are superimposed on the target 18, the same effect as in the first embodiment can be obtained.

[Modification 3 of the first embodiment]
In the first embodiment, the still image 140 is converted to grayscale, and an image 140 ′ including a target pattern 140a ′ that is a luminance component pattern is generated. However, this process may be omitted and the still image 140 may be used as it is as the image 140 ′ to implement the first embodiment and its modifications 1 and 2. Alternatively, an image obtained by enhancing or suppressing a specific color component of the still image 140 may be used as the image 140 ′, and the first embodiment or its modifications 1 and 2 may be implemented.

[Modification 4 of the first embodiment]
The positional relationship between the target pattern 18a and the luminance component pattern 1411a and the positional relationship between the target pattern 18a and the luminance component pattern 1412a may be changed over time. Thereby, it can be made to perceive so that the depth of the object 18 may change with progress of time. For example, as illustrated in FIGS. 5A and 5B, the deviation width (relative position) of the luminance component patterns 1411a and 1412a with respect to the target pattern 18a in the time interval T1 and the target pattern 18a in the time interval T2 other than the time interval T1. The deviation widths (relative positions) of the luminance component patterns 1411a and 1412a may be different. Thereby, it can be perceived that the depth of the object 18 changes in the time sections T1 and T2.

[Modification 5 of the first embodiment]
The moving images 1411 and 1412 may be superimposed on the moving object 18. Also in this case, the relative position of the luminance component pattern 1411a with respect to the target pattern 18a and the relative position of the luminance component pattern 1412a with respect to the target pattern 18a are made different so that the depth of the moving target 18 is perceived as being changed. Can be made. In the example of FIG. 6A, the position of the target pattern 18a in the time section T1 is different from the position of the target pattern 18a in the time section T2, and the luminance component patterns 1411a and 1412a are superimposed on the respective target patterns 18a. Thereby, it can be made to perceive as the change was given to the depth of the object 18 in which the position is different in the time sections T1 and T2. The object 18 can be moved by physically moving the installation plate 17. Alternatively, instead of setting the printed matter fixed on the plane portion 171 as the target 18, the image projected on the plane portion 171 may be set as the target 18. In this case, the target 18 is moved by moving the mechanism of the projector. May be.

[Modification 6 of the first embodiment]
You may combine the modification 4 and the modification 5 of 1st Embodiment. That is, the moving images 1411 and 1412 are superimposed on the moving target 18, and the positional relationship between the target pattern 18a and the luminance component pattern 1411a and the positional relationship between the target pattern 18a and the luminance component pattern 1412a are set as time. You may change with progress. Thereby, it can be made to perceive that the depth of the moving object 18 changes with time passage. For example, as illustrated in FIG. 6B, the position of the target pattern 18a in the time interval T1 may be different from the position of the target pattern 18a in the time interval T2. Further, the deviation width of the luminance component pattern 1411a and the luminance component pattern 1412a with respect to the target pattern 18a in the time interval T1, and the deviation of the luminance component pattern 1411a and the luminance component pattern 1412a with respect to the target pattern 18a in the time interval T2 other than the time interval T1. The width may be different. Thereby, it can be made to perceive so that the depth of the object 18 from which a position differs in time interval T1 and T2 may change.

[Modification 7 of First Embodiment]
The relative position of the luminance component pattern 1411a with respect to the target pattern 18a may be made different from the relative position of the luminance component pattern 1412a with respect to the target pattern 18a by mechanically moving the projectors 161 and 162. In this case, the same image 1411 (FIG. 2C) is projected from the projectors 161 and 162 onto the target 18a, the relative position of the luminance component pattern 1411a projected from the projector 161 with respect to the target pattern 18a, and the luminance component pattern 1411a projected from the projector 162 The relative positions with respect to the target pattern 18a may be different from each other. This difference can be realized by mechanically shifting the projection directions of the projectors 161 and 162.

[Modification 8 of the first embodiment]
A time interval R (for example, an odd-numbered frame) in which the target 18 and the image 1411 are superimposed but the image 1412 is not superimposed, and a time interval L (for example, an even number) in which the target 18 and the image 1412 are superimposed but the image 1411 is not superimposed. And the second frame) may be alternately repeated. For example, a time interval R in which the luminance component pattern 1411a of the image 1411 is superimposed on the target pattern 18a of the target 18 as illustrated in FIG. 7A, and a luminance component of the image 1412 in the target pattern 18a of the target 18 as illustrated in FIG. 7B. The time interval L on which the pattern 1412a is superimposed may be alternately repeated (FIG. 7C). An observer has a right lens with a liquid crystal shutter that is transmissive in time interval R and non-transmissive in time interval L, and a left side that has a liquid crystal shutter in transmissive state in time interval L and non-transmissive in time interval R. Wear LCD shutter glasses with a lens. The observer's right eye passes through the right lens and the left eye passes through the left lens, and the object 18 and the image 1411 and the object 18 and the image 1412 are seen superimposed. Thereby, the observer's right eye visually recognizes that the luminance component pattern 1411a and the target pattern 18a are superimposed in the time interval R, and the left eye visually recognizes that the luminance component pattern 1412a and the target pattern 18a are superimposed in the time interval L. This also makes it possible to perceive a change in the depth of the object 18.

[Second Embodiment]
Instead of projecting the images 1411 and 1412, the transparent images 1411 and 1412 may be displayed on the transmissive display. As illustrated in FIG. 8A, the video display system according to the present embodiment includes a display device 35, a transmissive display 36, an installation plate 17, and an object 18 fixed to the flat portion 171 of the installation plate 17. The display device 35 includes a reproduction processing unit 151 and a storage unit 152. One surface 361 of the transmissive display 36 is disposed to face the target 18 side (plane portion 171 side) of the installation plate 17. In this case, the reproduction processing unit 151 first sends the images 1411 and 1412 to the transmissive display 36 for alignment, and displays the transmissive images 1411 and 1412 on the transmissive display 36. When alignment is performed in appearance, an observer browses the A direction from the other surface 362 side of the transmissive display 36, and the transmissive images 1411 and 1412 displayed on the transmissive display 36 overlap with the target 18. Adjust the condition. The adjustment method is the same as in the first embodiment, and the relative position of the luminance component pattern 1411a with respect to the target pattern 18a is different from the relative position of the luminance component pattern 1412a with respect to the target pattern 18a. When viewed from the other surface 362 side (direction A) of the transmissive display 36, the images 1411 and 1412 and the object 18 appear to overlap each other. Here, the target pattern 18a is visually recognized by both eyes of the observer and the luminance component pattern 1411a is visually recognized only by the right eye due to a difference in polarization, switching of a displayed time interval, and the like (polarization lens method, liquid crystal shutter method, etc.). The component pattern 1412a is made visible only with the left eye of the observer. As a result, an observer who wears glasses equipped with a polarizing lens and a liquid crystal shutter and views the transmissive display 36 from the A direction perceives that the depth of the object 18 has been changed. Even if it does in this way, the effect similar to 1st Embodiment can be acquired.

[Modification 1 of the second embodiment]
A transparent object and images 1411 and 1412 displayed on a display (transmission type or non-transmission type) may be superimposed. As illustrated in FIG. 8B, the video display system of the present embodiment includes a display device 35, a display 36 ′, a transmissive installation plate 37, and a transmissive target 318. A transparent object 318 is printed on one surface 371 of the installation plate 37. One surface 362 ′ of the display 36 ′ is disposed opposite to the other surface 372 side of the installation plate 37. First, for alignment, the reproduction processing unit 151 sends the images 1411 and 1412 to the display 36 ′, and displays the transparent images 1411 and 1412 on the display 36 ′. When aligning the appearance, the observer views the direction A from the one surface 371 side of the installation board 37, and the transparent object 318 of the installation board 37 and the transparent image displayed on the display 36 '. 1411 and 1412 are adjusted. The adjustment method is the same as in the first embodiment, and the relative position of the luminance component pattern 1411a with respect to the target pattern of the target 318 is made different from the relative position of the luminance component pattern 1412a with respect to the target pattern. When viewed from the A direction, the images 1411 and 1412 and the object 18 appear to overlap each other. Here, the target pattern of the target 318 is visually recognized by both eyes of the observer, and the luminance component pattern 1411a is visually recognized only by the right eye due to the difference in polarization and switching of the displayed time interval (polarized lens method, liquid crystal shutter method, etc.). The luminance component pattern 1412a is made visible only with the left eye of the observer. Thus, an observer who wears glasses equipped with a polarizing lens and a liquid crystal shutter and views the installation plate 37 from the A direction perceives that the depth of the object 318 has been changed.

[Modification 2 of the second embodiment]
Similar to the first modification of the first embodiment, in the second embodiment and the first modification thereof, only a partial region of the target pattern may be perceived as having a change in depth. Moreover, you may use the images 1411 and 1412 produced | generated by the method demonstrated in the modifications 2 and 3 of 1st Embodiment. In addition, as described in Modifications 4 and 6 of the first embodiment, the positional relationship between the target pattern to be moved or stopped and the luminance component pattern 1411a, and the relationship between the target pattern and the luminance component pattern 1412a. You may change the positional relationship between them with progress of time. As described in the fifth modification of the first embodiment, the moving images 1411 and 1412 may be superimposed on the moving object.

[Other variations]
The present invention is not limited to the embodiment described above. The various processes described above are not only executed in time series according to the description, but may also be executed in parallel or individually as required by the processing capability of the apparatus that executes the processes. Needless to say, other modifications are possible without departing from the spirit of the present invention.

  When the above configuration is realized by a computer, the processing contents of the functions that each device should have are described by a program. By executing this program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium. An example of a computer-readable recording medium is a non-transitory recording medium. Examples of such a recording medium are a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, and the like.

  This program is distributed, for example, by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of the server computer and transferring the program from the server computer to another computer via a network.

  A computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. When executing the process, the computer reads a program stored in its own storage device, and executes a process according to the read program. As another execution form of the program, the computer may read the program directly from the portable recording medium and execute processing according to the program, and each time the program is transferred from the server computer to the computer. The processing according to the received program may be executed sequentially. The above-described processing may be executed by a so-called ASP (Application Service Provider) type service that realizes a processing function only by an execution instruction and result acquisition without transferring a program from the server computer to the computer. Good.

  In the above embodiment, the processing functions of the apparatus are realized by executing a predetermined program on a computer. However, at least a part of these processing functions may be realized by hardware.

  A first image including a first luminance component pattern which is a pattern corresponding to a target pattern of a target and perceivable by one eye; A second image including a second luminance component pattern corresponding to the target pattern and visible to the other eye, and a relative position of the first luminance component pattern with respect to the target pattern, A data structure used in an apparatus that superimposes the first image and the second image on the target may be distributed so that the relative position of the second luminance component pattern with respect to the target pattern is different. This data structure may be distributed by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM that records the data structure, or a server computer on a network such as the Internet. You may do this by uploading the data structure to and distributing from there.

  The present invention can provide a new appreciation method and depth expression method by allowing a user to perceive a change in the depth of an object such as a painting, a work of art, or a photograph exhibited in a museum or a photo studio.

DESCRIPTION OF SYMBOLS 11 Image production | generation apparatus 15 Projection apparatus 35 Display apparatus 18,318 Target 18a Target pattern 1411,1412 Image 1411a, 1412a Luminance component pattern

Claims (1)

A data structure for performing projection or display for superimposing a first difference image and a second difference image on a target pattern of interest,
The first region includes a first region that is associated with each other and is superimposed in the vicinity of the binocular parallax region in order to give a binocular parallax to a certain binocular parallax region of the target pattern in a certain time interval. A difference image, and the second difference image including a second region superimposed in the vicinity of the binocular parallax region in order to give the binocular parallax to the binocular parallax region in the time interval,
The first difference image, the first region, the binocular parallax, and identification information are associated with each other as a set, and the second difference image, the second region, the binocular parallax, and the identification information are combined. And has an associated structure,
Stored in a storage device,
The first difference image includes an original image including a luminance component pattern based on the target still image and an area of the luminance component pattern corresponding to the binocular parallax area included in the original image in a first direction. It is an image generated based on the difference from the moved first modified image,
The second difference image moves the region of the luminance component pattern corresponding to the binocular parallax region included in the original image and the binocular parallax region included in the original image in a second direction opposite to the first direction. And an image generated based on the difference between the second modified image and
The total of the amount of movement for moving the region corresponding to the binocular parallax region in the first direction and the amount of movement for moving the region corresponding to the binocular parallax region in the second direction is the binocular Corresponding to parallax,
In response to the input of control information to the playback processing device,
Correspondence between the time interval corresponding to the first difference image, the binocular parallax, and the first region, and the time interval corresponding to the second difference image, the binocular disparity, and the second region. According to the relationship
The first differential image having the time interval, the binocular parallax, and the first region, which are specified by information input to the reproduction processing device and are associated with each other, the time interval, The binocular parallax and the second difference image having the second region are read from the storage device into the reproduction processing device,
In the time interval, the first difference image is reproduced by the reproduction process so that each of the first difference image and the second difference image can be simultaneously recognized by one eye of the observer and the other eye. Output from one channel of the apparatus and projected or displayed on the target pattern, and the second difference image is output from the other channel of the reproduction processing apparatus and projected or displayed on the target pattern;
In the time interval, the first area is superimposed on the vicinity of the binocular parallax area, and the second area is used for processing that causes the observer to perceive a state of being superimposed on the vicinity of the binocular parallax area. data structure.

Images