JP2018197879A - data structure - Google Patents

Abstract

To enable an observer to easily perceive such that a change in motion is provided to an object.SOLUTION: A data structure is used having a combination of identification information identifying an object, a single image group that is a collection of a plurality of images, and display order for the plurality of images included in the single image group, in order to provide an effect equivalent to processing of moving at least one of a single image and the object while the single image and object are superimposed on each other to change the position relationship between a luminance component pattern of an image area included in the single image and an object pattern corresponding to an image area included in the object, the plurality of images in the single image group are projected or displayed respectively according to the display order to enable an observer to perceive such that a motion is provided to the object. The plurality of images are obtained by at least one of one-dimensional enlargement of the single image that is one still image corresponding to the object, one-dimensional reduction of the single image, and one-dimensional deformation of the single image indicating deformation of the single image occurring when a member on which the single image is printed, drawn, or displayed is mechanically bent.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a technique for causing an object to perceive a change in motion.

  In general, a light projection technique is used to give an impression of motion to a stationary object. In the existing technology, an object surface is regarded as a kind of canvas, and a new image is projected thereon, thereby giving an impression of motion to a stationary object (for example, see Non-Patent Documents 1 and 2). In this case, since a new image is superimposed on the surface of the projection target, the impression of the color, texture, and texture of the stationary target is impaired. In order to avoid this problem, a technique has been proposed in which a motion is given to a grayscale image to be projected and a difference between the moving image and the original grayscale image is projected (for example, Patent Document 1). Etc.). Since only the grayscale image information is projected, only the luminance is modulated on the projection target side, so that the technique of Patent Document 1 does not impair the target color, texture, and texture.

International Publication No. WO / 2015/163317

Raskar, R., Ziegler, R., & William, T., “Cartoon Dioramas in motion,” (2002), Int Symp on Non-photorealistic Animation and Rendering (NPAR) 2002, Annecy, France. Siegl, C., Colaitani, M., Thies, L., & Zollhofer, M., Izadi, S., Stamminger, M., & Bauer, F., “Real-Time Pixel luminance optimization for dynamic multi-projection mapping , ”(2015), ACM Transactions on Graphics (TOG)-Proceedings of ACM SIGGRAPH Asia 2015, 34 (6), 237.

  In the technique of Patent Document 1, it is necessary to generate an image sequence including a plurality of types of images in order to perceive an object as if a change in motion has been given. In other words, a sequence of a plurality of types of modified videos generated by deforming or moving the target grayscale image and a difference image obtained by taking a difference between the original grayscale image is created, and the sequence is continuously created. There was a need to display.

  An object of the present invention is to make it easier to perceive a subject as if a change in motion has been given.

  A data structure used in a device that perceives a subject as if a change in motion has been applied, and moves the single image and / or the target in a state of superimposing the single image and the target, A data structure is provided that is used for processing that provides an effect equivalent to the processing of changing the positional relationship between the luminance component pattern of an image region included in an image and the target pattern corresponding to the image region included in the target. This data structure has a set of identification information for identifying a target, a single image group which is a set of a plurality of images, and a display order of a plurality of images included in the single image group. However, multiple images are one-dimensional enlargement of a single image, one-dimensional reduction of a single image, and when a member on which a single image is printed, drawn, or displayed is mechanically curved Is obtained by at least one of a one-dimensional deformation for a single image representing the deformation of the single image. The single image is a single still image corresponding to the target, and the luminance component pattern of the image area included in the single image and the target pattern corresponding to the image area included in the target spatially match or approximate. It is a pattern. At least a part of the spatial frequency component of the luminance component pattern of the image area included in the single image has a lower spatial frequency component suppressed than the high frequency component than the spatial frequency component of the target pattern corresponding to the image area included in the target. It is a thing. By projecting or displaying multiple images of a single image group according to the display order, one-dimensional enlargement of a single image, one-dimensional reduction of a single image, and one-dimensional deformation of a single image The video represents a motion equivalent to at least any of the motions. The set of the identification information of the data structure, the single image group, and the display order is stored in the storage unit of the device, and the device corresponds to the single corresponding to the target from the storage unit based on the input target information. Read the image group, and based on the information on the target edge, each of the plurality of images of the single image group such that the target edge overlaps the vicinity of each edge of the plurality of images of the read single image group Is used for processing for projecting or displaying each of the plurality of images of the read single image group in accordance with the display order.

  In the present invention, since a single image is used, it is possible to perceive a subject as if a change in motion has been given more easily than in the conventional case of generating an image sequence composed of a plurality of types of images.

FIG. 1 is a block diagram for illustrating a functional configuration of a video generation system according to an embodiment. FIG. 2A is a conceptual diagram for explaining an example of a still image obtained by photographing an object. FIG. 2B is a conceptual diagram for explaining an example of a single image obtained from a still image. FIG. 2C is a conceptual diagram for explaining an example of movement of a single image. FIG. 3A is a block diagram for illustrating the configuration of the video projection system according to the embodiment. FIG. 3B is a conceptual diagram for explaining an example of an image projected on an object. FIG. 4A is a conceptual diagram for explaining an example of a single image obtained from a still image. FIG. 4B is a conceptual diagram for explaining an example of movement of a single image. FIG. 4C is a conceptual diagram for explaining an example of an image projected on an object. FIG. 5A is a conceptual diagram for explaining an example of a video obtained by moving a single image. FIG. 5B is a conceptual diagram for explaining an example of an image projected on an object. FIG. 6 is a block diagram for illustrating the configuration of the video projection system of the embodiment. FIG. 7A is a conceptual diagram for explaining an example of a video obtained by moving a still image obtained by photographing an object. FIG. 7B is a conceptual diagram for explaining an example of a single image obtained from a still image. FIG. 7C is a conceptual diagram for explaining an example of a projected video and a single image. FIG. 8A is a conceptual diagram for explaining an example of a video obtained by moving a still image obtained by photographing an object. FIG. 8B is a conceptual diagram for explaining an example of a video obtained by moving a single image. FIG. 8C is a conceptual diagram for explaining an example of a projected video and a single image. FIG. 9A is a conceptual diagram for explaining an example of a video obtained by moving a still image obtained by photographing an object. FIG. 9B is a conceptual diagram for explaining an example of a video obtained by moving a single image. FIG. 9C is a conceptual diagram for explaining an example of a projected video and a single image. FIG. 10 is a block diagram for illustrating the configuration of the video display system of the embodiment. FIG. 11 is a block diagram for illustrating the configuration of the video projection system of the embodiment. FIG. 12A is a conceptual diagram for explaining an example of a single image obtained from a still image obtained by photographing an object. FIG. 12B and FIG. 12C are conceptual diagrams illustrating a state in which the single image transmitting member is moved. FIG. 12D is a conceptual diagram for explaining an example of an image projected on an object. FIG. 13A is a conceptual diagram for explaining an example of a single image obtained from a still image obtained by photographing an object. FIG. 13B and FIG. 13C are conceptual diagrams illustrating a state where the single image transmitting member is moved. FIG. 13D is a conceptual diagram for explaining an example of an image projected on an object.

Embodiments of the present invention will be described below.
[Overview]
First, an outline of the embodiment will be described.
In the embodiment, in order to perceive the “object” as if a change in motion is given, the “single image” and the “object” are overlapped with the “single image” and the “object”. Move between at least one of the luminance component patterns of the “image area” included in the “single image” and the “target pattern included in the“ target ”(pattern corresponding to the“ image area included in the “single image”) ” The positional relationship of is changed. Since a “single image” is used, it is possible to perceive a subject as if a change in motion has been given more easily than in the conventional case of generating an image sequence composed of a plurality of types of images. “To make a subject perceive as a change in motion” means that a stationary “subject” is perceived as having a motion, or a moving “subject”. It means that the movement is perceived as changed.

  The “target” is, for example, a pattern on a predetermined surface (for example, a screen such as paper, a board, a wall, a screen, electronic paper, a normal display or a transmissive display) (for example, “print”, “draw”, “ A display or projected image, a photograph, a pattern or pattern based on the hue of the material constituting the predetermined surface, a pattern based on the shape of the predetermined surface, a boundary line, a shading, or the like). The “predetermined surface” may be a flat surface, an object that can be regarded as a flat surface, a curved surface, or an uneven surface. The “object” is a pattern (eg, “printed”, “drawn”, “displayed” or “projected” on the surface of an object having a three-dimensional shape (eg, vase, ball, model, building, etc.) It may be a photograph, a pattern or pattern based on the color of the material constituting the surface, a pattern based on the shape of the surface, a boundary line, shading, etc.).

  The “single image” is one still image (one type of image) corresponding to the “target”, and the whole area or a part of the area is called an “image area”. The “single image” may be obtained from a still image obtained by photographing the “object”, or may be obtained from a still image obtained by photographing an image that is the same as or similar to the “object”. It may be obtained from a still image drawn based on the “target”. The luminance of the “single image” is not spatially uniform, and the “image region” included in the “single image” has a “luminance component pattern” that is a pattern composed of luminance components. The “single image” may be an image composed only of luminance components, or may be an image composed of luminance components and color components (color difference components). In order to perceive the subject as if a change in motion is given while suppressing changes in the color and texture of the subject, the luminance component of the “single image” is perceived as being superior to the color component. It is desirable that If the “single image” is an image consisting only of luminance components, the “subject” is perceived as having a change in motion, with almost no change in the color or texture appearance of the “subject”. be able to. Further, since the high spatial frequency component of the “image region” is perceived as being superior to the low spatial frequency component, the “target” can clearly perceive movement (the reason will be described later). Therefore, it is desirable that the “image region” is a region where the high spatial frequency component is perceived more preferentially than the low spatial frequency component. In other words, the “image region” is preferably a region where the low spatial frequency component is suppressed with respect to the high spatial frequency component, or a region where the high spatial frequency component is emphasized more than the low spatial frequency component.

  There is no limitation on the method of superimposing the “single image” and the “target”. A transparent “single image” may be displayed over a non-transparent “object”, or a transparent “object” may be displayed over a non-transparent “single image”. It is also possible to display a transparent “single image” superimposed on a transparent “object”, or to overlay a transparent “object” on a transparent “single image”. May be displayed. For example, a “single image” may be projected onto a printed or drawn “target” with a projector or the like, or a “single image” may be projected onto the projected “target”. And “single image” may be displayed on the same screen, “single image” may be projected on the “object” displayed on the display (non-transmission type or transmission type), or the display The “object” may be projected onto a “single image” displayed in (non-transmission type or transmission type). Further, for example, a transparent liquid crystal screen such as a transmissive display may be installed between the “target” and the observer, and a transparent “single image” may be displayed on the liquid crystal screen. This also means that a transparent “single image” is superimposed on the “object” when viewed from the observer. Further, for example, a transparent liquid crystal screen such as a transmissive display may be installed between the “single image” and the observer, and a transparent “target” may be displayed on the liquid crystal screen. From the viewpoint of the observer, a transparent “object” is superimposed on the “single image”. Further, a “single image transmitting member” in which a transparent “single image” is printed or drawn on a transparent material (plastic, polyethylene, glass, etc.) may be provided. By making light from the light source incident on the “single image transmitting member” and projecting the light after transmission onto the “target”, the “single image” can be superimposed on the “target”. In addition, the “single image transmitting member” may be a transparent liquid crystal screen that displays a transparent “single image”. In addition, a “subject transmission member” in which a transparent “subject” is printed or drawn on a transparent material is provided, and the light from the light source is incident on the “single image transmission member”. The “single image” may be superimposed on the “target” by projecting the emitted light that has passed through the “target transmitting member”. In this case, the “single image transmission member” and the “target transmission member” are arranged between the light source and the observer, and the “single image transmission member” is arranged between the light source and the “target transmission member”. Also good. As a result, the observer can observe a state in which the “single image” is superimposed on the “object” by viewing the transmission image of the “object transmission member”. The “object transmission member” may be a transparent liquid crystal screen that displays a transparent “object”. The “single image” and the “target” may be superimposed by causing light from the light source to enter the “target transmission member” and projecting the transmitted light onto the “single image”. Further, “target” may be displayed on a display screen of a smartphone or the like, and a “single image transmitting member” may be attached on the display screen to superimpose the “single image” on the “target”. The light source may be an artificial one such as an LED or a fluorescent lamp, or a natural light such as the sun.

  The “luminance component pattern” included in the “image area” is overlaid on or near the “target pattern” included in the “target”. For example, the outline of “luminance component pattern” or the vicinity thereof may be arranged so as to overlap with the outline of “target pattern”, or the outline of “single image” or the vicinity thereof may overlap with the outline of “target”. The edge included in the “luminance component pattern” or the vicinity thereof may overlap with the edge included in the “target pattern”.

  At least one of the “single image” and the “object” may be moved by software, or may be moved by hardware. In the case of moving by software, for example, the movement of at least one pattern of “single image” and “target” to be “displayed” or “projected” may be realized by image processing. When moving by hardware, a member in which “single image” is “printed”, “drawn”, or “displayed” may be moved mechanically, and “target” is “printed”, “drawn”, or “ The “displayed” member may be moved mechanically, or a device for projecting a “single image” or “object” may be moved mechanically. When superimposing a “single image” on a “target” by transmitting the light from the light source to the “single image transmitting member” and projecting the transmitted light onto the “target”, from the light source to the “target” A mechanism relating to at least one of members (including a light source and an “object”) existing in the optical path may be mechanically moved. The light from the light source is incident on the “single image transmitting member” and the emitted light that has passed through the “single image transmitting member” is projected onto the “target transmitting member”, thereby superimposing the “single image” on the “target”. In this case, a mechanism related to at least one of members (including the light source and the “target transmission member”) existing in the optical path from the light source to the “target transmission member” may be mechanically moved. In the case of a “single image” printed, drawn, or displayed on a flexible member such as a film, the “single image” can be curved by mechanically bending the member. Similarly, when the “object” is printed, drawn, or displayed on a flexible member, the “object” can be bent by mechanically bending the member. When the “target” is displayed on the display screen and the “single image transmitting member” is attached to the display screen, the “single image transmitting member” may be mechanically moved (such as a slide).

  For example, “object” appears in the “target part”, “single image” that appears in the transparent “single image part”, “light source” and “target part” ”Between the two. Examples of the “target portion” include a predetermined surface (for example, a screen such as paper, a board, a wall, a screen, an electronic paper, a normal display or a transmissive display) or a three-dimensional shape (for example, a vase, a ball, a model). , Buildings, etc.). The aforementioned “target transmission member” may be used as the “target portion”. The “target” is a pattern on the “target part” or a pattern on the surface of the “target part”. An example of the “single image portion” is the aforementioned “single image transmitting member”. The “light source” may be a dedicated light source (LED, etc.) installed for the “single image portion” and “target portion”, or an external light source (LED, fluorescent light, natural light, etc.) Also good. In this case, the “light source” in a state in which the “single image” is superimposed on the “target” by the light projection from the “light source” (the projected image of the “single image” is superimposed on the “target”). Any member (eg, “light source”, “single image portion”, “target portion” and other members such as a lens and a filter disposed on the optical path) to the “target” (target portion) The position between the luminance component pattern of the image area included in the superimposed "single image" and the pattern included in the "target" (pattern corresponding to the image area included in the "single image") The relationship may be changed.

  Or, for example, a single image appears in a “single image portion”, a transparent “target” appears in the “target portion”, and the “target portion” is a “light source” and a “single image portion”. Suppose they are placed between. Examples of a “single image portion” include a predetermined surface (for example, a screen such as paper, board, wall, screen, electronic paper, a normal display or a transmissive display) or a three-dimensional shape (for example, a vase, a ball) , Models, buildings, etc.). The aforementioned “single image transmitting member” may be a “single image portion”. An example of the “target portion” is the above-mentioned “target transmitting member”. In this case, the “light source” in the state where the “object” is superimposed on the “single image” by the projection by the light from the “light source” (the projected image of the “object” is superimposed on the “single image”). Any member on the optical path from the "single image" (single image part) to the "single image part" (for example, "light source" "single image part" "target part" and other such as lenses and filters arranged on the optical path A mechanism relating to at least one of the members) and a luminance component pattern of the image area included in the superimposed “single image” and a pattern included in the “target” (pattern corresponding to the image area included in the “single image”); You may change the positional relationship between.

  Alternatively, for example, “object” appears in the “object portion”, and a transparent “single image portion” is displayed as a transparent “single image”. It is assumed that the “single image portion” is arranged at a position where light (image) from the “target portion” is transmitted. For example, the “single image portion” is a transmissive display that displays a “single image”, and the “single image portion” is arranged in a state facing the “target”. In this case, the “object” that is transmitted through the “single image portion” is superimposed on the “single image” displayed in the “single image portion”, and then the “object portion” to the “single image portion”. A mechanism related to any member on the optical path (for example, “single image portion”, “target portion” and / or other members such as a lens and a filter disposed on the optical path) is moved and overlapped “single The positional relationship between the luminance component pattern of the image area included in the “image” and the pattern included in the “target” (pattern corresponding to the image area included in the “single image”) may be changed.

  Alternatively, for example, a transparent “target part” displays a transparent target, a single image appears in the “single image part”, and the “target part” is light (image) from the “single image part”. ). In this case, any member on the optical path from the “single image portion” to the “target portion” in a state where the single image transmitted through the “target portion” is superimposed on the target displayed by the “target portion” ( For example, by moving a mechanism related to “single image portion”, “target portion” and / or other members such as lenses and filters arranged on the optical path), the brightness of the image region included in the superimposed “single image” The positional relationship between the component pattern and the pattern included in the “target” (pattern corresponding to the image area included in the “single image”) may be changed.

  The power of the mechanical movement may be electrical such as an actuator, may be due to human power, or may be due to an environment such as wind force or shaking. One of “single image” and “object” may be moved in software, and the other may be moved in hardware.

  An example of the movement of at least one of “single image” and “object” is at least one of movement, enlargement, reduction, rotation, and curvature, and may be a combination of these movements. These movements may be relative movements between the “single image” and the “target”, or may be absolute movements with respect to a predetermined reference point. The movement may be repetitive or periodic, or may be repetitive or non-periodic. Further, the “movement” of at least one of the “single image” and the “target” may be a continuous movement, an intermittent movement, or a single movement. Good.

  The change in the positional relationship (for example, relative position) between the “luminance component pattern” of the “image area” and the “target pattern” included in the “target” is limited within a predetermined range. For example, the “luminance component pattern” is limited to a range that moves in the vicinity of the “target pattern”. For example, the positional relationship between the “image region” and the “target pattern” may be changed in a state where the vicinity of the contour of the “image region” overlaps with the contour of the “target pattern”. The positional relationship between the “image area” and the “target pattern” may be changed in a state where the vicinity of the outline of the “single image” overlaps with the outline of the “target”, or the “image area” The positional relationship between the “image region” and the “target pattern” may be changed in a state where the vicinity of the edge included in the image overlaps with the vicinity of the edge included in the “target pattern”. The deviation width between the “luminance component pattern” and the “target pattern” is limited to a range in which both do not seem to be separated. The apparent non-separated range is set in consideration of the size of the luminance component pattern and the target pattern, the size when displayed on a screen, the viewing angle from the user, and the like. In the above-described movement, the “luminance component pattern” may or may not intersect with the “target pattern”.

[First Embodiment]
Next, a first embodiment will be described with reference to the drawings.
<Configuration of video generation system>
As illustrated in FIG. 1, the video generation system according to this embodiment includes a video generation device 11, a photographing device 12, an installation plate 13, and a target 14. The video generation device 11 includes an imaging processing unit 111, a gray scale conversion unit 112, a filtering unit 113, and a storage unit 115. The video generation apparatus 11 is a general-purpose or dedicated computer including a processor (hardware processor) such as a CPU (central processing unit) and a memory such as random-access memory (RAM) and read-only memory (ROM), for example. Is an apparatus configured by executing a predetermined program. The computer may include a single processor and memory, or may include a plurality of processors and memory. This program may be installed in a computer, or may be recorded in a ROM or the like in advance. In addition, some or all of the processing units are configured using an electronic circuit that realizes a processing function without using a program, instead of an electronic circuit (circuitry) that realizes a functional configuration by reading a program like a CPU. May be. In addition, an electronic circuit constituting one device may include a plurality of CPUs. The photographing device 12 is a general camera capable of photographing a color still image. The installation plate 13 is a plate having a flat portion 131, and the object 14 is a printed matter fixed to the flat portion 131. The object 14 is not uniform and has a pattern at least partially. That is, the spatial frequency of an image or video obtained by photographing the object 14 is not zero.

<Configuration of video projection system>
As illustrated in FIG. 3A, the video projection system of this embodiment includes a video projection device 15, a projector 16, a setting plate 17, and a target 18. The video projection device 15 includes a reproduction processing unit 151 and a storage unit 152. The video projection device 15 is, for example, a device configured by the above-described computer executing a predetermined program. The installation plate 17 is a plate having a flat portion 171, and the object 18 is a printed matter fixed to the flat portion 131. The target 18 may be the target 14 described above, a duplicate of the target 14, or an analog of the target 14. The projector 16 may be a general one. Examples of the similar object 14 include those in which a part of the color, pattern, brightness, and the like of the object 14 are changed or omitted, and those in which the color, pattern, brightness, etc. are added to the object 14.

<Video generation processing>
First, the video generation process will be described. In this process, an image to be superimposed on the object 18 is generated in order to perceive the object 18 as if a motion is given. First, under the control of the imaging processing unit 111, the imaging device 12 images the object 14 (FIG. 1). A color still image 140 (FIG. 2A) obtained by shooting is sent to the shooting processing unit 111 and then sent to the grayscale conversion unit 112.

  The grayscale conversion unit 112 converts the still image 140 to grayscale, and generates a single image 140 ′ (FIG. 2A) including a luminance component pattern. The single image 140 'consists only of luminance components. For example, the gray scale conversion unit 112 uses the NTSC weighted average method (luminance Y = R × 0.298912 + G × 0.586611 + B × 0.114478, where R, G, and B represent the red, green, and blue channel intensities of each pixel, respectively. ) To convert the still image 140 into a single grayscale image 140 ′. However, any other method may be used as long as it can be converted to grayscale.

  The single image 140 ′ is sent to the filtering unit 113. The filtering unit 113 performs high spatial frequency filtering on the single image 140 ′ and generates a single image 141 in which low spatial frequency components are suppressed. The high spatial frequency component of the single image 141 is perceived as being superior to the low spatial frequency component. Although the filter size at this time is arbitrary, if the filter size is increased (that is, the pass band of the high spatial frequency filter is widened), a single image 141 close to the original single image 140 ′ is projected onto the target 18. As a result, the appearance of the target 18 changes. That is, rather than the object 18 itself appearing to move, it is perceived as another image being projected. Therefore, it is desirable to set the filter size of the high spatial frequency filter as small as possible. However, the smaller the size of the high spatial frequency filter, the smaller the magnitude (modulation amount) of the movement of the object 18 that can be perceived (details will be described later). Therefore, the size of the high spatial frequency filter must be determined in consideration of the relationship with the magnitude of the movement of the object 18 to be perceived. The filter used for the high spatial frequency filtering can extract a high spatial frequency component without changing the phase of the single image 140 ′, for example. For example, the same result can be obtained by using an edge detection filter incorporated in existing image editing software such as Adobe Photoshop (registered trademark) or by calculating by convolving a high spatial frequency direction component. it can. The single image 141 includes an image region having a luminance component pattern 141a (FIG. 2B). The obtained single image 141 is stored in the storage unit 115.

<Video projection processing>
As preprocessing, the single image 141 is stored in the storage unit 152 of the video projection device 15 (FIG. 3A). If the storage unit 115 is the same as the storage unit 152, this pre-processing is not necessary. Next, for alignment, the reproduction processing unit 151 sends a single image 141 to the projector 16, and the projector 16 projects the single image 141 on the target 18. At that time, the alignment may be performed by appearance, or the alignment may be performed by taking the correspondence between the light source of the projector 16 and the imaging device 12 using an existing technique such as a structured light method. When alignment is performed in appearance, for example, the luminance component pattern 141a (FIG. 2B) of the image area of the single image 141 is performed so as to overlap the target pattern 18a (FIG. 3B) of the target 18 or the vicinity thereof. For example, the outline of the luminance component pattern 141a or the vicinity thereof may be arranged so as to overlap the outline of the target pattern 18a, or the outline of the single image 141 or the vicinity thereof may be arranged so as to overlap the outline of the target 18. Alternatively, the edge included in the luminance component pattern 141a or the vicinity thereof may be arranged so as to overlap the edge included in the target pattern 18a.

  After that, the reproduction processing unit 151 sends the single image 141 to the projector 16 and moves the single image 141 by image processing while projecting the single image 141 according to the target 18 from the projector 16 (FIG. 2C). Then, the positional relationship between the luminance component pattern 141a of the single image 141 and the target pattern 18a of the target 18 is changed (FIG. 3B). In this embodiment, the single image 141 is repeatedly moved (vibrated) one-dimensionally in the ab direction. The repetitive movement of the luminance component pattern 141a is limited to the vicinity of the target pattern 18a. Thus, the impression of the movement of the target 18 can be modulated by spatially shifting the position of the luminance component pattern 141a with respect to the target pattern 18a. That is, when the single image 141 projected with the object 18 stationary is spatially shifted, the object 18 appears to move in that direction, and in the example of this embodiment, the object 18 is perceived as vibrating. The

<Why is subject 18 perceived as moving?>
If there is a phase shift between the high spatial frequency component of the single image 141 and the low spatial frequency component of the object 18, the phase of the low spatial frequency component is perceptually captured by the phase of the high spatial frequency component (Reference 1). ). In this embodiment, the single image 141 having a high spatial frequency component is shifted and projected onto a stationary object 18. Based on the shift, phase modulation of the high spatial frequency component occurs in the final image information. Since the phase modulation of the high spatial frequency component perceptually captures the phase of the low spatial frequency component, it seems that the projection object appears to move in the phase modulation direction. The higher the cut-off frequency of high spatial frequency filtering, the narrower the spatial range in which phase modulation occurs, so the amount of space in which the single image 141 can be moved becomes smaller.
Reference 1: Morrone, MC & Burr, DC, “Feature detection in human vision: a phase-dependent energy model,” 1988, Proceedings of the Royal Society of London, B235, 221-245.

<Features of this embodiment>
In this embodiment, while projecting a single image 141, which is a single high spatial frequency image, onto the object 18, the relative position between them is shifted, and the movement of the object 18 is performed by utilizing the human spatial frequency integration mechanism. The impression can be modulated. Thereby, it can be made to perceive as the motion is given to the object 18 more simply than before. That is, in the present embodiment, the photographed still image 140 is converted into a gray scale to generate a single image 140 ′ composed only of luminance components, but unlike the existing technology, a moving image (image sequence) in which the shape of the pattern is deformed And the difference between the generated moving image and the single image 140 ′ is not calculated. Nevertheless, the illusion can be made that the subject 18 is given movement. For example, it is possible to give an impression of movement by projecting a single image to art museum paintings, food samples, etc., and change the apparent impression and texture of the object, improving the degree of attention of the object Can do. From this point, it is possible to provide a new method for expressing movement in the interior and artistic aspects.

In addition, a hybrid image method is proposed that can display different appearances when viewed from a distance and from a distance by displaying a high spatial frequency component of an image superimposed on a low spatial frequency component of a different image. (See, for example, Reference 2). However, this existing technology does not add a motion impression to the image information on the superimposed side by superimposing high spatial frequency components. In addition, a low spatial frequency component image is assumed as the superimposed side, and it is not assumed that a high spatial frequency component is superimposed on an actual object or a normal photograph. Even if the high spatial frequency components of the real object are displayed in an overlapping manner, the effect of the motion as proposed by the present technology does not occur only by increasing the apparent high spatial frequency of the real object.
Reference 2: Oliva, A., Torralba, A., & Schyns, PG, “Hybrid Images. ACM Transactions on Graphics,” (2006), ACM Siggraph, 25-3, 527-530.

[First Modification of First Embodiment]
In the first embodiment, the entire target pattern 18a of the target 18 is perceived as moving. However, only a partial area of the luminance component pattern 141a may be moved while being superimposed on a partial area of the target pattern 18a, and a motion impression may be given only to the partial area of the target pattern 18a. For example, uniform illumination may be applied to an area where it is not desired to give a motion impression. By operating so that the brightness of the uniform illumination becomes an intermediate brightness between the edges of the target pattern 18a, a part of the projected brightness component pattern 141a (a region where a motion impression is not desired) is apparently applied. Disappear. Thereby, a motion impression can be given only to a partial region of the target pattern 18a. A similar effect can be obtained by not projecting a part of the luminance component pattern 141a (a region where a motion impression is not desired).

  For example, only a partial region 141a ′ (region of both eyes) of the luminance component pattern 141a as shown in FIG. 4A is repeatedly moved (vibrated) one-dimensionally in the ab direction as shown in FIG. 4B, as shown in FIG. 4C. In addition, a motion impression may be given to only a part of the target pattern 18a by superimposing it on a part of the target pattern 18a (a region of both eyes). Alternatively, for example, only a partial area 141a ″ (right-eye area) of the luminance component pattern 141a as shown in FIG. 5A is enlarged and reduced, and as shown in FIG. 5B, a partial area (right-eye area) of the target pattern 18a is obtained. By superimposing, a motion impression may be given only to a partial region of the target pattern 18a.

[Modification 2 of the first embodiment]
The movement given to the single image 141 is not limited to that of the first embodiment and the modification 1 thereof. The positional relationship between the luminance component pattern 141a and the target pattern 18a may be changed by at least one of movement, enlargement, reduction, rotation, and curvature of the single image 141. The moving direction is not limited to the ab direction, and the moving direction may be other directions. Further, the movement, enlargement, reduction, rotation, and bending are not limited to one-dimensional ones, but may be two-dimensional ones or may not be repeated (the same applies hereinafter).

[Modification 3 of the first embodiment]
The video generation device 11 further includes a video generation unit 114 that outputs a plurality of images (for example, FIG. 2C) obtained by moving, enlarging, reducing, rotating, and curving the single image 141 as videos. (FIG. 1). As a result, this image can be sent from the reproduction processing unit 151 to the projector 16 and the single image 141 can be projected from the projector 16 according to the target 18 so that the target 18 can be perceived as having a motion. . A plurality of images output from the video generation unit 114 may be distributed via the Internet or the like, or may be recorded and distributed on a recording medium.

[Modification 4 of the first embodiment]
In the first embodiment, the still image 140 is converted to a gray scale, and a single image 140 ′ including a luminance component pattern is generated, which is subjected to high spatial frequency filtering to generate a single image 141. However, the process of converting the still image 140 to gray scale may be omitted, and the obtained still image 140 may be subjected to high spatial frequency filtering to generate a single image 141. Alternatively, a single image 141 may be generated by performing high spatial frequency filtering on an image in which a specific color component of the still image 140 is emphasized or suppressed. Further, with the still image 140, the process of converting to gray scale may be omitted, or the process of high spatial frequency filtering may be omitted.

[Modification 5 of the first embodiment]
In the first embodiment, the positional relationship between the luminance component pattern 141a of the single image 141 and the target pattern 18a of the target 18 is changed by moving the single image 141 by image processing (FIG. 2C) ( FIG. 3B). However, the single image 141 is moved by mechanically moving the projector 16 (including the light source), and the positional relationship between the luminance component pattern 141a of the single image 141 and the target pattern 18a of the target 18 is changed. Also good. Alternatively, the target 18 may be mechanically moved to change the positional relationship between the luminance component pattern 141a of the single image 141 and the target pattern 18a of the target 18. Alternatively, the positional relationship between the luminance component pattern 141a of the single image 141 and the target pattern 18a of the target 18 may be changed by mechanically moving the projector 16 and the target 18. Further, by projecting the single image 141 so as to move mechanically or by image processing with a larger amplitude than that of the mechanically oscillating target 18, it is possible to make an illusion that the target 18 appears to move more than it actually is. . However, it is desirable that the vibration frequency of the object 18 and the vibration frequency of the single image 141 be the same or approximate. On the other hand, when the object 18 is mechanically vibrated and a stationary single image 141 is projected thereon, the vibration of the object 18 is weakened or stopped. Furthermore, by projecting the single image 141 so as to move mechanically or by image processing with an amplitude smaller than the vibration of the mechanically vibrating object 18, the movement of the object 18 looks small. Also in this case, it is desirable that the vibration frequency of the object 18 and the vibration frequency of the single image 141 are the same or approximate. In addition, the positional relationship between the luminance component pattern 141a and the target pattern 18a may be changed by at least one of movement, enlargement, reduction, rotation, and curvature of at least one of the single image 141 and the target 18.

[Second Embodiment]
You may change the positional relationship between them, projecting a single image on the object projected with the projector. Below, it demonstrates centering around difference with 1st Embodiment and its modification, and it abbreviate | omits description about the common matter using the same reference number.

<Configuration of video projection system>
As illustrated in FIG. 6, the video projection system according to this embodiment includes a video projection device 25, projectors 261 and 262, and an installation plate 17. The video projection device 25 includes a reproduction processing unit 251 and a storage unit 252. The video projection device 25 is, for example, a device configured by the above-described computer executing a predetermined program.

<Video projection processing>
As preprocessing, the single image 141 is stored in the storage unit 252 of the video projector 25 (FIG. 6). In this embodiment, the storage unit 252 also stores a target 241 that is one still image of the target 14 obtained by shooting the target 14 with the shooting device 12. Next, for alignment, the reproduction processing unit 251 sends the single image 141 to the projector 261, sends the object 241 to the projector 262, and sets the single image 141 from the projector 261 to the object 241 from the projector 262. 17 projected onto 17 plane portions 171. The alignment method may be the same as in the first embodiment.

  Thereafter, the reproduction processing unit 251 sends the single image 141 to the projector 261, sends the object 241 to the projector 262, and projects the single image 141 on the flat part 171 of the installation plate 17 according to the object 241, while performing image processing. By moving at least one of the single image 141 and the target 241, the positional relationship between the luminance component pattern 141 a of the single image 141 and the target pattern of the target 241 is changed. For example, as described in the first embodiment and the modifications thereof, the positional relationship between the luminance component pattern 141a of the single image 141 and the target pattern of the target 241 is changed by moving the single image 141. . Alternatively, without moving the single image 141 (FIG. 7B), only the object 241 may be vibrated in the ab direction (FIG. 7A), and they may be superimposed and projected (FIG. 7C). Both the single image 141 and the object 241 may be vibrated. For example, the object 241 may be vibrated in the ab direction (FIG. 8A), the single image 141 may be vibrated in the ab direction with a larger amplitude (FIG. 8B), and the images may be superimposed and projected. (FIG. 8C). Thereby, it is possible to make an illusion that the object 241 seems to move more than it actually is. Conversely, the object 241 is vibrated in the ab direction (FIG. 9A), the single image 141 is vibrated in the ab direction with a smaller amplitude (FIG. 9B), and they are superimposed and projected. Good (FIG. 9C). Thereby, it is possible to make an illusion that the object 241 seems to move smaller than the actual size. In addition, when the object 241 is vibrated in the ab direction and the stationary single image 141 is projected thereon, the vibration of the object 241 is weakened or appears to stop. Also in this embodiment, the relative position of the luminance component pattern 141a with respect to the target pattern 18a is limited to a predetermined range. That is, the movement of at least one of the single image 141 and the target 241 is limited within a range in which the luminance component pattern 141a is located in the vicinity of the target pattern 18a.

<Features of this embodiment>
Also in this embodiment, as in the first embodiment, the object 241 can be perceived as being given movement more easily than in the past. Furthermore, by projecting the object 241 that is actually moving and the single image 141 in an overlapping manner, the movement of the object 241 can be perceived to be different from the actual movement.

[Modification 1 of the second embodiment]
By superimposing only a partial area of the luminance component pattern 141a of the single image 141 on a partial area of the target pattern of the target 241 and changing the positional relationship therebetween, a part of the target pattern of the target 241 It is also possible to give a motion impression only to the area.

[Modification 2 of the second embodiment]
The positional relationship between the luminance component pattern 141a and the target pattern of the target 241 may be changed by at least one of movement, enlargement, reduction, rotation, and curvature of at least one of the single image 141 and the target 241.

[Third Embodiment]
Instead of projecting the single image 141, the transparent single image 141 may be displayed on the transmissive display. As illustrated in FIG. 10, the video display system of the present embodiment includes a video display device 35, a transmissive display 36, an installation plate 17, and a target 18. The video display device 35 includes a reproduction processing unit 151 and a storage unit 152. One surface 361 of the transmissive display 36 is disposed to face the target 18 side (plane portion 171 side) of the installation plate 17. In this case, first, the reproduction processing unit 151 sends the single image 141 to the transmissive display 36 for alignment, and the transmissive display 36 displays the transmissive single image 141. When alignment is performed in appearance, the observer views the A direction from the other surface 362 side of the transmissive display 36, and the overlap between the single image 141 with transparency displayed on the transmissive display 36 and the object 18 overlaps. Adjust the condition. The adjustment method is the same as in the first embodiment. Thereafter, the reproduction processing unit 151 sends the single image 141 to the transmissive display 36, and displays the single image 141 on the transmissive display 36 (FIG. 2B), and moves the single image 141 as described above by image processing. (FIG. 2C). Thus, when viewed from the other surface 362 side (direction A) of the transmissive display 36, the luminance component pattern 141a of the single image 141 and the target pattern of the target 18 in a state where the single image 141 and the target 18 are superimposed. The positional relationship with 18a changes (FIG. 3B). An observer who views the transmissive display 36 from the A direction perceives that the object 18 has been moved.

[Modification 1 of the third embodiment]
In this case as well, only a part of the luminance component pattern 141a may be moved while being superimposed on a part of the target pattern 18a, and a motion impression may be given only to the part of the target pattern 18a. The positional relationship between the luminance component pattern 141a and the target pattern 18a may be changed by at least one of movement, enlargement, reduction, rotation, and curvature of the single image 141. The single image 141 may be moved by mechanically moving the transmissive display 36, and the positional relationship between the luminance component pattern 141a of the single image 141 and the target pattern 18a of the target 18 may be changed. Alternatively, the target 18 may be mechanically moved to change the positional relationship between the luminance component pattern 141a of the single image 141 and the target pattern 18a of the target 18. In addition, the transmissive display 36 and the target 18 may be mechanically moved to change the positional relationship between the luminance component pattern 141a of the single image 141 and the target pattern 18a of the target 18. Also in this modification, the relative position of the luminance component pattern 141a with respect to the target pattern 18a is limited to a predetermined range. That is, the movement of at least one of the single image 141 and the target 241 is limited within a range in which the luminance component pattern 141a is located in the vicinity of the target pattern 18a.

[Modification 2 of the third embodiment]
A single image 141 and object 18 may be displayed on the same display. In other words, the single image 141 is displayed on the same display so as to be superimposed on the target 18, and at least one of the single image 141 and the target 18 is moved, and the luminance component pattern 141a included in the single image 141 and the target pattern included in the target 18 are displayed. You may change the positional relationship between 18a.

[Modification 3 of the third embodiment]
Instead of the single image 141, the transparent object 18 may be displayed on the transmissive display 36, and the single image 141 may be printed, drawn, displayed, or projected on the flat portion 171 of the installation plate 17. While displaying the target 18 on the transmissive display 36, the target 18 is moved by image processing. Thus, when viewed from the other surface 362 side (direction A) of the transmissive display 36, the luminance component pattern 141a of the single image 141 and the target pattern of the target 18 in a state where the single image 141 and the target 18 are superimposed. The positional relationship with 18a changes. An observer who browses the transmissive display 36 from the A direction perceives that the movement of the object 18 is reduced.

[Fourth Embodiment]
A single transparent image similar to that of the first embodiment may be printed on a transparent film, projected from behind it onto the object, and the positional relationship between them may be changed. Thereby, the motion impression of the object can be modulated without using a video display device such as a projector or a display.

<Configuration of video projection system>
As illustrated in FIG. 11, the video projection system of the present embodiment includes a video projection device 45, a projection device 46, an installation plate 47, and a target 18. The video projection device 45 includes a reproduction processing unit 451, a drive unit 453, and a storage unit 452. The video projection device 45 is, for example, a device configured by the above-described computer executing a predetermined program. The projection device 46 includes a light source 461, a single image transmission member 462, and a convex lens 464. The light source 461 is an LED or the like. The single image transmission member 462 is obtained by printing a transparent single image 141 (FIG. 2B) on a transparent film. The installation plate 47 is a plate having a flat portion 471, and the object 18 is a printed matter fixed to the flat portion 431. The light from the light source 461 enters the single image transmission member 462, and the emitted light that has passed through the single image transmission member 462 is condensed by the convex lens 464 and projected onto the target 18. Thereby, the single image 141 can be superimposed on the object 18. The single image 141 and the object 18 are aligned in advance. The alignment method is the same as in the first embodiment. Further, it is possible to mechanically move a mechanism related to at least one of members (including the light source and the “target”) existing in the optical path from the light source 461 to the target 18. That is, the mechanism relating to any of the light source 461, the single image transmission member 462, the convex lens 464, and the object 18 can be mechanically moved. The storage unit 452 of the video projector 45 stores control information for mechanically moving a mechanism related to at least one of the members existing in the optical path from the light source 461 to the target 18.

<Video projection processing>
When the light source 461 is turned on, the light enters the single image transmitting member 462, and the emitted light that has passed through the single image transmitting member 462 is condensed by the convex lens 464 and projected onto the target 18. Thereby, the single image 141 is superimposed on the object 18. The reproduction processing unit 451 extracts control information from the storage unit 452 and sends a control signal based on the control information to the driving unit 453. The drive unit 453 mechanically moves a mechanism related to at least one of the members existing in the optical path from the light source 461 to the target 18 based on the input control signal. As a result, the positional relationship (relative position) between the luminance component pattern 141a of the image area included in the single image 141 and the target pattern 18a included in the target 18 is changed in a state where the single image 141 is superimposed on the target 18. Let Also in this embodiment, the relative position of the luminance component pattern 141a with respect to the target pattern 18a is limited to a predetermined range. That is, the movement of at least one of the single image 141 and the target 241 is limited within a range in which the luminance component pattern 141a is located in the vicinity of the target pattern 18a.

  Any mechanism may be mechanically moved as long as the mechanism is a member existing in the optical path from the light source 461 to the target 18. For example, a configuration in which the positions of the light source 461 and the target 18 are fixed and only the single image transmitting member 462 is movable is conceivable. A plurality of ways of moving the single image transmitting member 462 are assumed. For example, the single image transmission member 462 is moved (for example, vibrated) substantially parallel to the target 18 (for example, the Y-axis direction, the Z-axis direction, and the YZ plane direction), or the target 18 of the single image transmission member 462 is used. Or the single image transmission member 462 is rotated (for example, rotation in a YZ plane substantially parallel to the object 18 (rotation about a rotation axis substantially parallel to the Y axis), YZ By rotating an arbitrary rotation axis on a plane as a center, or a rotation obtained by mixing them) or bending the single image transmitting member 462 by an external force, the positional relationship between the projected single image 141 and the object 18 is changed. The motion of the object 18 can be modulated as described above. For example, when the single image transmitting member 462 (FIG. 12A) is vibrated in the Z-axis direction (FIG. 2C), the luminance component pattern 141a of the single image 141 is the target pattern 18a of the target 18 as in the first embodiment. Can be perceived as if the object 18 vibrates in the Z-axis direction (FIG. 3B). For example, when the single image transmitting member 462 (FIG. 12A) is rotated around the rotation axis substantially parallel to the Y axis (FIGS. 12B and 12C), the single image 141 projected on the target 18 is the target 18. A movement to be compressed in the Z-axis direction and a movement to restore the original shape are performed on the target pattern 18a. As a result, it is possible to perceive the movement of the object 18 being compressed in the Z-axis direction or being restored to the original shape. For example, when the single image transmitting member 462 (FIG. 13A) is bent by applying a force in the Z-axis direction (FIGS. 13B and 13C), the single image 141 projected on the target 18 is A movement that is compressed in the Z-axis direction and a movement that restores the original shape are performed. This also makes it possible to perceive movement of the object 18 being compressed in the Z-axis direction or restored to the original shape. Alternatively, the focal point may be changed by moving the convex lens 464 substantially parallel to the X axis, the convex lens 464 may be moved substantially parallel to the YZ plane, or the convex lens 464 may be rotated (for example, YZ It may be rotated about an arbitrary rotation axis on a plane).

  The light source 461 and the single image transmitting member 462 may be moved in synchronization. That is, the light source 461 and the single image transmission member 462 may be integrated and moved in synchronization. Alternatively, the single image transmission member 462 and the installation plate 47 may be moved independently of each other, or the integrated light source 461 and the single image transmission member 462 may be moved, and the installation plate 47 may be moved independently thereof. For example, the object 18 may be vibrated in the Z-axis direction, the single image 141 may be vibrated in the Z-axis direction with an amplitude larger than that, and the images may be superimposed and projected. As a result, an illusion can be made so that the object 18 appears to move more than it actually is. However, it is desirable that the vibration frequency of the object 18 and the vibration frequency of the single image 14 be the same or approximate. Conversely, the object 18 may be vibrated in the Z-axis direction, the single image 141 may be vibrated in the Z-axis direction with an amplitude smaller than that, and may be controlled so as to be superimposed and projected. As a result, an illusion can be made so that the object 18 appears to move smaller than it actually is. Also in this case, it is desirable that the vibration frequency of the object 18 and the vibration frequency of the single image 14 be the same or approximate. In addition, if the object 18 is vibrated in the Z-axis direction and a stationary single image 141 is projected thereon, the vibration of the object 18 is weakened or stopped.

<Features of this embodiment>
Also in this embodiment, the object 18 can be perceived as being given a motion or the movement of the object 18 can be modulated more easily than in the past. In particular, in this embodiment, without using a video display device such as a projector or a liquid crystal monitor, the object 18 is perceived as being moved using only an inexpensive member such as a film or a light source. You can modulate the movement. For example, it is possible to propose an inexpensive and simple device when it is desired to give an impression of movement to a painting in a museum or a food sample, or to change an apparent impression or texture. From this point, it is expected to spread in a wide range of fields such as interior and art.

[Modification 1 of Fourth Embodiment]
In this embodiment, a single image transmitting member 462 having a transparent single image 141 (FIG. 2B) printed on a transparent film is used. As described in the first embodiment, the single image 141 is an image obtained by performing high spatial frequency filtering on the gray-scaled single image 140 ′. However, instead of the single image 141, a single image transmission member 462 in which a transparent single image before gray scale conversion or a single transparent image before high spatial frequency filtering is printed on a transparent film is used. Also good.

[Modification 2 of the fourth embodiment]
Instead of the installation plate 47 to which the target 18 is fixed, a target transmission member 47 ′ obtained by printing the transparent target 18 on a plate made of a transparent material (for example, a plastic plate or a glass plate) may be used. In this case, the observer can see a transmission image in which the single image 141 is superimposed on the object 18 and the relative position between the single image 141 and the object 18 changes through the object transmission member 47 ′.

[Modification 3 of the fourth embodiment]
Natural light such as sunlight or ambient light may be used instead of the light source 461. In this case, natural light is incident on the single image transmitting member 462, and the emitted light transmitted through the single image transmitting member 462 is condensed by the convex lens 464 and projected onto the object 18. Others may be the same as those of the fourth embodiment and any one of the first and second modifications.

[Modification 4 of the fourth embodiment]
In place of the installation plate 47 to which the target 18 is fixed, a target transmissive member 47 ′ obtained by printing the transmissive target 18 on a plate made of a transparent material (for example, a plastic plate or a glass plate) is used. You may arrange | position outside the object transmission member 47 '(right side in FIG. 11) instead of the outer side (left side in FIG. 11) of the single image transmission member 462. In this case, the light from the light source 461 is incident on the target transmissive member 47 ′ on which the transmissive target 18 is printed, and the emitted light transmitted through the target transmissive member 47 ′ is collected by the convex lens 464. Are projected onto the single image transmitting member 462. Also by this, the single image of the single image transmission member 462 and the object 18 can be superimposed, and the mechanism relating to at least one of the members existing in the optical path from the light source 461 to the single image transmission member 462 is mechanically performed. By moving the object 18, it can be perceived as if a change in movement is given to the object 18. In this case, natural light may be used instead of the light source 461. Instead of the single image transmitting member 462, a member having no transparency in which a single image is printed, drawn, displayed, or the like may be used.

[Fifth Modification of Fourth Embodiment]
In the fourth embodiment and its modifications, the convex lens 464 may be omitted, and another lens (such as a concave lens) may be interposed in the above-described optical path.

[Other variations]
In addition, this invention is not limited to the above-mentioned embodiment. For example, the prints, drawings, display images, display images, projection images, projection images, patterns and patterns based on the color of the material constituting the predetermined surface, and plane objects other than those described in the above-described embodiment may be used for the objects 14 and 18. It may be a pattern based on the surface shape of a three-dimensional object, a boundary line, shading, or the like. When the above configuration is realized by a computer, the processing contents of the functions that each device should have are described by a program. By executing this program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium. An example of a computer-readable recording medium is a non-transitory recording medium. Examples of such a recording medium are a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, and the like.

  This program is distributed, for example, by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of the server computer and transferring the program from the server computer to another computer via a network.

  A computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. When executing the process, the computer reads a program stored in its own storage device, and executes a process according to the read program. As another execution form of the program, the computer may read the program directly from the portable recording medium and execute processing according to the program, and each time the program is transferred from the server computer to the computer. The processing according to the received program may be executed sequentially. The above-described processing may be executed by a so-called ASP (Application Service Provider) type service that realizes a processing function only by an execution instruction and result acquisition without transferring a program from the server computer to the computer. Good.

  A data structure of a video that perceives the subject as if a change in motion is given, and moves the single image and at least one of the target in a state where the single image and the target are superimposed, A data structure of a video used in an apparatus that changes a positional relationship between a luminance component pattern of an image area included in a single image and a pattern corresponding to the image area included in the target may be distributed. Further, a data structure of a video to be superimposed on a target in order to perceive the subject as if a change in motion is given, and a single image including a luminance component pattern is moved, enlarged, reduced, rotated, and curved A data structure of a video that is composed of a plurality of images and is projected or displayed by the apparatus may be distributed. The data structure may be distributed, for example, by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM that records the data structure, or to a server computer on a network such as the Internet. This may be done by uploading the data structure and distributing from there.

  As described above, at least a part of processing functions realized by executing a predetermined program on a computer may be realized by hardware.

DESCRIPTION OF SYMBOLS 11 Image | video production | generation apparatus 12,46 Image pick-up device 14,18 Object 15,25,45 Image | video projection apparatus 35 Image | video display apparatus 16,261,262 Projector 36 Transmission type display 141 Single image

Claims (1)

A data structure used in a device that makes an object perceive a change in motion,
In a state where the single image and the target are overlapped, at least one of the single image and the target is moved to correspond to the luminance component pattern of the image area included in the single image and the image area included in the target. It is used for processing that gives an effect equivalent to processing that changes the positional relationship with the target pattern,
A set of identification information for identifying the target, a single image group that is a set of a plurality of images, and a display order of the plurality of images included in the single image group,
The plurality of images include a one-dimensional enlargement of the single image, a one-dimensional reduction of the single image, and a member on which the single image is printed, drawn, or displayed is mechanically curved. Obtained by at least one of a one-dimensional deformation of the single image representing a deformation of the single image that occurs when
The single image is a single still image corresponding to the target, and the luminance component pattern of the image area included in the single image and the target pattern corresponding to the image area included in the target are a space. Pattern that matches or approximates
The spatial frequency component of at least a part of the luminance component pattern of the image region included in the single image has a lower spatial frequency component than the spatial frequency component of the target pattern corresponding to the image region included in the target. Is suppressed against the ingredients,
By projecting or displaying the plurality of images of the single image group according to the display order, the one-dimensional enlargement of the single image, the one-dimensional reduction of the single image, and the single image The image represents a motion equivalent to at least any one of the one-dimensional deformation of one image,
A set of the identification information, the single image group, and the display order is stored in the storage unit of the device,
The device is
Based on the input information of the target, the single image group corresponding to the target is read from the storage unit,
Based on the information on the target edge, each of the plurality of images of the single image group such that the target edge overlaps the vicinity of each edge of the plurality of images of the read single image group. Set the reference position necessary for alignment to project or display
A data structure used for a process of projecting or displaying each of the plurality of images of the read single image group according to the display order.

Images