WO2006006642A1 - Image producing system and image producing method - Google Patents

Abstract

An image producing system which enables the audience to feel the reality of an image by acquiring an integrated feeling with the image displayed on a floor surface or the tread of a stairway step or the like. The system comprises an image output device (22) for displaying an image on a floor surface (20a) or the tread of a stairway step or the like based on a received image signal, detection units (24, 26) that detect, when a moving body (6) moving on the a floor surface (20a) or the tread is present thereon, the position or/and the size of the contact portion of the moving body (6) on the floor surface (20a) or the tread, and a production control device (38) that holds an image material (48c) and sends to the image output device (22) an image signal obtained by performing processing, corresponding to the position or/and the size of the contact portion of the moving body (6) detected by the detection units (24, 26), on this image material (48c).

Description

 Video production system and video production method

,Technical field

 In the present invention, the position and size of the contact portion of a moving body that touches the floor surface or the tread surface when the image is projected on the floor surface or the tread surface of the stairs by a video output device such as a projector or a TV monitor. The present invention relates to a video production system and a video production method that change video in real time according to the above. Background art

 Recently, video production by video output devices such as projectors and TV monitors has been performed in amusement spaces and stores. As one form of such an image production, there was a technique in which a predetermined image was projected on a floor surface or a tread surface of a stairs where a spectator can walk around.

 As described above, as a method of projecting an image on the floor surface or the like, there is a method of fixing the projector to the ceiling and projecting the image output from the projector onto the floor surface or the like.

 In addition, as a method different from the method of projecting images from the ceiling side, there was a method of embedding a TV monitor or the like on the floor and outputting the images from the floor. In this way, when video is output from the floor using a TV monitor or the like, the load on the floor is applied to the floor, so a protective forest made of tempered glass with translucency is used as the flooring. Therefore, it was necessary to use an embedded display device in which a television monitor or the like was embedded under the protection forest (for example, see Patent Document 1 or Patent Document 2).

 If an image is projected on the floor using a projector as described above or an embedded display device such as the TV monitor of Patent Document 1 or Patent Document 2, the audience can simply place the image at a distance. In addition to being able to see it, it was possible to move around on the projected image, so the audience was able to get a sense of being in a space different from reality.

Further, conventionally, using the projector as described above or the embedded display device as in Patent Document 1 and Patent Document 2, the image is not only displayed on the floor surface but also the image displayed on the floor surface is an attraction. There was what was used for the production of the game (for example, see Patent Document 3) The attraction game of this Patent Document 3 is said to be a simulated one bridge. It is a game that walks so as not to step on a horizontal thin bridge with a height, and it is detected by a laser sensor when a player steps off the main bridge and puts his foot on the floor . And, in order to make the simulated one-bridge look as if it was at a high place, a deep valley bottom image was projected on the floor.

 Patent Document 1 Japanese Patent Application Laid-Open No. 9-1 1 7 5 8 5 9

 Patent Document 2 Japanese Patent Application Laid-Open No. 2 0 0 2— 0 2 3 6 7 4

 Patent Document 3 Japanese Patent Laid-Open No. 2 0 0 1-0 0 0 5 7 8 Disclosure of Invention

 Problems to be solved by the invention

 However, the video effect using the projector as described above or the embedded display device as in Patent Document 1 or Patent Document 2 is simply displaying a predetermined video material prepared in advance on the floor surface. Since the video cannot be changed in real time depending on the position and size of the contact part of the moving object that touches the floor or tread surface, the audience gets a sense of unity between the video and its own movement. Because I couldn't do it, there was a problem of lack of reality.

 In addition, as in the attraction game of Patent Document 3, the image of the valley floor and the like projected on the floor as a video effect changes in accordance with the position and size of the player's feet on the simulated bridge or on the floor. Therefore, the player can obtain a sense of unity with the image as in the case of the video production by the projector as described above or the embedded display device as in Patent Document 1 and Patent Document 2. There was a problem of lack of realism because it was not possible.

 Therefore, in view of the above problems, the present invention provides a video presentation system and a video presentation that allow a spectator to feel a sense of reality by obtaining a sense of unity with a video projected on a tread such as a floor surface or a staircase. It is an object to provide a method. Means for solving the problem

 In order to solve the above-mentioned problem, a video production system according to the present invention includes:

 When a video output device for projecting an image on a floor surface or a tread surface such as a staircase based on the received video signal and a moving body moving on the floor surface or the tread surface are mounted, the floor surface or the tread surface A detection device for detecting the position or Z and size of the contact portion of the moving body on the top;

An image material is held, and the position of the contact portion of the moving body detected by the detection device is detected on the image material. Or an effect control device that transmits to the video output device a video signal that has been subjected to processing corresponding to the position or z and size. In addition, in order to solve the above-mentioned problem,

 When a video output device that projects an image on a floor surface or a tread surface such as a stairs based on a received video signal and a moving body that moves on the floor surface or the tread surface are mounted, the floor surface or the tread surface A detection device for detecting the position and size of the contact portion of the moving body on the top;

 And an effect control device that generates an image corresponding to the position or Z and size of the contact portion of the moving object detected by the detection device and transmits the generated image to the image output device. . In addition, in order to solve the above-described problem, a video presentation method according to the present invention is:

 An image output device for projecting an image on the floor or a tread such as a staircase,

 When a moving body moving on the floor surface or the tread surface is mounted on the floor surface or the tread surface, and using a detection device that detects the position and size of the contact portion of the moving body on the floor surface or the tread surface,

 The video displayed by the video output device is automatically processed by a computer in accordance with the position and size of the contact portion of the moving body detected by the detection device. Is. The invention's effect

 According to the video presentation system and the video presentation method of the present invention, since the motion of the audience and the video projected on the tread such as the floor or the stairs interact, the audience can A sense of unity can give you a sense of reality. BEST MODE FOR CARRYING OUT THE INVENTION

 Hereinafter, embodiments of a video effect system and a video effect method according to the present invention will be specifically described with reference to the drawings.

FIG. 1 to FIG. 10 are diagrams which are referred to for explaining the video effect system 2 and the video effect method according to the embodiment of the present invention. 12982 As shown in FIG. 1, the video production system 2 according to the present embodiment is constructed in an entrance passage 4 such as an amusement space. This entrance passage 4 is sandwiched between two gates 8 and 10 arranged in the traveling direction of the spectator 6 (corresponding to the moving body) to enter, and the spectator 6 enters from the gate 8 side. Then, walk on the floor 20 of the entrance passage 4 and exit from the gate 10 side.

 The floor 20 of the entrance passage 4 has a predetermined length in the width direction, and this length is such that two spectators 6 cannot walk side by side. It has become. Therefore, if multiple spectators 6 enter, it will inevitably progress in a line in the direction of travel.

 The spectator 6 who entered the entrance passage 4 from the gate 8 has an actual feeling of the phenomenon caused by the video presentation described later in the entrance passage 4 by the video production system 2 until the exit from the gate 10. You can experience it.

 As shown in Fig. 2, the video production system 2 constructed in the entrance passage 4 is composed of a floor 20, a video output device 2 2, an equipment controller 28, an audio device 30, a blower 3 2 ( Equivalent), lighting lamp 3 4, and computer 3 8 (corresponding to the production control device).

 In addition, as shown in FIG. 3, the video production system 2 includes area sensors 2 4 (2 4 a, 2 4 b) and 2 6 (2 6 a, 2 6 b) (corresponding to a detection device). . The area sensors 2 4 and 2 6 will be described in detail later, but the area sensor 2 4 and the area sensor 2 6 are arranged at right angles to each other. In FIG. 2, the area sensors 2 6 a and 2 6 b are arranged on the back side and the front side of the paper with the spectator 6 in between, so they are not shown and only the area sensors 2 4 a and 2 4 b are shown. I will do it.

 The floor 20 shown in FIG. 2 has translucency and is constant so that it will not be damaged or damaged even if the spectator 6 walks on the floor surface 20 a above the floor 20 a. It has the strength and hardness. As such a floor 20, transparent tempered glass, a transparent synthetic resin material having a certain strength and hardness, or the like can be used.

The video output device 2 2 includes a projector 2 2 a (projector) and a rear transmission screen 2 2 b. The rear transmission screen 22 b has a plane size that is substantially the same as the floor surface 20 a, and is arranged in the vicinity of the lower side of the floor 20 in parallel with the floor 20. The projector 2 2 a is arranged at a position below the rear transmission screen 2 2 b, receives a video signal from the computer 38, and projects the image on the rear transmission screen 2 2 b. Yes. From the audience 6 walking on the floor surface 20 a, it appears that the image projected on the rear transmission screen 22 b is projected on the floor surface 20 a.

The area sensor 2 4 is a light transmission type sensor provided with a projector 2 4 a and a light receiver 2 4 b. Each of the projector 2 4 a and the light receiver ^{2 4} b has a substantially square bar shape whose length direction is substantially the same as the length of the floor ^{20 in} the width direction. Each of the projector 2 4 a and the light receiver 2 4 b is oriented so that its length direction coincides with the width direction of the floor 20, and sandwiches the length range of the floor 20 in the length direction. Arranged to face each other.

 Although not shown, the light emitters 24 a of the area sensor 24 are provided with a plurality of light emitting elements arranged in a line at regular intervals of about several millimeters in the length direction. The light receiver 2 4 b is provided with a plurality of light receiving elements arranged in a line at the same intervals as the light emitting elements corresponding to the light emitting elements of the projector 24 4 a.

 Therefore, the optical axes connecting the light emitting elements of the projectors 2 4 a and the light receiving elements of the light receivers 2 4 b that correspond to each other face each other in the length direction of the floor 20 as shown in FIG. The shafts are arranged in parallel at regular intervals in the width direction of the floor 20.

 As shown in Fig. 3, the area sensor 1 26 includes a projector 2 6 a and a light receiver 2 6 b. The length direction of each of the projector 2 6 a and the light receiver 2 6 b is It is oriented in the length direction of floor 20. Each of the projectors 26 a and the receivers 26 b has a length substantially the same as the length of the floor 20, and faces each other across the length range of the floor 20 in the width direction. Is arranged.

 Each of the projector 2 6 a and the receiver 2 6 b is configured in the same manner as the projector 2 4 a and the receiver 2 4 b of the area sensor 2 4. Each of the plurality of optical axes connecting the light receiving elements of the unit 26 b faces the width direction of the floor 20, and these are aligned in the length direction of the floor 20 and parallel to each other.

 The plurality of optical axes of the area sensor 26 are arranged in such a manner that the optical axes adjacent to each other have a constant interval, similarly to the optical axis of the carrier sensor 24. The interval may be the same as the interval, or it may be different from the interval of the area sensor 24.

In addition, the distance between the plurality of optical axes of the area sensor 24 and the area sensor 26 and the height direction of the floor surface 20 a is as follows when the spectator 6 is walking on the floor surface 20 a. The moment when the sole of the spectator 6 touches the floor 20 0 a and the optical axis passing through the range of the sole of the spectator 6 is blocked. The moment is so narrow that it can be regarded as almost the same time. For this reason, the area sensor 24 and the area sensor 26 can detect the moment when the soles of the spectators 6 contact the floor 20a.

 Further, the acoustic device 30, the blower 32, and the illuminating lamp 34 shown in FIG. 2 are arranged at arbitrary positions in the entrance passage 4. The blower 3 2 and the illuminating lamp 3 4 can be manually adjusted by means of the equipment adjuster 28, such as the output size.

 The computer 3 8 directly controls the video output device 2 2, the area sensors 2 4 and 2 6, and the audio device 3 0, and controls the blower 3 2 and the illuminating lamp 3 4 via the equipment adjuster 28. It has become.

 FIG. 4 is a block diagram showing the configuration of the computer 38. The computer 38 includes a determination unit 40, a video generation unit 42, a video synthesis unit 44, a video effect unit 46, a storage unit 48, a device control unit 50, an acoustic control unit 52, and an effect setting unit 5 4. Operation means 5 5, update means 5 6, and communication means 60 connected to the public line 58.

 The computer 3 8 includes the information 4 8 a, the video generation program 4 8 b, the video material 4 8 c, the video effect program 4 8 d, the sound generation program 4 8 e, and the sound material 4 8. f, sound effect program 48g, and device control program 48h are stored.

 The video generation program 4 8 b and the video effect program 4 8 d are video processing programs for performing processing as will be described later on the video. The sound generation program 4 8 e and the sound effect program 4 8 g As described later, this is a sound effect program for causing the audio device 30 to output a sound effect.

 The supplementary information 4 8 a of the storage means 4 8 includes the correspondence between each optical axis of the area sensors 2 4 and 2 6 and the position on the floor 20 0 a, and the actual position and image on the floor 20 0 a. The correspondence relationship with the position on the image displayed by the output device 22 and the traveling direction predetermined as the direction in which the spectator 6 walks on the floor 20a are stored.

Further, in the supplementary information 48 a, the typical shape of the sole of the foot as the contact portion is stored for the audience 6 who is assumed to walk on the floor 20 a. The typical shape of the sole of the foot is recorded for the left foot and the right foot for each predetermined size. In addition, the typical shape of the sole of such a foot is, for example, a toe side and a heel side shape connected like a walking shoe, or a toe side like a high heel. Heel side shape They are stored separately from those that are separated from each other.

 The video generation program 48 b is a program that defines the operation content of the video generation means 42. The video material 4 8 c is data information of the captured video, and is subject to processing by the video generation means 4 2, the video composition means 4 4, and the video effect means 4 6, and the storage means 4 8 There are a number of video materials 48c recorded. The video effect program 48 d is a program that defines the operation content of the video effect means 46.

Also, the sound generator 4 8 e and sound effect program 4 8 g is a program that defines about what to output any sound effect to the sound control unit ⁵ 2 Gaoto sound device 3 0. The sound material 48 f is recorded sound data information, and the storage means 48 stores a plurality of sound materials 48 f. Such sound material 4 8 f also includes music, etc. The judging means 40 obtains the detection information from the carrier sensors 2 4 and 2 6 and supplements the information 4 8 a stored in the memory means 4 8 a. For each of the legs of the spectator 6 walking on the floor surface 20 a, the position, size and shape of the sole of the foot in contact with the floor surface 20 a are determined as follows: It has become.

 A spectator 6 wearing walking shoes, etc., where the toes and heels of the soles (sole) of the soles are integrated, proceeds in the direction of travel on the floor 20 0 a, and as shown in FIG. Assume that the left foot (corresponding to one part) is stepped on and the back of the left foot touches the floor 20a. Here, the range in which the back of the left foot is in contact with the floor 20a is represented by L, and the range in which the back of the right foot is in contact is represented by R. In addition, the vertical and horizontal arrows in FIG. 5 are the optical axes of the area sensors 2 4 and 2 6.

 The multiple optical axes of the area sensor 1 2 4 are directed in the length direction of the floor surface 20 a (the direction opposite to the traveling direction of the spectator 6), and the multiple optical axes of the area sensor 1 2 6 are the floor surface 2 0 Since it faces the width direction of a (horizontal right direction in the figure), it corresponds to the range L where the back of the left foot is in contact with the floor 20 a, and the optical axis is in a certain range in each detection direction. Since it is shielded, it is possible to detect the size of the area where the back of the left foot is in contact with the floor 20a.

Also, as shown in FIG. 1, since the floor 20 a has a constant width, the left foot of the spectator 6 is detected at the left half position of the floor 20 a in the traveling direction. (See Fig. 3) Because the optical axis of the area sensor 24 corresponding to the left half of the floor 20a is shielded, see the supplementary information 48a in Fig. 4 to see the shielded light. Compare the width position of the shaft and floor 20 a Thus, it is possible to detect the position of the range L where the back of the left foot is in contact with the floor surface 20a and that the left foot is in contact with the floor surface 20a.

 Further, the judging means 40 is that the size of the range L in which the back of the left foot is in contact with the floor 20 a, and the range L is the left foot detected in the left half of the floor 20 a. Based on supplementary information 48 a, select the typical shape of the sole of the foot that most closely matches such conditions, and determine that this is the shape of the sole of the left foot of Audience 6. ing.

 Although not shown, if the soles of the toes and the heel are separated from each other like the high heel, the area between the toes and the heel is not shown. Since the optical axis of the sensor 24 or the area sensor 26 is not shielded, it can be distinguished from walking shoes or the like in which the toe side and the heel side are integrated as shown in FIG. Therefore, when the area sensors 2 4 and 2 6 detect high heels etc. as the soles of the spectators 6, the judging means 40 refers to the supplementary information 4 8 a and most closely approximates such a condition. As the typical shape of the sole of the foot, a shape in which the toe side and the heel side are separated from each other is selected, so that it can be judged that this is the sole of the spectator 6's foot.

 In addition, as shown in Fig. 5, when the back of the right foot touches the floor surface 20 0 a on the right foot (corresponding to other parts) that the spectator 6 steps after the left foot, the back of the right foot is the floor surface. The shape of the range R in contact with 20 a should generally be symmetric with the shape of the range L in which the back of the left foot contacts the floor 20 a. The shape can be estimated. The estimated shape of the contact area of the right foot sole can be corrected by referring to the position and size of the actual contact area R of the right foot sole and supplementary information 48a. .

 In addition, as shown in Fig. 6, when the right foot is stepped on after the left foot, the heel side part of the contact area R of the right foot is in contact with the contact area L of the left foot and the floor 20 Even in the case where they overlap in the length direction of a, the determination means 40 can determine the position, size and shape of the range R in contact with the sole of the right foot.

That is, when the right foot is stepped on, for the area sensor 26 that detects the shield on the floor surface 20 a at each position in the longitudinal direction of the floor surface 20, This part can be detected because a new optical axis other than the optical axis shielded by the area L in contact with the back of the left foot is shielded. In addition, the area sensor 24 that detects the shield at each position in the width direction of the floor 20 newly detects the area R that contacts the back of the right foot separately from the area L that contacts the back of the left foot. can do. 2 Therefore, the position and range of the newly shielded optical axis of area sensor 2 4 and area sensor 2 6, and the contact range L of the right foot estimated from the contact range L of the left foot sole is large. The position, size, and shape of the area R in contact with the sole of the right foot can be determined (estimated) based on the shape and shape.

 In addition to stepping on the right foot shown in Fig. 6, as shown in Fig. 7, when stepping on the right foot next to the left foot, part of the heel side of the contact area R on the back of the right foot is If the area L that touches the back of the floor overlaps with both the length and width of the floor 20 or if the area R that touches the back of the right foot, as shown in Figure 8, Even if it overlaps in the length direction of the floor surface 20 with the contact area L of the left foot, the position and range of the newly shielded optical axis of the area sensor 24 and area sensor 26, and the left foot Based on the size and shape of the contact area R of the right foot, estimated from the contact area L of the back, the position, size and shape of the contact area of the back of the right foot are judged (estimated). ing.

 As shown in FIG. 4, the determination means 40 is the information on the position, size and shape of the soles of the spectators 6 determined as described above, the image generation means 42, the image effect means 46, and the device control means. This is output to each of 50 and acoustic control means 52.

 In addition, the above explanation about the processing operation of the judgment means 40 is based on the case where the spectator 6 steps the right foot next to the left foot, but the reverse case where the left foot is stepped next to the right foot. Even so, the processing operation of the determining means 40 is performed in the same manner.

 Further, as shown in FIGS. 5 to 8, the above description of the processing operation of the judging means 40 is mainly performed when the shape of the sole of the spectator 6 is integrated with the toe side and the heel side. Even if the shape of the soles of the spectators 6 is based on the toe side and the heel side are separated from each other as in the case of high-health, the judging means 4 The 0 processing operation is performed in the same way.

 Next, as shown in FIG. 4, the video generation means 42 newly generates additional video based on the video generation program 48b. The additional video generated by the video generation means 42 is output to the video composition means 44 for a certain period of time.

As described above, the operation of the video generation means 4 2 is performed based on the video generation program 4 8 b of the storage means 4 8, and the video generation program 4 8 b The content is such that the video generation means 42 generates additional video along any one of the themes selected from the plurality of themes of 8b. As will be described later, the production setting means 5 4 sets the video generation means 4 2 to generate the additional video according to the theme based on the video generation program 4 8 b. The production setting means 54 can also be set so that the video generation means 42 does not generate additional video. If the video generation means 42 is set not to generate such additional video, the video generation means 42 does not generate additional video and outputs nothing to the video synthesis means 44.

 The video synthesizing means 4 4 continuously reads the additional video received from the video generating means 4 2 from the storage means 4 8 as time passes as the processing for the video material 4 8 c. It is designed to be superimposed on video material 4 8 c. Then, the synthesized video obtained by synthesizing the additional video and the video material 48 c is output to the video effect means 46.

 Here, when the video generation means 4 2 does not generate the additional video according to the setting of the production setting means 5 4, the video composition means 4 4 selects any of the video materials read from the storage means 4 8. 4 8 c is output to the video effect means 46 as it is. As described above, the video material 48 c in which the additional video is not synthesized is also referred to as a synthesized video after being output from the video synthesis means 44.

 Further, even if the production setting means 5 4 is set so that the additional image is output from the video generation means 4 2 to the video synthesis means 4 4, as will be described later, the video synthesis means 4 4 may be set not to read video material 4 8 c. In such a case, the video composition unit 44 outputs the additional video received from the video generation unit 42 to the video effect unit 46 as it is. As described above, since the video material 48 c is not read out, the additional video that is not synthesized with the video material 48 c is also referred to as a synthesized video after being output from the video synthesis means 44.

 The video effect means 4 6 applies a predetermined video effect based on the video effect program 48 d to the composite video as a processing for the composite video output from the video composite means 44, and outputs the video signal to the projector. 2 2 Sends to a.

Here, the video effect means 4 6 operates based on the video effect program 4 8 d of the storage means 4 8, but the video effect program 4 8 d is different from the video effect means 4 6. The video effect means 46 has a plurality of video effects that can be processed by such a video effect program 48 d. One of the selected video effects is processed.

 As will be described later, the effect setting means 5 4 sets which of the image effects is processed by the image effect means 4 6 based on the image effect program 48 d. Further, the effect setting means 54 can be set so that the video effect processing by the video effect means 46 is not performed. When the video effect means 46 is set not to perform such a video effect, the received composite video is directly transmitted to the projector 2 2a.

 Also, when the device control means 50 receives information on the position, size and shape of the soles of the spectators 6 from the judgment means 40, it is shown in FIG. 2 based on the device control program 48 h. A signal for controlling the operation of the blower 3 2 and the lighting lamp 3 4 is output to the equipment controller 2 8.

 Here, as shown in FIG. 4, the device control means 50 operates the blower 3 2 and the illumination lamp 3 4 based on the device control program 48 h of the storage means 48. The device control means 50 operates the blower 3 2 and the illuminating lamp 3 4 based on any one of the operation methods selected from a plurality of operation methods in the device control program 48 h. Therefore, which operation method is used is set by the production setting means 54, as will be described later.

 When the sound control means 5 2 of the computer 3 8 receives information on the position, size and shape of the sole of the audience 6 from the judgment means 40, the sound generation program 4 8 e, the sound material 4 8 f Based on the sound effect program 48g, the sound device 30 shown in Fig. 2 outputs sound effects.

 The sound generation program 4 8 e in FIG. 4 is a program that defines the operation content for generating the sound effect when the sound control means 52 generates a new sound effect. In addition, the sound effect program 4 8 g outputs the sound and sound material 4 8 f generated based on the sound generation program 4 8 e to the acoustic control device 52 in any case and how. For example, when the sound control means 5 2 receives specific information from the judgment means 40, the sound or sound material generated based on the sound generation program 4 8 e 4 8 f On the other hand, special effects such as echo (reverberation effect) are given and output.

In addition, the sound control means 5 2 includes a sound generation program 4 8 e, a sound material 4 8 f, and a sound effect program. As will be described later, the effect setting means 54 sets the sound effect output from the sound device 30 based on the ram 48g.

 The update means 5 6 is configured such that the communication means 60 connected to the public line 58 is connected through the public line 58 to the supplementary information 4 8 a of the storage means 4 8, the video generation program 4 8 b, and the video effect program 4. 8d, sound generation program 4 8 e, sound effect program 4 8 g, or device control program 4 8 h, when new data is received from outside, the corresponding contents of storage means 4 8 The new contents received are changed.

 In addition, when the communication unit 60 receives the data of the video material 48c or the sound material 48f through the public line 58, the update unit 56 transmits the received video material 48c or sound material. The data of 48 8 f is additionally stored together with the video material 48 8 c or the sound material 48 8 f already stored in the storage means 48.

 Based on the input operation from the operation means 5 5 connected to the effect setting means 54, the effect setting means 54 is based on the judging means 40, the image generating means 42, the image synthesizing means 44, the image effect means 4 6. The operation contents of the device control means 50 and the sound control means 52 are set as follows.

 When the input operation from the operation means 5 5 is to change the setting of the determination means 40, the effect setting means 5 4 is configured so that the determination means 40 operates based on this input operation. It can be set or set so that it does not work. If the determination means 40 is set not to operate, the detection information is not acquired from the area sensors 24, 26, and the video generation means 42, the video effect means 46, the device control means 5 0 and no signal output to sound control means.

 If the input operation from the operation means 5 5 is to change the setting of the video generation means 4 2, the production setting means 5 4 uses the input operation to generate the video generation means 4 2. The program 4 8 a is set according to which theme to generate additional video. In addition, it is possible to set whether the video generation means 42 is to generate additional video or not.

When the input operation from the operation means 5 5 is to change the setting of the video composition means 4 4, the effect setting means 5 4 is based on this input operation, and the video composition means 4 4 stores the storage means. It is configured to select which of the 4 8 video materials 4 8 c is to be read. Also, the video composition means 4 4 does not read any video material 4 8 c It can also be set as follows.

 When the input operation from the operation means 5 5 is to change the setting of the video effect means 4 6, the effect setting means 5 4 determines that the video effect means 4 6 The effect program 4 8 d sets what kind of image effect is given to the composite image. In addition, it is possible to set the power to cause the video effect means 46 to perform the video effect processing, or whether to prevent such processing.

 When the input operation from the operation means 5 5 is to change the setting of the device control means 50, the production setting means 5 4 is configured so that the device control means 50 is based on this input operation. 3 2 and the lighting lamp 3 4 are set for which operation method of the equipment control program 4 8 h. In addition, it is possible to set whether or not to operate each of the blower 3 2 and the illumination lamp 3 4.

 When the input operation from the operation means 5 5 is to change the setting of the sound control means 52, the production setting means 5 4 is controlled by the sound control means 52 according to the input operation. The device 30 is configured to set what kind of sound effect is output under what circumstances. Further, the sound control means 52 can be set so that no sound effect is output from the sound device 30 at all.

 Further, the production setting means 5 4 is connected to the public line 58 via the communication means 60, and the communication means 60 is externally determined through the public line 58, as the determination means 40, the video generation means 4 2.When receiving a signal to change the setting of any one of the video composition means 44, the video effect means 46, the device control means 50, or the sound control means 52, from the operation means 55 As with the input operation, the setting of the judging means 40, the image generating means 42, the image synthesizing means 44, the image effect means 46, the device control means 50, or the sound control means 52 is changed. Next, when the spectator 6 is walking on the floor 20 0 a on which the video is displayed by the video output device 2 2 shown in FIG. The processing to be performed on the image is performed based on the flowchart shown in Fig. 9 Akira to.

Here, each of the determination means 40, the image generation means 42, the image composition means 44, the image effect means 46, the device control means 50, and the sound control means 52 shown in FIG. According to 5-4, the following settings are assumed. That is, it is assumed that the determination means 40 is set to perform a predetermined operation by the setting of the effect setting means 54.

 Also, the video generation means 42 is selected by the effect setting means 54 as one of the themes of the video generation program 48 b, and “fish shadow” is selected as the additional video. It is assumed that the setting is such that a still image is generated. · The still image of the fish shadow as the additional video is based on the contents of the video generation program 4 8 b corresponding to the theme of “fish shadow”, and the foot of the audience 6 on the floor 20 a It is generated according to the position, size and shape. Specifically, as shown in Fig. 10, with the position on the floor 20 a where the sole of the spectator 6 is in contact as a reference, the shadow of a fish that swims in any posture facing this position Pictographs are generated in any direction from the position of the sole of the foot and at any position within a predetermined range corresponding to the size and shape of the sole of the foot.

 The video composition means 44 is set so as to read out a specific video material 48c from the plurality of video materials 48c in the storage means 48. This particular video material 4 8 c is a picture of the lake surface reflected from the surrounding scenery reflected from above, and it looks like the surface of the lake appears to slightly shake. Suppose that

 Based on the position, size, and shape of the soles of the spectators 6 in contact with the floor surface 20 a, the image effect means 4 6, It is determined on the composite image received from the generating means 42, and a change is made to the pixels in the vicinity of the contour line so that the light refraction direction changes and appears to be distorted. However, it is assumed that it is set to give a video effect that spreads and changes in a ripple pattern over time. .

 When the position of the soles of the spectators 6 on the floor surface 20 a is a predetermined position, the device control means 50 has a time determined according to the size of the soles. The fan 3 2 is operated intermittently at a certain number of intervals, and the lamp 3 4 is set to flash in accordance with this, and the shape of the sole of the foot of the audience 6 is on the toe side. When the heel side has a shape separated from each other like high heels, the operation interval of the blower 3 2 and the lighting lamp 3 4 is set to be doubled accordingly. .

Based on the sound effect program 48g, the sound control means 52 receives information on the position, size and shape of the soles of the spectators 6 on the floor 20a from the judgment means 40 force. sometimes Immediately tone for stepped into puddle read from the sound material ⁴ 8 f, is assumed to be set to output.

 Also, if the position of the soles of the audience 6 on the floor 20 0 a is a predetermined position, the sound generation program 4 8 e determines the size of the soles of the feet. It is assumed that it is set to output a lightning sound with a length of sound that appears to be a lightning strike.

 When the shape of the soles of the spectators 6 is separated from each other such as the toe side and the heel side like a high-heel, the sound control means 52 corresponds to this, and the sound material 4 8 It is assumed that the sound read from f is set to apply echo (reverberation effect). The specific video material 48c read out by the video synthesizing means 44 is the processing operation (step 1 to step S5 in FIG. 9) performed by the judging means 40, the video generating means 42, and the video effect means 46. Regardless of whether the video is projected according to the passage of time or not, it is output from the video composition means 4 4 and then continuously through the video effect means 4 6. (See Fig. 4). The processing operations in step S4 and step S5 in FIG. 9 are performed on the signals of the video material 48c that are continuously output.

 When there is no spectator 6 on the floor surface 20 0 a shown in FIG. 2, the area sensors 2 4 and 2 6 do not detect anything, so the processing operations in steps S 1 to S 5 in FIG. 9 are not performed. The video generation means 4 2 generates a new additional video, the video synthesis means 4 4 does not synthesize the additional video to the video material 4 8 c, and the video effect means 4 6 does not process the video effect at all. .

 Therefore, on the floor surface 20a in Figure 2, based on the contents of the video material 48c itself, the image of the lake surface reflecting the surrounding scenery appears to slightly shake. Is projected.

In this state, when the spectator 6 enters the floor 20a and the foot is stepped on, the area sensors 2 4 and 2 6 detect this (step S1 in FIG. 9) and judge. Means 40 determines the position, size and shape of the area in which the soles of the spectators 6 are in contact with the floor surface 20 a based on the detection information acquired from the area sensors 24 and 26. (Step S2). 'Next, based on the information on the position, size, and shape of the soles of the feet of the audience 6, a video for adding shadows of fish swimming underwater is newly generated by the video generation means 42. (Step S3). This additional video is synthesized with the video material 48 c by the video synthesizing means 44 (step S 4).

 Then, for the composite image of the additional image and the image material 48c, the position, size and shape on the floor surface 20a where the soles of the audience 6 are in contact by the image effect means 46. In addition to the change in the light refraction direction that appears to be distorted for the pixels in the vicinity of the contour line corresponding to, the pixels that are subject to such changes change to ripples over time. (Step S5).

 For the second and subsequent steps of walking on the floor 20 a of the spectator 6, steps S1 to S5 are repeated as in the first step.

 Since the processing operation of such step 1 to step S5 is performed in real time, for the spectator 6 walking on the floor 20a, as shown in FIG. 10, walking on the lake surface, It appears that the shadow of the fish has come to the position of the sole of the foot in contact with the lake surface, and a ripple corresponding to the position, size and shape of the sole of the foot in contact with the lake surface is generated, and this ripple is shown in FIG. Since it appears to spread in the direction of the arrow as shown by the dashed line inside, the shadow of the fish that came near and the scenery reflected on the lake surface appear to be distorted with ripples.

 Further, immediately after the processing operation of step S2 in FIG. 9 by the determination means 40, the control of the device control means 50 and the acoustic control means 52 shown in FIG. By the operation, the acoustic device 30, the blower 32, and the illumination lamp 34 shown in FIG. 2 perform a predetermined operation based on the position, size, and shape of the sole of the audience 6.

In other words, the sound device 30 outputs a sound effect as if the foot of the spectator 6 touched the floor surface 20 a and the foot of the spectator 6 touched the puddle. Is output corresponding to the size of the soles of the audience ⁶ .

 If the position where the sole of the spectator 6 touches the floor 20 a is a predetermined position, the time corresponding to the size of the sole of the spectator 6 At intervals, the blower 3 2 operates intermittently, causing the audience 6 to feel that the wind has begun to blow, and the illuminating light 3 4 flashes, and a sound like a lightning strike is output from the acoustic device 30. Therefore, the approach of the thundercloud is simulated.

In particular, when the shape of the soles of the spectators 6 is such that the toe side and the heel side are separated from each other like high heels, the interval between the time when the blower 3 2 and the lighting lamp 3 4 operate Is twice as long, and the sound of thunderbolts output from the acoustic device 30 is echoed. 2 It feels like walking in a storm.

 Further, if the production setting means 5 4 in FIG. 4 is set so that each of the video generation means 4 2, the video synthesis means 4 4 and the video effect means 4 6 performs processing operations different from the above, the image generation means 4 2. Video composition means 4 and video effect means 46 can be used to produce different video effects.

 For example, the video composition means 4 4 is set not to read any video material 4 8 c. Also, set the video effect program 48d so that no video effect processing is performed. That is, the processing operation in step S5 in FIG. 9 is not performed.

 For the video generation means 42, the floor setting 20 4 is selected by selecting one of the rebound figures from the plurality of themes of the video generation program 48b by the production setting means 54. Corresponding to the position where the sole of the foot of the spectator 6 is in contact with a, an arbitrary geometric figure is generated as an additional image at an arbitrary position separated from this position by a certain distance. The image generation means 42 continuously generates an image whose shape moves toward the foot of the audience 6 and rebounds according to the size and shape of the sole of the audience 6 It is assumed that the settings are correct.

 If each of the image generation means 4 2, the image composition means 4 4, and the image effect means 4 6 has such a setting, it corresponds to the walking of the audience 6 on the floor surface 20 a, as shown in FIG. Since the processing operations from step S 1 to step S 4 are repeated, the spectator 6 can enjoy watching the generation of geometric figures and rebounding as they walk. Also, regarding the setting of the video generation means 4 2, a different “adhesion” is used instead of selecting the theme of “reflecting figure” from the multiple themes of the video generation program 4 8 b by the production setting means 5 4. The “graphic” theme may be selected.

 In this case, the image generation means 42 does not rebound when an arbitrary geometric figure hits the audience 6, unlike the case where the theme of “rebound shape” is selected. Corresponding to the size and shape of the sole of the foot of the spectator 6, images that appear to adhere while changing the outer shape are continuously generated. When the image generation means 4 2 is set as described above, the audience 6 on the floor 2 0 a is attached to his / her feet while deforming the geometric figure generated according to his / her walking. You can enjoy watching it.

According to the video production system 2 and the video production method according to the present embodiment, the audience 6 Since the movement of the screen and the image projected on the floor surface 20 a interact with each other, the audience 6 can feel the reality of the image by obtaining a sense of unity with such an image.

 In addition, by placing the video output device 2 2 on the lower side of the floor 20, the shadow of the spectator 6 is different from the image projected on the floor 20 a from the ceiling side. Therefore, it is possible to prevent the image projected on the floor surface 20 a from being hidden by the shadow of the spectator 6 and becoming invisible. '

 Further, the judging means 40 of the computer 3 8 is the position of the sole of the spectator 6 on the floor surface 20 a, the size, and the supplementary information 4 8 a of the storage means 4 8. Therefore, the video material 4 8 c is processed to correspond to the position, size and shape of the sole of the foot of the spectator 6 and is displayed on the floor 2 0 a. The image can be made to feel real.

 In addition, as a processing for the video material 48c, a new additional video generated by the video generation means 42 is synthesized by the video synthesis means 44, so that the production by the video is possible. The effect can be improved.

 In addition, as the video material 48c, additional video, or composite processing of the additional video and video material 48c, the video effect means 46 will give a predetermined change. It is possible to improve the production effect by the video.

 Also, as a processing process for the video material 48c, the video effect means 46 has a contour of the sole shape corresponding to the position, size and shape where the sole contacted on the floor 20a. In addition to defining the line, a change is made to the pixel near the contour line of the sole shape so that the light refraction direction changes and appears distorted. Since the image effect is such that the ripples spread and change, it is possible to produce an image as if the spectator 6 is walking on the surface of a lake or the like.

 In addition to the video production means 4 2, the video synthesis means 4 4 and the video effect means 4 6 performing video production on the video material 4 8 c projected on the floor 20 a, the audio device 3 0, because the production by the blower 3 2 and the illuminating lamp 3 4 is performed, it is possible to further improve the production effect of making the video feel realistic.

In addition, the update means 5 6 allows the communication means 60 and the public line 58 to be used to store information 4 8 a in the storage means 4 8 a, video generation program 4 8 b, video material ⁴ 8 c, and video effect program 4 8 d. Can be changed to new ones from the outside, so that various images can be displayed on the floor 2 0 a. The image material 48c can be projected, and various kinds of processing can be performed on the image 48c.

 Also, the update means 5 6 allows the sound generation program 4 8 e, the sound material 4 8 f, the sound effect program 4 8 g, and the equipment control program 4 8 of the storage means 4 8 through the communication means 60 and the public line 58. Since the content can be changed to a new one from the outside, the video material 4 8 c displayed on the floor 2 0 a and the processing performed on such video 4 8 c can be changed. The sound effect output from the audio device 30 can be changed, and the operation of the blower 32 and the lighting lamp 34 can be changed.

 In the present embodiment, the case where the present invention is applied to an image projected on the floor 20 a has been described, but the present invention is applied to an image projected on a tread such as a staircase. Moyore. In addition, it goes without saying that the present invention can also be applied to an image projected on a foot step other than a step surface such as a floor surface or a staircase.

 In the present embodiment, the rear transmissive screen 2 2 b is arranged in parallel near the lower side of the floor 20, but such a rear transmissive screen 2 2 b Is a different type of rear transmissive screen, and is in the form of a film such as “Dradd Screen (trade name)” manufactured by Kimoto Co., Ltd. A material that can be directly attached to the opposite surface may be used as a.

 In this embodiment, the image of the projector 2 2 a is projected on the rear transmissive screen 2 2 b, but instead of the rear transmissive screen 2 2 b, such a rear transmissive screen is used. A thin paper or the like that functions in the same way as 2 2 b may be placed parallel to the lower side of the floor 20 so that an image is projected on such a thin paper.

In the present embodiment, the video output device 2 ² includes a projector 2 2 a and a rear transmission screen 2 2 b, which are arranged below the floor 20. You can install the projector 2 2 a on the ceiling and project the image from the upper side on the floor 20 a. In such a case, the floor 20 should be made of a material other than a transparent material. In the present embodiment, the video output device 22 includes a projector 2 2 a and a rear transmission screen 2 2 b, which are arranged below the floor 20. Instead of the projector 2 2 a and the rear transmission screen 2 2 b, a monitor such as a plasma display may be arranged below the floor 20.

In this embodiment, the video production system 2 includes only one video output device 2 2. However, a plurality of video output devices 22 may be provided.

 In the present embodiment, as an example of the sound effect of the acoustic device 30 by the acoustic control means 52, the position where the soles of the spectators 6 are in contact with each other on the floor surface 20a is a predetermined predetermined value. The sound device 30 generates a sound like a lightning strike, and the length of this sound is determined according to the sole of the audience 6, and the sole of the audience 6 is An echo is applied when the toe side and the heel side are separated from each other. However, the sound effect output from the acoustic device 30 is not limited to this.

 For example, the sound device 30 emits a predetermined sound other than lightning when the position where the soles of the spectators 6 touch on the floor surface 20 a is a predetermined position. May be. Further, the volume, pitch, or sound quality may be changed according to any of the position, size, or shape of the soles of the spectators 6 on the floor surface 20 a.

 Further, in the present embodiment, as an example of the operation of the blower 3 2 and the illuminating lamp 3 4, the position where the soles of the spectators 6 are in contact with each other on the floor 20 a is a predetermined position. In such a case, the fan 3 2 was intermittently operated a certain number of times, and the lamp 3 4 was blinking. However, each operation of the fan 3 2 and the lamp 3 4 Les that are limited to such things.

 For example, as the operation of the blower 3 2 and the illuminating lamp 3 4, when the sole of the spectator 6 on the floor 20 0 a comes into contact with the first predetermined position, the blower 3 2 starts to blow and illuminates. When the lamp 34 is turned on and comes into contact with the second predetermined position, the blower 32 may stop blowing and the illumination lamp 34 may be turned off.

 Also, the blower 3 2 changes the strength of the wind in accordance with any one of the position, size and shape of the floor of the spectator 6 on the floor 20 a where the soles contact. May be.

 In addition, the illuminating lamp 3 4 is lit, extinguished, or blinking according to the position, size and shape of the floor of the spectator 6 on the floor 20 a where the soles of the spectators 6 are in contact. It is also possible that the interval of blinking of the lighting lamps 3 4 and the brightness when the lamps are lit change.

Further, in the present embodiment, in addition to performing an image projected on the floor surface 20 a, the sound effect is improved by providing the acoustic device 30, the blower 3 2, and the illumination lamp 3 4. However, it is possible to improve the visual effect of the image displayed on the floor 20 a by providing such a dynamic device other than the acoustic device 30, the blower 3 2, and the lamp 3 4. To do It may be. -In the present embodiment, the area sensors 24 and ²⁶ are used as a detection device for detecting the position and size of the soles of the spectators 6 on the floor 20 a. However, a plurality of individual light transmission sensors may be arranged in a line at intervals so that they function in the same manner as the area sensors 24 and 26.

 In addition, a sensor other than a light transmission type sensor such as an area sensor may be used as the detection device. For example, a pressure sensitive element or the like may be arranged on the floor 20 a to detect the position, size and shape of the sole of the audience 6. In such a case, the determination means 40 of the computer 3 8 may omit the processing operation for determining the shape of the sole of the audience 6 by referring to the supplementary information 4 8 a of the storage means 48. it can.

 In the present embodiment, the storage means 4 8 of the computer 3 8 stores the typical shape of the sole of the audience 6 as supplementary information 4 8 a, and the typical shape of the sole of the foot is stored. The shape corresponds to the combination of the position and size of the sole of the spectator 6 on the floor 20 0 a, but it corresponds to the size of the sole of the spectator 6 only. May be.

 Further, in the present embodiment, as shown in FIG. 2, the video production system 2 is constructed in the entrance passage 4, and the video is projected on the floor 20a of the video production system 2. However, the video production system 2 may be constructed in a place other than the entrance passage 4, and the video may be projected on the floor 20a of the place.

 In the present embodiment, the image displayed on the floor surface 20a interacts with the audience 6 as a moving body walking on the floor surface 20a. The video production system is not limited to this, and an object other than a person may be a moving object.

 For example, when a ring-throwing target is placed on the floor surface 20 a and the ring-throwing ring thrown toward the target touches the floor surface 20 a, the floor surface 20 The image shown in a may be processed so as to correspond to the position, size and shape of the ring. In such a case, the ring tossed instead of the spectator 6 becomes a moving body, so the supplementary information 4 8 a of the storage means 4 8 shown in FIG. 4 is replaced with the typical shape of the sole of the foot. Also remember the shape of the ring.

As another embodiment different from the present embodiment, the video production system 2 may be constructed in a bowling lane for indoor competition. In such a case, the lane corresponds to the floor 20 in the present embodiment, and the bowling ball corresponds to the moving body. Become.

 Further, in the present embodiment, each of the video generation means 4 2 and the video effect means 4 6 corresponds to the position, size and shape of the sole of the audience 6 on the floor surface 20 a in contact with each other. It was designed to generate a video for attached calorie or to process the video effect on the composite video, but either the position, size or shape of the sole of the audience 6 touching the floor 20 Based on the above, it may be so arranged that an additional video is generated or a video effect is processed on the synthesized video. In addition, based on one of the combination of the position and size of the sole of the audience 6, the combination of position and shape, or the combination of size and shape, or the video effect on the composite image The process may be performed.

 In this embodiment, the video effect means 46 corresponds to the position, size, and shape of the soles of the spectators 6 on the floor 20 a based on the video effect program 48 d. As a result, the pixels in the vicinity of the contour line on the composite image change so that the direction of light refraction changes and appears distorted. However, the video effects provided by the video effect means 46 are not limited to this, for example, the pixels that are subject to change. On the other hand, a video effect may be provided in which the brightness is changed by a predetermined amount together with or in place of such a change that the light refraction direction changes and looks distorted.

 In addition, the video effect that the video effect means 4 6 gives to the video material 4 8 c etc. corresponds to the position, size, and shape of the sole of the audience 6 on the floor 20 0 a, Part of the image may be deformed as seen through a fisheye lens, or deformed as if stretched in a certain direction, and the contents of the image effect program 4 8 d may be changed. This makes it possible to give various video effects.

In the present embodiment, the updating means 5 6 of the computer 3 8 receives the video material 4 8 c or the sound material 4 8 f when the communication means 60 receives the video material 4 8 c or the sound material 4 8 f through the public line 5 8. The recorded video material 4 8 c or sound material 4 8 f was added and stored together with the video material 4 8 c or sound material 4 8 f already stored in the storage means 4 8. However, as another embodiment, the received video material 4 8 c or sound material 4 8 f is replaced with the video material 4 8 c or sound material 4 8 f already stored in the storage means 48, In the present embodiment, the video material 48c shown in FIG. 4 has the entire data information. As a unified file, it was stored in the storage means 48, but the video material 48c is not limited to this.

 For example, real-time video captured outside the video production system 2 is transmitted to the computer 3 8 via the public line 5 8, and such video is transmitted to the computer 3 by streaming technology or the like. 8 is continuously received by the communication means 60, and after the update means 56, the storage means 48 is stored as a fragmentary video material 4 8c and buffered (held), and then the video composition means 4 4 May be read sequentially. Here, the streaming technology refers to a technology that simultaneously plays back information such as audio and video.

 In the present embodiment, the communication means 60 of the computer 38 is connected to the public line 58 and receives signals. What is the communication line for transmitting and receiving such signals? For example, it may be via the Internet. In addition, the communication means 60 is not only configured to receive signals from a communication line that can be transmitted and received bidirectionally like the public line 58, but also unilaterally such as broadcasting. You may be able to receive signals that will be transmitted.

 Further, in the present embodiment, the case where the computer 38 and the projector 22a are arranged as separate devices has been described, but these may be integrated. Brief Description of Drawings

 Figure 1

 It is a perspective view showing entrance passage 4 in which picture direction system 2 concerning one embodiment of the present invention is constructed.

 Figure 2

 1 is a block diagram showing a configuration of a video effect system 2 according to an embodiment of the present invention. FIG. Fig 3

 FIG. 3 is a perspective view showing positions where area sensors 2 4 a, 2 4 b, 2 6 a, 2 6 b arranged around a floor 20 shown in FIG. 2 are arranged.

 Fig 4

 FIG. 3 is a block diagram showing a detailed configuration of a computer 38 shown in FIG.

Fig 5 Figure 3 shows the relationship between the optical axis between area sensors 2 4 a and 2 4 b and between area sensors 2 6 a and 2 6 b, and the position and size of the soles of the audience 6 on the floor 20 a FIG.

 Fig 6

 The optical axis between the area sensors 2 4 a and 2 4 b and between the area sensors 2 6 a and 2 6 b shown in FIG. 3 and the position and size of the soles of the spectators 6 on the floor 20 a It is a top view which shows the other relationship.

 Fig 7

 The optical axis between the area sensors 2 4 a and 2 4 b and between the area sensors 2 6 a and 2 6 b shown in FIG. 3 and the position and size of the soles of the spectators 6 on the floor 20 a It is a top view which shows another relationship.

 Fig 8

 The optical axis between the area sensors 2 4 a and 2 4 b and the area sensors 2 6 a and 2 6 b shown in FIG. 3 and the position and size of the soles of the spectators 6 on the floor 20 a It is a top view which shows the other relationship.

 Fig 9

 3 is a flowchart showing the operation procedure of the computer 38 shown in FIG.

 Fig. 10

 FIG. 3 is a plan view schematically showing the soles L and R of the foot of the spectator 6 on the floor surface 20 a shown in FIG. 2 and an image projected on the floor surface 20 a. Explanation of symbols

 2 Video production system

 4 Entrance passage

 6 Audience

 8, 1 0 gate

 2 0 floor

 2 0 a Floor

 2 2 Video output device

2 2 a projector b Rear transmissive screen

, 24 a, 24 b, 26, 2 6 a, 26 b Area sensor Device adjuster

 Sound equipment

 Blower

 Lighting

 Computer

 Judgment means

 Video generation means

 Video composition means

 Image effect means

 Storage means

a Additional information

b Video generation program

c Video material

d Picture effects program

e Sound generator

f Sound material

g Sound effect program

h Device control program

 Device control means

 Sound control means

 Production setting device

 Operation means

 Update means

 Public line

 Communication means

Claims

The scope of the claims

1. a video output device for projecting video on a floor surface or a tread surface such as stairs based on the received video signal;

 A detection device for detecting the position or Z and size of the contact portion of the moving body on the floor surface or the tread surface when a moving body moving on the floor surface or the tread surface is mounted on the floor surface or the tread surface;

 The video material is held, and the video signal processed by the video material processed according to the position or / and size of the contact portion of the moving body detected by the detection device is transmitted to the video output device. Equipment and

 A video production system characterized by comprising:

 2. The floor or tread is translucent,

 2. The video effect system according to claim 1, wherein the video output device is arranged below the floor surface or the tread surface.

 3. The production control device

 While holding the typical shape of the contact portion of the moving body on the floor surface or the tread surface as supplementary information,

 When the detection device detects that one part of the moving body is in contact with the floor surface or the tread surface, based on the size of the contact part of the one part, or the position and size thereof. Determining that the shape of the contact portion is the typical shape held as the supplementary information;

 3. The video effect system according to claim 1, wherein the processing is performed not only for the position and / or size of the contact portion of the moving body but also for the shape thereof.

4. When the detection device detects that another part different from the one part has contacted after the one part of the moving body has contacted the floor surface or the tread surface, 4. The video rendering system according to claim 3, wherein the position, size, and shape of the contact portion with respect to another portion are estimated from the position, size, and shape of the contact portion on the floor surface or the tread surface with respect to the portion. Mu.

 5. The video presentation system according to any one of claims 1 to 4, wherein the processing performed on the video material by the effect control device is performed by synthesizing a newly generated additional video. .

6. The processing performed on the video material by the effect control device is performed on the video material. 5. The image production system according to any one of claims 1 to 4, wherein the video production system is performed by changing all or part.

 7. The processing performed on the video material by the effect control device is to change a part or all of the synthesized video after synthesizing a newly generated additional video to the video material to make a synthesized video. 5. The video production system according to claim 1, wherein the video production system is performed.

8. The processing applied to the video material by the effect control device changes pixels in the vicinity of the contour line corresponding to the position, size and shape of the contact portion of the moving body in the video material. 5. The video effect system according to claim 3 or 4, wherein a pixel to be changed is changed to a ripple shape as time passes.

 9. The processing applied to the video material by the effect control device is performed by synthesizing a newly generated additional video with the video material to form a composite video, and then a contact portion of the moving body in the composite video. 5. The video effect system according to claim 3 or 4, wherein a pixel in the vicinity of the contour line corresponding to the position, size, and shape of the image is changed, and the pixel to be changed is changed to a ripple shape.

 1 0. Equipped with sound device, ''

 10. The effect control device according to claim 1, wherein the sound device outputs a sound effect corresponding to a position or / and a size of a contact portion of the moving body detected by the detection device. The video production system described.

 1 1. The processing for the video material is performed based on a video processing program held by the production control device,

 The production control device has communication means, and holds when the video material or the video processing program different from the video material or the video processing program held by the production control device is received by the communication means. The video production system according to any one of claims 1 to 10, wherein the video material or the video processing program is updated to the received one.

1 2. The production control device

 Based on the sound material and sound effect program held by the effect control device, the sound device outputs the sound effect,

When the communication means receives a sound material or a sound effect program different from the sound material or the sound effect program held by the effect control device, the sound material held The video presentation system according to claim 11, wherein the video sound effect program is updated to the one received.

 1 3. With lighting device,

 The effect control device turns on, turns off, or blinks the lighting device or changes the brightness of the lighting device in accordance with the position or Z and the size of the contact portion of the moving body detected by the detection device. The video production system according to any one of claims 1 to 12.

 1 4. Equipped with air conditioner,

 The production control device starts or stops the air conditioning operation corresponding to the position or / and the size of the contact portion of the moving body detected by the detection device, or changes the air volume during operation. The video production system according to any one of claims 1 to 13.

1 5. A video output device for projecting video on a floor surface or a tread surface such as stairs based on the received video signal;

 A detection device for detecting a position and a size of a contact portion of the moving body on the floor surface or the tread surface when a moving body moving on the floor surface or the tread surface is mounted on the floor surface or the tread surface;

 An effect control device that generates an image corresponding to the position or Z and size of the contact portion of the moving object detected by the detection device and transmits the generated image to the image output device

 A video production system characterized by comprising:

 1 6. A video output device for projecting video on the floor or a tread such as stairs;

 When a moving body moving on the floor surface or the tread surface is mounted on the floor surface or the tread surface, and using a detection device that detects the position and size of the contact portion of the moving body on the floor surface or the tread surface,

 The computer automatically processes the video displayed by the video output device in accordance with the position and size of the contact portion of the moving body detected by the detection device. A video production method.