JP6403648B2 - Aerial image effect device, control method of aerial image effect device, and video system - Google Patents

Description

  The present invention relates to an aerial image effect device that displays an aerial image, a control method for the aerial image effect device, and a video system.

  In sports broadcasts and the like, a technique is being studied in which a video recording a sports player at a remote location is produced as if the player is on the spot and played in a more realistic manner. As one of such techniques, Non-Patent Document 1 discloses a technique for displaying a display image displayed on a display unit (display) as a spatial image on a space.

  In Non-Patent Document 1, an image is displayed on a display, and an aerial image of the display image is formed on a stage by an optical element, and the aerial image is moved according to the movement of an actual object on the stage. A technique for projecting an image corresponding to a shadow of an aerial image by a projection device provided at the top is disclosed. According to this technology, the aerial image is moved according to the movement of the real object, or the image corresponding to the shadow of the aerial image is projected, so that the object indicated by the aerial image is actually placed on the stage. An observer can visually recognize the image as if it existed, and a more effective performance is possible.

Hanyuool Kim, Issei Takahashi, Hiroki Yamamoto, Satoshi Maekawa, Takeshi Naemura, "MARIO: Mid-air Augmented Reality Interaction with Objects", Entertainment Computing, Volume 5, Issue 4, December 2014, pages 233-241

  In general, when reproducing video data recording an object (forming a spatial image of the image shown in the video data) and making it visible to an observer, the position of the light source in the recording environment where the object is recorded, the light from the light source By reproducing the strength, color, and the like in a playback environment for playing back video data, a more realistic effect can be achieved.

  However, in the technique disclosed in Non-Patent Document 1, information such as the position of the light source in the recording environment, the intensity of light from the light source, and the color is not sufficiently taken into consideration, and the presence is more realistic. There is a problem that it is difficult for the viewer to visually recognize the aerial image in this manner.

  For example, when a light source illuminates an object from an oblique direction in a recording environment, it is necessary to project an image corresponding to a shadow extending in the oblique direction in the reproduction environment for a realistic effect. Even in the technique disclosed in Non-Patent Document 1, it is possible to project an image corresponding to a shadow extending in an oblique direction as if illuminated from an oblique direction.

  However, in the technique disclosed in Non-Patent Document 1, an image corresponding to a shadow of an aerial image is only projected by a projection device provided on the upper part of the stage. Therefore, even if an image corresponding to a shadow extending obliquely from the aerial image according to the recording environment is projected by the projection device, the projection device provided above the stage is recognized as a light source when viewed from the observer. There is a fear. As a result, the viewer may feel uncomfortable due to a visual contradiction that the shadow extends in an oblique direction even though the light source is provided on the upper part of the stage. Since such a sense of incongruity impairs a sense of reality in video reproduction, the technique disclosed in Non-Patent Document 1 has a problem that it is difficult for an observer to visually recognize an aerial image in a more realistic manner. .

  An object of the present invention is to provide a spatial image rendering device, a control method for a spatial image rendering device, and a video system that can solve the above-described problems and allow an observer to visually recognize a spatial image in a more realistic manner. It is in.

  In order to solve the above problems, the aerial image rendering device according to the present invention is a spatial image rendering device that reproduces the video data by forming a spatial image of the video shown in the video data recording the object, Information relating to the light source in the recording environment, as environment presentation means for producing the reproduction environment, including at least a display device for displaying video in the reproduction environment for reproducing the video data, and recording environment information relating to the recording environment of the object Recording environment information acquisition means for acquiring the recording environment information, and reproduction control means for controlling the environment rendering means according to the recording environment information acquired by the recording environment information acquisition means, wherein the reproduction control means As the control of the environmental effect means according to environmental information, the point of the light source device at the position in the reproduction environment corresponding to the position of the light source in the recording environment Display of the image corresponding to the shadow of the object caused by the light source in the recording environment by the display device according to the position where the aerial image is formed, and the image corresponding to the light from the light source in the recording environment At least two of the displays by the display device are performed.

  In addition, in order to solve the above problems, the control method of the aerial image rendering device according to the present invention is a spatial image rendering that reproduces the video data by forming a spatial image of the video shown in the video data recording the object. An apparatus control method, according to the acquisition step of acquiring information about a light source in the recording environment as recording environment information about the recording environment of the object, and the recording environment information acquired by the recording environment information acquisition unit And a control step for controlling an environment rendering means for rendering the playback environment, including at least a display device for displaying the video in a playback environment for reproducing the video data. In the control step, the recording environment information As a control of the environment effect means according to the position of the light source apparatus A display corresponding to the position at which the aerial image is formed, and an image corresponding to light from the light source in the recording environment. The display by the display device is performed at least two times.

  In order to solve the above problems, a video system according to the present invention includes a recording side for recording an object, and the recording side connected to the recording side via a network, and the video data on which the object is recorded is recorded on the recording side. A playback side that plays back the acquired video data, and plays back the video data by forming a spatial image of the video indicated by the video data on the playback side. An aerial image effect device is provided, and the aerial image effect device includes at least a display device that displays an image in a reproduction environment for reproducing the video data, an environmental effect means for effecting the reproduction environment, and the object Recording environment information acquisition means for acquiring information relating to the light source in the recording environment as recording environment information related to the recording environment, and information acquired by the recording environment information acquisition means Reproduction control means for controlling the environmental effect means according to the recording environment information, and the reproduction control means controls the environment effect means according to the recording environment information at the position of the light source in the recording environment. Lighting of the light source device at the corresponding position in the reproduction environment, display by the display device according to the position where the aerial image is formed corresponding to the shadow of the object generated by the light source in the recording environment, and At least two of the display corresponding to the light from the light source in the recording environment are displayed by the display device.

  According to the aerial image effect device, the control method of the aerial image effect device, and the video system according to the present invention, the aerial image can be visually recognized by the observer in a more realistic manner.

It is a figure which shows the outline | summary of the aerial image production apparatus which concerns on one Embodiment of this invention. It is a figure which shows the example of whole structure of the aerial image production apparatus shown in FIG. It is a figure which shows an example of the structure for forming an aerial image. It is a figure which shows another example of the structure for forming an aerial image. It is a figure which shows another example of the structure for forming an aerial image. It is a figure which shows the structure of the control apparatus shown in FIG. It is a figure which shows the example of control of the environmental presentation means by the reproduction | regeneration control part shown in FIG. It is a figure which shows the example of control of the environmental presentation means by the reproduction | regeneration control part shown in FIG. It is a figure which shows the example of control of the environmental presentation means by the reproduction | regeneration control part shown in FIG.

  Embodiments of the present invention will be described below.

  FIG. 1 is a diagram showing an overview of an aerial image effect device 10 according to an embodiment of the present invention. The aerial image effect device 10 according to the present embodiment is provided on the reproduction side in a video system including a recording side for recording the object 1 and a reproduction side for reproducing the video data on which the object 1 is recorded on the recording side. The video data is reproduced by forming a spatial image of the video shown in the video data. For example, the recording side and the reproduction side are connected via a network, and the reproduction side can acquire video data from the recording side via the network.

  The aerial image effect device 10 shown in FIG. 1 receives and inputs media information (video data) obtained by photographing (recording) an object 1 (for example, a sports athlete during a competition) with the photographing device 2. The aerial image 3 shown in the media information is formed on the stage 4 to reproduce the video data so that the viewer 5 can visually recognize it. In addition, at the time of imaging | photography of the target object 1, an audio | voice may be recorded together and the recorded audio | voice data may be contained in media information. Further, as media information, recording side environment information (recording environment information) such as lighting information and wind direction information in the recording environment of the video data may be recorded together with the video data. The media information may be stored in a recording medium or distributed to a remote place through a network.

  FIG. 2 is a diagram showing an example of the overall configuration of the aerial image effect device 10 shown in FIG.

  The aerial image effect device 10 shown in FIG. 2 includes an aerial image projection device 11, a projector 12, an illumination device 13, a light source device 14, a blower / air conditioner 15, a smoke generator 16, a speaker 17, and a reproduction. An environment information acquisition unit 18 and a control unit 100 are provided. The projector 12, the illumination device 13, the light source device 14, the blower / air conditioning device 15, the smoke generating device 16, and the speaker 17 are examples of environmental effect means for performing effects in a reproduction environment (stage 4 and its surroundings) for reproducing video data. is there. In addition to the various devices shown in FIG. 2, the environmental performance means includes a terrain control device that controls the inclination and undulation of the stage 4.

  The aerial image projection device 11 is provided facing the floor surface 4a of the stage 4, and is, for example, a projector. The floor surface 4a acts as a screen (display unit), and the aerial image projection device 11 projects (displays) an image shown in the media information (video data) on the floor surface 4a (screen) according to the control of the control unit 100. . By this display, a spatial image of a display image (video displayed in the video data) is formed. Details of the method for forming the aerial image will be described later.

  The projector 12 is a display device that displays (projects) an image (for example, an image 3 a corresponding to the shadow of the formed aerial image 3) in the reproduction environment under the control of the control unit 100.

  The illumination device 13 illuminates the reproduction environment according to the control of the control unit 100.

  The light source device 14 is a light source device such as an LED (Light Emitting Diode), for example, and lights up according to the control of the control unit 100. Here, the light source device 14 is provided so as to be recognized as a light source in the reproduction environment when viewed from the observer 5 who observes the aerial image 3, and is not intended for illumination of the stage 4. Therefore, the light source device 14 is provided at a position that can be viewed by the observer 5, and is viewed by the observer 5 as if the light source device 14 is illuminating the aerial image. As described above, since the light source device 14 is not intended for illumination of the stage 4, a portion of the light source device 14 that faces the stage 4 is disposed so that light from the light source device 14 does not enter the stage 4. A weathering may be performed. However, when the light from the light source device 14 does not greatly affect the display on the stage 4, such a scale may not be provided.

  The blower / air conditioner 15 controls air conditioning (wind direction, wind speed), temperature, humidity, and the like in the reproduction environment according to the control of the control unit 100.

  The smoke generator 16 generates smoke (fog) in the reproduction environment according to the control of the control unit 100.

  The speaker 17 controls sound in the reproduction environment according to the control of the control unit 100.

  As described above, the projector 12, the illumination device 13, the light source device 14, the air blower / air conditioner 15, the smoke generator 16 and the speaker 17 which are the environment presentation means produce the reproduction environment (reproduction) for reproducing information media (video data). Lighting control, air conditioning control, acoustic control, smoke generation, video display, etc. in the environment can be performed. Note that a plurality of light source devices 14 are arranged around the stage 4 or provided so as to be movable around the stage 4.

  The reproduction environment information acquisition unit 18 is, for example, a photographing device, photographs the reproduction environment of information media (video data), and acquires various information from the photographed video.

  The control unit 100 is, for example, a personal computer, and receives media information and causes the aerial image projection device 11 to display an image indicated by the input media information (video data). A spatial image of the display image is formed on the stage 4 by displaying the video by the aerial image projector 11.

  In addition, the control unit 100 acquires recording environment information that is information related to the recording environment of video data in response to the input of media information, and controls each device that is an environment rendering unit in accordance with the acquired recording environment information. . Specifically, the control unit 100 acquires information about the light source in the recording environment (such as the position of the light source, the color of light from the light source, and the intensity) as the recording environment information, and turns on the light according to the acquired information. It controls the position of the light source device 14 and the projection (display) of images by the projector 12.

  Next, formation of the aerial image will be described with reference to FIGS. 3 to 5, the same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted.

  FIG. 3 is a diagram illustrating an example of a configuration for forming an aerial image.

  In FIG. 3, the screen 20 as a display unit is provided substantially horizontally with respect to the observation direction (X direction) of the observer 5. The screen 20 corresponds to the floor surface 4a of the stage 4 in FIG. The aerial image projection device 11 is, for example, a projector, is provided on one surface (lower surface) side of the screen 20, and projects (displays) an image on the screen 20 under the control of the control unit 100.

  A transparent plate 21 that is an optical element is provided on the other surface (upper surface) side of the screen 20. The transparent plate 21 is inclined by approximately 45 ° toward the observer 5 side (in the −X direction) when viewed from the screen 20. In response to the display of the image on the screen 20, the light emitted from the screen 20 enters the transparent plate 21 and is directed in the direction toward the observer 5 on the transparent plate 21. By doing so, a spatial image B (virtual image) of the display image A displayed on the screen 20 is formed substantially perpendicular to the screen 20 and is visually recognized by the observer 5.

  FIG. 4 is a diagram illustrating another example of a configuration for forming an aerial image.

  A real image mirror 22 which is an optical element is provided on the upper surface side of the screen 20. The real image mirror 22 is inclined by approximately 45 ° toward the opposite side of the observer 5 as viewed from the screen 20 (in the X direction). In response to the display of the image on the screen 20, the light emitted from the screen 20 enters the real image mirror 22 and is directed toward the observer 5 in the real image mirror 22. By doing so, a spatial image B (real image) of the display image A displayed on the screen 20 is formed substantially perpendicular to the screen 20 and is visually recognized by the observer 5. In addition, when FIG. 3 and FIG. 4 are compared, the upper and lower sides of the displayed display image A are reversed.

  3 and 4, an example in which the aerial image projector 11 projects an image from the lower surface of the screen 20 has been described. However, the aerial image projector 11 projects an image from the upper surface of the screen 20 as illustrated in FIG. 2. May be. In this case, the aerial image of the display image on the screen 20 is formed by using an optical element that transmits the projection light from the aerial image projector 11 and directs the emitted light from the screen 20 toward the observer 5. Can do.

  3 and 4, an image is displayed (projected) on the screen 20 by the aerial image projection device 11, and light emitted from the screen 20 corresponding to the display is displayed by the optical element (transparent plate 21, real image mirror 22). Although an example of forming an aerial image by directing in the direction toward the observer 5 has been described, the present invention is not limited to this. For example, the aerial image projection device 11 may be configured by a liquid crystal device, a display surface of the liquid crystal device may be provided at the position of the screen 20, and an aerial image may be formed by displaying an image on the display surface.

  FIG. 5 is a diagram showing still another example of a configuration for forming an aerial image. In FIG. 5, an example in which an aerial image is formed using a see-through screen 23 instead of the screen 20 will be described.

  The see-through screen 23 is provided so as to face the observer 5 (substantially perpendicular to the X direction). The see-through screen 23 is a substantially transparent screen, and the image projected by the aerial image projection device 11 from one surface side (the surface opposite to the surface facing the observer 5) is used as the aerial image as the observer 5. The background behind the see-through screen 23 can also be visually recognized by the observer 5 in a portion other than the projected portion. Accordingly, the display image of the see-through screen 23 and the background behind the see-through screen 23 can be superimposed on the front and back to be viewed by the observer 5. In addition, since the fog screen which projects an image | video on the fog generated artificially brings the same effect as a see-through screen, you may use a fog screen.

  Next, the configuration of the control unit 100 will be described with reference to FIG.

  The control unit 100 illustrated in FIG. 6 includes a recording environment information acquisition unit 101 (recording environment information acquisition unit) and a reproduction control unit 102 (reproduction control unit).

  The recording environment information acquisition unit 101 acquires recording environment information related to the recording environment of the media information (video data) in response to the input of the media information, and outputs the acquired recording environment information and media information to the playback control unit 102. Here, the recording environment information acquisition unit 101 acquires information about the light source in the recording environment (the position of the light source, the color and intensity of light from the light source, etc.) as the recording environment information. Note that the recording environment information acquisition unit 101 acquires the recording environment information by analyzing the video indicated in the video data, or acquires it from a sensor (such as an optical sensor) provided in the recording environment. The recording environment information acquisition unit 101 can also acquire recording environment information with reference to control information such as recording-side illumination and air volume during recording.

  The reproduction control unit 102 displays the video indicated by the media information (video data) output from the recording environment information acquisition unit 101 on the aerial image projection device 11, and if the audio information is included in the media information, The audio data is reproduced on the speaker 17. Further, the reproduction control unit 102 controls each device that is an environment effect unit based on the recording environment information output from the recording environment information acquisition unit 101.

  FIG. 7 is a diagram showing an example of control of the environmental effect means by the reproduction control unit 102.

  The reproduction control unit 102 causes the aerial image projection device 11 to display the video indicated by the video data (video recording the target object) on the floor surface 4a (screen) of the stage 4. By this display, a spatial image 3 of the video shown in the video data is formed.

  Further, the reproduction control unit 102 controls the projector 12 and the light source device 14 according to the recording environment information output from the recording environment information acquisition unit 101.

  For example, the reproduction control unit 102 controls the position and inclination of the light source device 14 to be turned on according to the position and inclination of the light source in the recording environment indicated by the recording environment information. Specifically, the reproduction control unit 102 has one or a plurality of light source devices whose positional relationship with the aerial image 3 matches the relative positional relationship between the object 1 and the light source (virtual light source 6) in the recording environment. 14 is turned on. As described above, a plurality of light source devices 14 are arranged around the stage 4 or are provided so as to be movable around the stage 4. Therefore, the reproduction control unit 102 turns on the light source device 14 provided at a position where the relative positional relationship with the aerial image 3 matches the relative positional relationship between the object 1 and the virtual light source 6 in the recording environment. Alternatively, the light source device 14 is moved to such a position and turned on.

  In addition, the playback control unit 102 causes the projector 12 to display a video 3a (black video) corresponding to a shadow generated when the object is illuminated from the position of the light source (virtual light source 6) in the recording environment. However, the projector 12 cannot directly project a black image corresponding to a shadow. Therefore, the projector 12 projects an image whose portion corresponding to the shadow is black. By doing so, the video 3a corresponding to the shadow can be displayed. Further, instead of displaying the video 3a corresponding to the shadow by the projector 12, a display may be arranged on the floor surface 4a of the stage 4, and the video 3a corresponding to the shadow may be displayed by this display. Note that the reproduction control unit 102 generates the video 3a corresponding to the shadow of the aerial image, for example, by binarizing the aerial image and changing the aspect ratio.

  Further, the reproduction control unit 102 causes the projector 12 to project an image 3b (for example, a light trajectory of the virtual light source 6) corresponding to the light from the light source (virtual light source 6) in the recording environment.

  As described above, the reproduction control unit 102 turns on the light source device 14 at a position corresponding to the virtual light source 6 in the recording environment, and further corresponds to the image 3 a corresponding to the shadow generated by the virtual light source 6 and the light from the virtual light source 6. The image 3b to be displayed is displayed on the projector 12.

  As described above, the light source device 14 is provided at a position that can be viewed by the observer 5, and in the reproduction environment, the light source device 14 is visually recognized by the observer 5 as if the light source device 14 is illuminating the aerial image. Is done. Then, by turning on the light source device 14 at a position corresponding to the virtual light source 6 in the recording environment, it is as if the positional relationship between the object 1 and the light source in the recording environment and the aerial image 3 and the aerial image 3 in the reproduction environment are illuminated. As a result, a visual contradiction does not occur in the positional relationship with the light source device 14 that is visually recognized.

  Further, in the present embodiment, the reproduction control unit 102 applies the image 3a corresponding to the shadow generated when the object 1 is illuminated from the position of the light source (virtual light source 6) in the recording environment and the light from the virtual light source 6 to the light. The corresponding video 3b is displayed on the projector 12. For this reason, the viewer 5 can visually recognize the shadow or light trajectory as a result of illumination by the light source device 14, so that a more realistic effect can be achieved without causing visual contradiction. .

  In addition, as the control of the environment effect device (light source device 14 and projector 12) according to the recording environment information, the above-described control of the position of the light source device 14 to be turned on and the object generated by the light source (virtual light source 6) in the recording environment It is not always necessary to perform all of the display of the image 3a corresponding to the shadow of the image 3 and the display of the image 3b corresponding to the light from the virtual light source 6. By performing a combination of at least two of these three, the observer 5 can be made aware of the position and direction of the light source in the reproduction environment.

  For example, even if the light source device 14 is not turned on (not provided), only by displaying the video 3a corresponding to the shadow of the object generated by the virtual light source 6 and the video 3b corresponding to the light from the virtual light source 6, The observer 5 can grasp the position and direction of the light source in the reproduction environment.

  The recording environment information acquisition unit 101 not only includes information on the light source in the recording environment, but also information on the wind direction, wind speed, temperature, humidity, fog generation, topography (tilt and undulation) of the recording environment, and the like as the recording environment information. You may get it. The recording environment information acquisition unit 101 acquires information such as wind direction, wind speed, temperature, and humidity in the recording environment from, for example, sensors (anemometer, thermometer, hygrometer) provided in the recording environment. The recording environment information acquisition unit 101 acquires information such as the topography (tilt and undulation) of the recording environment from a depth sensor or a laser range finder provided in the recording environment.

  Then, the playback control unit 102 may control various devices of the environment effect unit according to various information acquired as the recording environment information by the recording environment information acquisition unit 101. Another control example of the environment effect means by the reproduction control unit 102 will be described with reference to FIGS.

  FIG. 8 is a diagram illustrating an example of wind (wind direction, wind speed) control by the regeneration control unit 102.

  When the recording environment information indicates information related to wind in the recording environment (wind direction, wind speed), the reproduction control unit 102 controls the blower / air conditioner 15 so as to reproduce the wind direction and wind speed. Specifically, the reproduction control unit 102 causes the blower / air conditioner 15 to blow at a wind speed in the recording environment from a direction that matches the wind direction in the recording environment. When the wind direction and the wind speed in the reproduction environment are controlled, a plurality of the air blower / air conditioners 15 are arranged around the stage 4 or can be moved around the stage 4, and the reproduction control unit 102 records The air blower / air conditioner 15 that can blow air from the direction that matches the wind direction in the environment or the air blower / air conditioner 15 is moved to such a position to blow air.

  In addition, by providing the entity 7 (for example, a flag) that is affected by the air blow by the air blower / air conditioner 15 on the stage 4, it is possible to make the viewer visually recognize the aerial image in a more realistic manner.

  FIG. 9 is a diagram illustrating an example of terrain (undulation) control by the reproduction control unit 102.

  When the recording environment information indicates the terrain (undulation) information of the recording environment, the reproduction control unit 102 controls a terrain control device (not shown in FIG. 2) so as to reproduce the undulation. The terrain control device is a device that enables vertical movement for each area of the stage 4 by an actuator such as a solenoid or a hydraulic pump, as shown in FIG. The reproduction control unit 102 controls the terrain control device so that the area moves up and down according to the undulations indicated in the recording environment information.

  For example, an aerial image (for example, a background image) may be further displayed behind the aerial image 3. Further, an image may be displayed on the back surface or side surface of the stage 4. In this case, it is preferable to synchronize the display of the aerial image 3 with the display of another aerial image or the display of the video on the back surface or the side surface using a time stamp. By doing so, it is possible to prevent the display timing of each image from being shifted.

  Moreover, it is preferable to synchronize the illumination effect of the stage 4 by the illuminating device 13 (color and intensity of light, direction of light) and the lighting state of the light source device 14 using a time stamp or absolute time synchronization. In this way, when illumination is performed by the light source device 14, the viewer 5 is made to visually recognize and a more realistic effect is possible.

  In addition, the playback environment information acquisition unit 18 captures the display state of the video on the stage 4, and the playback control unit 102 determines whether or not a desired effect is performed from the captured image, and the desired effect is obtained. If it is determined that it has not been performed, each device that is an environmental effect means may be controlled again.

  As described above, the aerial image rendering device 10 according to the present embodiment relates to an environment rendering means for rendering a playback environment, including at least the projector 12 that is a display device that displays video in the playback environment, and a recording environment for the object. As recording environment information, a recording environment information acquisition unit 101 (recording environment information acquisition unit) that acquires information about a light source in the recording environment, and a reproduction control unit 102 (reproduction) that controls the environment effect unit according to the acquired recording environment information Control means). The reproduction control unit 102 controls the environmental effect unit according to the recording environment information, such as lighting the light source device 14 at a position in the reproduction environment corresponding to the position of the light source in the recording environment, and shadowing of an object caused by the light source in the recording environment. At least two of the display by the projector 12 corresponding to the position where the aerial image of the video 3a corresponding to is formed and the display by the projector 12 of the video 3b corresponding to the light from the light source in the recording environment are performed.

  At least two of the control of the position of the light source device 14 to be turned on, the display of the video 3a corresponding to the shadow of the object caused by the light source in the recording environment, and the display of the video 3b corresponding to the light from the light source in the recording environment In combination, the position and illumination direction of the light source in the recording environment can be more accurately recognized by the observer in the playback environment, thus preventing visual inconsistencies and creating a more realistic space. An image can be visually recognized by an observer.

  Although the present invention has been described based on the drawings and embodiments, it should be noted that those skilled in the art can easily make various variations or modifications based on the present disclosure. Therefore, it should be noted that these variations or modifications are included in the scope of the present invention.

DESCRIPTION OF SYMBOLS 10 Aerial image production device 11 Aerial image projection device 12 Projector 13 Illumination device 14 Light source device 15 Air-conditioning / blower device 16 Smoke generating device 17 Speaker 18 Playback environment information acquisition unit 100 Control unit 101 Recording environment information acquisition unit 102 Playback control unit

Claims (4)

A spatial image rendering device for reproducing the video data by forming a spatial image of the video shown in the video data recording the object,
An environment rendering means for rendering the playback environment, including at least a display device for displaying the video in a playback environment for playing the video data;
Recording environment information acquisition means for acquiring information about a light source in the recording environment as recording environment information about the recording environment of the object;
Playback control means for controlling the environment effect means according to the recording environment information acquired by the recording environment information acquisition means,
The reproduction control means turns on the light source device at a position in the reproduction environment corresponding to the position of the light source in the recording environment as the control of the environment rendering means according to the recording environment information, and in the recording environment Display of an image corresponding to a shadow of the object generated by a light source by the display device according to a position where the aerial image is formed, and display of an image corresponding to light from the light source in the recording environment by the display device have a row at least one of the,
The light source device is provided so as to be visible to an observer who observes the aerial image, and is provided so that light from the light source device does not enter the reproduction environment. Production device. The aerial image effect device according to claim 1 ,
The recording environment information acquisition means acquires the recording environment information by a video provided in the video data or a sensor provided in the recording environment. A method for controlling an aerial image rendering device that reproduces the video data by forming a spatial image of the video shown in the video data recording the object,
An acquisition step of acquiring information on a light source in the recording environment as recording environment information on the recording environment of the object;
A control step for controlling an environment rendering means for rendering the playback environment, including at least a display device that displays video in a playback environment for playing the video data in accordance with the acquired recording environment information;
In the control step, as the control of the environment effect unit according to the recording environment information, the light source device is turned on at the position in the reproduction environment corresponding to the position of the light source in the recording environment, and the light source in the recording environment Display of the image corresponding to the shadow of the object generated by the display device according to the position where the aerial image is formed, and display of the image corresponding to the light from the light source in the recording environment by the display device. have a row at least one,
The light source device is provided so as to be visible from an observer who observes the aerial image, and is provided so that light from the light source device does not enter the reproduction environment. . A recording side for recording an object and the recording side are connected to the recording side via a network, and video data on which the object is recorded is acquired from the recording side via the network, and the acquired video data is reproduced. With a playback side,
The reproduction side is provided with a spatial image effect device for reproducing the video data by forming a spatial image of the video shown in the video data,
The aerial image rendering device is
An environment rendering means for rendering the playback environment, including at least a display device for displaying the video in a playback environment for playing the video data;
Recording environment information acquisition means for acquiring information about a light source in the recording environment as recording environment information about the recording environment of the object;
Playback control means for controlling the environment effect means according to the recording environment information acquired by the recording environment information acquisition means,
The reproduction control means turns on the light source device at a position in the reproduction environment corresponding to the position of the light source in the recording environment as the control of the environment rendering means according to the recording environment information, and in the recording environment Display of an image corresponding to a shadow of the object generated by a light source by the display device according to a position where the aerial image is formed, and display of an image corresponding to light from the light source in the recording environment by the display device have a row at least one of the,
The light source device is provided so as to be visible from an observer who observes the aerial image, and is provided so that light from the light source device does not enter the reproduction environment. .

Images