JP6400551B2 - Aerial image effect device, control method of aerial image effect device, and video system - Google Patents

Description

  The present invention relates to an aerial image effect device that displays an aerial image, a control method for the aerial image effect device, and a video system.

  In sports broadcasts and the like, a technique is being studied in which a video recording a sports player at a remote location is produced as if the player is on the spot and played in a more realistic manner. As one of such techniques, Non-Patent Document 1 discloses a technique for displaying a display image displayed on a display unit (display) as a spatial image on a space.

  In Non-Patent Document 1, an image is displayed on a display, and an aerial image of the display image is formed on a stage by an optical element, and the aerial image is moved according to the movement of an actual object on the stage. A technique for projecting an image corresponding to a shadow of an aerial image by a projection device provided at the top is disclosed. According to this technology, the aerial image is moved according to the movement of the real object, or the image corresponding to the shadow of the aerial image is projected, so that the object indicated by the aerial image is actually placed on the stage. An observer can visually recognize the image as if it existed, and a more effective performance is possible.

Hanyuool Kim, Issei Takahashi, Hiroki Yamamoto, Satoshi Maekawa, Takeshi Naemura, "MARIO: Mid-air Augmented Reality Interaction with Objects", Entertainment Computing, Volume 5, Issue 4, December 2014, pages 233-241

  In general, when video data recording an object is reproduced (a spatial image of the video shown in the video data is formed) and viewed by an observer, an aerial image and a real object (real object) are created in a reproduction environment for reproducing the video data. By arranging the body together (which may be an actual person), it is possible to improve the reality of the aerial image and to make the production more realistic.

  However, in the playback environment, when only the real object is affected by the playback environment and the aerial image is not affected by the playback environment, it is difficult to perceive that the real object and the aerial image exist in the same place. There is.

  For example, when a shadow is generated on a real object by illumination that illuminates the playback environment, this illumination does not cause a shadow on the aerial image, so only the real object has a shadow due to illumination, and the real object and the aerial image are the same. It becomes difficult to perceive as existing at a place. In addition, when a video is projected into the reproduction environment by the projector, a shadow is generated in the reproduction environment by the real object, and the reproduction environment cannot be sufficiently reproduced.

  An object of the present invention is to provide a spatial image rendering device, a control method for a spatial image rendering device, and a video system that can solve the above-described problems and allow an observer to visually recognize a spatial image in a more realistic manner. It is in.

In order to solve the above-described problems, an aerial image rendering device according to the present invention reproduces the video data by forming a spatial image of the video indicated by the video data recorded on the recording side for recording the object. A rendition environment information acquisition unit for acquiring video in a reproduction environment for reproducing the video data, and position information of a real object existing in the reproduction environment, and the reproduction environment information acquisition unit. Comparing the video in the playback environment with the video to be displayed in the playback environment when the real object does not exist in the playback environment, and complementary video information for reducing the influence of the real object a control unit for calculating and displaying an image based on the complementary video information, and the complementary image projector to reduce the influence of the real object, in the light source in the recording side of the recording environment which records the object That and a projector for displaying a shadow of the aerial image corresponding to a shadow caused by a virtual light source, the projector is also characterized in that displaying a shadow of the real object corresponding to the shadow caused by the virtual light source.

In order to solve the above problems, the control method of the aerial image rendering device according to the present invention is characterized in that the video data is formed by forming a spatial image of the video indicated by the video data recorded on the recording side for recording the object. A method for controlling an aerial image rendering device for reproducing a video, the step of obtaining a video in a reproduction environment for reproducing the video data, and position information of a real object existing in the reproduction environment, and the acquired reproduction Comparing a video in the environment with a video to be displayed in the playback environment when the real object does not exist in the playback environment, and calculating complementary video information for reducing the influence of the real object If, by displaying an image based on the complementary video information, comprising the steps of reducing the influence of the real object, the virtual light source is a light source in the recording side of the recording environment which records the object And displaying the shadow of the aerial image corresponding to the shadow Jill, the steps also display a shadow of the real object corresponding to the shadow caused by the virtual light source.

In order to solve the above problems, a video system according to the present invention includes a recording side for recording an object, and the recording side connected to the recording side via a network, and the video data on which the object is recorded is recorded on the recording side. A playback side that plays back the acquired video data, and plays back the video data by forming a spatial image of the video indicated by the video data on the playback side. A spatial image rendering device is provided, and the spatial image rendering device includes a playback environment information acquisition unit that acquires video in a playback environment for playing back the video data, and position information of a real object existing in the playback environment; Comparing the video in the playback environment acquired by the playback environment information acquisition unit with the video to be displayed in the playback environment when the real object does not exist in the playback environment, A control unit for calculating a complementary video information for reducing the effects of, and displays an image based on the complementary video information, and the complementary image projector to reduce the influence of the real object, the record containing the object A projector that displays a shadow of the aerial image corresponding to a shadow generated by a virtual light source that is a light source in the recording environment on the side, and the projector also displays a shadow of the real object corresponding to the shadow generated by the virtual light source It is characterized by doing .

  According to the aerial image effect device, the control method of the aerial image effect device, and the video system according to the present invention, the aerial image can be visually recognized by the observer in a more realistic manner.

It is a figure which shows the outline | summary of the aerial image production apparatus which concerns on one Embodiment of this invention. It is a figure which shows the example of whole structure of the aerial image production apparatus shown in FIG. It is a figure which shows an example of the structure for forming an aerial image. It is a figure which shows another example of the structure for forming an aerial image. It is a figure which shows another example of the structure for forming an aerial image. It is a figure for demonstrating an example which reduces the influence of a real object within reproduction environment. It is a figure for demonstrating another example which reduces the influence of a real object within reproduction environment.

  Embodiments of the present invention will be described below.

  FIG. 1 is a diagram showing an overview of an aerial image effect device 10 according to an embodiment of the present invention. The aerial image effect device 10 according to the present embodiment is provided on the reproduction side in a video system including a recording side for recording the object 1 and a reproduction side for reproducing the video data on which the object 1 is recorded on the recording side. The video data is reproduced by forming a spatial image of the video shown in the video data. For example, the recording side and the reproduction side are connected via a network, and the reproduction side can acquire video data from the recording side via the network.

  The aerial image effect device 10 shown in FIG. 1 is an aerial image of an image shown in media information (video data) obtained by shooting (recording) an object 1 (for example, a sports athlete in competition) by a shooting device 2. 3 is formed on the stage 4 to reproduce the video data so that the observer 5 can visually recognize it. In addition, at the time of imaging | photography of the target object 1, an audio | voice may be recorded together and the recorded audio | voice data may be contained in media information. Further, as media information, recording side environment information (recording environment information) such as lighting information and wind direction information in the recording environment of the video data may be recorded together with the video data. The media information may be stored in a recording medium or distributed to a remote place through a network.

  FIG. 2 is a diagram showing an example of the overall configuration of the aerial image effect device 10 shown in FIG.

  The aerial image effect device 10 shown in FIG. 2 includes an aerial image projection device 11, a projector 12, an illumination device 13, a light source device 14, a blower / air conditioner 15, a smoke generator 16, a speaker 17, and a reproduction. An environment information acquisition unit 18, a complementary video projector 19, and a control unit 100 are provided. The projector 12, the illumination device 13, the light source device 14, the blower / air conditioning device 15, the smoke generating device 16, and the speaker 17 are examples of environmental effect means for performing effects in a reproduction environment (stage 4 and its surroundings) for reproducing video data. is there.

  The aerial image projection device 11 is provided facing the floor surface 4a of the stage 4, and is, for example, a projector. The floor surface 4a acts as a screen (display unit), and the aerial image projection device 11 projects (displays) an image shown in the media information (video data) on the floor surface 4a (screen) according to the control of the control unit 100. . By this display, a spatial image of a display image (video displayed in the video data) is formed. Details of the method for forming the aerial image will be described later.

  Under the control of the control unit 100, the projector 12 displays (projects) images (for example, an image 3a corresponding to the shadow of the formed aerial image 3 and an image 6a corresponding to the shadow of the real object 6) in the reproduction environment. Display device. Here, the shadow 3 a of the aerial image 3 is a shadow image corresponding to a shadow generated by a light source (hereinafter also referred to as “virtual light source”) in the recording environment of the target object 1 displayed as a video by the projector 12. It is. In addition, the shadow 6a of the real object 6 is obtained by causing the projector 12 to display a shadow image 6a corresponding to a shadow generated when the real object 6 is illuminated from the direction of the virtual light source. Here, it is assumed that the real object 6 includes things that are not merely objects, such as a person who performs together with the aerial image 3 on the stage 4.

  For example, the projector 12 may display (project) an image on the back surface or side surface of the stage 4. A plurality of projectors 12 may be provided in accordance with the application. For example, a rear image and a side image may be displayed (projected) by different projectors 12. Instead of displaying (projecting) an image on the back and side surfaces of the stage 4 with the projector 12, a display may be installed on the back and side surfaces of the stage 4, and the image may be displayed on the display.

  The illumination device 13 illuminates the reproduction environment according to the control of the control unit 100.

  The light source device 14 is a light source device such as an LED (Light Emitting Diode), for example, and lights up according to the control of the control unit 100. Here, the light source device 14 is provided so as to be recognized as a light source in the reproduction environment when viewed from the observer 5 who observes the aerial image 3, and is not intended for illumination of the stage 4. Therefore, the light source device 14 is provided at a position that can be viewed by the observer 5, and is viewed by the observer 5 as if the light source device 14 is illuminating the aerial image. As described above, since the light source device 14 is not intended for illumination of the stage 4, a portion of the light source device 14 that faces the stage 4 is disposed so that light from the light source device 14 does not enter the stage 4. A weathering may be performed. However, when the light from the light source device 14 does not greatly affect the display on the stage 4, such a scale may not be provided.

  The blower / air conditioner 15 controls air conditioning (wind direction, wind speed), temperature, humidity, and the like in the reproduction environment according to the control of the control unit 100.

  The smoke generator 16 generates smoke (fog) in the reproduction environment according to the control of the control unit 100.

  The speaker 17 controls sound in the reproduction environment according to the control of the control unit 100.

  As described above, the projector 12, the illumination device 13, the light source device 14, the air blower / air conditioner 15, the smoke generator 16 and the speaker 17 which are the environment presentation means produce the reproduction environment (reproduction) for reproducing information media (video data). Lighting control, air conditioning control, acoustic control, smoke generation, video display, etc. in the environment can be performed.

  The reproduction environment information acquisition unit 18 is, for example, a photographing apparatus, and acquires information on the video in the reproduction environment and position information of the real object 6 existing in the reproduction environment. The reproduction environment information acquisition unit 18 outputs the acquired information to the control unit 100.

  The complementary video projector 19 maps the video to the reproduction environment so as to reduce undesirable effects caused by the real object 6 occurring in the reproduction environment. Details of the function of the complementary video projector 19 will be described in detail with reference to FIGS.

  The control unit 100 is a personal computer or the like, for example, and causes the aerial image projection device 11 to display a video indicated by video data obtained by shooting (recording) the object 1 with the shooting device 2. A spatial image of the display image is formed on the stage 4 by displaying the video by the aerial image projector 11.

  The control unit 100 displays the video indicated by the media information (video data) on the aerial image projection device 11 and, when the audio information is included in the media information, causes the speaker 17 to reproduce the audio data. Moreover, the control part 100 controls each apparatus which is an environmental presentation means as needed.

  When the control unit 100 acquires the position information of the real object 6 from the reproduction environment information acquisition unit 18, the control unit 100 calculates the position of the shadow of the real object 6 that should be generated due to the illumination effect from the position of the virtual light source. A shadow 6a corresponding to the real object 6 by the light source is displayed (projected). As a result, the shadow of the virtual light source is displayed on both the real object 6 and the aerial image 3, and the observer 5 can perceive as if the real object 6 and the aerial image 3 are at the same place. .

  The control unit 100 controls the complementary video projector 19 based on the video information in the playback environment acquired by the playback environment information acquisition unit 18. Details of the control of the complementary video projector 19 by the control unit 100 will be described in detail with reference to FIGS. 6 and 7.

  Next, formation of the aerial image will be described with reference to FIGS. 3 to 5, the same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted.

  FIG. 3 is a diagram illustrating an example of a configuration for forming an aerial image.

  In FIG. 3, the screen 20 as a display unit is provided substantially horizontally with respect to the observation direction (X direction) of the observer 5. The screen 20 corresponds to the floor surface 4a of the stage 4 in FIG. The aerial image projection device 11 is, for example, a projector, is provided on one surface (lower surface) side of the screen 20, and projects (displays) an image on the screen 20 under the control of the control unit 100.

  A transparent plate 21 that is an optical element is provided on the other surface (upper surface) side of the screen 20. The transparent plate 21 is inclined by approximately 45 ° toward the observer 5 side (in the −X direction) when viewed from the screen 20. In response to the display of the image on the screen 20, the light emitted from the screen 20 enters the transparent plate 21 and is directed in the direction toward the observer 5 on the transparent plate 21. By doing so, a spatial image B (virtual image) of the display image A displayed on the screen 20 is formed substantially perpendicular to the screen 20 and is visually recognized by the observer 5.

  FIG. 4 is a diagram illustrating another example of a configuration for forming an aerial image.

  A real image mirror 22 which is an optical element is provided on the upper surface side of the screen 20. The real image mirror 22 is inclined by approximately 45 ° toward the opposite side of the observer 5 as viewed from the screen 20 (in the X direction). In response to the display of the image on the screen 20, the light emitted from the screen 20 enters the real image mirror 22 and is directed toward the observer 5 in the real image mirror 22. By doing so, a spatial image B (real image) of the display image A displayed on the screen 20 is formed substantially perpendicular to the screen 20 and is visually recognized by the observer 5. In addition, when FIG. 3 and FIG. 4 are compared, the upper and lower sides of the displayed display image A are reversed.

  3 and 4, an example in which the aerial image projector 11 projects an image from the lower surface of the screen 20 has been described. However, the aerial image projector 11 projects an image from the upper surface of the screen 20 as illustrated in FIG. 2. May be. In this case, the aerial image of the display image on the screen 20 is formed by using an optical element that transmits the projection light from the aerial image projector 11 and directs the emitted light from the screen 20 toward the observer 5. Can do.

  3 and 4, an image is displayed (projected) on the screen 20 by the aerial image projection device 11, and light emitted from the screen 20 corresponding to the display is displayed by the optical element (transparent plate 21, real image mirror 22). Although an example of forming an aerial image by directing in the direction toward the observer 5 has been described, the present invention is not limited to this. For example, the aerial image projection device 11 may be configured by a liquid crystal device, a display surface of the liquid crystal device may be provided at the position of the screen 20, and an aerial image may be formed by displaying an image on the display surface.

  FIG. 5 is a diagram showing still another example of a configuration for forming an aerial image. In FIG. 5, an example in which an aerial image is formed using a see-through screen 23 instead of the screen 20 will be described.

  The see-through screen 23 is provided so as to face the observer 5 (substantially perpendicular to the X direction). The see-through screen 23 is a substantially transparent screen, and the image projected by the aerial image projection device 11 from one surface side (the surface opposite to the surface facing the observer 5) is used as the aerial image as the observer 5. The background behind the see-through screen 23 can also be visually recognized by the observer 5 in a portion other than the projected portion. Accordingly, the display image of the see-through screen 23 and the background behind the see-through screen 23 can be superimposed on the front and back to be viewed by the observer 5. In addition, since the fog screen which projects an image | video on the fog generated artificially brings the same effect as a see-through screen, you may use a fog screen.

  Next, the reduction of the influence of the real object 6 in the reproduction environment by the complementary video projector 19 will be described.

  First, with reference to FIG. 6, the reduction of the influence of the shadow of the real object 6 by the illumination device 13 in the reproduction environment will be described.

  FIG. 6 is a diagram showing a case where the aerial image 3 is formed on the stage 4 by the aerial image projector 11 and the real object 6 exists on the floor surface 4 a of the stage 4. In FIG. 6, it is assumed that the illumination device 13 is illuminating the stage 4 from the lateral direction as indicated by a dotted arrow.

  In this case, as shown in FIG. 6, a shadow 6 b of the real object 6 is formed by illumination of the illumination device 13. However, since the shadow due to the illumination of the lighting device 13 is not formed in the aerial image 3, the observer 5 feels uncomfortable and it is difficult to perceive that the real object 6 and the aerial image 3 exist in the same place. .

  Therefore, the aerial image effect device 10 reduces the influence of the shadow 6b of the real object 6 formed by the illumination of the illumination device 13 as follows. The shadow 3a and the shadow 6a shown in FIG. 6 are obtained by projecting a shadow corresponding to the aerial image 3 and the real object 6 by the virtual light source with the projector 12 (not shown).

  The reproduction environment information acquisition unit 18 acquires the position information of the real object 6 and the information on the video in the reproduction environment, and outputs the acquired information to the control unit 100.

  The control unit 100 compares the video to be displayed on the bottom surface in the playback environment when the real object 6 does not exist in the playback environment with the video in the playback environment acquired by the playback environment information acquisition unit 18, Complementary video information for reducing the influence of the real object 6 (for example, the shadow 6b of the real object 6 due to the illumination of the lighting device 13) is calculated. The control unit 100 outputs the calculated complementary video information to the complementary video projector 19.

  The complementary video projector 19 displays (projects) complementary video information for reducing the influence of the real object 6 in the reproduction environment. Thereby, the influence (for example, shadow 6b of the real object 6) produced only by the real object 6 by the reproduction environment can be reduced, and the aerial image 3 can be visually recognized by the observer 5 in a more realistic manner. .

  For example, when the influence of the shadow 6b of the real object 6 is reduced, the complementary image projector 19 may project an image that brightens the position of the shadow 6b on the position of the shadow 6b. Further, when the floor surface 4a is configured as a display instead of a screen, and the display displays a shadow 3a, a shadow 6a, etc., the luminance within the range where the shadow 6b of the real object 6 is formed on the display. You may reduce the influence of the shadow 6b by making it display brightly.

  Next, with reference to FIG. 7, the reduction of the influence of the see-through screen 23 in the reproduction environment will be described.

  FIG. 7 is a diagram illustrating a case where the aerial image 3 is formed on the see-through screen 23. The aerial image 3 is formed on the see-through screen 23 by projection onto the see-through screen 23 by the aerial image projector 11 installed at the rear of the see-through screen 23.

  In FIG. 7, a projector 12-1 is a projector that projects an image of the back surface of the stage 4 and a shadow 3 a of the aerial image 3, and a projector 12-2 is a projector that projects an image of the side surface of the stage 4. .

  In the configuration using the see-through screen 23 as shown in FIG. 7, the observer 5 can view the back image and the side image through the see-through screen 23. However, an image viewed through the see-through screen 23 is darker than an image displayed on the front portion of the see-through screen 23 because the see-through screen 23 is not completely transparent. For example, in the example shown in FIG. 7, the circular images 7 a to 7 c that are originally all the same brightness are displayed on the side surface of the stage 4, but due to the influence of the see-through screen 23, the observer 5 The image 7c displayed on the rear side surface of the see-through screen 23 is visually recognized as a darker image than the images 7a and 7b displayed on the front side surface of the see-through screen 23. As a result, the observer 5 recognizes the presence of the see-through screen 23 in the stage 4, and the reality of the aerial image is lowered. Here, the “front part” of the see-through screen 23 indicates the side where the observer 5 is present with respect to the see-through screen 23, and the “rear part” of the see-through screen 23 indicates the opposite side.

  Therefore, the aerial image effect device 10 reduces the effect of darkening the image at the rear of the see-through screen 23 as follows.

  The playback environment information acquisition unit 18 acquires video information in the playback environment and outputs the acquired information to the control unit 100.

  For example, the control unit 100 compares the image displayed on the front part of the see-through screen 23 with the image displayed on the rear part of the see-through screen 23, and the front image and the rear image of the see-through screen 23 are equivalent. Complementary video information for complementation to obtain brightness is calculated. The control unit 100 outputs the calculated complementary video information to the complementary video projector 19.

  The complementary video projector 19 displays (projects) complementary video information for making the front video and the rear video of the see-through screen 23 have the same brightness in the reproduction environment. As a result, the brightness before and after the see-through screen 23 can be made equal, so that the observer 5 does not recognize the presence of the see-through screen 23, and the aerial image 3 is presented to the observer 5 in a more realistic manner. It can be visually recognized.

  For example, when the brightness before and after the see-through screen 23 is compared, the control unit 100 can compare the brightness of the image displayed on the side surface before and after the see-through screen 23.

  The complementary video projector 19 does not project an image for complementing the influence of the see-through screen 23, but the brightness of the images projected by the projector 12-1 and the projector 12-2 is increased before and after the see-through screen 23. The brightness before and after the see-through screen 23 may be made equal by using the adjusted image. In this case, the control unit 100 uses the projector 12 to project data for projecting a video whose brightness is adjusted before and after the see-through screen 23 based on the video information in the playback environment acquired by the playback environment information acquisition unit 18. -1 and 12-2.

  In addition, when the back and side surfaces are configured by a display instead of a screen and the display displays an image, the brightness setting of the display is changed before and after the see-through screen 23 to change the front and rear of the see-through screen 23. You may make it the brightness | luminance of the image | video in the same.

  The playback environment information acquisition unit 18 captures the display state of the video on the stage 4, and the control unit 100 determines whether or not a desired effect is performed from the captured image, and performs the desired effect. If it is determined that the device is not connected, each device that is the environment rendering means may be controlled again.

  As described above, the aerial image effect device 10 according to the present embodiment acquires the reproduction environment information acquisition unit 18 that acquires the video in the reproduction environment for reproducing the video data and the position information of the real object 6 existing in the reproduction environment. And the image in the reproduction environment acquired by the reproduction environment information acquisition unit 18 and the image to be displayed in the reproduction environment when the real object 6 does not exist in the reproduction environment, and the influence of the real object 6 is reduced. A control unit 100 that calculates supplemental video information to display, and a supplemental video projector 19 that displays an image based on the supplemental video information and reduces the influence of the real object 6. Thereby, since the influence on the real object by the reproduction environment can be reduced, the observer 5 can be perceived as if the real object 6 and the aerial image 3 are in the same place, and there is more presence. Production is possible.

  Although the present invention has been described based on the drawings and embodiments, it should be noted that those skilled in the art can easily make various variations or modifications based on the present disclosure. Therefore, it should be noted that these variations or modifications are included in the scope of the present invention.

DESCRIPTION OF SYMBOLS 10 Aerial image production device 11 Aerial image projection device 12 Projector 13 Illumination device 14 Light source device 15 Air-conditioning / blower device 16 Smoke generating device 17 Speaker 18 Reproduction environment information acquisition unit 19 Complementary image projector 100 Control unit

Claims (4)

A spatial image rendering device for reproducing the video data by forming a spatial image of the video shown in the video data recorded on the recording side for recording the object ,
A reproduction environment information acquisition unit for acquiring a video in a reproduction environment for reproducing the video data, and position information of a real object existing in the reproduction environment;
Compare the video in the playback environment acquired by the playback environment information acquisition unit with the video to be displayed in the playback environment when the real object does not exist in the playback environment, and determine the effect of the real object. A control unit for calculating complementary video information for reduction;
A complementary video projector that displays video based on the complementary video information and reduces the influence of the real object;
A projector that displays a shadow of the aerial image corresponding to a shadow generated by a virtual light source that is a light source in the recording environment on the recording side on which the object is recorded ;
The aerial image rendering device , wherein the projector also displays a shadow of the real object corresponding to a shadow generated by the virtual light source .   The aerial image rendering device according to claim 1, wherein the influence of the real object is a shadow of the real object generated by illumination that illuminates the reproduction environment. A method for controlling an aerial image rendering device that reproduces the video data by forming a spatial image of the video shown in the video data recorded on the recording side for recording the object ,
Obtaining video information in a reproduction environment for reproducing the video data, and position information of a real object existing in the reproduction environment;
Complementary video information for comparing the acquired video in the reproduction environment and the video to be displayed in the reproduction environment when the real object does not exist in the reproduction environment, and reducing the influence of the real object Calculating steps,
Displaying a video based on the complementary video information to reduce the influence of the real object;
Displaying a shadow of the aerial image corresponding to a shadow generated by a virtual light source that is a light source in the recording environment on the recording side where the object is recorded;
Displaying the shadow of the real object corresponding to the shadow generated by the virtual light source . A recording side for recording an object and the recording side are connected to the recording side via a network, and video data on which the object is recorded is acquired from the recording side via the network, and the acquired video data is reproduced. With a playback side,
The reproduction side is provided with a spatial image effect device for reproducing the video data by forming a spatial image of the video shown in the video data,
The aerial image rendering device is
A reproduction environment information acquisition unit for acquiring a video in a reproduction environment for reproducing the video data, and position information of a real object existing in the reproduction environment;
Compare the video in the playback environment acquired by the playback environment information acquisition unit with the video to be displayed in the playback environment when the real object does not exist in the playback environment, and determine the effect of the real object. A control unit for calculating complementary video information for reduction;
A complementary video projector that displays video based on the complementary video information and reduces the influence of the real object;
A projector that displays a shadow of the aerial image corresponding to a shadow generated by a virtual light source that is a light source in the recording environment on the recording side on which the object is recorded ;
The video system , wherein the projector also displays a shadow of the real object corresponding to a shadow generated by the virtual light source .

Images