JP6447096B2 - Display device and display method - Google Patents

Description

  The present invention relates to a display device and a display method, and more particularly, to a display device and a display method having a function of superimposing and displaying another image on a certain image.

  Conventionally, various display devices that superimpose and display another image on a certain image have been proposed. An example of such a display device is an electronic signboard disclosed in Non-Patent Document 1. The electronic signboard disclosed in Non-Patent Document 1 captures a user with a camera and inverts the image processed by CG (Computer Graphics) like a mirror and displays it on a liquid crystal display. Therefore, the electronic signboard disclosed in Non-Patent Document 1 does not use a mirror.

  On the other hand, as a display device using a plane mirror, those disclosed in Patent Document 1, Non-Patent Document 2, or Non-Patent Document 3 are known. These display devices are display devices in which a display is arranged in the immediate vicinity of a flat half mirror, and a virtual image of an object located in front of the flat half mirror is superimposed and displayed together with an image displayed on the display. Since the basic structures are similar to each other, the mirror with an information display function disclosed in Patent Document 1 will be described with reference to FIG.

  The mirror main body 90 of the mirror with an information display function disclosed in Patent Document 1 includes a liquid crystal display unit 92 as an information display unit for displaying various image information and character information, and a back disposed on the back surface of the liquid crystal display unit 92. A light 94, a translucent protective plate 96 disposed on the front surface of the liquid crystal display unit 92, and various types of light disposed on the front surface of the translucent protective plate 96 and displayed on the liquid crystal display unit 92 when the backlight 94 is lit. And a cover 98 as a half mirror that acts as a mirror surface by the mirror reflection layer 98a when the backlight 94 is turned off.

  According to the mirror with an information display function disclosed in Patent Document 1, the mirror main body 90 transmits and displays various image information and character information displayed on the liquid crystal display unit 92 when the backlight 94 is lit. By providing the cover 98 that acts as a mirror surface when the light is turned off, a function different from the original function can be added, and a highly versatile mirror can be provided.

  Furthermore, what was disclosed by patent document 2 is known as another display apparatus using a plane mirror. FIG. 5B shows the display device 100 disclosed in Patent Document 2.

  As shown in FIG. 5B, the display device 100 has a half mirror 102 attached to the front surface side (user 110 side) of the wall plate 108 having an opening corresponding to the display surface of the display unit 104. An imaging unit 106 such as a digital camera is installed on the upper front side, and a display unit 104 is installed on the back side of the wall plate 108. Then, the image data of the user 110 captured by the imaging unit 106 and the image data stored in the image data storage unit (not shown) are combined, and the combined image is displayed on the display unit 104.

  According to the display device 100 disclosed in Patent Document 2, it is possible to simulate a hair style, a hair color, and the like by actively using a user's image taken with a digital camera or the like and a user's appearance reflected in a half mirror. A display device can be realized.

JP 2002-229494 A Japanese Patent Laying-Open No. 2005-010356

http://prtimes.jp/main/html/rd/p/000000005.000003285.html http://www.cybertecturemirror.com/ http://pioneer.jp/corp/news/press/index/1825

  However, the electronic signboard disclosed in Non-Patent Document 1 using a camera and a liquid crystal display has a drawback that it lacks the realism of a mirror image (video). This is due to the fact that the mirror image is not three-dimensional and the movement of the video is delayed with respect to the actual movement of the user. Further, it is also caused by the fact that an object near the display surface of the liquid crystal display does not deviate from the angle of view of the camera or a large shift occurs.

  In addition, the display device using the flat mirror (half mirror) disclosed in Patent Document 1 has a drawback that it cannot display a deep depth. Since the mirror image observed by the plane mirror has the same depth as the real world, it is difficult to superimpose and display the image displayed on the display so that the user can see the distant place.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a sense of depth to a superimposed image using a mirror image and an image, and to create a more realistic superimposed image by natural perspective. It is an object to provide a display device and a display method that can be combined.

In order to achieve the above object, the display device according to claim 1 reflects light incident from one surface side to the one surface side and transmits light incident from the other surface side to the one surface side. A plurality of mirrors that are disposed on the other surface side of the semi-transparent mirror and that display images transmitted on the one surface side and that are disposed at positions before and after the viewing direction of display . An image display unit, and the semi-transparent mirror forms a reduced or enlarged virtual image of an object arranged on the one surface side on the other surface side, and is observed from the one surface side The video displayed on the video display unit is observed as an image in which the video and the virtual image are superimposed on each other and is closer to the semi-transparent mirror than the position where the virtual image is formed in the observation direction. Is arranged at the position where the virtual image is formed. Displayed on a video display unit disposed at a position farther from the semi-transparent mirror than a position where the virtual image is formed with respect to the observation direction, or a video displaying a near view with respect to the video displayed by the video display unit The video is at least one of images that display a distant view with respect to the video indicated by the video display unit arranged at the position where the virtual image is formed .
Display device.
In order to achieve the above object, the display device according to claim 2 reflects light incident from one surface side to the one surface side and transmits light incident from the other surface side to the one surface side. And a semi-transparent mirror that is transmitted to the other surface of the semi-transparent mirror and an image that is transmitted to the one surface and is disposed at different positions in a direction that intersects the viewing direction of the display. A plurality of video display units, and the semi-transparent mirror forms a reduced or enlarged virtual image of an object disposed on the one surface side on the other surface side, from the one surface side When observed, the image and the virtual image are observed as a superimposed image, and perspective is generated due to the parallax of the observer.

According to a third aspect of the present invention, in the first or second aspect of the present invention, the semi-transparent mirror may be configured to display the reduced virtual image of the object on the other surface of the semi-transparent mirror. To the focal point of the semi-transparent mirror.

According to a fourth aspect of the present invention, in the invention according to any one of the first to third aspects of the present invention, the video display unit is configured such that the semi-transparent mirror is formed from the other surface of the semi-transparent mirror. The video is displayed until the focal point.

The invention according to claim 5 is the display according to any one of claims 1 to 4 , which is displayed on the video display unit based on the illuminance on the one surface side of the semi-transmissive mirror. And a control unit for controlling the luminance of the video to be played.

The invention according to claim 6 is the invention according to any one of claims 1 to 5 , wherein the semi-transmissive mirror is a convex semi-transmissive mirror, and the video display section is a liquid crystal display. There is something.

On the other hand, in order to achieve the above object, the display method according to claim 7 , the light incident from one surface side is reflected to the one surface side and the light incident from the other surface side is reflected on the one surface side. A semi-transparent mirror that transmits to a surface side, and is disposed on the other surface side of the semi-transparent mirror, and displays an image that is transmitted to the one surface side, and is disposed at a position that moves back and forth in the viewing direction of the display. A display method using a display device including a plurality of video display units, wherein a reduced or enlarged virtual image of an object arranged on the one surface side by the semi-transparent mirror is displayed on the other surface side When the image is observed from the one surface side, the image and the virtual image are displayed so as to be observed as superimposed images, and more than the position where the virtual image is formed with respect to the observation direction. Video display placed near the translucent mirror The video displayed is a video displaying a near view with respect to the video shown by the video display unit arranged at the position where the virtual image is formed, or from the position where the virtual image is formed with respect to the observation direction Whether the image displayed by the image display unit arranged at a position away from the semi-transparent mirror is an image displaying a distant view with respect to the image shown by the image display unit arranged at the position where the virtual image is formed , Which is at least one of the following.

  According to the display device and the display method according to the present invention, it is possible to provide a superimposed image using a mirror image and a video with a sense of depth and to synthesize a more realistic superimposed image with a natural perspective. Play.

FIG. 1 is a schematic configuration diagram illustrating an example of a configuration of a display device according to an embodiment, and a conceptual diagram for explaining the principle of the display device according to the embodiment. It is a schematic block diagram which shows an example of a structure of the display apparatus which concerns on 1st Embodiment. It is a schematic block diagram which shows an example of a structure of the display apparatus which concerns on 2nd Embodiment. It is a schematic block diagram which shows an example of a structure of the display apparatus which concerns on 3rd Embodiment. It is a block diagram of the display apparatus which concerns on a prior art.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. First, referring to FIG. 1, a common configuration of a display device according to the present invention and a display method according to the present invention will be described. The principle will be described.

  As shown in FIG. 1A, the display device 10 according to the present embodiment includes a convex mirror 12, a display D (indicated as “D1”, “D2”, and “D3” in FIG. 1A), and The controller 14 is configured to be included.

  The convex mirror 12 is a semi-transmissive mirror (half mirror) that forms a reduced virtual image of the object OB arranged on the front surface F side (convex surface side) of the convex mirror 12 on the rear surface R side (concave surface side). The convex mirror 12 is not limited to a so-called convex mirror having a reflective surface formed on the convex surface shown in FIG. 1A, and a Fresnel half mirror or the like may be used.

  The display D is disposed on the back surface R side of the convex mirror 12 with the display surface 16 facing the convex mirror 12, and displays an image to be superimposed on the virtual image. The number of the displays D may be an arbitrary number depending on the mode of the video displayed on the display device 10, but in this embodiment, the positions are shifted back and forth (on the center line CL in FIG. 1A). Three displays D1, D2, and D3 are arranged in multiple stages (as different positions). In this embodiment, a multistage liquid crystal display is used as the display D, but the form of the multistage display is not limited to this. For example, as another example, a volume display, a multi-stage transmissive liquid crystal display, a projection mapping to a non-flat screen, an LED (Light Emitting Diode) array, or the like may be used.

  The control unit 14 is a part that controls switching of video displayed on the display D, video luminance, and the like, and is configured using, for example, a PC (Personal Computer). The control unit 14 may include a storage unit that stores video to be displayed on the display D.

  In the display device 10 configured as described above, the image displayed on the display D and the object OB formed by the convex mirror 12 are reduced when the observer H observes from the front surface F side of the convex mirror 12. This is a superimposed image display device in which an image on which a virtual image is superimposed is observed.

  With reference to FIG.1 (b) and (c), the superimposed image by the display apparatus 10 is demonstrated in detail.

  As shown in FIG. 1B, when the observer H is positioned on the front surface F side of the convex mirror 12, the observer can observe his reduced virtual image H ′. In this case, the distance d1 ′ between the convex mirror 12 and the virtual image H ′ is smaller than the distance d1 between the observer H and the convex mirror 12. As shown in FIG. 1C, when the display D is arranged in the vicinity of the virtual image H ′ and the video E is displayed in addition to the virtual image H ′, the video E is superimposed on the virtual image H ′ of the observer H. An image is observed. Since its own virtual image H ′ is reduced, for example, when the video E is an image that makes the viewer H aware of the distance, and the display D is closer to the convex mirror 12 than the virtual image H ′, the viewer H feels that the superimposed image is located far away from the observer H, and that there is a front-rear perspective between the virtual image H ′ and the video E. That is, when the observer H observes the superimposed image of the virtual image H ′ and the video E, the observer H is separated by a distance d2 that feels considerably longer than the actual distance d2 ′ between the convex mirror 12 and the display D, and It is seen as if image E ′ is present behind.

  With reference to FIG. 2, the virtual image by the convex mirror 12 is demonstrated in detail. FIG. 2 shows an example in which a real-world object (object) OB is arranged in front of a display device 10a (not shown in the control unit 14) having a convex mirror 12 and one display D. Show. The observer H observes the display device 10a from the front surface F side of the convex mirror 12. The observed observer H observes the object OB as a reduced virtual image OB ′ as shown in FIG. 2 by the action of the convex mirror 12.

  When the display D is arranged on the back surface R side of the convex mirror 12, the image displayed on the display D is transmitted through the convex mirror 12 by the action of the convex mirror 12 as a half mirror, and is observed by the observer H in actual size (actual size). Is done. For this reason, when the display D is disposed at a depth substantially equal to the virtual image OB ′ of the object OB, it is as if the video displayed at the same depth as the virtual image OB ′ is reflected on the observer H, that is, superimposed. To be observed.

In FIG. 2, the candle (disappearing) as the object OB is disposed on the front surface F side of the convex mirror 12, and a virtual image OB ′ of the candle is formed on the rear surface R side of the convex mirror 12. A display D on which a flame image is projected is disposed in the vicinity of the upper end of the virtual image OB ′.
In this case, when the observer H observes the display device 10a, a flame-lit candle image is observed as the observation image V1.

Now, with the intersection of the vertex of the convex mirror 12 and the center line CL as the origin O, coordinates are taken on the center line CL, the position of the object OB is a (> 0), and the position of the virtual image OB ′ is b (<0). If the focal position is f (<0, that is, the focal length of the convex mirror 12 is f), the following formula (Formula 1) holds from the lens formula.

  In the present embodiment, | b | <| a | always holds, and the virtual image OB ′ of the object OB at an arbitrary distance a from the convex mirror 12 falls within the focal length f. That is, from (Equation 1), it can be seen that the virtual image of the object OB at an arbitrary distance a from the origin O is formed within the focal length f of the convex mirror 12 from the origin O. That is, an arbitrary distance a from the convex mirror 12 to the object OB is compressed within a distance f from the origin O. Thus, the distance sensation perceived by the observer H between the object OB at an arbitrary distance a from the convex mirror 12 and the image E by the display D arranged on the back surface R side of the convex mirror 12 can be adjusted. it can.

[First Embodiment]
A display device 10b according to the present embodiment will be described with reference to FIG. In the present embodiment, a plurality of displays D (in this embodiment, three of D1, D2, and D3) are center lines so that the display surface 16 does not overlap when the display device 10b is observed from the front. This is a configuration in which the direction of the CL, that is, the direction of observation by the observer H is arranged back and forth. In addition, illustration of the control part 14 is abbreviate | omitted in FIG.

  An extinguished candle as the object OB is arranged on the front surface F side of the convex mirror 12, and a virtual image OB ′ of the object OB is formed on the back surface R side of the convex mirror 12. The same flame image is displayed on each of the displays D1, D2, and D3, the display D2 is disposed at substantially the same position as the virtual image OB ′, and the display D1 is closer to the convex mirror 12 than the virtual image OB ′. Is arranged on the side farther from the convex mirror 12 than the virtual image OB ′.

  For the observer H who has observed the display device 10b configured as described above, an image on the display D2 is displayed at the position of the virtual image OB ′ of the object OB, and an image on the display D1 is displayed before and after the virtual image OB ′. An observation image V2 in which a video by is reflected is observed. That is, an observation image V2 in which a floating flame is reflected before and after the candle with a flame is observed. Flame A exists on the front side of the virtual image OB 'and flame C exists on the back side of the virtual image OB'. To be observed. At this time, a perspective is generated due to the parallax formed by the difference between the observation image by the right eye and the observation image by the left eye, and another two flames float to the observer H before and after the candle that is lit. It is perceived to exist.

  The above-described relative positional relationship between the virtual image by the object and the video by the display is a relationship that does not depend on the viewpoint (observation position) of the observer who observes the display device. For this reason, when the observer moves and observes the display device according to the present embodiment, the effect of the image observed (feeled) by the observer, or a plurality of observers can perform the present embodiment. When observing the display device according to the form, there is no difference in the effect of the image observed (feeled) by each observer. That is, the display device according to the present embodiment does not fail depending on the viewpoint of the observer.

  As described above in detail, according to the display device and the display method according to the present embodiment, a real-world image (virtual image) reflected in a mirror and a video perceived at a desired relative depth are displayed together. Can be made. As a result, it is possible to make the viewer feel as if the actual state of the image exists and is reflected with the real world. And the effect on the expression of a superimposed image can be changed by changing the video of a display apparatus variously. That is, taking the above embodiment as an example, in addition to turning on and off the candle flame, for example, moving the flame with a sense of perspective between a position away from the position approaching the observer H. Is also possible.

  Therefore, according to the display device and the display method according to the present embodiment, it is possible to add a sense of depth to the superimposed image using the mirror image and the video, and to synthesize a more realistic superimposed image with a natural perspective. .

[Second Embodiment]
A display device 10c according to the present embodiment will be described with reference to FIG. In the present embodiment, the region on the back side of the convex mirror, which is substantially the same position as the position where the virtual image is formed, is divided into a plurality of regions (in this embodiment, an upper region, a central region, and a lower region), A plurality of displays D (in this embodiment, three displays D1, D2, and D3 respectively corresponding to the upper region, the center region, and the lower region) are arranged corresponding to each region.

  As shown in FIG. 4, in the present embodiment, the display D2 in the central area is arranged at substantially the same position as the head of the virtual image H ′ of the observer H, and the display D1 in the lower area is arranged in front of the display D2. The upper display D3 is arranged behind the display D2.

  The display D2 displays, for example, an image of an ornament (for example, sunglasses, a hat) of the observer H, and the display D1 displays, for example, an image of the foreground (foreground, for example, a drink, a character, etc.). For example, a background (a distant view, for example, the sky, the sun, etc.) is displayed on the display D3. By forming the superimposed image of the display device 10c as described above, it is possible to form an image in which a person wearing a decorative object present in a certain background is projected together with a near view.

  In the example shown in FIG. 4, sunglasses are displayed on the display D2, a parfait is displayed on the display D1, and the sun is displayed on the display D3. Then, the observer H observes the parfait in front of the person (observer H himself) so that the sun exists behind the person. That is, the superimposed image generated by the display device 10c is an image that is visually natural, particularly in perspective.

  As described above, even with the display device and the display method according to the present embodiment, the superimposed image using the mirror image and the video is given a sense of depth, and a more realistic superimposed image is synthesized with a natural perspective. Can do.

  In each of the above-described embodiments, a convex mirror is used as a means for generating a virtual image, and the reduced virtual image and the image displayed on the display are illustrated as examples. However, the present invention is not limited to this. For example, a virtual image enlarged using a concave mirror and an image displayed on a display may be superimposed.

  In each of the above embodiments, for example, a light-shielding cover may be provided on the back side of the convex mirror so that light other than the display is not transmitted from behind the convex mirror.

  In each of the above embodiments, for example, a dimming unit that adjusts the luminance of the display may be provided based on the illuminance of the environment in front of the convex mirror or the relationship with the image projected on the display. In this case, the control unit (for example, the control unit 14 shown in FIG. 1) may adjust the luminance by the light control unit.

10, 10a, 10b, 10c Display device 12 Convex mirror 14 Control unit 16 Display surface 90 Mirror body 92 Liquid crystal display unit 94 Backlight 96 Translucent protective plate 98 Cover 98a Specular reflection layer 100 Display device 102 Half mirror 104 Display unit 106 Imaging Part 108 Wall plate 110 User CL Center line D, D1, D2, D3 Display OB Object OB 'Virtual image H Observer H' Virtual image V1, V2, V3 Observation image F Front surface R Rear surface

Claims (7)

A semi-transmissive mirror that reflects light incident from one surface side to the one surface side and transmits light incident from the other surface side to the one surface side;
A plurality of video display units arranged on the other surface side of the semi-transparent mirror and displaying images transmitted on the one surface side and arranged at positions before and after the viewing direction of display, and
The semi-transparent mirror forms a reduced or enlarged virtual image of an object arranged on the one surface side on the other surface side, and the image and the virtual image when viewed from the one surface side. Is observed as a superimposed image ,
An image displayed on the image display unit arranged at a position closer to the semi-transparent mirror than a position at which the virtual image is formed with respect to the observation direction is arranged at a position at which the virtual image is formed. The image displayed on the image display unit arranged at a position farther from the semi-transparent mirror than the position where the virtual image is formed with respect to the observation direction, A display device that is at least one of images that display a distant view with respect to an image indicated by an image display unit disposed at a position where the virtual image is formed .   A semi-transmissive mirror that reflects light incident from one surface side to the one surface side and transmits light incident from the other surface side to the one surface side;
  A plurality of video display units arranged on the other surface side of the semi-transparent mirror and displaying images transmitted on the one surface side and arranged at different positions in a direction intersecting a viewing direction of display; With
  The semi-transparent mirror forms a reduced or enlarged virtual image of an object arranged on the one surface side on the other surface side, and the image and the virtual image when viewed from the one surface side. Is observed as a superimposed image, and perspective is caused by the parallax of the observer
  Display device. The semitransparent mirror is displayed according to reduced the virtual image of the object, in claim 1 or claim 2, formed between the said other surface of the semitransparent mirror to the focal point of the semi-transmissive mirror apparatus. The image display unit, a display device according to any one of claims 1 to 3 for displaying the image during a period from the other surface of the semitransparent mirror to the focal point of the semi-transmissive mirror. Display device according to any one of the semitransparent mirror the one further control unit for controlling the brightness of the video displayed on the video display unit on the basis of the illuminance of the surface side of including claims 1 to 4 . The semitransparent mirror is a convex semi-transmissive mirror, a display device according to any one of claims 1 to 5 wherein the image display unit is a liquid crystal display. A semi-transmission mirror that reflects light incident from one surface side to the one surface side and transmits light incident from the other surface side to the one surface side, and the other surface side of the semi-transmission mirror A display method comprising: a plurality of video display units that are arranged on the one surface side and are arranged at positions before and after the viewing direction of the display. ,
Forming a reduced or enlarged virtual image of the object disposed on the one surface side by the semi-transparent mirror on the other surface side;
When observed from the one surface side, the image and the virtual image are displayed so as to be observed as a superimposed image ,
An image displayed on the image display unit arranged at a position closer to the semi-transparent mirror than a position at which the virtual image is formed with respect to the observation direction is arranged at a position at which the virtual image is formed. The image displayed on the image display unit arranged at a position farther from the semi-transparent mirror than the position where the virtual image is formed with respect to the observation direction, A display method that is at least one of a video for displaying a distant view with respect to a video displayed by a video display unit arranged at a position where the virtual image is formed .