WO2005124450A1

WO2005124450A1 - Exhibition system

Info

Publication number: WO2005124450A1
Application number: PCT/JP2005/010916
Authority: WO
Inventors: Ikuro Choh
Original assignee: Cad Center Corporation
Priority date: 2004-06-15
Filing date: 2005-06-15
Publication date: 2005-12-29
Also published as: JP2006003414A

Abstract

An exhibition system in which an appreciator can appreciate with a realistic sensation when an actually existing real object is exhibited. The screen (11) of the exhibition system (1) disposed between an exhibition object, i.e. a real object (9), and an appreciation position A is translucent and has such a size that the real object (9) can be viewed by the appreciator (14) at the appreciation position A. A projector (13) projects the image of a real object taking the substantially same attitude as that of the real object (9) when viewed through the screen (11) at the view point of the appreciator (14) such that it is viewed superposed on the real object (9).

Description

Specification

Exhibition equipment

Technical field

The present invention relates to a display device.

Background art

[0002] Patent Document 1 discloses a display device. This exhibition device performs an exhibition that combines the projected image and the exhibits. Patent Literature 1 discloses an exhibition example in which an image of a dinosaur is combined with a forest miniature.

[0003] Patent Document 2 discloses a virtual operation system. This virtual operation system can provide a virtual experience as if the power of a personal computer at home, for example, is touching the real thing or moving the real thing through the Internet. Patent Document 2 discloses a specific example of remotely controlling a toy robot or the like via the Internet.

[0004] Patent Document 3 discloses a pointing device. The pointing device includes an input plane plate arranged in front of the display device, an optical sensor unit for projecting and receiving scanning light within a plane having a predetermined distance from the input plane plate, and a light projection unit of the optical sensor unit. A retroreflective member that retroreflects light rays, imaging means that uses the retroreflected light received by the optical sensor unit to image a pointer on the input flat plate, and converts the pointer into an electric signal, and an imaging means. Image processing means for analyzing the obtained imaging signal to calculate the coordinate position of the pointer.

[0005] Patent Document 4 discloses a virtual space movement control device that moves a virtual space image displayed on a display screen of a display unit. The virtual space movement control device includes a detection unit that detects a touch operation or a drag operation of a plurality of pointing parts, which are performed on a display screen, and a viewpoint of a virtual space image based on a detection result of the detection unit. The apparatus includes viewpoint position information generating means for generating position information, and stereoscopic image generating means for generating virtual space image data viewed from the viewpoint indicated by the viewpoint position information and outputting the data to the display means.

Patent Document 1: Japanese Patent Application Laid-Open No. 5-35192 (Abstract, etc.)

Patent Document 2: Japanese Patent Application Laid-Open No. 2002-170055 (Abstract, etc.) Patent Document 3: Japanese Patent Application Laid-Open No. 2004-5271 (Claims, etc.)

Patent Document 4: Japanese Patent Application Laid-Open No. 2004-5272 (Claims, etc.)

Disclosure of the invention

Problems to be solved by the invention

[0007] Conventionally, when real objects such as arts, crafts, and commodities are displayed, the real objects are displayed in a display case. However, if you put the real thing in the display case and display it in this way, you will not be able to freely watch the real thing and look at the back of the real thing! is there.

[0008] Therefore, it is conceivable to take an image of a real object to be exhibited in advance and provide the photographed still image or the like. This makes it possible to show the back side of the real thing stored in the display case. In providing such a still image or the like, it is conceivable to use the devices described in the above-mentioned patent documents.

[0009] In spite of this, while providing a photograph or a still image of the real object next to the real case, for example, in addition to the real object housed in the display case, the viewer always gets the viewpoint. Must be able to associate the real image shown in the photograph or still image with the real object contained in the display case in your own head.

[0010] For example, when providing a magnified image of a part of a handicraft in a photograph, the viewer must use his or her imagination to fit the magnified part into the real thing contained in the display case. It is difficult to understand with real feeling the fineness and fineness of the work of the enlarged part. In this way, it is difficult to give photographs and the like the real size and texture.

[0011] It is an object of the present invention to provide a display device that allows a viewer to view with realism when exhibiting a real object that actually exists.

Means for solving the problem

[0012] The display device according to the present invention is provided between the real object to be displayed and the viewing position, and the viewer's power at the viewing position is large enough to see the real object and is a transparent screen. And, from the viewer's point of view, the real posture that is almost the same as the real posture when viewed through the screen And a projector for projecting an image on a screen so that the image overlaps with the real object.

[0013] This display device allows the viewer to perceive that the image of the real object formed on the screen corresponds one-to-one with the real object, so that the real image formed on the screen is the real object itself. Illusion can be given. This display device can give a real image to a real image that actually exists.

[0014] In addition to the configuration of each of the above-described inventions, the exhibition apparatus according to the present invention further includes a viewing position detecting unit that detects a viewing position or a viewpoint position of a viewer, and a position detected by the viewing position detecting unit. Image change means for changing the image of the real object formed on the screen so that the image of the actual object overlaps the actual object in view of the positional force.

[0015] If this configuration is adopted, the real image appears to overlap with the real object, taking into account the viewer's position. Further, it is not necessary to specify a position where the real image is seen overlapping with the real image.

[0016] The display device according to the present invention, in addition to the configuration of each of the above-described inventions, includes a viewing position detecting unit 1S, a screen force, a distance sensor for detecting a distance to a viewer, and a predetermined range on the viewer side of the screen. An imaging device for imaging, and a viewer viewpoint specifying means for specifying the position of the viewpoint of the viewer based on the distance detected by the distance sensor and the image captured by the imaging device.

With this configuration, it is possible to accurately specify the viewpoint position of the viewer.

[0018] In addition to the configuration of each of the above-described inventions, the display device according to the present invention may be configured such that, when a plurality of viewers are included in a captured image, the viewer viewpoint specifying means is located at the center of the image. This is to identify the viewpoint position of the viewer who is closest to the center of the viewer or the screen.

[0019] By employing this configuration, even if there are a plurality of viewers in front of the screen, the viewer is in the middle of the captured image or closest to the center of the screen. Image appears to overlap with the real one.

[0020] In addition to the configuration of each of the above-described inventions, the exhibition device according to the present invention further includes a viewing position detecting unit, a contact position detecting unit that detects a position touching the power screen, and a contact position detected by the contact position detecting unit. Based on the screen assuming that the viewer reached out and touched And a viewer viewpoint specifying means for specifying the position of the viewer based on the positional relationship with the viewer.

By employing this configuration, the position where the viewer is present can be specified by simple processing.

[0022] In the display device according to the present invention, in addition to the configuration of each of the above-described inventions, the screen is a transmissive screen having a transmissivity of 50% or more and 80% or less, and is arranged on the real side of the screen. The first control to reduce the amount of light output by the light projecting member and the actual light image formed on the screen when the real image is formed on the screen and the light projecting member that illuminates the real object And a light amount control means for executing at least one of the second controls for increasing the light amount output from the light projecting member.

With this configuration, when a real image is formed on the screen, the amount of light output from the light projecting member is reduced by the first control. Can be illusioned as if the real object on the other side of the screen had moved to the screen. In addition, if this configuration is adopted, when erasing the real image formed on the screen, the second control increases the amount of light output from the light emitting member, so that the light is output to the screen by the viewer. Real Image Power You can move to the real object on the other side of the screen to give the illusion of a warmth. Executing one of these two controls can enhance the sense of match between the real image formed on the screen and the real object.

The display device according to the present invention, in addition to the configuration of each of the above-described inventions, further includes an operation detecting means for detecting an operation of the viewer on the screen, an operation detected by the operation detecting means, and an image of the image at that time. Image control means for rotating or enlarging or reducing the real image formed on the screen based on the display state.

[0025] With this configuration, the viewer can operate the screen on which the real image is formed by overlapping the real object, thereby rotating the real image formed on the screen. And can be enlarged or reduced.

[0026] In addition to the configuration of each of the above-described inventions, the display device according to the present invention further includes an operation detecting means for detecting an operation of the viewer on the screen, an operation detected by the operation detecting means, Image forming means for forming an image, video, or character information related to the real thing on the screen based on the display state of the image at the time.

[0027] With this configuration, it is possible to allow a viewer to view an image, a video, or character information related to a real thing seen through a screen by operating the screen.

The invention's effect

[0028] According to the present invention, when exhibiting a real thing that is actually present, the viewer can appreciate the presence with a sense of realism.

Brief Description of Drawings

FIG. 1 is a view showing a display device according to Embodiment 1 of the present invention.

FIG. 2 is a cross-sectional view of the display device of FIG. 1.

FIG. 3 is a cross-sectional view of the display device of FIG. 1.

FIG. 4 is an explanatory view showing a layout and a structure of a transmission screen, a retroreflective tape, and two infrared light emitting and receiving units of the exhibition apparatus of FIG. 1.

FIG. 5 is a block diagram showing a hardware configuration of a control system of the exhibition device of FIG. 1.

FIG. 6 is a block diagram showing a control system of the exhibition device of FIG. 1.

FIG. 7 is a diagram showing data stored in the hard disk device of FIG. 5.

FIG. 8 is a diagram showing an example of an image based on the three-dimensional CG data of FIG. 7.

FIG. 9 is a diagram showing an example of another image based on the three-dimensional CG data of FIG. 7.

FIG. 10 is a diagram showing still another example of an image based on the three-dimensional CG data of FIG. 7.

FIG. 11 is a diagram showing a projection state of the initial image of FIG. 8 onto a transmission screen.

FIG. 12 is a view showing a display device according to Embodiment 2 of the present invention.

FIG. 13 is a block diagram showing a hardware configuration of a control system of the exhibition device in FIG. 12.

FIG. 14 is a block diagram showing a control system of the display device in FIG. 12.

FIG. 15 is a diagram showing data stored in the hard disk device of FIG.

FIG. 16 is a diagram showing a geometrical positional relationship between a real object, a viewer, and a transmission screen.

FIG. 17 is a diagram showing an example of an image based on three-dimensional CG data.

FIG. 18 is a diagram showing a state of projection of the image of FIG. 17 onto a transmission screen. FIG. 19 is a diagram showing a situation where three viewers are standing in front of a transmissive screen.

FIG. 20 is a diagram showing a state in which a viewer is touching a transmission screen.

FIG. 21 is a block diagram showing a hardware configuration of a control system of the display device according to Embodiment 3 of the present invention.

FIG. 22 is a block diagram showing a control system of the display device in FIG. 21.

FIG. 23 is a diagram showing data stored in the hard disk device of FIG. 21.

FIG. 24 is a cross-sectional view showing a modification of the display device having a spot lamp that outputs incandescent light and a spot lamp that outputs monochromatic light.

FIG. 25 is a cross-sectional view of a display device having a plurality of spot lamps and a real object.

Explanation of symbols

[0030] 4 spot lamps (light emitting members), 9 real objects, 11 transmissive screens (screens), 13 projectors, 14 viewers, 21 retroreflective tapes (operation detecting means, contact position detecting means), 22, 23 infrared Light receiving unit (operation detection means, contact position detection means), 61 projected image generation unit (image change means, image control means), 63 operation detection unit (operation detection means, viewer viewpoint identification means), 71 distance sensor (viewing position Detection means), 72 imaging device (appreciation position detection means), 91 projected image generation unit (image changing means, image control means), 92 person detection unit (viewer viewpoint identification means, appreciation position detection means), 131 projected image Generator (image changing means, light quantity control means, image control means), 132 Lamp control section (light quantity control means)

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, a display device according to an embodiment of the present invention will be described with reference to the drawings.

Embodiment 1.

The display device according to the first embodiment of the present invention is a display device that can be suitably used when exhibiting arts and crafts that cannot be directly touched. The display device according to the first embodiment of the present invention provides an image based on the combi- ter graphics as well as real objects such as arts and crafts in a state where the viewer can freely operate it.

FIG. 1 is a diagram showing a display device according to Embodiment 1 of the present invention. Fig. 1 (A) is a side view of the exhibition device. FIG. 1B is a front view of the display device. 2 and 3 are cross-sectional views of the display device of FIG. Fig. 2 (A) is a cross-sectional view of the display device of Fig. 1 (A) taken along line A-A. . FIG. 2 (B) is a BB cross-sectional view of the display device of FIG. 1 (A). FIG. 3 is a CC cross-sectional view of the display device shown in FIGS. 1 (A) and 1 (B).

As shown in FIGS. 1 to 3, the exhibition apparatus according to the first embodiment includes an access restriction frame 1, a mounting table 2, a cover member 3, and a spot lamp 4 as a light emitting means. Have.

The entry restriction frame 1 has four column members 5. The four long pillar members 5 are arranged so as to be erected at the four corners of the square. The four column members 5 are connected to each other by the beam members 6, and are assembled into a cubic frame structure. Restricted access frame 1 is installed on floor 7. The four column members 5 of the entry restriction frame 1 may be fixed to the floor 7. Restricted access frame 1 is about 2.4m tall, higher than an adult.

The entry restriction frame 1 has four horizontal bar members 8 connecting the four column members 5 to be erected.

The four horizontal bar members 8 are provided so as to bridge between the adjacent column members 5 at the height of the adult's knee or at a height above it. A person who wants to enter the restricted access frame 1 needs to cross over the horizontal bar member 8. A person who attempts to enter Restricted Access Box 1 must raise his or her feet significantly when attempting to enter Restricted Access Box 1. As a result, a viewer or a thief cannot easily enter the restricted access frame 1. The restricted access frame 1 is reinforced by the four horizontal bar members 8.

[0037] In the entrance restriction frame 1, a transparent reinforcing glass may be provided between the four pillar members 5 that are erected. As a result, it is possible to more effectively restrict the entrance of the viewer into the restricted access frame 1 and more effectively prevent theft of the real object 9 described later.

The mounting table 2 is arranged at the center inside the entrance restriction frame 1. The mounting table 2 has the height of the waist of an adult or more. The mounting table 2 has a substantially quadrangular prism shape.

[0039] On the upper surface of the mounting table 2, arts, crafts, commodities, and other real objects 9 to be displayed are mounted. In FIG. 1, a silver cup is mounted on the upper surface of the mounting table 2. By arranging the real thing 9 in the center of the inside of the restricted access frame 1, the viewer cannot directly touch the real thing 9 for viewing.

[0040] The cover member 3 covers the real object 9 mounted on the upper surface of the mounting table 2. The cover member 3 is formed of a transparent material, and covers the real object 9 mounted on the upper surface of the mounting table 2. Hippopotamus Examples of the material of the one member 3 include glass and a transparent acrylic plate. By covering the actual object 9 with the transparent cover member 3, it is possible to prevent dust or dust from adhering to the actual object 9 without hindering the appreciation of the actual object 9.

The spot lamp 4 is disposed on the ceiling of the entry restriction frame 1 so that the spot light illuminates the real object 9 mounted on the mounting table 2. The spot lamp 4 is a kind of lighting equipment and outputs a spot light having a brightness according to the supplied electric power. The spot light of the spot lamp 4 is incandescent. The greater the power supplied, the brighter the spotlight. The smaller the power supplied, the darker the spotlight. When no power is supplied, the spot lamp 4 is turned off. In the first embodiment, the spot lamp 4 is always supplied with power.

The display device according to the first embodiment includes a translucent screen 11 as a screen, an opaque plate 12, and a projector 13.

[0043] The transmission screen 11 has a rectangular shape. The transmissive screen 11 is a set of entrance restriction frames 1 so that the lengthwise direction of the translucent screen 11 is parallel to the horizontal direction and the height extends from the height of the adult's waist to the height of the head. It is disposed between the pillar members 5 of the first and second members. The transmission screen 11 has a transmittance of about 65%.

The opaque plate 12 has a rectangular shape. The opaque plate 12 is disposed between the pair of column members 5 of the entrance restriction frame 1 above the transmissive screen 11. The opaque plate 12 has a height up to the ceiling of the restricted access frame 1.

The opaque plate 12 is disposed so that its surface is substantially parallel to the surface of the transmission screen 11. The opaque plate material 12 is disposed so as to be shifted outside the entrance restriction frame 1 from the transmission screen 11. As shown in the interval B in FIG. 3, between the surface of the transmissive screen 11 (the surface outside the restricted access frame 1) and the back surface of the opaque plate 12 (the surface inside the restricted access frame 1). Will form a gap of several centimeters.

When the video signal or the still image data is input, the projector 13 outputs an image based on the video signal or the still image data from the output unit. The projector 13 is disposed on the ceiling of the entrance restriction frame 1 in such a manner that the center of the output image is the center of the transmissive screen 11. The image output from the projector 13 is projected on the transmission screen 11. From the front side of the transmissive screen 11 (outside the entrance restriction frame 1), the projector 13 can see the image projected on the transmissive screen 11.

[0047] The projector 13 is disposed so as to be positioned obliquely upward at 45 degrees from the center of the transmissive screen 11. By arranging the projector 13 in such an angle direction with respect to the transmissive screen 11, a viewer standing in front of the transmissive screen 11 (hereinafter referred to as “viewer”) 14 and a viewpoint of an output unit of the projector 13. The opaque plate 12 will be located. From the viewer 14 standing in front of the translucent screen 11, the output of the projector 13 is not visible. The viewer 14 is not dazzled by the direct light from the output unit of the projector 13.

When projecting an image in the direction of an angle of 45 ° with respect to the vertical direction of the transmissive screen 11 as described above, unlike when projecting an image from the vertical direction of the transmissive screen 11, The projected image has a trapezoidal outline. Therefore, it is preferable that the output of the projector 13 is corrected by the trapezoidal distortion correction function so that the image is projected on the translucent screen 11 with a rectangular outline.

The display device according to the first embodiment includes a retroreflective tape 21 and two infrared light emitting and receiving units 22 and 23. The retroreflective tape 21 and the two infrared light emitting and receiving units 22, 23 are operation detecting means and contact position detecting means. FIG. 4 is an explanatory diagram showing the layout and structure of the transmissive screen 11, the retroreflective tape 21, and the two infrared light emitting and receiving units 22, 23 of the display device of FIG.

[0050] The retroreflective tape 21 is a tape that reflects irradiated light in the irradiation direction.

The retroreflective tape 21 is, for example, a plurality of beads 24 each having a reflective layer adhered to half of the surface of a transparent sphere such as glass, which is also strong, arranged in such a manner that the reflective layer is on the side where the tape adheres. Some have a structure. In the retroreflective tape 21, the left and right sides and the lower side of the transmissive screen 11 are arranged so that the surface where the tape is attached is outside the transmissive screen 11. The light irradiated on the retroreflective tape 21 enters the bead body 24 from the front side of the tape, is reflected by the reflective layer, and is reflected from the front side of the tape in the irradiation direction. Note that the plurality of bead bodies 24 may be encapsulated in a tape or encapsulated in the tape. [0051] One of the two infrared light emitting and receiving units 22 and 23 includes an infrared LED (Light Emitting Diode) 25, a polygon mirror 26, and an infrared CCD (Charge-Coupled Device) 27. And The infrared LED 25 outputs infrared light. Infrared rays are a type of light. The polygon mirror 26 is, for example, a polygon mirror such as a hexagon mirror. The infrared CCD 27 has a plurality of infrared light receiving elements. The infrared light receiving element outputs a light receiving level signal corresponding to the amount of received infrared light. The infrared CCD 27 outputs an infrared image based on the light receiving level signals of the plurality of infrared light receiving elements.

One infrared projection / reception unit 22 is provided near one end of the translucent screen 11 in the longitudinal direction. One infrared light emitting / receiving unit 22 is provided in a gap between the transmission screen 11 and the opaque plate 12. The plurality of infrared light receiving elements are arranged along the surface of the transmission screen 11.

In FIG. 4, as indicated by a dotted line, one infrared light emitting / receiving unit 22 emits infrared light, and the ED 25 outputs infrared light. The polygon mirror 26 reflects the infrared light output from the infrared LED 25 on one mirror surface. reflect. The infrared light reflected by the polygon mirror 26 travels along the surface of the transmission screen 11 and enters the retroreflective tape 21 provided along the outer periphery of the transmission screen 11. The retroreflective tape 21 reflects the incident infrared light in the incident direction. The infrared light reflected by the retroreflective tape 21 returns to one of the infrared light emitting / receiving units 22 along substantially the same path as the case of incidence. The infrared light returned to one infrared light emitting / receiving unit 22 is received by a certain infrared light receiving element among the plurality of infrared light receiving elements of the infrared CCD 27.

[0054] The polygon mirror 26 rotates. When the polygon mirror 26 rotates and the direction of the mirror surface that reflects infrared light changes, the direction of infrared light output from one infrared light emitting and receiving unit 22 changes. The infrared rays output in the different directions proceed along the surface of the transmissive screen 11 and are incident on the retroreflective tape 21 at a site different from the one before. The retro-reflective tape 21 reflects the irradiated infrared rays in the direction of incidence. The infrared light reflected by the retroreflective tape 21 returns to one of the infrared light emitting and receiving units 22 along substantially the same path as the case of incidence. The infrared light that has returned to the one infrared light emitting / receiving unit 22 is received by a certain infrared light receiving element different from the previous one among the plurality of infrared light receiving elements of the infrared CCD 27. The path of the infrared light output from one infrared light emitting / receiving unit 22 gradually moves along the surface of the transmission screen 11 as the polygon mirror 26 rotates. When the position of the path on the surface of the transmission screen 11 changes, the infrared light receiving element that receives infrared light at the infrared CCD 27 changes. During a period in which the polygon mirror 26 rotates by an angle obtained by dividing 360 degrees by the number of surfaces, the plurality of infrared light receiving elements of the infrared CCD 27 receive infrared light once. When the polygon mirror 26 further rotates beyond that period, the plurality of infrared light receiving elements of the infrared CCD 27 receive infrared light again.

In other words, one infrared projection / reception unit 22 moves the polygon mirror 26 by a predetermined range (see FIG. 4) of the surface of the transmission screen 11 every time the polygon mirror 26 rotates by an angle obtained by dividing 360 degrees by the number of surfaces. Scan the area C with infrared light. Further, one infrared light emitting and receiving unit 22 repeats the scanning. If there is no obstacle in a predetermined range on the surface of the transmission screen 11 during a period required for one scan, the plurality of infrared light receiving elements receive infrared light once. The infrared CCD 27 of the infrared emitting / receiving unit 22 outputs an infrared image every time the polygon mirror 26 rotates by an angle obtained by dividing 360 degrees by the number of surfaces.

If there is an obstacle (for example, a finger or the like used during operation) in a predetermined range above the surface of the transmissive screen 11, the infrared ray that receives the infrared ray passing through the position where the obstacle is located The light receiving element stops receiving infrared light. The infrared CCD 27 outputs an infrared image in which a shadow is formed in a small portion that does not receive the infrared rays.

[0058] The other infrared projection / reception unit 23 is provided near the other end in the longitudinal direction of the transmission screen 11. The other infrared light emitting / receiving unit 23 is disposed in a gap between the transmission screen 11 and the opaque plate 12. The configuration and operation of the other infrared projection / reception unit 23 are the same as the configuration and operation of the infrared projection / reception unit 22, and are denoted by the same reference numerals and description thereof will be omitted. Also in the other infrared projection / reception unit 23, the infrared CCD 27 outputs an infrared image every time the polygon mirror 26 rotates by an angle obtained by dividing 360 degrees by the number of surfaces.

As shown in FIG. 4, one infrared light emitting / receiving unit 22 and the other infrared light emitting / receiving unit 23 are disposed at both ends on the upper side of the transmission screen 11. So the other red A predetermined range of the surface of the transmission screen 11 scanned by the external light emitting / receiving unit 23 (a range C indicated by a dashed line in FIG. 4) and a predetermined range of the surface of the transmission screen 11 scanned by one infrared light emitting / receiving unit 22 (Range D shown by a dashed line in FIG. 4) does not coincide with each other, although there are overlapping portions, because the two infrared light emitting / receiving units 22, 23 are disposed at different positions. A point on the transmissive screen 11 (for example, point E in FIG. 4) is in a direction different from the direction viewed from one infrared light emitting / receiving unit 22 and the direction viewed from the other infrared light emitting / receiving unit 23. .

The display device according to the first embodiment includes a control device 31. Although not shown in FIGS. 1 to 3, the control device 31 is arranged at a position where the viewer's power is not visible. FIG. 5 is a block diagram showing a hardware configuration of a control system of the exhibition apparatus of FIG. FIG. 6 is a block diagram showing a control system of the exhibition device of FIG.

[0061] The control device 31 can be realized by a personal computer or the like. The control device 31 has an input / output port 32, a CPU (Central Processing Unit: central processing unit) 33, a memory 34, a hard disk device 35, and a system node 36 connecting these.

The input / output port 32 is connected to the projector 13, one infrared light emitting / receiving unit 22, and the other infrared light emitting / receiving unit 23. The one infrared light emitting and receiving unit 22 and the other infrared light emitting and receiving unit 23 output an infrared image of the infrared CCD 27 to the input / output port 32 every time scanning is performed.

[0063] The hard disk device 35 stores data. FIG. 7 is a diagram showing data stored in the hard disk device 35 of FIG.

The hard disk device 35 stores, for example, programs such as a projection image generating program 41, a moving image reproducing program 42, and an operation detecting program 43, and display data such as three-dimensional computer graphics data 44 and moving image data 45.

The three-dimensional computer graphics data 46 is data for generating still image data of an image including an image when the real object 9 is viewed in any direction. The three-dimensional computer graphics data 46 includes, for example, modeling data of the real object 9 and data of an image attached to the surface of the modeling data. The data of the image pasted on the surface of this modeling data includes, for example, image power It is possible to use the data of the image obtained.

FIG. 8 is a diagram showing one image 51 based on still image data generated based on the three-dimensional computer graphics data 44 of FIG. In the image 51 of FIG. 8, the same real image as when the real 9 (silver cup) is viewed from the front side of the transmission screen 11 is formed.

FIG. 9 is a diagram showing another image 52 based on still image data generated based on the three-dimensional computer graphics data 44 of FIG. In the image 52 in FIG. 9, a real image larger than the real image in the image 51 in FIG. 8 is formed.

FIG. 10 is a diagram showing still another image 53 based on still image data generated based on the three-dimensional computer graphics data 44 of FIG. In the image 53 in FIG. 10, the same real image as when the real 9 (silver cup) is viewed upward is formed.

[0069] The moving image data 45 is data for generating a video signal. The moving image data 45 is, for example, moving image data 45 that introduces the manufacturing process of the real 9.

[0070] The projection image generation program 41 is read into the memory 34 and executed by the CPU 33.

As a result, the projection image generation unit 61 shown in FIG. 6 as the image changing unit and the image control unit is generated. The projection image generation unit 61 generates still image data from the three-dimensional computer graphics data 44, and outputs the generated still image data to the projector 13.

The moving image reproducing program 42 is read into the memory 34 and executed by the CPU 33. As a result, the moving image reproducing unit 62 shown in FIG. 6 as an image forming unit is generated. The moving image reproducing unit 62 generates a video signal based on the moving image data 45, and outputs the generated video signal to the projector 13.

The operation detection program 43 is read into the memory 34 and executed by the CPU 33. As a result, the operation detecting unit 63 shown in FIG. 6 is generated as the operation detecting unit and the viewer viewpoint specifying unit. The operation detection unit 63 determines an operation on the transmissive screen 11 based on the infrared images input from the two infrared light emitting and receiving units 22 and 23, and according to the determined operation, the projection image generation unit 61 and the moving image reproduction unit. Output instructions to 62.

Next, the operation of the display device according to Embodiment 1 of the present invention will be described.

[0074] In the display device, the real object 9 (here, a silver cup) is placed on the mounting table 2, The spot lamp 4 illuminates the light. Thereby, a viewer or the like can check the appearance and color of the real object 9 through the translucent screen 11.

[0075] The projection image generation unit 61 reads the three-dimensional computer graphics data 44, and, based on the read three-dimensional computer graphics data 44, two-dimensional still image data obtained by projecting an image of the real object 9 on a predetermined plane. Generate Here, the projection image generation unit 61 generates still image data of the image shown in FIG.

The projection image generator 61 outputs the generated still image data to the projector 13 via the input / output port 32. The projector 13 outputs an image 51 shown in FIG. An image projected by the projector 13 is formed on the transmission screen 11. FIG. 11 is a diagram showing a state where the initial image 51 shown in FIG.

Based on the image 51 shown in FIG. 8, the real image is projected substantially in the center of the transmissive screen 11 in comparison to the image projected on the transmissive screen 11. Based on the initial screen data 45, the real image formed on the transmissive screen 11 has a viewing height having a standard height (for example, 175 cm) at the position of point A (the position viewed by the viewer 14) shown in FIG. When the person 14 stands and looks in the direction of the translucent screen 11, the real image and the real object 9 seen through the transmissive screen 11 are positioned and overlapped. In the case of the viewer 14 who is not the standard height, the real 9 and the real image slightly deviate, but the real 9 and the real image rarely appear to be separated.

As described above, by forming the real image projected on the transmissive screen 11 on the real object 9, the viewer 14 can see both the real object 9 and the real image. As a result, the viewer 14 can be given an illusion as if the real thing 9 itself is at hand.

When the viewer 14 or the like stands at the position of the point A shown in FIG. 2 and reaches out to the transmissive screen 11, the two infrared light emitting / receiving units 22 , 23 output two infrared images in which the shadow of the finger of the hand is formed. This set of infrared images is input to the operation detection unit 63 via the input / output port 32. Further, the two infrared light emitting / receiving units 22, 23 output one set of infrared images for each scan. Hereinafter, two infrared images output from the two infrared light emitting and receiving units 22, 23 for each scan are referred to as a set of infrared images. The operation detection unit 63 determines an operation on the transmission screen 11 based on each set of infrared images, and outputs an instruction to the projection image generation unit 61 or the moving image reproduction unit 62 according to the determined operation.

[0081] Specifically, for example, the operation detecting unit 63 first determines the position and the number of fingers based on each set of infrared images. As described above, when infrared light is blocked by a finger, a shadow is formed in the infrared image. The operation detection unit 63 determines the position and number of shadows in each infrared image.

[0082] For example, when one shadow is formed in each of a set of infrared images, the operation detection unit 63 determines that the shadow in the two infrared images is a shadow by one finger. Further, the operation detecting unit 63 specifies the direction of the finger from each infrared light emitting / receiving unit (if the shadow has a width, the direction of the center of the shadow) based on the position of the shadow in each infrared image. . The operation detection unit 63 uses the specified direction of the finger from each infrared light emitting / receiving unit and the distance between one infrared light emitting / receiving unit 22 and the other infrared light emitting / receiving unit 23 based on the principle of the triangulation measurement method. Then, the position of the one finger on the transmissive screen 11 is specified. Accordingly, when a finger is present at point E in FIG. 4, for example, operation detection unit 63 can determine that there is one finger at that position.

[0083] In addition, for example, when two shadows are formed in each infrared image, the operation detection unit 63 determines that the shadow in the two infrared images is a shadow by two fingers. In addition, the operation detecting unit 63 determines that the right shadows in the two infrared images are shadows of the first finger, and the left shadows in the two infrared images are shadows of the remaining first finger. Assuming that there is, the direction of each finger from each infrared light emitting / receiving unit is specified. The operation detection unit 63 uses the specified direction of each finger from each infrared light emitting and receiving unit and the distance between one infrared light emitting and receiving unit 22 and the other infrared light emitting and receiving unit 23 to determine the principle of triangulation. The positions of the two fingers on the transmissive screen 11 are specified based on

After specifying the number and position of the fingers on the transmissive screen 11 based on the infrared images of each set, the operation detecting unit 63 determines the number and position of the fingers based on the specified number and positions of the fingers. The contents of the operation instruction for the transmission screen 11 are determined. Alternatively, the operation detection unit 63 Based on the change of the finger position with respect to the finger position in the previous set of infrared images, the content of the operation instruction on the translucent screen 11 is determined. After determining the content of the operation instruction, the operation detection unit 63 outputs an instruction to the projection image generation unit 61 or the moving image reproduction unit 62 according to the determined operation instruction.

[0085] Specifically, for example, the positions of two fingers are specified in a certain set of infrared images, and the positions of the two fingers are specified in a certain set of previous infrared images. When the specified distance between the two fingers is wider than before, the operation detection unit 63 performs an operation to instruct an enlargement of the image projected on the transmissive screen 11. Judge. If it is determined that the operation is an operation for instructing enlargement of the image, the operation detection unit 63 outputs an instruction for enlarging the image to the projection image generation unit 61.

[0086] In addition, for example, the positions of two fingers are specified in a certain set of infrared images, and the positions of two fingers are specified in a certain set of infrared images before that. In this case, when the specified distance between the two fingers is smaller than before, the operation detection unit 63 determines that an operation for instructing reduction of the image projected on the transmissive screen 11 has been performed. If it is determined that the operation is an operation to instruct to reduce the image, the operation detecting unit 63 outputs an instruction to reduce the image to the projection image generating unit 61.

[0087] For example, the positions of two fingers are specified in a certain set of infrared images, and the positions of two fingers are specified in a certain set of infrared images before that. In such a case, when the two specified fingers are moving in substantially the same direction, the operation detecting unit 63 projects the image on the transmissive screen 11 and instructs to rotate the image. to decide. If it is determined that the operation is to instruct the rotation of the image, the operation detection unit 63 outputs an instruction to rotate the image to the projection image generation unit 61.

[0088] In addition, for example, when the position of one finger is specified within a predetermined position range in a certain set of infrared images, the operation detection unit 63 determines that the operation force for instructing the reproduction of the moving image has been input. to decide. If it is determined that the operation is an operation for instructing reproduction of a moving image, the operation detection unit 63 outputs an instruction to reproduce the moving image to the moving image reproduction unit 62.

When an instruction to enlarge the image, an instruction to reduce the image, or an instruction to rotate the image is input, the projection image generation unit 61 reads the three-dimensional computer graphics data 44. From the three-dimensional computer graphics data 44, two-dimensional still image data in which the image of the real object 9 is projected onto a predetermined plane is generated.

[0090] Projection image generation section 61 generates still image data for projecting a projection image obtained by enlarging, reducing, or rotating the image based on the image projected by projector 13 on transmission screen 11. . At the time of the first operation, the image 51 output to the projector 13 by the initial screen display unit 61 is used as a reference. The projection image generation unit 61 outputs the generated still image data to the projector 13. Projector 13 outputs a screen based on the newly input still image data. On the transmissive screen 11, an image newly projected by the projector 13 is formed.

Thus, for example, when an instruction to enlarge the image is given while the initial image 51 shown in FIG. 8 is being projected on the transmissive screen 11, An image 52 having an enlarged image of is projected. In addition, for example, when an image 52 having an enlarged image of the real object 9 shown in FIG. 9 is projected on the transmission screen 11 and an instruction to rotate the image is given, the transmission screen 11 includes the image shown in FIG. An image 53 having an image of the real object 9 shown as viewed from above is projected.

[0092] As described above, the image of the real object which was initially formed on the transmissive screen 11 so as to be superimposed on the real object 9 is enlarged, reduced or rotated by operating the transmissive screen 11. Or you can. As a result, it is possible to give an illusion to the viewer 14 who is operating as if he / she is holding the real thing 9 on display.

If the next operation is not detected for a predetermined period, the operation detection unit 63 instructs the projection image generation unit 61 to display the initial image 51 shown in FIG. As a result, an image 51 overlapping the real object 9 shown in FIG. As a result, it is possible to give the operating viewer 14 an illusion that the real object 9 held and watched by the user is placed on the mounting table 2.

[0094] The projection image generation unit 61 continuously enlarges the real image until the image power of the real object formed on the transmissive screen 11 matches the real image in the image based on the initial screen data shown in Fig. 8. The reduced and rotated still image data may be generated, and then the still image data of the image 51 overlapping the real object 9 shown in FIG. 8 may be generated. This allows the transmission screen to The image of the real object formed on the screen 11 becomes an image that overlaps with the real object 9 after its size and orientation smoothly change. In this way, by smoothly changing the image of the real object formed on the transmissive screen 11 so as to overlap with the real object 9, the sense of unity between the real image formed on the transmissive screen 11 and the real object 9 is further enhanced. You can have.

[0095] The moving image reproducing unit 62 generates a video signal from the moving image data 45 when a moving image reproducing instruction is input. The moving image reproducing unit 62 outputs the generated video signal to the projector 13. The projector 13 outputs a moving image based on the video signal. The moving image projected from the projector 13 is displayed on the transmission screen 11.

When the generation of the video signal based on the video data 45 ends, the video playback unit 62 instructs the projection image generation unit 61 to display the initial image 51 shown in FIG. As a result, an image 51 overlapping the real object 9 shown in FIG. 8 is displayed on the transmission screen 11.

[0097] As described above, the display device according to the first embodiment is configured such that the image of the real object having the same posture as the real object 9 when viewed through the transparent screen 11 is placed on the transmissive screen 11. It can be overlaid with the real thing 9 above. This allows the viewer 14 to recognize that the real image formed on the transmissive screen 11 has a one-to-one correspondence with the real 9, and the real image formed on the transmissive screen 11 is the real 9 itself. It can give the illusion as if.

[0098] For this reason, the display device of the first embodiment allows the viewer 14 to view the real object 9 and the virtual real image from the same viewpoint, and has the same feeling between them. I can do it. For example, it is possible to give the size and texture of the real object 9 to the virtual real image, which is difficult to grasp only with the virtual real image. As a result, the display device of the first embodiment can give the real image a sense of reality.

[0099] The viewer 14 operates the transmission screen 11 to enlarge, reduce, or rotate the real image formed on the transmission screen 11. can do. Therefore, the viewer 14 can freely view the inaccessible real object 9 in the image of the real object. As a result, a high learning effect for art objects can be expected.

In the first embodiment, the operation on the transmission screen 11 is detected by the retroreflective tape 21 and the two infrared light emitting and receiving units 22 and 23. Embodiment 1 In this configuration, by employing this configuration, it is possible to detect an operation on the transmissive screen 11 without disposing a member for detecting an operation on the transmissive screen 11 so as to overlap the transmissive screen 11. Since there are no members arranged on the transmissive screen 11, there is no loss of the real object 9 seen through the transmissive screen 11 or the sharpness of the real image formed on the transmissive screen 11.

[0101] In the first embodiment, the two infrared light projecting and receiving units 22, 23 are arranged above the translucent screen 11 that is erected. Therefore, compared to the case where the two infrared emitting and receiving units 22 and 23 are arranged below the transmission screen 11, for example, infrared rays other than the infrared rays from the infrared LED 25 enter the infrared CCD 26. . Also, since infrared light is used as light used for detecting operations, the influence of visible light is reduced. When the visible light is used as the light for detecting the operation, the light becomes susceptible to, for example, the light of the spot lamp 4 illuminating the real object 9. As a result, for the infrared image in the first embodiment, operate the transmission screen 11! / The shadow of the hand is clearly formed. The operation detecting section 63 can easily specify the position of the hand to be operated based on the infrared image in which the shadow of the hand is clearly seen.

In Embodiment 1, the initial image 51 shown in FIG. 8 is projected on the transmission screen 11 at a predetermined position. In addition to this, for example, the initial image 51 shown in FIG. 8 projected on a predetermined position of the transmissive screen 11 is moved right and left and up and down on the transmissive screen 11 in accordance with the operation of the viewer 14, and is enlarged or reduced. Or may be able to do so. Thus, the viewer 14 can move the real image so as to overlap the real image 9 with his / her eyes. In this case, an image to be subsequently projected on the transmissive screen 11 may be projected based on the moved position.

In the first embodiment, the real image formed based on the three-dimensional computer graphics data 44 is the real object 9 mounted on the mounting table 2 itself. In addition to this, for example, in the case where the real object 9 is an old artwork with discoloration, the real image formed based on the three-dimensional computer graphics data 44 adds the discolored color to the real object 9. Image may be used. As a result, it is difficult to grasp only with the real thing 9, and it is possible to appreciate it in its original form, such as artwork. In the first embodiment, moving image data 45 is only continuously projected on transmissive screen 11. In addition to this, for example, a video signal based on the moving image data 45 may be generated stepwise according to an operation of the viewer 14 on the translucent screen 11. As a result, for example, the viewer 14 can relive the coloring process of the real object 9 and the like.

In the first embodiment, moving image data 45 is stored in hard disk device 35. In addition to this, for example, various data such as slide data and audio data may be reproduced on an exhibition device to form an image, a video, or character information related to a real object on the transparent screen 11.

In the first embodiment, the operation on the transmission screen 11 is detected by the retroreflective tape 21 and the two infrared light emitting and receiving units 22 and 23. In addition to this, for example, the operation on the transmissive screen 11 may be detected by a touch panel or the like disposed so as to overlap the transmissive screen 11. However, when hand movements are detected with a touch panel or the like, the viewer feels that the operation of the viewer 14 is not as much as operating the real image formed on the transmissive screen 11 but as being operating on the touch panel. turn into. As a result, it is difficult to give the viewer 14 a sense of unity between the real image formed on the transmissive screen 11 and the real object 9. It is preferable that the operation on the transmissive screen 11 is detected by the retroreflective tape 21 and the two infrared light emitting and receiving units 22 and 23, because such a sense of unity can be maintained.

In the first embodiment, a screen having a transmittance of 65% is used as the transmission screen 11. Alternatively, for example, the transmission screen 11 may have a transmittance of 10% or more and 90% or less. Further, a polarizing screen may be used in place of the transmission screen 11. However, the polarizing screen is not suitable for a large-scale display device in which a plurality of viewers 14 can view at the same time, because the color of the image changes only by slightly changing the viewing angle. In addition, since the projector 13 is disposed on the actual 9 side of the transmissive screen 11, the occupied area of the display device is larger than when the projector 13 is disposed on the viewer 14 side of the transmissive screen 11, for example. Become smaller.

[0108] Embodiment 2.

The display device according to the second embodiment is configured such that the viewer 14 stands in front of the transmission screen 11. The point that the position and the size of the real image formed on the transmissive screen 11 are controlled in accordance with the height, the position of the viewpoint (eye), the standing position, and the like is different from the display device according to the first embodiment. You. In the following description, this difference will be mainly described.

FIG. 12 is a diagram showing a display device according to Embodiment 2 of the present invention. FIG. 12A is a side view of the display device. FIG. 12B is a front view of the display device. FIG. 13 is a block diagram showing a hardware configuration of a control system of the exhibition device in FIG. FIG. 14 is a block diagram showing a control system of the display device of FIG. FIG. 15 is a diagram showing data stored in the hard disk device 35 of FIG.

As shown in FIG. 12, the exhibition device according to the second embodiment includes a distance sensor 71 as a viewing position detecting unit and an imaging device 72 as a viewing position detecting unit.

The distance sensor 71 is attached to the center of the lower end of the transmission screen 11 toward the front of the transmission screen 11. The distance sensor 71 outputs infrared light or other light, and receives reflected light of the light. The distance sensor 71 calculates the distance to the object reflecting the light based on the time from when the light is output to when the force receives the reflected light. The distance sensor 71 outputs the calculated distance to the input / output port 32, as shown in FIG.

[0112] The imaging device 72 has a plurality of light receiving elements (not shown). The light receiving element outputs a light receiving level signal corresponding to the amount of received light. The plurality of light receiving elements are arranged vertically and horizontally in the same plane. The surface on which the plurality of light receiving elements are arranged is called a light receiving surface. The imaging device 72 is attached to the center of the upper end of the opaque plate 12 in such a manner that the light receiving surface thereof is directed downward by a predetermined angle in front of the transmission screen 11. The imaging device 72 outputs a captured image based on the light receiving level signals of the plurality of light receiving elements to the input / output port 32, as shown in FIG.

The hard disk device 35 according to the second embodiment stores a projection image generation program 81 and a human detection program 82, as shown in FIG.

[0114] The projection image generation program 81 is read into the memory 34 and executed by the CPU 33.

As a result, the projection image generation unit 91 shown in FIG. 14 as the image changing unit and the image control unit is generated. The projection image generation unit 91 generates still image data based on the three-dimensional computer graphics data 44, and sends the generated still image data to the projector 13. Output.

The human detection program 82 is read into the memory 34 and executed by the CPU 33. As a result, a person detecting unit 92 shown in FIG. 14 is generated as a viewer viewpoint specifying unit and a viewing position detecting unit. To the human detection unit 92, the captured image captured by the imaging device 72 and the distance to the object reflecting the light calculated by the distance sensor 71 are input.

[0116] In the display device according to the second embodiment, the components other than the components described above are the same as the components of the display device according to the first embodiment, and will be described using the same reference numerals and names. Is omitted.

Next, the operation of the display device according to Embodiment 2 of the present invention will be described.

[0118] In an initial state where there is no person around the display device, the distance sensor 71 outputs light in the direction in front of the transmission screen 11. The imaging device 72 images a predetermined range on the near side of the transmission screen 11. Spot lamp 4 is lit. The projector 13 is off.

[0119] The projector 13 can be turned off by setting its luminance to 0. When the projector 13 cannot be turned off, a black image may be output.

[0120] When the viewer 14 stands in front of the translucent screen 11 to view the real object 9 (silver cup) illuminated by the light of the spot lamp 4, the distance sensor 71 The emitted reflected light is received. The distance sensor 71 calculates the distance to the viewer 14 and outputs the distance to the input / output port 32. The imaging device 72 outputs a captured image including the image of the viewer 14 to the input / output port 32.

[0121] Information on the distance to the viewer 14 detected by the distance sensor 71 and the captured image are input to the human detection unit 92. When the information on the distance from the distance sensor 71 is input, the human detection unit 92 detects the head of the viewer 14 standing in front of the translucent screen 11 based on the information on the distance and the captured image at that time. Identify the location. Instead of the head, a position such as the eye or the space between the eyebrows may be specified as the viewpoint position. At this time, for example, the viewpoint position (L, H) of the installation height of the imaging device 72 is specified based on the shooting angle について of each pixel of the captured image and the distance L to the viewer 14. FIG. 16 is a diagram showing a geometric positional relationship between the real object 9, the viewer 14, and the transmission screen 11. The human detection unit 92 specifies the position of the head of the viewer 14 (that is, the viewpoint position) in the captured image by image processing. The human detection unit 92 assumes that the distance to the viewer 14 detected by the distance sensor 71 is the distance from the translucent screen 11 to the viewer 14 and virtually captures the captured image from the translucent screen 11 at that distance. And the relative position of the identified head with respect to the transmissive screen 11 and the real object 9 is identified based on the virtual arrangement. The human detection unit outputs information on the specified relative position of the head to the projection image generation unit 91.

[0123] Based on the information of the relative position of the head (that is, the viewpoint position) and the three-dimensional computer graphics data 44, the projection image generation unit 91 generates a real image power to be formed on the translucent screen 11. When viewed from the position of the head, still image data that matches the real object 9 is generated.

[0124] Specifically, for example, as shown in FIG. 16, the projection image generation unit 91 firstly determines the position of the head (that is, the viewpoint position) specified by the human detection unit 92 and the center of the real object 9. The position 102 of the transmissive screen 11 that intersects the connecting center line is specified. This position 102 is the center of the real image formed on the transmissive screen 11. In addition, the projection image generation unit 91 specifies the size 101 of the real image formed on the transmissive screen 11, as shown in FIG.

[0125] After specifying the center 102 and the size 101 of the real image formed on the transmissive screen 11, the projection image generation unit 91 generates still image data in which the real image is formed on the specified part. The projection image generation unit 91 outputs the generated still image data to the projector 13. The projector 13 starts outputting and outputs an image based on the still image data. An image projected by the projector 13 is formed on the transmissive screen 11.

FIG. 17 is a diagram showing an image 111 based on still image data generated based on the three-dimensional computer graphics data 44. In the image 111 in FIG. 17, the image force of the real object 9 (here, the silver cup) is seen from the front side of the translucent screen 11, and its center is formed shifted to the lower left in FIG. .

FIG. 18 is a diagram showing a state where image 111 shown in FIG. 17 is projected on transmissive screen 11. As described above, when the viewer 14 stands in front of the transmissive screen 11 and stands at the left side in FIG. 18 and the height of the viewer 14 is lower than the standard height. The real image formed on the transmission screen 11 is formed at a position where the central force of the transmission screen 11 is shifted to the lower left. As a result, the viewer 14 standing to the left in front of the transmissive screen 11 sees the real image formed on the transmissive screen 11 and the real object 9 seen through the transmissive screen 11 completely overlap. In this manner, by superimposing the real image formed on the transmissive screen 11 on the real object 9 by controlling its size and position, it can be given to the viewer 14 regardless of the height or standing position of the viewer 14. On the other hand, you can give the illusion that the 9 real objects on display are at hand.

[0128] When the viewer 14 approaches the translucent screen 11, a large image is projected by the same processing. As a result, the viewer 14 who approaches the transmissive screen 11 sees the real image formed on the transmissive screen 11 and the real object 9 seen through the transmissive screen 11 completely overlap.

Further, based on detection of viewer 14 by distance sensor 71, projection image generating section 91 generates still image data, and projector 13 starts outputting an image based on the still image data. . Thus, it is possible to give an illusion to the viewer 14 approaching the translucent screen 11 as if the real object 9 mounted on the mounting table 2 has moved toward the user.

[0130] In the display device according to the second embodiment, the operation of the display device after the display of the initial screen is the same as the operation of the display device according to the first embodiment, and a description thereof will be omitted.

[0131] As described above, the display device according to the second embodiment has the position and size of the real image formed on the transmission screen 11 according to the height and position of the viewer 14 standing in front of the transmission screen 11. Control. The display device according to the second embodiment adjusts the position of the real image on the transmission screen 11. This allows the viewer 14 to see the real image formed on the transmissive screen 11 irrespective of the height and the standing position, superimposed on the real object 9. Further, unlike Embodiment 1, the standing position of the viewer 14 does not have to be specified. In the case of the display device according to the second embodiment, the position where the viewer 14 views may be on the front side of the transmission screen 11.

[0132] In the second embodiment, a description is given of a case where one viewer 14 stands in front of the transmissive screen 11. In front of the translucent screen 11, a plurality of viewers can be seen at once. May stand. FIG. 19 is a diagram showing a situation where three viewers 14 are standing in front of the transmissive screen 11. When a plurality of viewers stand in front of the transmissive screen 11 in this way, the human detection unit 92 outputs the viewer closest to the center of the transmissive screen 11 (in FIG. 19, three out of three viewers). The middle viewer 14) is identified as a representative viewer 14 operating on the transmission screen 11, and the image of the real object formed on the transmission screen 11 is displayed to the representative viewer 14 in real time. You can make it overlap with nine. The other viewers 14 who do not operate the translucent screen 11 merely observe the operations of the representative viewers 14, so that a sufficient viewing effect can be obtained even with such control. You. It should be noted that the same effect can be expected even if the viewer located in the center of the captured image is specified instead of the viewer located closest to the center of the transmissive screen 11.

[0133] In the second embodiment, the human detection unit 92 accurately specifies the position of the viewer 14 based on the detection information of the distance sensor 71 and the imaging device 72. In addition to this, for example, as shown in FIG. 20, the human detection unit 92 has the viewer 14 touch the translucent screen 11, and based on the touched position, and when the viewer 14 extends his arm, The approximate position of the head of the viewer 14 may be specified based on the positional relationship between the translucent screen 11 and the viewer 14 when it is assumed that the touch has been made. FIG. 20 is a diagram showing a state in which the viewer 14 is touching the transmission screen 11. This makes it possible to specify the position of the viewer 14 with simple processing in the same hardware configuration as the display device of the first embodiment, and expect the same effect as the display device of the second embodiment. In addition, the human detection unit 92 may display a message such as “Touch here” on the transmission screen 11 so that the viewer 14 touches the transmission screen 11.

When the position of the viewer 14 is detected by the method shown in FIG. 20, the position of the retroreflective tape 21 and the two infrared light emitting and receiving units 22, 23 is detected. Based on the positional relationship between the transmissive screen 11 and the viewer 14 assuming that the viewer 14 has extended his arm and touched it, based on the detected contact position, the operation detection unit 63! It is a viewer viewpoint specifying means for specifying the position of the viewer 14.

In the second embodiment, when displaying the initial screen, the human detection unit 92 The position is specified, and the formation position of the real image is adjusted. In addition to this, for example, a human detection unit

The 92 may specify the position of the viewer 14 and adjust the formation position of the real image each time the projection image generation unit 91 outputs the still image data. As a result, even if the viewer 14 moves, the real image can be formed at a position that always overlaps with the real object 9 by shifting the real image according to the eyes of the viewer 14. However, in such a case where control is performed so that the real image always overlaps with the real object, a control device 31 capable of high-speed image processing is required, and the display device becomes expensive.

In Embodiment 2, when there is no viewer 14 around the display device, projector 13 is turned off. In addition, for example, when there is no viewer 14 around the display device, the projector 13 may output an image other than the real image. This makes it easier for viewers 14 who are far away from the display equipment to see.

[0137] Embodiment 3.

The display apparatus according to the third embodiment is different from the display apparatus according to the second embodiment in that the spot lamp 4 is dimmed in accordance with the projection of an image onto the transmission screen 11. The following description focuses mainly on this difference.

FIG. 21 is a block diagram showing a hardware configuration of a control system of the display device according to Embodiment 3 of the present invention. FIG. 22 is a block diagram showing a control system of the display device of FIG. FIG. 23 is a diagram showing data stored in the hard disk device 35 of FIG.

In the display device according to Embodiment 3, the spot lamp 4 is connected to the input / output port 32 as shown in FIG. The light amount of the spot lamp 4 is controlled by the control system of the exhibition device. The hard disk device 35 according to the third embodiment stores a projection image generation program 121 and a lamp control program 122, as shown in FIG.

[0140] The projection image generation program 121 is read into the memory 34 and executed by the CPU 33. As a result, the projection image generation unit 131 shown in FIG. 22 is generated as the image changing unit, the light amount control unit, and the image control unit. The projection image generation unit 131 generates still image data based on the three-dimensional computer graphics data 44, and outputs the generated still image data to the projector 13.

[0141] The lamp control program 122 is read into the memory 34 and executed by the CPU 33. This As a result, a lamp control unit 132 shown in FIG. 22 is generated as light amount control means. The lamp control unit 132 controls the light amount of the spot lamp 4 to be 0 to 100%.

[0142] In the display device according to the third embodiment, the components other than the components described above are the same as the components of the display device according to the second embodiment, and will be described using the same reference numerals and names. Is omitted.

Next, the operation of the display device according to Embodiment 3 of the present invention will be described.

In an initial state in which no person is around the display device, the distance sensor 71 outputs light in the forward direction of the transmission screen 11. The imaging device 72 images a predetermined range on the near side of the transmission screen 11. The lamp control unit 132 lights the spot lamp 4 at 100% output. The projector 13 is off.

[0145] When the viewer 14 stands in front of the transmissive screen 11 to view the real object 9 (here, the silver cup) illuminated by the light of the spot lamp 4, the distance sensor 71 The distance to is output. The human detection unit 92 specifies the position of the head of the viewer 14 and outputs information on the relative position of the specified head to the translucent screen 11 and the real object 9 to the projection image generation unit 131.

[0146] Based on the information on the relative position of the head and the three-dimensional computer graphics data 44, the projection image generation unit 131 generates a real image formed on the transmissive screen 11 when viewed from the position of the head. Then, still image data that matches the real object 9 is generated and output to the projector 13. The projector 13 starts outputting and outputs an image based on the still image data. An image projected by the projector 13 is formed on the translucent screen 11.

Further, before and after outputting the still image data to projector 13, projection image generation section 131 instructs lamp control section 132 to turn off the light. The lamp control unit 132 turns off the spot lamp 4.

[0148] As described above, when the spot lamp 4 is turned off when the projection of the image on the transmissive screen 11 is started, there is the transmissive screen 11 having a transmittance of 65% between the real object 9 and the viewer 14. Therefore, the real object 9 cannot be seen through the transmission screen 11. As a result, it is possible to give the viewer 14 an illusion that the real object 9 placed on the mounting table 2 has moved such that the force approaches the front. [0149] It should be noted that when expecting the effect of giving the illusion that the real object 9 placed on the mounting table 2 also moves so that the force approaches the near side, the transmittance of the transmission screen 11 becomes It is better to use the one with 50% or more and 80% or less. If the transmittance of the transmissive screen 11 is lower than 50%, the real object 9 disappears as soon as the spot lamp 4 is turned off, and the force of the real object 9 placed on the mounting table 2 also approaches the near side. It is difficult to give an impression as if they have moved to the city. If the transmittance of the transmissive screen 11 is higher than 80%, even if the spot lamp 4 is turned off, the actual object 9 may be seen indefinitely, and the actual object 9 placed on the mounting table 2 may be invisible. It is difficult to give the impression that your power has moved closer to you.

If no operation has been performed for a certain period of time, the operation detection unit 63 instructs the projection image generation unit 131 to display the previously displayed initial image. After displaying the initial image 51 previously displayed on the transmissive screen 11 after a predetermined time has elapsed, the projection image generation unit 131 outputs an instruction to turn off the light to the projector 13 and turns on the lamp control unit 132. Output instructions. The lamp control unit 132 turns on the spot lamp 4. The projector 13 is turned off.

[0151] As described above, when the projection of the image on the transmissive screen 11 is completed and the spot lamp 4 is turned on at the end of the projection, the illusion of holding the hand up to immediately before is as if! /ヽ It is possible to give an illusion to the viewer 14 as if the object 9 had returned to the mounting table 2. When the effect of giving such an illusion is expected for the same reason as when the spot lamp 4 is turned off when the projection of the image onto the transmissive screen 11 is started, the transmittance of the transmissive screen 11 becomes It is better to use the one with 50% or more and 80% or less.

[0152] In the display device according to the third embodiment, the operation of the display device from the initial display of the initial screen to the end of the display of the initial screen is the same as that of the display device according to the second embodiment. It is the same, and the description is omitted.

As described above, in the display device of the third embodiment, when displaying the real image on the transmissive screen 11, the spot lamp 4 is turned off. Thereby, the viewer 14 can be given an illusion as if the real object 9 placed on the mounting table 2 is approaching. The attention of the viewer 14 will come and go between the real 9 and the real image. In addition, spot The same effect can be expected by simply reducing the light amount of the spot lamp 4 instead of turning off the lamp 4.

In the display device according to the third embodiment, when the display of the real image on transmission screen 11 is finished, spot lamp 4 is turned on. Thereby, the viewer 14 can be given an illusion of returning to the real image 9 on the other side of the transmissive screen 11 formed on the transmissive screen 11. The point of interest of the viewer 14 will be toggling between the real 9 and the real statue. The same effect can be expected by merely increasing the light amount of the spot lamp 4 instead of turning on the spot lamp 4.

[0155] In Embodiment 3, only spot lamp 4 is turned on when there is no person around the display device, and only projector 13 is turned on when a viewer comes. In addition to this, for example, the lighting of the spot lamp 4 and the lighting of the projector 13 may be controlled stepwise or may be controlled so as to change slowly.

[0156] Only the lighting of the spot lamp 4 may be controlled according to the presence or absence of a person.

In the case of this modification, it is possible to use a projector 13 that does not have an extinguishing function, and to expect the same effect as the display device of the third embodiment while suppressing the total cost of the display device. can do.

[0157] Further, when there is no person around the display device, the spot lamp 4 and the projector 13 are turned off, and when the viewer comes, only the spot lamp 4 is turned on. You can turn it on.

In the third embodiment, the display device has one spot lamp 4 that outputs incandescent light. In addition to this, for example, as shown in FIG. 24, the display device may have a spot lamp 4 that outputs incandescent light and a spot lamp 141 that outputs monochromatic light. Further, the display device may be controlled such that the plurality of spot lamps 4 and 141 are switched on or off, or may be turned on simultaneously. When a plurality of spot lamps 4 and 141 are turned on at the same time, the color of the real object 9 can be changed by combining light. FIG. 24 is a cross-sectional view showing a modification of the display device having the spot lamp 4 that outputs incandescent light and the spot lamp 141 that outputs monochromatic light. In the third embodiment, the display device has one spot lamp 4 and one real object 9. In addition to this, for example, as shown in FIG. 25, the display device may have a plurality of sets of spot lamps 4, 151 and real objects 9, 152. In addition, the display device may switch the plurality of spot lamps 4 and 151 to be lit, thereby switching the point of interest of the viewer 14 between the plurality of real objects 9 and 152. FIG. 25 is a cross-sectional view showing a modification of the display device having a plurality of sets of spot lamps 4 and 151 and real objects 9 and 152.

[0160] Each of the above embodiments is an example of a preferred embodiment of the present invention, but the present invention is not limited to this, and various modifications and changes can be made.

[0161] For example, in each of the above embodiments, the entrance restriction frame 1 of the display device is assembled in a cubic frame structure. In addition to this, for example, the entry restriction frame 1 may be formed in a hexagonal column shape or another column shape. The display device may be installed in a pillar of a building or the like.

In each of the above embodiments, the transmissive screen 11 is provided only between the pair of column members 5 of the entry restriction frame 1. In addition to this, for example, a plurality of transmissive screens may be provided between the column members 5 of all the sets of the entrance restriction frame 1. This allows a plurality of viewers 14 to operate the respective translucent screens at the same time, and to watch at the respective paces.

Industrial applicability

[0163] The display device according to the present invention can be used to display arts, crafts, commodities, and the like that actually exist.

Claims

The scope of the claims

[1] A screen, which is provided between the actual object to be displayed and the viewing position, and is sized and transparent for the viewer to see at the viewing position,

A projector that projects an image of a real object having substantially the same posture as the real object when viewed through the screen from the viewpoint of the viewer on the screen so as to overlap with the real object,

A display device comprising:

[2] viewing position detecting means for detecting a viewing position or a viewpoint position of the viewer,

Image changing means for changing the image of the real object formed on the screen in accordance with the position detected by the viewing position detecting means so that the image of the real object overlaps the real object when viewed from the position force;

The display device according to claim 1, comprising:

[3] The viewing position detecting means,

A distance sensor for detecting a distance to the viewer, the screen capa;

An imaging device for imaging a predetermined range on the viewer side of the screen;

Based on the distance detected by the distance sensor and the image captured by the imaging device, a viewer viewpoint specifying unit that specifies the position of the viewer's viewpoint,

3. The display device according to claim 2, comprising:

[4] In the case where a plurality of viewers are shown in the captured image, the viewer viewpoint identification means may be located at the center of the image or the viewer closest to the center of the screen. 4. The display device according to claim 3, wherein a viewpoint position of a viewer present is specified.

[5] The viewing position detecting means,

Contact position detecting means for detecting a position touching the screen,

Based on the contact position detected by the contact position detecting means, based on the positional relationship between the screen and the viewer, assuming that the viewer extended his arm and touched the viewer, Viewer viewpoint specifying means for specifying the position of the

3. The display device according to claim 2, comprising:

[6] The screen is a transmissive screen having a transmittance of 50% or more and 80% or less, and is disposed on the real side of the screen and illuminates the real. The first control is to lower the amount of light output by the light emitting member when forming an image, and the second control is to increase the amount of light output by the light emitting member to erase the real image formed on the screen. Light amount control means for executing at least one of the controls,

The display device according to claim 1, comprising:

[7] operation detecting means for detecting a viewer's operation on the screen,

2. An image control means for rotating or enlarging or reducing a real image formed on the screen based on an operation detected by the operation detection means and a display state of the image at that time. Exhibition equipment.

[8] operation detecting means for detecting a viewer's operation on the screen,

Image forming means for forming, on the screen, an image, video or character information relating to the real object based on the operation detected by the operation detecting means and the display state of the image at that time;

The display device according to claim 1, comprising: