JPH11296158A - Method and device for displaying solid - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable more natural three-dimensional(3D) view without overlapping preceding and following display images in the view from an observer by synthesizing a mask image with respective 2D images except a front picture, erasing the display information at the hidden sections of respective 2D images except the front picture, and displaying it on a 2D display device. SOLUTION: Mask image generators 120-122 and 133-135 for generating mask images for hiding the sections hidden so as not to be watched by the image of the front picture and synthesizers 126, 131 and 132 are arranged. Relating to the synthesizer 126, for example, the mask images generated by the mask image generators 120-122 are overlapped on a 2D image 119 displayed on a 2D display device 103. Next, the section to be hidden by images 115-117 displayed from 2D display devices 101-103 is erased by the mask images or its transmission factor is changed. Thus, the section hidden by the images 115-117 is not watched through.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereoscopic display method and apparatus, and more particularly, to a depth sampling type stereoscopic display device including a variable focus type stereoscopic display device, which covers an image portion to be hidden from a viewer. The present invention relates to a stereoscopic display method and apparatus capable of solving an inconsistency between an actual image in stereoscopic vision and an image by a depth sampling type stereoscopic display device by hiding the image.

[0002]

2. Description of the Related Art Conventionally, as a three-dimensional display device for developing a two-dimensional image of a two-dimensional image display device in the depth direction and reproducing a three-dimensional image, a variable focus type three-dimensional display device (Japanese Patent Application No. 8-182).
No. 222), or a depth sampling type stereoscopic display device ("3D video" edited by Shuichi Inada, Shokodo Co., Ltd., 1991.
7.5, p13-24) are well known. FIG. 9 is a view for explaining the display operation principle of a variable focus lens type device as an example of the variable focus type stereoscopic display device. Here, the varifocal lens 802 is a lens whose focal length changes by a function of sandwiching a Fresnel lens liquid crystal layer between transparent electrodes and applying an electric field to change the refractive index of the liquid crystal. In this variable focus lens type device, first, as shown in FIG.
Is depth-sampled into a set 1007 of depth-sampled images that are two-dimensional images. Next, as shown in FIG. 9, the depth sampling image 1007 is displayed on the two-dimensional display device 801 in a time-division manner by the driving device 811, and the variable focus is synchronized with the display by the synchronization device 810. The focal length of the lens 802 is changed. Accordingly, from the lens principle, the image position of the depth sampled image 1007 displayed on the two-dimensional display device 801 changes in the depth direction according to the focal length of the variable focus lens 802. Therefore, if this is performed at high speed within the afterimage time of the human eye, the three-dimensional image 803 shown in FIG. 9 can be observed due to the afterimage effect. 9A shows a case where the three-dimensional image 803 is a virtual image (the two-dimensional display device 801 is arranged within the focal length of the variable focus lens 802), and FIG. 9B shows a case where the three-dimensional image 803 is a real image. (The two-dimensional display device 801 is connected to the varifocal lens 8
02 (outside the focal length of 02).

FIG. 10 is a diagram for explaining the display operation principle of a vibrating screen type device as an example of a depth sampling type stereoscopic display device. Also in this vibrating screen type device, first, as shown in FIG.
6 is depth-sampled and decomposed into a set 1007 of depth-sampled images that are two-dimensional images. Next, as shown in FIG. 10, the depth sampled image 1007 is displayed on the two-dimensional display device 901 in a time-division manner, and in synchronization with this display, the two-dimensional display device 901 is driven at a high speed in the depth direction by the driving device 902. To move. If this is performed at high speed within the afterimage time of the human eye, the three-dimensional image 903 shown in FIG. 10 can be observed due to the afterimage effect.

In the above-mentioned conventional stereoscopic display device, since the display image is actually changed and displayed in the depth direction, physiological factors of human stereoscopic vision (binocular parallax, convergence, focus adjustment, dynamic parallax, etc.). ) Has an almost satisfactory advantage.

[0005]

However, in the above-mentioned conventional three-dimensional display device, since the depth direction is displayed in a time-division manner and integrated into a three-dimensional image by an afterimage phenomenon, the viewer (for example, FIG. 9 (or 904 shown in FIG. 10) is not visible (or hidden) from the back or inside point of the object (for example, 805 shown in FIG. 9 or FIG. 10). 90 shown
5), or it is difficult to avoid a phantom phenomenon in which an object behind can be seen through. This is a major obstacle in reproducing a natural image, and has been a major cause of the fact that the conventional stereoscopic display device described above can be used substantially only for reproducing a wire frame image.

[0006] On the other hand, holography is well known as a stereoscopic display system that almost satisfies the physiological factors of stereoscopic vision and can avoid the phantom phenomenon. However, holography has drawbacks in that coherent light is required for imaging, and the amount of required information is enormous, making electrical rewriting difficult and not suitable for dynamic display. As described above, the conventional stereoscopic display apparatus has a problem that it is difficult to substantially satisfy physiological factors of stereoscopic vision and to reproduce a natural three-dimensional image as a moving image while avoiding a phantom phenomenon. .

SUMMARY OF THE INVENTION The present invention has been made to solve the problems of the prior art, and an object of the present invention is to provide a stereoscopic display method and apparatus in which display images before and after a viewer see each other and overlap each other. It is an object of the present invention to provide a technique capable of avoiding the phantom phenomenon of being visible and obtaining a more natural stereoscopic view.

The above and other objects and novel features of the present invention will become apparent from the description of the present specification and the accompanying drawings.

[0009]

SUMMARY OF THE INVENTION Among the inventions disclosed in the present application, the outline of a representative one will be briefly described.
It is as follows.

That is, the present invention provides a three-dimensional image by repeating a step of sequentially displaying individual two-dimensional images obtained by depth sampling a three-dimensional stereoscopic image on a two-dimensional display device within the afterimage time of the human eye. In the stereoscopic display method for displaying a stereoscopic image, the step includes, when the individual two-dimensional image to be displayed is not the foreground two-dimensional image as viewed from the observer, the individual other than the foreground as viewed from the observer. A first step of generating, as a mask image, a hidden part of each of the two-dimensional images other than the foreground in the object image in the two-dimensional image located before the two-dimensional image; And synthesizing the individual two-dimensional images of the two-dimensional images, deleting the display information of the hidden parts of the individual two-dimensional images other than the foreground, and displaying the information on the two-dimensional display device. Features.

Further, the present invention has a variable focus means for changing an image forming position of a two-dimensional image displayed on the two-dimensional display device. It is characterized in that individual two-dimensional images obtained by depth sampling a stereoscopic image are sequentially displayed on a two-dimensional display device.

The present invention also relates to a two-dimensional display device which uses a plurality of the two-dimensional display devices, and converts each of the two-dimensional images obtained by depth sampling the three-dimensional stereoscopic image into a corresponding two-dimensional display device of the plurality of two-dimensional display devices. Is displayed.

Further, the present invention is characterized in that the two-dimensional display devices display two-dimensional images at different image forming positions.

Further, according to the present invention, in the first step, an object image in a two-dimensional image located before the individual two-dimensional image other than the foreground when viewed from the observer, Each of the hidden parts of the two-dimensional image is generated as a mask image, and in the second step, the mask image is combined with the individual two-dimensional images other than the foreground, and the individual parts other than the foreground are combined. The display information of the hidden portion of the two-dimensional image is deleted and displayed on a two-dimensional display device that displays a two-dimensional image other than the foreground two-dimensional image.

The present invention also provides a parallel movement process in proportion to the vertical and horizontal movements of the two-dimensional image object in front of the viewer due to the movement of the viewpoint position of the observer.
The present invention is characterized in that enlargement / reduction processing in proportion to the amount of movement is performed on the front-back movement of the object of the two-dimensional image in front due to the movement of the viewpoint position of the observer.

Further, the present invention is characterized in that a hidden portion of the two-dimensional image overlapping the mask image is displayed with a desired luminance or a desired color tone.

Further, according to the present invention, the two-dimensional image to be displayed in each of the two-dimensional images obtained by depth-sampling the three-dimensional stereoscopic image is not the foreground two-dimensional image as viewed from the observer in the stereoscopic display device. In this case, a hidden portion of each of the two-dimensional images other than the foreground is generated as a mask image in the object image in the two-dimensional image located in front of the respective two-dimensional images other than the foreground as viewed from the observer. A mask image generating device, a moving device for moving and deforming the mask image generated by the mask image generating device in accordance with the movement of the viewpoint position of the observer, a mask image generated by the moving device, and the forefront surface A synthesizing apparatus for synthesizing the individual two-dimensional images other than the foreground and deleting display information of a hidden portion of the individual two-dimensional image other than the foreground, changing the display information to a desired luminance, or a desired color tone; A foreground two-dimensional image and the combining device; Characterized by comprising a two-dimensional display device for displaying a two-dimensional image outputted from.

Further, the present invention provides a display means for displaying a display image of the two-dimensional display device, a focus changing means for changing an image forming position of the display image displayed on the display means, and A shutter device for displaying or blocking a display image of the two-dimensional display device in synchronization with a change in the focal position.

Further, the present invention provides a plurality of two-dimensional display devices for displaying individual two-dimensional images obtained by depth-sampling a three-dimensional stereoscopic image, and display means for displaying each display image of the plurality of two-dimensional display devices. A focus changing means for changing an image forming position of a display image displayed on the display means; and a corresponding one of the display images of the plurality of two-dimensional display devices synchronized with the change of the focus position of the focus changing means. And a shutter device for selecting a display image to be displayed, wherein each of the two-dimensional display devices for displaying a two-dimensional image other than the foreground two-dimensional image is displayed on each of the two-dimensional display devices. In the object image in each two-dimensional image which is closer to the observer than the power two-dimensional image, the hidden part of the two-dimensional image to be displayed on each two-dimensional display device is generated as a mask image. Same number as 2D image before 2D image A mask image generating device, a same number of moving devices as the mask image generating device for moving and deforming a mask image generated by each of the mask image generating devices according to a movement of a viewpoint position of an observer, and each of the moving devices The mask image generated in the above is combined with the two-dimensional image to be displayed on each of the two-dimensional display devices, and display information of a hidden part of the two-dimensional image to be displayed on each of the two-dimensional display devices is deleted, A two-dimensional display device for displaying a two-dimensional image other than the foreground two-dimensional image, comprising a two-dimensional image output from the two-dimensional image. Is displayed.

Further, according to the present invention, the display means is provided for each of the two-dimensional display devices and the projection screen, and projects a display image displayed on each of the two-dimensional display devices onto the projection screen. And a projection optical system.

Further, according to the present invention, the display means is arranged on the same optical axis as a projection screen, reflects an image projected from each of the two-dimensional display devices to a front surface, and transmits an image on a rear surface as it is. A plurality of reflecting devices, and a projection optical system provided for each of the two-dimensional display devices, for reflecting a display image displayed on each of the two-dimensional display devices to the reflecting device and projecting the reflected image on the projection screen. It is characterized by comprising.

According to the present invention, the display means may include a plurality of reflecting devices arranged on the same optical axis to reflect an image projected from the two-dimensional display device to a front surface and to transmit an image on a rear surface as it is. It is characterized by becoming.

The present invention also provides a plurality of transmissive two-dimensional display devices for displaying individual two-dimensional images obtained by depth-sampling a three-dimensional stereoscopic image; Reflecting the light of the light source from the front or side in the direction of the observer, and a plurality of reflection devices that transmit light from the back, and are arranged on the same optical axis as the plurality of transmission type two-dimensional display devices, A three-dimensional display device comprising: a focus changing unit that changes an image forming position of a display image displayed on each of the transmission type two-dimensional display devices, wherein a two-dimensional image other than the foreground two-dimensional image is displayed. Each transmission-type two-dimensional display device displays each transmission-type two-dimensional display with an object image in each two-dimensional image that is closer to the observer than a two-dimensional image to be displayed by each transmission-type two-dimensional display device. Generates a hidden part of the two-dimensional image to be displayed on the device as a mask image The same number of mask image generation devices as the two-dimensional images that are in front of the two-dimensional image to be displayed, and the mask images generated by the respective mask image generation devices are moved and moved according to the movement of the viewpoint position of the observer. The same number of moving devices as the mask image generating devices to be deformed, the mask images generated by each of the moving devices, and the two-dimensional image to be displayed on each transmission type two-dimensional display device are combined, and Display information of the hidden part of the two-dimensional image to be displayed on the type two-dimensional display device,
A transmission device for displaying a two-dimensional image other than the foreground two-dimensional image, which is output from the synthesis device. It is characterized by displaying a two-dimensional image.

Further, the present invention provides a plurality of transmissive two-dimensional display devices for displaying individual two-dimensional images obtained by depth-sampling a three-dimensional stereoscopic image, and the same optical axis as the plurality of transmissive two-dimensional display devices. And a focus changing unit that changes an image forming position of a display image displayed on each of the transmission type two-dimensional display devices, wherein the two-dimensional image is a two-dimensional image other than the foreground two-dimensional image. Each transmission type two-dimensional display device that displays an image is an object image in each two-dimensional image that is closer to the observer than a two-dimensional image to be displayed by each transmission type two-dimensional display device. A mask image generating device for generating a masked portion of a two-dimensional image to be displayed by a two-dimensional display device as a mask image, and the same number of mask image generating devices as the two-dimensional images in front of the two-dimensional image to be displayed; The mask image generated by the device is
The same number of moving devices as the mask image generating devices that move and deform according to the movement of the observer's viewpoint position, the mask images generated by each of the moving devices, and the transmission type two-dimensional display devices should be displayed. The two-dimensional image is synthesized and the transmission type 2
And a synthesizing device for deleting display information of a hidden portion of the two-dimensional image to be displayed by the two-dimensional display device, changing the display information to a desired brightness, or changing a desired color tone. Each transmission type two-dimensional display device for displaying an image displays a two-dimensional image output from the synthesizing device.

The present invention is further characterized by further comprising means for detecting the movement of the observer and sending information of the detected movement amount to the moving device.

[0026]

Embodiments of the present invention will be described below in detail with reference to the drawings.

In all the drawings for explaining the embodiments, parts having identical functions are given same symbols and their repeated explanation is omitted.

[First Embodiment] FIG. 1 is a diagram showing a schematic system configuration of a three-dimensional display device according to a first embodiment of the present invention. The three-dimensional display device of the present embodiment includes a two-dimensional display device (101 to 104), a projection screen 105, a variable focus lens 106, a shutter device (107 to 110),
Projection optical system (111-114), mask image generation device (1
20-122, 133-135), moving device (123-
125, 136-138), and the synthesizer (126, 136-138).
131, 132). As the two-dimensional display device (101 to 104), a CRT, a projector, a liquid crystal display, a plasma display, an EL display, or the like can be used.

The shutter devices (107 to 110) are used to control the focal position of the varifocal lens 106 (that is, the image (115 to 1)).
18) This is a device for displaying the depth images on the projection screen 105 in a time-division manner in synchronization with the change of the imaging position (18), and can use a mechanical mechanical shutter or a shutter using a liquid crystal. . When the two-dimensional display device is a transmission type or a reflection type, the light source itself may blink in synchronization with an image instead of the shutter device (107 to 110). A shutter device to be blocked may be arranged in front of the light source, and the shutter device may be controlled in a time-division manner. The varifocal lens 106 moves the focus position (that is, the image (1
15 to 118) are periodically changed, and a two-frequency liquid crystal driven by switching between high frequency and low frequency is used, so this frequency is as high as 60 Hz or more per second.

In the present embodiment, the two-dimensional display device (10
1 to 104), a desired sampled two-dimensional image is displayed, and the shutter devices (107 to 110) are initially closed. When the focal position of the varifocal lens 106 is periodically changed, the imaging position of the sampled two-dimensional image is 11
The shutter device 1 is synchronized with the timing of the position 5
07 is opened, an image is projected from the two-dimensional display device 101 onto the projection screen 105 to display an image 115, and the shutter device 107 is immediately closed. Next, the shutter device 108 is opened in synchronization with the timing at which the imaging position of the sampled two-dimensional image becomes the position 116, and the image is projected on the projection screen 105 from the two-dimensional display device 102 to display the image 116. Then, the shutter device 108 is immediately closed. This procedure is similarly performed in the two-dimensional display device (103, 104) in synchronization with the periodic change of the focal position of the variable focus lens 106. At this time, the speed of one cycle of the varifocal lens is 60 Hz or more, so it is within the afterimage time of the human eye, and the observer sees images having different image formation positions (115 to 11).
8) is observed almost simultaneously, and is recognized as a solid in space.

However, in this state, the image 115 is obtained from the observer.
Images that should not be seen in the shadow of (116, 117, 1
Part of 18) is seen through. Therefore, a mask image generating apparatus (120 to 122, 13) for generating a mask image for covering a part which should not be seen by being hidden by the front image.
3 to 135) and the synthesizing device (126, 131, 132). For example, in the synthesizing device 126, the mask image generated by the mask image generating device (120 to 122) is displayed on the two-dimensional display device 103. Two-dimensional image 11
9 and a two-dimensional display device (101, 102, 1)
The part which must be hidden by the image (115, 116, 117) displayed from step 03) is erased or the transmittance is changed by the mask image.

As a result, the image (115, 116, 117) of the image (back image) 118 projected on the projection screen 105 by projecting the image from the two-dimensional display device 103 is displayed.
This eliminates the need to see through the parts that must be hidden. In this case, when the object to be displayed is translucent such as a glass product, the translucent substance can be reproduced by superimposing the mask image with a high transmittance changed by the synthesizing device 126. . In the synthesizing device 126, the mask image generating device (120 to 12) is used.
The color tone of the mask image generated in 2) may be changed. Here, the mask image generation device (120-1)
22, 133 to 135) are obtained by simply converting the image signal of the image displayed on the front side into a simple binary or gradation expression. The mask image generating device (120 to 122, 133 to 135) and the moving device (1
23-125, 136-138), and the synthesis device (1
26, 131, 132) can be realized by dedicated electronic circuits or processing on a computer.

In FIG. 1, the mask image generated by the mask image generation device 120 corresponding to the image 117, the image 11
6, a mask image generated by the mask image generating device 121, and a mask image generating device 122 corresponding to the image 115.
Is moved by the moving device (123, 124, 125) according to the movement of the observer's viewpoint from the sensor 127 that detects the position of the observer, and the two-dimensional mask image is moved by the combining device 126. The image is superimposed on the two-dimensional image 119 displayed on the display device 103, the image of the overlapped portion is deleted or the transmittance is changed, and the image is projected by the two-dimensional display device 103. In addition, the synthesis device (126,
131, 132), for example, the original two-dimensional image 119 is added to another image (mask image generation device (120, 12
For example, a device that deletes only pixels where an image generated by (1,122) overlaps, or a device that deletes only pixels where another image overlaps by image processing by a computer is used.

In the present embodiment, the same number of moving devices and mask image generating devices as the number of sampled two-dimensional images in front of the two-dimensional image are required.
(The number of all sampled two-dimensional images -1) (three in the case of FIG. 1)
Required. For example, in the case of the two-dimensional image 119 in FIG. 1, three sets of mask image generating devices (120 to 122) and moving devices (123 to 125)
, Two sets of mask image generation devices (134, 13
5) and a moving device (137, 138) are required.

Here, as shown in FIG. 1, it is expected that a trapezoidal distortion will occur in the projected image when projected at an angle other than a right angle with respect to the projection screen 105, but such a two-dimensional display device (101 To 104) and the projection screen 105, and make the projection angle small, or a two-dimensional display device (1
This trapezoidal distortion problem can be solved by a method such as displaying a transformed image of the display images of Nos. 01 to 104) in consideration of the trapezoidal distortion or deforming the display image by a lens system.

The mask image generator (120 to 122,
133 to 135), the concept of the mask image
This will be described with reference to FIG. As shown in FIG. 6A, for example, since the display image 501 is displayed on the foreground, there is no image on the front, so that the display image 501 is directly projected as the projection image 510 without a mask image. Further, as shown in FIG. 6B, the next display image 502 is formed by overlapping a mask image 507 in order to hide a portion hidden by the display image 501 on the front of the next display image 502, so that only a portion not hidden by the mask image 507 is displayed. Projected image 51
1 is projected. Similarly, as shown in FIG. 6C, the next display image 503 is formed by superimposing a mask image 508 for hiding the immediately preceding display image and superimposing a mask image 507 for obscuring the frontmost display image. A projection image 512 is projected. Similarly, as shown in FIG. 6D, the next display image 504 overlaps a mask image 509 that hides the display screen immediately in front, and overlays a mask image 508 that hides another display image in front. Further, a projected image 513 is projected by superimposing a mask image 507 that covers the foreground display image. A conventional stereoscopic display device displaying a stereoscopic display image having four depths is a display image 5 shown in FIG.
Although the back is seen through like 05, the one displayed according to the present embodiment is such that the sampled two-dimensional images overlap (or the back is seen through) like the projected image 514 shown in FIG. It can be displayed without the need.

When the observer moves, the mask image is moved according to the movement of the observer (123 to 125, 13).
6 to 138), the part of the rear image that must be hidden from the observer by the observer is hidden according to the position of the observer.
The concept of the moving device (123 to 125, 136 to 138) will be described with reference to FIG. FIG. 7 shows an image 605 of the front.
From the image 601 to the image 60
9). For example, in the horizontal direction, when the observer moves from the front to the right toward the stereoscopic display device, the mask image 610 is changed from the front image 605 to the right image 60.
By moving to the left as shown in FIG.
The parts that need to be seen from the position of the 11 observer are visible, and the parts that must be hidden are hidden by the mask image 610. In the case of the vertical direction, the image is moved from the front image 605 to the upper image 602 or to the lower image 608. Further, by simultaneously moving the image in the vertical and horizontal directions, the image 603 at the upper right and the image 609 at the lower right can be moved.

The amount of movement is proportional to the amount of movement of the observer in the vertical and horizontal directions, and the size of the mask image to be displayed is also proportional to the amount of movement of the observer in the longitudinal direction. Zoom in and out. FIG. 8 shows a method of detecting a movement position by sensors as a method of detecting a position due to the movement of the observer. In the present embodiment, as shown in FIG. 8A, a plurality of infrared sensors
10 are arranged so that they can be detected, and an infrared sensor system that detects the range of the sensor 710 from the front or the rear of the observer 710, as shown in FIG. Or forward, or backward,
Alternatively, a distance sensor (ultrasonic distance sensor or laser distance sensor) 703 is arranged on both of them, and the distance sensor 70
A distance measurement method for measuring the distance from the observer 710 to the observer 710 and detecting the position of the observer 710, as shown in FIG. 8C, disposing the optical sensors 704 on the floor or on the front, back, left and right of the observer 710. Then, the position of the observer 710 is calculated by image processing from an image of the fixed camera 705 as shown in FIG. 8D, or an optical sensor method for detecting a place where light is blocked by the observer 710, or Any of the camera systems that detect the position of the marker of the observer 710 with the marker from the image can be adopted. In addition,
In the present embodiment, a mask image generating device (120 to 122, 133 to 135) and a moving device (1
23-125, 136-138), and the synthesis device (1
26, 131, 132), and
This has the advantage that complicated processing of the image is not required.
For this reason, this embodiment has an advantage that it can be applied to a moving image that requires high-speed display, such as a moving image.

[Second Embodiment] FIG. 2 is a diagram showing a schematic system configuration of a stereoscopic display device according to a second embodiment of the present invention. The three-dimensional display device of the present embodiment differs from the first embodiment in that projection is performed on the projection screen 205 from the front. In the present embodiment, the same mask image generating apparatus, moving apparatus, and synthesizing apparatus as those in the first embodiment are used, but are omitted in FIG. That is, in order to obscure a portion hidden by an image formed before each image (215 to 218), each two-dimensional display device (201 to 204) is displayed in front of the image as viewed from the observer. A mask image generating device for generating a mask image for concealing a portion overlapping with an image to be displayed, and a moving device for moving the mask image are arranged by the number of images in front of the display image. Dimensional display device (201
By overlapping the mask image generated by each of the mask image generating devices on the image of (1) to (204), the problem that the image can be seen through even when there are a plurality of depths is solved.

In the present embodiment, for example, an image projected from the two-dimensional display device 201 on the projection screen 205 is formed as an image 215 by the variable focus lens 206. The next image from the two-dimensional display device 202 is 2
After superimposing a mask image for covering a part hidden by the image 215 from the two-dimensional display device 201, the image 21
6 is imaged. The next image from the two-dimensional display device 203 is the image (2) from the two-dimensional display device (201, 202).
15, 216) are superimposed on a mask image for covering the part hidden by the mask, and then formed as an image 217. As described above, in the present embodiment, similarly to the above-described embodiment, the two-dimensional display devices (201 to 204) to be displayed include:
This is a configuration in which a necessary number of mask images that cover a portion hidden by an image displayed on the front when viewed from the observer are superimposed by a required number.

Only when the two-dimensional display device (201 to 204) is a transmission type or a reflection type (for example, a liquid crystal display or the like that requires a backlight or utilizes reflection), illumination (such as a backlight) is used. EL, LED,
(Including fluorescent tubes, discharge tubes, and light bulbs) with a shutter device in front of it to transmit / block the light from the backlight source, or to flash the backlight source directly instead of the shutter device to time-division. It can be performed.

[Third Embodiment] FIG. 3 is a diagram showing a schematic system configuration of a three-dimensional display device according to a third embodiment of the present invention. In each of the above embodiments, the reason why a plurality of two-dimensional display devices are used is that, in the case of displaying a three-dimensional moving image, high-speed display switching such that the number of displayed images per second satisfies “the number of frames × the number of depth samples” is achieved. This is necessary and difficult with a real two-dimensional display device. However, in the case where a device capable of extremely high display / erasing speed is used, one two-dimensional display device is used instead of the plurality of two-dimensional display devices, and the one two-dimensional display device is used. By displaying each two-dimensional image on the device in a time-sharing manner, it is possible for one two-dimensional display device to perform the role of a plurality of two-dimensional display devices. This embodiment is a three-dimensional display device that uses the one two-dimensional display device described above. Note that the mask image generation device (1) shown in FIG.
20-122, 133-135), moving device (123-
125, 136-138), and the synthesizer (126, 136-138).
131, 132) are the same as in FIG.

The variable focus lens 1105 periodically changes the focal position (ie, the image forming position), and uses a dual-frequency liquid crystal driven by switching between high frequency and low frequency. The frequency is as fast as 60 Hz or more per second.

In this embodiment, the switching device 1110
, A display signal for displaying a desired sampled two-dimensional image, for example, the image of 1106, is selected, and the two-dimensional display device 11 is selected.
The image 1106 is displayed at 01, and the shutter device 1102 is initially closed. Variable focus lens 1105
When the focal position of is periodically changed, the imaging position becomes 11
The shutter device 1102 is opened in synchronization with the timing of the position 06, the image is projected on the projection screen 1104 from the two-dimensional display device 1101, and the image 1106 is displayed.
The shutter device 1102 is immediately closed. Next, a desired sampled two-dimensional image, for example,
A display signal for displaying the image of 1107 is selected, and the image of 1107 is displayed on the two-dimensional display device 1101,
The shutter device 1102 is closed. The imaging position is 11
The shutter device 1102 is opened in synchronization with the timing of the position 07, the image is projected from the two-dimensional display device 1101 onto the projection screen 1104 to display the image 1107, and the shutter device 1102 is immediately closed. The image 11 is synchronized with the periodic change of the focal position of the varifocal lens 1105.
The same procedure is performed for 08 and 1109.
At this time, the speed of the variable focus lens 1105 in one cycle is 60
Hz or more, which is within the afterimage time of the human eye,
The observer can see images (1106, 1107,
1108, 1109) are observed almost simultaneously, and recognized as a solid in space. The two-dimensional display device 11
Processing such as synthesis of a mask image with the image displayed at 01 is the same as in the first embodiment.

[Fourth Embodiment] FIG. 4 is a diagram showing a schematic system configuration of a stereoscopic display device according to a fourth embodiment of the present invention. The three-dimensional display device according to the present embodiment is configured so that the centers of the luminous fluxes of all the projected or transmitted images are the same. Note that also in the present embodiment, the mask image generating device, the moving device, and the synthesizing device are the same as those in the first embodiment.
Are used, but are omitted in FIG. FIG.
The variable focus lens 306 shown in (1) periodically changes the focus position (that is, the image formation position) and uses a dual frequency liquid crystal driven by switching between high frequency and low frequency. It is as fast as 60 Hz or more.

In the three-dimensional display device of this embodiment, 2
A desired two-dimensional sampled image is displayed on each of the three-dimensional display devices (301, 302, 303, 304).
The shutter devices (307, 308, 309, 310) are initially closed. When the focus position of the varifocal lens 306 is periodically changed, the shutter device 307 is opened in synchronization with the timing at which the image forming position becomes the position 318,
An image is projected from the two-dimensional display device 301 to the projection screen 305 by the reflection device 315 to display an image 318,
The shutter device 307 is immediately closed. Next, the shutter device 308 is opened in synchronization with the timing at which the image formation position becomes the position 319, and the image is projected on the projection screen 305 from the two-dimensional display device 302 by the reflection device 316 to display the image 319. The shutter device 308 is immediately closed. The above-described procedure is similarly performed on the two-dimensional display device (303, 304) in synchronization with the periodic change in the focal position of the variable focus lens 306. At this time, since the speed of one cycle of the variable focus lens 306 is 60 Hz or more, it is within the afterimage time of the human eye, and images (318, 319, 320, 321) having different imaging positions are almost simultaneously displayed to the observer. It is observed and recognized as a solid in space. Then, for example, the image displayed on the two-dimensional display device 303 is obtained by superimposing a mask image for hiding a portion overlapping the image (318, 319), and is formed as an image 320. As described above, the image behind the observer is reproduced by superimposing the mask image from the mask image generating device that hides the image in front of the image.

FIG. 4 shows a configuration method according to this embodiment.
As shown in (a), a two-dimensional image is projected on a projection screen 3.
05, and the projected image is formed by the varifocal lens 306, and as shown in FIG.
There is a method of forming an image from a two-dimensional display device by a variable focus lens 306. For example, the two-dimensional display device 3
The image displayed at 01 passes through the shutter device 307 and the projection optical system 311, and is projected on the projection screen 305 by the reflection device 315. The projected image is formed as an image 318 by the variable focus lens 306.
The image masked by the mask image generation device and displayed on the two-dimensional display device 302 passes through the shutter device 308 and the projection optical system 312, and is projected on the projection screen 305 by the reflection device 316. The projected image is formed as an image 319 by the variable focus lens 306. Similarly, masked by the mask image generating device, 2
The image displayed on the two-dimensional display device 303 is formed as an image 320, and the image displayed on the two-dimensional display device 304 is formed as an image 321 by being masked by the mask image generating device.

Here, each of the two-dimensional display devices (301 to 30)
In order to match the optical axis of the image from 4), a reflecting device (315, 31) that transmits light from the back and reflects light from the front.
6,317), a half mirror, an HOE (holographic optical element: one that reflects only light from one direction and transmits light in the other direction) and the like can be used. In addition, the reflection device (315,
316, 317), HPDLC (holographic polymer dispersed liquid crystal: high-speed reflection / transmission or blocking /
By using a liquid crystal that can drive the transmission operation,
The functions of the reflection device and the shutter device can be shared by one reflection device.

[Fifth Embodiment] FIG. 5 is a diagram showing a schematic system configuration of a stereoscopic display device according to a fifth embodiment of the present invention. The three-dimensional display device according to the present embodiment is obtained by stacking a plurality of two-dimensional display devices using a transmissive device (for example, a liquid crystal display) as the two-dimensional display device (401 to 404). . In this embodiment, the same mask image generating apparatus, moving apparatus, and synthesizing apparatus as those in the first embodiment are used, but are omitted in FIG. As a configuration method of the present embodiment, FIG.
As shown in FIG. 5A, there are a method using a reflection device (405 to 408) and a method not using a reflection device as shown in FIG. The method shown in FIG.
A reflection device (405-408) composed of E or the like is arranged, and the reflection device (405-408) reflects the light of the light source 410 from the front or side to the direction of the observer. Light is transmitted. In the method shown in FIG. 5B, a light source 410 is arranged behind each of the two-dimensional display devices (401 to 404). Here, each of the two-dimensional display devices (401 to 404) has transparency when not displaying an image, and causes each of the two-dimensional display devices (401 to 404) to display an image in synchronization with the varifocal lens 409. . The images displayed on the two-dimensional display devices (401 to 404) are superimposed on the two-dimensional display device on the rear surface by overlaying the mask image from the mask image generation device that covers a portion overlapping the image of the two-dimensional display device on the front surface. By matching, a part of the image of the two-dimensional display device on the rear side that must be hidden by the image of the two-dimensional display device on the front side is hidden.

The varifocal lens 409 of this embodiment is
Since the focus position, that is, the imaging position is periodically changed, and a two-frequency liquid crystal driven by switching between high frequency and low frequency is used, this frequency is as high as 60 Hz or more per second.

In this embodiment, the varifocal lens 409
When the focal position of is periodically changed, the imaging position is 41
The two-dimensional display device 4 is synchronized with the timing of the position 4
01 is displayed and the two-dimensional display device 401 is immediately erased. Next, the two-dimensional display device 402 is displayed in synchronization with the timing at which the imaging position becomes the position 413, and the two-dimensional display device 402 is immediately erased. In synchronization with the periodic change of the focal position of the variable focus lens 409, the two-dimensional display device (4
03, 404), the same procedure as above is performed.
At this time, the speed of one cycle of the variable focus lens 409 is 60H.
z or more, it is within the afterimage time of the human eye, and the observer sees images (411, 412, 41
3,414) are observed almost simultaneously, and are recognized as a solid in space. For example, the image projected from the two-dimensional display device 401 is
An image is formed as 14. The next image from the two-dimensional display device 402 is formed as an image 413 after superimposing a mask image for covering the image 414 from the two-dimensional display device 401. Image 412 from the next two-dimensional display device 403
Are images (41) from the two-dimensional display device (401, 402).
After superimposing a mask image for covering (3, 414), an image 412 is formed.

As described above, also in the present embodiment, a required number of mask images for hiding the image displayed on the front as viewed from the observer are superimposed on the two-dimensional display device desired to be displayed. .

In each of the above embodiments, a case has been described in which a variable focus type stereoscopic display device is used as the two-dimensional display device. However, the present invention is not limited to this. It goes without saying that the present invention can be applied to a stereoscopic display device. As described above, the invention made by the inventor has been specifically described based on the embodiment. However, the present invention is not limited to the embodiment, and can be variously modified without departing from the gist of the invention. Of course, it is.

[0054]

The effects obtained by typical ones of the inventions disclosed in the present application will be briefly described as follows.

According to the present invention, a mask image generating apparatus for generating a mask image and a synthesizing apparatus for superimposing a two-dimensional image and a plurality of mask images are provided, and a part which must be hidden from an observer. And a moving device,
Since the mask image is moved with the movement of the observer, the position of the observer is not specified, and a natural three-dimensional image,
Alternatively, a three-dimensional moving image can be displayed.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a schematic system configuration of a stereoscopic display device according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating a schematic system configuration of a stereoscopic display device according to a second embodiment of the present invention.

FIG. 3 is a diagram showing a schematic system configuration of a stereoscopic display device according to a third embodiment of the present invention.

FIG. 4 is a diagram showing a schematic system configuration of a stereoscopic display device according to a fourth embodiment of the present invention.

FIG. 5 is a diagram showing a schematic system configuration of a stereoscopic display device according to a fifth embodiment of the present invention.

FIG. 6 is a diagram for explaining the concept of a mask image generated by the mask image generation device according to each embodiment of the present invention.

FIG. 7 is a diagram for explaining the concept of a mobile device according to each embodiment of the present invention.

FIG. 8 is a diagram for explaining a viewpoint movement detection method in each embodiment of the present invention.

FIG. 9 is a diagram for explaining a display operation principle of a stereoscopic display device using a conventional variable focus lens.

FIG. 10 is a diagram for explaining a display operation principle of a conventional depth sampling type stereoscopic display device.

FIG. 11 is a diagram for describing a depth sampled image that is a two-dimensional image.

[Explanation of symbols]

101-104, 201-204, 301-304, 4
01 to 404, 801, 901, 1101 ... two-dimensional display device, 105, 205, 305, 1104 ... projection screen, 106, 206, 306, 409, 802, 1
105: Variable focus lens, 107 to 110, 207 to 2
10, 307 to 310, 1102 ... shutter device, 1
11 to 114, 211 to 214, 311 to 314, 11
03: Projection optical system, 120 to 122, 133 to 135 ...
Mask image generating devices, 123 to 125, 136 to 138 ...
Moving device, 126, 131, 132 ... Synthesizing device, 127
.., Sensors, 315 to 317, 405 to 408, reflecting devices, 410, light sources, 701, stereoscopic display devices, 702, infrared sensors, 703, distance sensors, 704, optical sensors,
705: camera, 710, 804, 904: observer, 8
10: Synchronizing device, 811, 902: Drive device, 1110
... Switching device.

Claims (18)

[Claims] 1. A step of sequentially displaying individual two-dimensional images obtained by depth-sampling a three-dimensional stereoscopic image on a two-dimensional display device,
By repeating at high speed within the afterimage time of the human eye, 3
In the three-dimensional display method for displaying a three-dimensional image, the step includes, when the individual two-dimensional image to be displayed is not the foreground two-dimensional image as viewed from the observer, the individual other than the foreground as viewed from the observer. A first step of generating, as a mask image, a hidden portion of each of the two-dimensional images other than the foreground in the object image in the two-dimensional image located before the two-dimensional image of the mask image, and the mask image and the foreground Combining the individual two-dimensional images other than the foreground image, deleting the display information of the hidden part of the individual two-dimensional image other than the foreground, and displaying the information on the two-dimensional display device. Stereoscopic display method characterized by the following. 2. A method according to claim 1, further comprising: changing a focus position of the two-dimensional image displayed on the two-dimensional display device.
Each two-dimensional image obtained by depth sampling a three-dimensional stereoscopic image
The stereoscopic display method according to claim 1, wherein the display is performed on a three-dimensional display device. 3. A two-dimensional display device, wherein a plurality of the two-dimensional display devices are used, and individual two-dimensional images obtained by depth sampling the three-dimensional stereoscopic image are displayed on a corresponding two-dimensional display device of the plurality of two-dimensional display devices. The stereoscopic display method according to claim 2, wherein: 4. The three-dimensional display method according to claim 3, wherein the two-dimensional display devices display two-dimensional images at different imaging positions. 5. The method according to claim 1, wherein, in the first step, an object image in the two-dimensional image located before the individual two-dimensional image other than the foreground when viewed from the observer, and Each of the hidden parts is generated as a mask image. In the second step, the mask image is combined with the individual two-dimensional image other than the foreground, and the individual two-dimensional image other than the foreground is generated. 5. The three-dimensional object according to claim 3, wherein display information of a hidden portion is deleted and displayed on a two-dimensional display device that displays a two-dimensional image other than the foreground two-dimensional image. 6. Display method. 6. A parallel movement process proportional to the amount of movement of the two-dimensional image object in front of the viewer due to the movement of the viewpoint position of the observer, and a movement of the viewpoint position of the observer. The three-dimensional object according to any one of claims 1 to 5, wherein an enlargement / reduction process in proportion to an amount of the movement of the object of the front two-dimensional image before and after the object is performed. Display method. 7. The display device according to claim 1, wherein a hidden portion of the two-dimensional image overlapping the mask image is displayed with a desired luminance or a desired color tone. 3D display method described. 8. When the two-dimensional image to be displayed in each of the two-dimensional images obtained by depth-sampling the three-dimensional stereoscopic image is not the foreground two-dimensional image as viewed from the observer, the corresponding two-dimensional image is viewed from the observer. A mask image generation device that generates, as a mask image, a hidden part of each of the two-dimensional images other than the foreground, as an object image in the two-dimensional image in front of the individual two-dimensional images other than the foreground; A moving device that moves and deforms the mask image generated by the image generating device according to the movement of the viewpoint position of the observer; and a mask image generated by the moving device and each two-dimensional image other than the foreground. A synthesizing device that performs a synthesizing process and deletes, changes the display information of a hidden part of each of the two-dimensional images other than the foreground to a desired luminance or a desired color tone, and the foreground two-dimensional image and the synthesizing. Display 2D image output from device 2 A three-dimensional display device comprising: a three-dimensional display device. 9. A display means for displaying a display image of the two-dimensional display device, a focus changing means for changing an image forming position of the display image displayed on the display means, and a change of a focus position of the focus changing means. The three-dimensional display device according to claim 8, further comprising: a shutter device that displays or blocks a display image of the two-dimensional display device in synchronization with the display device. 10. A plurality of two-dimensional display devices for displaying individual two-dimensional images obtained by depth-sampling a three-dimensional stereoscopic image, display means for displaying each display image of the plurality of two-dimensional display devices, and the display. A focus changing means for changing an image forming position of a display image displayed on the means, and a corresponding display image among the display images of the plurality of two-dimensional display devices in synchronization with a change in the focus position of the focus changing means. A two-dimensional display device that displays a two-dimensional image other than the foreground two-dimensional image, the two-dimensional image to be displayed by the two-dimensional display device. In the object image in each two-dimensional image which is closer to the observer than the observer, the hidden part of the two-dimensional image to be displayed on each two-dimensional display device is generated as a mask image.
The same number of mask image generation devices as the two-dimensional image located before the two-dimensional image, and the mask image generation for moving and deforming the mask images generated by the respective mask image generation devices in accordance with the movement of the viewpoint position of the observer The same number of moving devices as the device, a mask image generated by each of the moving devices, and a two-dimensional image to be displayed on each of the two-dimensional display devices are combined, and
A combination device for deleting display information of a hidden portion of the two-dimensional image to be displayed by the two-dimensional display device, changing the display information to a desired luminance or a desired color tone, and a two-dimensional image other than the foreground two-dimensional image. A three-dimensional display device, wherein each two-dimensional display device for displaying an image displays a two-dimensional image output from the synthesizing device. 11. The projection means, a projection screen, and a projection optical system provided for each of the two-dimensional display devices and projecting a display image displayed on each of the two-dimensional display devices onto the projection screen. The three-dimensional display device according to claim 10, wherein: 12. The display means is arranged on the same optical axis as the projection screen, and a plurality of reflections for reflecting an image projected from each of the two-dimensional display devices to a front surface and transmitting an image on a rear surface as it is. A projection optical system that is provided for each of the two-dimensional display devices and reflects a display image displayed on each of the two-dimensional display devices to the reflection device and projects the display image on the projection screen. The three-dimensional display device according to claim 10, wherein: 13. The display means comprises a plurality of reflection devices arranged on the same optical axis, reflecting an image projected from the two-dimensional display device to a front surface, and transmitting an image on a rear surface as it is. The stereoscopic display device according to claim 10, wherein 14. A plurality of transmissive two-dimensional display devices for displaying individual two-dimensional images obtained by depth-sampling a three-dimensional stereoscopic image, installed on the back of each of the transmissive two-dimensional display devices, and arranged in front and side directions. A plurality of reflection devices for reflecting light from a light source toward the observer and transmitting light from the back, and disposed on the same optical axis as the plurality of transmission type two-dimensional display devices, wherein each transmission type A three-dimensional display device comprising: a focus changing unit that changes an image forming position of a display image displayed on the two-dimensional display device, wherein each transmission type 2 displays a two-dimensional image other than the foreground two-dimensional image. The two-dimensional display device displays an object image in each two-dimensional image that is closer to the observer than a two-dimensional image to be displayed by each transmission two-dimensional display device, and displays the object image in each transmission two-dimensional display device. The display for generating a hidden part of a power two-dimensional image as a mask image The same number of mask image generating devices as the two-dimensional images located before the two-dimensional image to be formed; and the mask images generated by the respective mask image generating devices are moved and deformed in accordance with the movement of the viewpoint position of the observer. The same number of moving devices as the mask image generating device, and combining processing of a mask image generated by each of the moving devices and a two-dimensional image to be displayed by each of the transmission type two-dimensional display devices;
A synthesizing device for deleting display information of a hidden portion of the two-dimensional image to be displayed by each of the transmission type two-dimensional display devices, and changing the display information to a desired luminance or a desired color tone; A transmission type two-dimensional display device that displays a two-dimensional image other than the above two-dimensional image displays a two-dimensional image output from the synthesizing device. 15. The holographic device according to claim 15, wherein
15. The three-dimensional display device according to claim 12, wherein the three-dimensional display device is formed of an optical element. 16. A plurality of transmissive two-dimensional display devices that display individual two-dimensional images obtained by depth-sampling a three-dimensional stereoscopic image, and are arranged on the same optical axis as the plurality of transmissive two-dimensional display devices. A three-dimensional display device comprising: a focus changing unit that changes an image forming position of a display image displayed on each of the transmission type two-dimensional display devices, wherein a two-dimensional image other than the foreground two-dimensional image is displayed. Each transmission-type two-dimensional display device displays each transmission-type two-dimensional display with an object image in each two-dimensional image that is closer to the observer than a two-dimensional image to be displayed by each transmission-type two-dimensional display device. The same number of mask image generating devices as the two-dimensional images located before the two-dimensional image to be displayed, which generates a hidden part of the two-dimensional image to be displayed by the device as a mask image; Mask image according to the movement of the observer's viewpoint The same number of moving devices as the mask image generating devices to be moved and deformed, and a mask image generated by each of the moving devices and a two-dimensional image to be displayed on each of the transmission type two-dimensional display devices,
A synthesizing device for deleting display information of a hidden portion of the two-dimensional image to be displayed by each transmission type two-dimensional display device, changing the display information to a desired brightness, or changing a desired color tone; A three-dimensional display device, wherein each transmission type two-dimensional display device that displays a two-dimensional image other than an image displays a two-dimensional image output from the synthesizing device. 17. The apparatus according to claim 8, further comprising means for detecting a movement of an observer and transmitting information of the detected movement amount to said moving device.
Item 3. The stereoscopic display device according to item 1. 18. The three-dimensional display device according to claim 9, wherein the focus changing unit is a variable focus lens.