CN103969937A - Multi-projection three-dimensional display device and method based on pupil compound application - Google Patents

Abstract

The invention discloses a multi-projection three-dimensional display device based on pupil recombination, which includes a multi-projection array arranged in sequence along the optical path, a longitudinally oriented scattering screen, and a controller connected to the multi-projection array; the multi-projection array consists of The projector combination units located on the same arc surface and arranged at equal intervals are composed of each projector combination unit consisting of a plurality of stacked projectors, and each projector has a different pupil orientation angle. The invention also discloses a multi-projection three-dimensional display method based on pupil compounding. The present invention effectively expands the output angle of the projector combination through the angle splicing of the projectors in the projector combination unit, improves the defect caused by the narrow projection angle of the projector, and increases the size of the area seen by the observer in the observation area. So that the observer can get a better visual experience.

Description

Multi-projection three-dimensional display device and method based on pupil compounding

technical field

The invention relates to the technical field of large-scale three-dimensional display, in particular to a multi-projection three-dimensional display device and method based on pupil recombination.

Background technique

Compared with other human senses, visual perception is considered to be one of the most important channels for people to obtain information. Therefore, the research on display technology has attracted more and more attention from the academic community. Reconstructing virtual 3D scenes in real space has always been the goal of human beings, because it can provide more intuitive visual experience, richer details, and more expressive scenes, which is the development trend of future display technology. At present, 3D display technologies are mainly divided into four categories: stereoscopic 3D display technology, auto-stereoscopic 3D display technology, volumetric 3D display technology, light field 3D display technology, and holographic 3D display technology. Among them, the multi-projection light field 3D display technology has attracted more and more attention due to its excellent expressiveness.

Existing literature (see Qing Zhong, Yifan Peng, Haifeng Li, Chen Su, Weidong Shen, and Xu Liu. Multiview and light-field reconstruction algorithms for 360°multiple-projector-type3D display. Applied Optics, Vol.52, Issue19, pp.4419- 4425, 2013) proposed a large-scale 360° multi-projection 3D display device and method based on light field reconstruction technology. The device can reproduce a three-dimensional scene in a large-scale panorama, and has the advantages of 360° viewing and high image resolution. However, this device has certain defects: due to the limitation of the projection angle of the projector itself, the audience can only see a specific part of the reconstructed scene at a position, but cannot reach the theoretical whole scene, which greatly limits Further development and application of this technology.

Contents of the invention

The purpose of the present invention is to improve the display effect problem of narrow display area in the light field reconstruction technology, and propose a multi-projection three-dimensional display device and method based on pupil recombination.

A multi-projection three-dimensional display device based on pupil recombination, comprising a multi-projection array arranged sequentially along the optical path, a longitudinally oriented scattering screen, and a controller connected to the multi-projection array;

The multi-projection array is composed of projector combination units located on the same arc and arranged at equal intervals, each projector combination unit is composed of stacked multiple projectors, and each projector has a different pupil orientation angle .

Wherein, the projection angle of each projector satisfies the splicing relationship, and the purpose of expanding the projection angle is achieved by splicing the projection angles.

The longitudinal directional scattering screen is a transmissive cylindrical grating, which has a horizontal grating line direction, and realizes the purpose of expanding the pupil in the vertical direction.

Preferably, the longitudinally oriented scattering screen is an optical holographic screen with the same longitudinal scattering characteristics.

The longitudinally oriented scattering screen is an arc or a plane, which can be selected according to the needs of the system.

The controller is connected to each projector in the multi-projection array; the controller is used to describe the three-dimensional scene in three-dimensional space, calculate the projection image of each projector according to the observation viewpoint and imaging position information, and convert the projection image They are respectively sent to corresponding projectors as image sources for three-dimensional display.

When installing the projector, the half-width angle θ of the projector and the size W of the visible area of the longitudinally oriented scattering screen should satisfy:

$\mathrm{<span\; class="notranslate">\; W</span>}<span\; class="notranslate">\; =</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; *</span>\mathrm{<span\; class="notranslate">\; D.</span>}<span\; class="notranslate">\; *</span>\mathrm{<span\; class="notranslate">\; the\; tan</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; arcsin</span>}<span\; class="notranslate">\; (</span>\frac{\mathrm{<span\; class="notranslate">\; R</span>}<span\; class="notranslate">\; *</span>\mathrm{<span\; class="notranslate">\; sin</span>}\mathrm{<span\; class="notranslate">\; \&theta;</span>}}{\mathrm{<span\; class="notranslate">\; D.</span>}}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; )</span>$

Among them, R is the radius of the arc surface where the multi-projection array is located, and D is the distance from the human eye to the longitudinally oriented scattering screen.

The present invention also provides a multi-projection three-dimensional display method based on pupil compounding, comprising the following steps:

(1) Determine the spatial imaging position of the three-dimensional information to be displayed;

(2) According to the reverse deduction of the spatial imaging position, the light field reconstruction technology is used to calculate the projection image required by the projector combination unit in the multi-projection array;

(3) According to the angular relationship between the projectors in the projector combination unit, calculate the independent projected image of each projector, and input it into the projector;

(4) The projected images of the multi-projection array are unfolded through the longitudinally oriented scattering screen, and spliced and formed in the display area.

Compared with prior art, main advantage of the present invention is as follows:

Through the angle splicing of the projectors in the projector combination unit, the output angle of the projector combination is effectively expanded, the defects caused by the narrow projection angle of the projectors are improved, and the size of the area seen by the observer in the observation area is increased, so that Observers can get a better visual experience. This structure can provide observers with 3D images with fine lateral parallax, and meet the demands of multiple viewing angles, which provides great prospects for wider applications of 3D displays.

Description of drawings

Fig. 1 is a schematic diagram of the visible area of the multi-projection three-dimensional display technology of the present invention;

Fig. 2 is a schematic diagram of the light field splicing technology and display effect of the present invention;

3 is a schematic structural diagram of a multi-projection three-dimensional display device based on pupil recombination in the present invention;

Fig. 4 (a) is the front view of the projector combination unit of the present invention;

Figure 4 (b) is a schematic diagram of splicing projection angles of the projector combination unit of the present invention;

Fig. 5 is a schematic diagram of the structure and function of the vertically oriented scattering screen of the present invention.

Detailed ways

The present invention will be further described below in conjunction with the accompanying drawings and embodiments, but the protection scope of the present invention should not be limited thereby.

Please refer to Fig. 1 first. Fig. 1 is a schematic diagram of the visual area of the multi-projection three-dimensional display technology based on pupil compounding used in the present invention. The size of the visual area range W has the following relationship with the half-width angle θ of the projector:

$\mathrm{<span\; class="notranslate">\; W</span>}<span\; class="notranslate">\; =</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; *</span>\mathrm{<span\; class="notranslate">\; D.</span>}<span\; class="notranslate">\; *</span>\mathrm{<span\; class="notranslate">\; the\; tan</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; arcsin</span>}<span\; class="notranslate">\; (</span>\frac{\mathrm{<span\; class="notranslate">\; R</span>}<span\; class="notranslate">\; *</span>\mathrm{<span\; class="notranslate">\; sin</span>}\mathrm{<span\; class="notranslate">\; \&theta;</span>}}{\mathrm{<span\; class="notranslate">\; D.</span>}}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; )</span>$

R is the radius of the arc surface where the multi-projection array is located, and D is the distance from the human eye to the longitudinally oriented scattering screen.

It can be found that the size W of the visible area is positively correlated with the half-width angle θ of the projector. During the specific implementation process, due to the limitation of the hard-to-change hardware structure of the projector, the half-width angle θ of the projector cannot be increased.

As shown in FIG. 3 , FIG. 3 is a schematic structural diagram of a multi-projection three-dimensional display device based on pupil recombination in the present invention. A multi-projection array 1 and a longitudinally oriented scattering screen 3 are sequentially arranged in the device along the direction of the optical path, and the controller 4 is electrically connected to the multi-projection array 1 and is not in the optical path.

The multi-projection array 1 is composed of a plurality of concentric arc-shaped projector combination units 2 arranged at equal intervals, and the number of projector combination units 2 is determined by system requirements.

The projector combination unit 2 is composed of two or more projectors, and the number of projectors is determined by system requirements. As shown in Figure 2, the pupils of these projectors are at the same horizontal position and face different projection directions, and the projection angles have a splicing relationship. In this embodiment, the projector combination unit 2 is composed of two projectors, but this should not limit the protection scope of the present invention. The positional relationship is shown in Figure 4(a) and Figure 4(b). The pupils of the two projectors are on the same vertical line, and the edges of the projection areas of the two projectors are spliced to achieve the purpose of expanding the projection angle.

The longitudinal directional scattering screen 3 is a transmissive cylindrical grating or an optical holographic screen with the same longitudinal three-color scattering characteristics. As shown in Fig. 5, the grating line direction of the transmissive cylindrical grating is horizontal, so as to achieve the purpose of expanding the pupil in the vertical direction. The vertically oriented scattering screen described in this embodiment is a flat screen, but this should not limit the protection scope of the present invention.

Controller 4 is connected to each projector in the multi-projector array. The controller is used to describe the three-dimensional scene in three-dimensional space, calculate the projection image of each projector according to the observation viewpoint and imaging position information, and send the projection image to the corresponding projector respectively as the image source for three-dimensional display.

Taking the three-dimensional display device shown in FIG. 2 as an example, the present invention also provides a multi-projection three-dimensional display method based on pupil compounding. Contains the following steps:

(1) Determine the spatial imaging position of the three-dimensional information to be displayed, the so-called three-dimensional scene;

(2) Inverting the spatial imaging position information obtained in step (1), using the light field reconstruction technology to calculate the projection image required by the projector combination unit in the three-dimensional projection array;

(3) As shown in Figure 4 (b), according to the angular relationship between the projectors in the projector combination unit, calculate the separate projected image of each projector and input it into the projector;

(4) The projected images of the multi-projection array are spread longitudinally through the directional scattering screen, as shown in FIG. 2 , and are spliced and formed in the display area.

Although the present invention is further described here by way of illustration and example, it should be recognized that the present invention is not limited to the above-mentioned embodiments and examples, and the foregoing descriptions are only considered as illustrative rather than restrictive , those skilled in the art can make various changes or modifications, as long as they do not depart from the scope and spirit established in the appended claims, they are all deemed to be within the protection scope of the present invention.

Claims (8)

1. A multi-projection three-dimensional display device based on pupil recombination, characterized in that it includes a multi-projection array and a longitudinally oriented scattering screen sequentially arranged along the optical path, and a controller connected to the multi-projection array; The multi-projection array is composed of projector combination units located on the same arc and arranged at equal intervals, each projector combination unit is composed of stacked multiple projectors, and each projector has a different pupil orientation angle . 2 . The multi-projection three-dimensional display device based on pupil recombination according to claim 1 , wherein the projection angles of each projector satisfy a splicing relationship. 3 . 3. The multi-projection three-dimensional display device based on pupil recombination as claimed in claim 2, wherein the longitudinal directional scattering screen is a transmissive cylindrical grating, and the transmissive cylindrical grating has horizontal grid lines direction. 4. The multi-projection three-dimensional display device based on pupil recombination according to claim 1, wherein the longitudinally oriented scattering screen is an optical holographic screen with the same longitudinal scattering characteristics. 5 . The multi-projection three-dimensional display device based on pupil recombination according to claim 4 , wherein the longitudinally oriented scattering screen is an arc or a plane. 6 . 6. The multi-projection three-dimensional display device based on pupil compounding as claimed in claim 1, wherein the controller is connected to each projector in the multi-projection array; The controller is used to describe the three-dimensional scene in three-dimensional space, calculate the projection image of each projector according to the observation point of view and the imaging position information, and send the projection image to the corresponding projector as the image source for three-dimensional display. 7. The multi-projection three-dimensional display device based on pupil recombination as claimed in claim 1, wherein the half-width angle θ of the projector and the size W of the visible area of the vertically oriented scattering screen should satisfy: $\mathrm{<span\; class="notranslate">\; W</span>}<span\; class="notranslate">\; =</span>\mathrm{<span\; class="notranslate">\; 2</span>}<span\; class="notranslate">\; *</span>\mathrm{<span\; class="notranslate">\; D.</span>}<span\; class="notranslate">\; *</span>\mathrm{<span\; class="notranslate">\; the\; tan</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; arcsin</span>}<span\; class="notranslate">\; (</span>\frac{\mathrm{<span\; class="notranslate">\; R</span>}<span\; class="notranslate">\; *</span>\mathrm{<span\; class="notranslate">\; sin</span>}\mathrm{<span\; class="notranslate">\; \&theta;</span>}}{\mathrm{<span\; class="notranslate">\; D.</span>}}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; )</span>$ Among them, R is the radius of the arc surface where the multi-projection array is located, and D is the distance from the human eye to the longitudinally oriented scattering screen. 8. A multi-projection three-dimensional display method based on pupil compounding, characterized in that, comprising the steps of: (1) Determine the spatial imaging position of the three-dimensional information to be displayed; (2) According to the reverse deduction of the spatial imaging position, the light field reconstruction technology is used to calculate the projection image required by the projector combination unit in the multi-projection array; (3) According to the angular relationship between the projectors in the projector combination unit, calculate the independent projected image of each projector, and input it into the projector; (4) The projected images of the multi-projection array are unfolded through the longitudinally oriented scattering screen, and are spliced and formed in the display area.