TWI777430B - Light-field virtual and mixed reality system having foveated projection - Google Patents

Abstract

The present disclosure concerns a light-field projection system, comprising a pin-light array generating an incident light-field illuminating an optical light modulator for modulating the incident light-field and projecting a plurality of modulated light-field components along a projection axis; a first optical element configured for forming first pin-light images in a first pin-light plane and modulator images in a modulator image plane; and a second optical element defining an eye-box region and for forming second pin-light images in a second pin-light plane within the eye-box; the first and second pin-light planes and the modulator image plane being substantially perpendicular to the projection axis; the system further comprising at least one optical device at the first pin-light plane and being configured for interacting with at least one of the modulated light-field components, spatially shifting the modulated light-field components in the modulator image plane. The light-field projection allows for foveated projection.

Description

Light field virtual and mixed reality system with foveated projection

The present disclosure relates to near-eye light field virtual and mixed reality systems and in particular to near eye light field virtual and mixed reality systems with foveated projection.

The human eye has a very wide field of view (FOV). The human eye individually has a horizontal FOV of about 135° and a vertical FOV of slightly over 180°. FOV can cover a block rather than a single focus. In virtual reality (VR) and/or mixed reality devices, a large FOV is important to produce an immersive physical-like experience. The wider FOV also provides better sensor coverage and accessibility for many other optical devices.

Virtual or mixed reality devices must provide approximately 400 million pixels to cover this FOV with regularly distributed pixels to satisfy the highest resolution of the eye.

However, the resolution of an eye is not uniformly distributed. It has high resolution only in about 20° FOV around its fovea. One of the ultra-high-quality displays (1920×1080) covering 20° FOV has reached retinal resolution in the fovea. Eye resolution gradually decreases away from the fovea. The entire FOV (outside the fovea) can be covered by about the same amount of information as the inside of the fovea, making the total number of pixels required about 4 000 000.

So-called foveated imaging and projection are added to virtual and mixed reality headsets to precisely exploit this feature of human vision. But this is still implemented with flat images. The light field device still doesn't have any solution for foveated projection.

Document US20190324272 discloses a three-dimensional (3D) image display device. The apparatus includes: a plurality of light sources; a spatial dimmer configured to modulate light from the plurality of light sources according to 3D image information; and a focusing optical system configured to focus formed by the spatial dimmer One of the images is on a focal plane. The plurality of light sources may be configured such that a plurality of foci respectively corresponding to the plurality of light sources are formed on a focal plane close to a pupil of a user.

The present disclosure relates to a light field projection system, which includes: a point light array, which includes a plurality of point lights and generates an incident light field for illuminating an optical dimmer, the optical dimmer for modulating the incident light field and projecting the complex modulated light field components along a projection axis; a first optical element configured to form a first point light image in a first point light plane and a tone in the modulator image plane a transformer image; and a second optical element defining an eye box area and configured to form a second point light image in a second point light plane within the eye box; wherein the first and second point light planes and the modulator image plane are substantially perpendicular to the projection axis and wherein the modulator image plane is between the first and second optical elements; and wherein the The system further includes at least one optical device in the first point light plane and configured to refract at least one of the modulated light field components such that the modulator image plane in the The modulator image is spatially displaced.

The light field projection system can provide virtual and mixed reality experiences to the eyes of any person, animal or a camera. A user of the light field projection system can experience a realistic mix of real and virtual 3D scenes. The light field projection system is suitable for delivering 3D virtual and augmented reality information while comfortably performing correct eye vision adjustment.

The light field projection system may include an eye tracking and steering device. The eye tracking and steering device can be used to determine where a viewer is looking to thereby determine where the foveal region is relative to the projected image.

This light field projection system can be used for foveated projection. In detail, the light field projection system can generate a light field that provides higher angular resolution images in a narrow field of view (FOV) and lower angular resolution images for a wide FOV. The light field projection system reduces imaging workload by substantially reducing image quality in the peripheral field of view (outside the area stared by the fovea).

Figure 1a shows a light field projection system 1 comprising a spot light array 10 that generates an incident light field 100 that illuminates an optical dimmer 20 configured for modulating The incident light field 100 projects the complex modulated light field component 110 along a projection axis 170 . The system 1 further includes a first spot light optical element 70, the first spot light optical element 70 is configured to form a first spot light image 31 in the first spot light plane 30, and the first spot light The light plane 30 is substantially perpendicular to the projection axis 170 . The first spot light optical element 70 may include an imaging lens. The system 1 further includes a second optical element 40 that defines an eye box area 121 and is configured to form a second spot light plane 124 in the eye box 121 . The second point light image 120 . The second spot light plane 124 is substantially perpendicular to the projection axis 170 . The second point light plane 124 may correspond to a virtual image aperture or an exit pupil in the viewing area 121, and the exit pupil 124 includes a plurality of second point light images 120 (three second point light images 120 are shown in FIG. 2a ). ).

Optionally, the light field projection system 1 may include a modulating optical element 32 configured to form a modulation of the optical dimmer 20 in a modulator image plane 115 The modulator image 114 , the modulator image plane 115 is also substantially perpendicular to the projection axis 170 . The modulator image plane 115 is projected at a distance D away from the viewing area 121 by the second optical element 40 . The distance D can be infinity or any distance along the projection axis 170 on either side of the viewport area 121 . The distance D at infinity or any distance along the projection axis 170 is generally outside the accommodating range of a viewer's vision.

Alternatively, the modulator image plane 115 may be formed by a first spotlight optical element 70 having a corresponding optical power or by placing the first spotlight optical element 70 at a different distance along the projection axis 170 produce.

The second optical element 40 may include an eyepiece. The eyepiece 40 may include optical elements such as convex lenses, mirrors, curved mirrors, semi-transparent mirrors or lens groups, mirrors or semi-transparent mirrors and may be configured to place the modulator image plane 115 away from the viewing area area One of the 121 images is at a distance D. The distance D can be set to infinity or any distance along the projection axis 170 on either side of the viewport area 121 .

The light field projection system 1 may comprise a Fourier filter 34 disposed in the first point light plane 30 . We note that the Fourier filter 34 does not have to be placed exactly in the Fourier plane of the optical dimmer 20 . For each viewpoint, the Fourier filter 34 can be configured to remove all but one diffracted modulated light from the modulated light field components 110 reflected and diffracted on the optical dimmer 20 field component. Here, the term "viewpoint" corresponds to one modulated light field component 110 .

The Fourier filter 34 may include at least one imaging lens that generates an image plane of the modulated light field component 110 . The Fourier filter 34 may include an array of pinholes formed from, for example, an optically non-transparent and non-translucent plate or other filter pattern. The Fourier filter 34 can also be configured in a reflective mode in which the pinholes or other filtering patterns are replaced by micromirrors. The Fourier filter 34 produces a modulated and filtered virtual light field 112 . Here, the viewpoint corresponds to a light field component 110 passing through a pinhole.

The light field projection system 1 is intended to be worn by a viewer for virtual and mixed reality applications. The light field projection system can be configured such that the viewing area 121 and the exit pupil 124 are within the viewer's eye 90 when the viewer wears it. The second optical element 40 emits the modulated light field components 110 towards the pupil 130 of the viewer's eye 90 such that the modulated light field components 110 are projected on the retina 92 .

The double line from each of the shown modulated light field components 110 is used to illustrate the boundaries of the real system that must be considered. Both the spot light array 10 and the Fourier filter 34 have holes. The image of the optical dimmer 20 must be processed so that the light from each pixel is projected towards the viewing zone 121 (and thus towards the viewer's eye 90 ) with a generally collimated narrow beam (preferably the light can be slightly converged to the A point far behind the viewing zone 121 is such that the viewer's eyes 90 cannot focus on the viewing zone and thus all images in the viewer's accommodative range look similar).

1b shows the projected images 140 of the optical dimmer 20 when the viewer's eyes 90 are focused at infinity for three second point light images 120 when the viewer wears the light field projection system 1 .

Figure 1c shows the projected image 140 when the viewer's eyes 90 are focused closer than infinity. Here, for each of the three second point light images 120, the viewer sees three projected images 141, 142, 143, wherein the three projected images 141, 142, 143 are slightly opposite displacement.

Figure 2a shows a light field projection system 1 according to an embodiment. The light field projection system 1 further includes at least one optical device 60 on the first point light plane 30 . The optical device 60 is configured to interact with at least one of the modulated light field components 110 . More specifically, the optical element includes a refraction element 60 configured to refract one of the modulated light field components 110 such that the modulator image 114 is in its modulator image Displaced spatially in plane 115 . The spatial displacement of the modulator image 114 in the modulator image plane 115 is represented by white triangles. The non-shift modulator images 114 are represented by black triangles. Relative to the modulator image plane 115 where the lens 60 is not used, the refractive lens 60 does not change the position of the modulator image 114 along the projection axis 170 . The remaining optical elements (the first and second optical elements 70 , 40 and the modulating optical element 32 ) also do not change the position of the modulator image 114 of the modulated light field component 110 refracted by the refracting element 60 .

A configuration for modulating the light field component 110 by one of the refracting poles 60 is shown in Figure 2d. The refraction angle θ _D can be defined as the angle from the incident modulated light field component 110 a to the outgoing modulated light field component 110 b leaving the refraction lens 60 . The refraction angle θ _D depends on the azimuth difference between the incident surface 611 and the exit surface of the refraction lens 60 , or the vertex angle θ _a in FIG. 2d . Other configurations of the refraction element 60 are contemplated. For example, the shape of the refracting prism 60 may comprise a uniform triangular prism with equal base angles or may be replaced by a diffraction grating.

FIG. 2b shows the projected images of the optical dimmer 20 when the viewer's eyes 90 are focused at infinity, ie, the second point light images 120 when a viewer wears the light field projection system 1 . If someone calls the second point light images 120 (and the first point light images 31 in the first point light plane 30) "viewpoints", then from these viewpoints, the viewer sees the FOV corresponding to the viewer One of the projected images 140 of the patch image (in a plane). More specifically, the viewer sees: a non-shifted projection image 141 corresponding to one of the non-shifted modulated light field components 110; and a shifted projection image 143 corresponding to the modulator image The modulator images 114 in plane 115 are spatially displaced by the refraction lens 60 and projected by the eyepiece 40 to a distance D away from the exit pupil 124 .

Figure 2c shows the projected image 140 when the viewer's eyes 90 are focused closer than infinity. The projected images 141 , 142 of the modulator image 114 corresponding to the equally non-displaced modulated light field component 110 correspond to the modulator spatially displaced in the modulator image plane 115 by the refraction element 60 The displacement projection image 143 of the image 114 has a larger displacement.

In FIG. 3a, a light field projection system 1 is shown comprising two refraction elements 60, wherein each refraction element 60 is configured to refract one of the modulating light field components 110 by a predetermined angle. Figures 3b and 3c compare the non-displaced projection image 142 and the displacement projection images 141, 143 seen by a viewer focused on infinity (Figure 3b) and by a viewer focused at a distance closer to infinity (Figure 3c).

The spatial displacement of the birefringent modulated light field components 110 is shown by white triangles, and the positions of the non-refractive modulated light field components 110 in the modulator image plane 115 are shown by black triangles.

The light field projection system 1 may include two or more refracting elements 60 to refract the complex modulated light field component 110 .

Figures 4a and 4b show cross-sectional views of the optical device comprising an array 160 comprising complex refractive spheres 60. For example, the array 160 can be a microchip array.

The array 160 may be configured such that each refractive element 60 interacts with a modulated light field component 110 . The array 160 can be further configured such that each refraction element 60 interacts with more than one modulated light field component 110 , or such that a plurality of elements 60 perform the same optical transformation on a plurality of light field components 110 .

In one aspect, the array 160 is configured such that different refractive poles 60 of the array 160 have different apex angles θ _a . 4a and 4b, the apex angle θ _a increases from the center of the array 160 to the periphery, so that the modulated light field components 110 are refracted with a refraction angle θ _D that increases from the center of the array 160 toward the periphery. The refractive spheres 60 in the array 160 may have other configurations. For example, the apex angle θ _a of the refraction elements 60 may be reduced from the center of the array 160 to the periphery or may be substantially the same for all the refraction elements 60 in the array 160 .

In one aspect, the array 160 includes at least one neutral optical element 61 . The modulated light field component 110 interacting with the neutral optical element 61 does not spatially displace the modulator image plane 115 . The modulator image 114 of the modulated light field component 110 interacting with the neutral optical element 61 is also not displaced relative to the modulator image plane 115 along the projection axis 170 .

The neutral optical element 61 may include a flat lens. In Figure 4a, the array 160 includes a neutral optical element 61 at the center of the array 160. In the example of FIG. 4 b , the array 160 alternately includes a refractive element 60 and a neutral optical element 61 from the center to the periphery of the array 160 . The center of the array is formed by a neutral optical element 61 . The Fourier filter 34 is also shown in Figures 4a and 4b.

Fig. 5a shows a specific configuration of the light field projection system 1 of Fig. 3, in which the bi-modulated light field components 110 are refracted by the halide array 160 such that they do not overlap in the viewer's FOV, but instead create a spatial separation One of the images 141 and 143 makes up the image. Figure 5b shows the non-shifted image 142 and the shifted images 141, 143 seen by a viewer focused at infinity and Figure 5c shows the non-shifted image 142 and shifted images 141, 143 seen by a viewer focused at a distance closer to infinity. They partially overlap with other viewpoints to form a light field, while the periphery is covered by a single image passing through their individual viewpoints.

FIG. 6a shows a light field projection system 1 comprising offset lenses 64 interacting with the modulated light field components 110 . Each offset lens 64 is configured such that the modulating light field component 110 is spatially displaced in the modulator image plane 115 and that the modulator image 114 of the modulating light field component 110 is relative to the modulator image The plane 115 is displaced along the projection axis 170 . In Figure 6a, the black triangles show that the refractive modulated light field components 110 are not spatially displaced in the modulator image plane 115, but the corresponding modulator images 114 are displaced along the projection axis 170 to To the left of the modulator image plane 115 of the non-refractive modulated light field component 110 in the modulator image plane 115 .

The offset lens 64 may be formed from an imaging lens lens in combination with a refractive lens.

In FIG. 6a, the two offset lenses 64 at the periphery of the first point light plane 30 can be formed by a cut-out portion of the same imaging lens, and the offset lens 64 at the center of the first point light plane 30 is formed by different. Modulating light field components 110 through the two peripheral offset lenses 64 can thus produce modulator images 114 that are relative to the modulator image plane 115 and relative to the modulator image plane 115 that passes through the central offset lenses The position of the modulator image 114 produced by the modulated light field component 110 of 64 is shifted along the projection axis 170 .

Figure 6b shows the non-shifted image 141 and the shifted image 143 seen by a viewer focused on infinity. Figure 6c shows the non-displaced image 142 and the displaced images 141, 143 as seen by a viewer focused at a distance closer than infinity. In this configuration, the system 1 displays the modulated light field component 110 by using two different reference depth planes, whereby the system produces a full range of depths in the same manner as systems with a reference depth plane. Here, the term "reference depth plane" corresponds to an image plane of the optical dimmer 20 as seen by the viewer. In Figures 6a-6c, the offset lenses 64 allow a viewer to see different image planes (or fiducials) of the optical dimmer 20 SLM in accordance with the offset lens 64 being traversed by the modulated light field components 110 image in the depth plane). Having at least one other reference depth plane can be used to display high spatial frequency images or traditional plane content such as text at different image distances D away from the viewing area 121 , other than other parts of the image. The different image distance D may be about 50 cm. Another reference depth plane can be used more for the non-light field portion of the scene at infinity etc.

The system 1 can provide better resolution images at specific depths or it can be used as a projector with only one volumetric image at several different depths, such as one flat screen closer and a second farther or a flat screen and A combination of light fields.

FIG. 7 shows a cross-sectional view of an optical device including an array 160 including complex offset lenses 64 . In a possible variation, the array 160 including the offset lenses 64 may be formed from rings that are cut out of different imaging lenses and grouped together and concentric. Alternatively, the array 160 including the offset lenses 64 may be formed from blocks cut out from an image lens to create an array of different concentric image lens portions, where several portions that are not necessarily symmetrically distributed have the same initial A part of the image lens, and the axis of the isocentric lens is consistent with the axis of the entire optical system.

In one aspect, the array 160 including the offset lenses 64 further includes one or more neutral optical elements 61 similar to the microarrays shown in Figures 4a and 4b.

For example, if the modulated light field components 110 are projected simultaneously through an array 160 including offset lenses 64 , the corresponding modulator images 114 may be formed at different optical distances along the projection axis 170 . The modulated light field components 110 are also refracted by the offset lens 64 which spatially displaces the modulator image 114 in the modulator image plane 115. Thus, the light field projection system 1 comprising the array 160 of offset lenses 64 produces images at different optical distances along the projection axis 170 and at different locations in the modulator image plane 115 .

In one aspect, the array 160 including the offset lenses 64 may further include one or more refractive lenses 60 .

In another embodiment shown in FIG. 8 a , the light field projection system 1 includes at least one imaging lens 63 , and the at least one imaging lens 63 is configured to make the modulated light field components 110 passing through the imaging lenses 63 . The modulator image 114 is displaced relative to the modulator image plane 115 along the projection axis 170 . The imaging lens 63 does not substantially spatially displace the modulated light field component 110 in the modulator image plane 115 . This can be achieved by a non-displaced modulator image 114 (black triangle) relative to the modulated light field component 110 that does not pass through the imaging lens 63, the modulator image 114 along the path of the modulated light field component 110 passing through the imaging lens 63 The displacement position (white triangle) of the projection axis 170 is seen.

Unlike the refraction lens 60, the imaging lens 63 (and the shift lens 64) change the vergence of the modulated light field component 110 beam. The refracting element 60 does not change the vergence of the modulated light field component 110 beam (it remains collimated), while the imaging lens produces a convergent (or diverging) modulated light field component 110 beam. The imaging lens 63 thus changes the optical position of the modulator image 114 along the projection axis 170 .

This works when the spot lights and holes in the Fourier filter have relatively large diameters (eg greater than 1 mm). Therefore, images can be displayed at different optical distances depending on which lens the image component passes through.

Figure 8b shows images 143, 142, 141 as seen by a viewer focused on infinity. Figure 8c shows the images 143, 142, 141 seen by a viewer focused at a distance closer than infinity. In addition to their apparent spatial displacement, these images 143, 142, 141 are also blurred or sharpened depending on the optical distance of each sub-image. Here, the term "sub-image" corresponds to a modulated light field component 110 for a viewpoint. The sub-image can be considered to be in focus because the minor dimming field component 110 and the pinhole make the depth of field small. However, in fact, each viewpoint also has its own optical distance that works especially when the modulated light field component 110 and the pinhole are not small enough. Thus, the optical distance of each of the sub-images may vary.

FIG. 9 shows a cross-sectional view of an optical device including an array 160 including a plurality of imaging lenses 63 . In a possible variation, the array 160 including the imaging lens 64 may further include one or more neutral optical elements 61 .

In one aspect, the light field projection system 1 may include any one or a plurality of the refractive lens 60 , the neutral optical element 61 , the imaging lens 63 and the offset lens 64 , alone or in combination. Of course, in order to obtain the spatial displacement of the modulated light field components 110 in the modulator image plane 115 , the light field projection system 1 must include at least one refraction lens 60 or an offset lens 64 .

In one embodiment, the array 160 is configured to interact with each modulated light field component of the modulated light field components 110 .

In one aspect, a modulated optical field component 110 passes through an optical device 60 , 61 , 63 , 64 of the array 160 .

FIG. 10 shows a possible embodiment of the spot light array 10 comprising an array of 100 spot lights 101 . The point lights 101 can emit light simultaneously so that the modulated light field components 110 are projected simultaneously. Alternatively, the point lights 101 may emit light sequentially so that the modulated light field components 110 are projected sequentially. The latter option is shown in Figure 10 by means of an active spotlight 101a and a passive spotlight 101b. The active spot lights 101a project to illuminate the incident light field 100 of the optical dimmer 20 so as to project the corresponding modulated light field components 110 along a projection axis 170 . In FIG. 10 , numerals 1 to 8 indicate a possible lighting sequence of the different spot lights 101 in the pinhole spot light array 10 . Other lighting sequences are also contemplated.

FIG. 11 shows a patchwork image of the projected modulator image 114 as seen by a viewer using a light field projection system 1 including a microarray 160 in the first point light plane 30 and including One of the nine spot lights 101 is the spot light array 10 . The outer perimeter of the rectangle corresponds to the size of the projected image 144, and the size of the projected image 144 corresponds to the viewer's FOV (in a plane). All nine modulator images 114 (viewpoints) overlap in a central area 145 of one of the projected images. The further away from the central region 145, the less the modulator images 114 overlap. There is only one modulator image 114 in the corner. Thus, the central region 145 corresponds to a narrow FOV with high light field and color resolution and the peripheral region corresponds to a wider FOV with lower light field (depth) and color resolution. In other words, the central area 145 corresponds to a gaze point area with a high light field and color resolution. The light field projection system 1 can thus provide high light field and color resolution in a narrow FOV and low resolution in a large FOV.

FIG. 12 shows a patchwork image of the projected modulator image 114 as seen by a viewer using a light field projection system 1 including a microarray 160 at the first point light plane 30 and including One of the 25 spot lights 101 is the spot light array 10 . The same inferences as in Figure 11 hold, while showing a more realistic situation for a higher resolution system.

FIG. 13 shows the projection modulator image 114 with the center region 145 generating a multi-component light field (including the complex modulator image 114 ) through the distribution of the refracting pole 60 while the periphery is covered by 8 independent displacement modulator images 114 Another example of a patchwork image.

Figure 14 shows another example of a patched image of the projected modulator image 114, wherein the modulated light field components 110 are projected simultaneously through the array 160 to produce a wide FOV peripheral image with low angle, color and depth resolution, The central region 145 produces a high-resolution multi-component light field (including the complex modulator image 114).

In one embodiment, the light field projection system 1 includes an eye tracking and projection steering device. The eye tracking and projection steering device can be used to determine where a viewer is looking to thereby determine where the foveal region is relative to the projected image 144 . Here, the foveal region corresponds to the central region 145 of the projected image 144 .

It should be understood that the present invention is not limited to the above-described exemplary embodiments and that other embodiments are also within the scope of the claimed patent application.

The optical dimmer 20 may include a spatial light modulator (SLM), such as a transmissive spatial light modulator or a reflective spatial light modulator. The SLM may comprise: a fast reflection SLM such as a liquid crystal on silicon (LCoS) or a ferroelectric liquid crystal on silicon (FLCoS), a digital micromirror device (DMD), or other suitable modulators.

The light field projection system 1 may include a collimating or partially collimating lens 50 . The spot light array 10 shows the optical dimmer 20 through the collimating or partially collimating lens 50 . The collimating or partially collimating lens 50 may comprise a reflective or holographic element having the same function as a collimating or partially collimating lens.

FIG. 15 shows a light field projection system 1 according to another configuration whereby the collimating or partially collimating lens 50 and the first point light optical element 70 may be placed on the surface of a reflective spatial light modulator 20 the same optics on the .

FIG. 16 shows a light field projection system 1 according to yet another configuration whereby the collimating or partially collimating lens 50 and the first point light optical element 70 are placed on the surface of a reflective spatial light modulator 20 of the same optics. In addition, the spot light array 10 is consistent with the optical devices 60 , 61 , 63 , 64 in the first spot light plane 30 . If the Fourier filter 34 is present, the spot light array 10 can also conform to the filter. In this configuration, the spot light array 10 should include holes (through holes) that allow the modulating light field components 110 to pass through the spot light array 10 and reach the modulating optical element 32 .

FIG. 17 shows the light field projection system 1 according to yet another configuration, whereby the second optical element 40 includes a matcher. The matcher 40 is configured to reflect the modulated light field component 110 from the modulating optical element 32 and to form the second spot light image 120 in the second spot light plane 124 in the viewing area 121 . The matcher 40 may include: a waveguide with a holographic grating that provides an image in a fixed focal plane (a stack of waveguides can be used to provide a plurality of focal planes), an omnidirectional reflector including a holographic pattern, a A beamsplitter or an elliptical matcher with a dome-shaped semi-transparent mirror. The adapter 40 may further include a translucent first element including a first reflective surface having a concave and elliptical shape. The adapter 40 may further include a substantially curved surface. The matcher 40 may comprise an array of different or identical tilt mirrors.

The coordinator can be further configured to emit natural light from the real world toward the viewing area, so that both the projected virtual light field and the natural light are projected in the viewing area area 121 through the coordinator.

1: light field projection system 10: point light array 20: optical dimmer 30: first point light plane 31: first point light image 32: modulating optical element 34: Fourier filter 40: second optical element; Eyepieces; Fittings 50: Collimating or Partially Collimating Lenses 60: Optical Devices; Refractive Lenses 61: Neutral Optical Elements 63: Imaging Lenses 64: Offset Lenses 70: First (Point Light) Optical Elements 90: Viewing Subject's eye 92: retina 100: incident light field 101: spot light 101a: active spot light 101b: passive spot light 110: modulated light field component 110a: incoming modulated light field component 110b: outgoing modulated light field component 112: virtual Light field 114: Modulator image 115: Modulator image plane 120: Second point light image 121: View area (region) 124: Second point light plane; Exit pupil 130: Pupil 140, 141, 142, 143, 144: Projection image 145: Center area 160: Array 170: Projection axis 611: Incident plane D: Distance θ _a : Apex angle θ _D : Refraction angle

The present invention may be better understood with the aid of the description of an embodiment provided by way of example and shown by these figures, wherein: Figure 1a shows a light field projection system including an optical dimmer that projects modulates the light field component; Figures 1b and 1c show projected images of the optical dimmer seen by a viewer when the viewer's eyes are focused at infinity (Figure 1b) and closer to infinity (Figure 1c); FIG. 2a shows a light field projection system including a refractive element interacting with at least one of the modulated light field components, according to an embodiment; Figures 2b and 2c show projected images of the optical dimmer of the system of Figure 2a when a viewer's eyes are focused at infinity (Figure 2b) and closer than infinity (Figure 2c); Figure 2d shows a configuration for modulating light field components through one of the refraction spheres; FIG. 3a shows a light field projection system including a complex refractive element according to an embodiment; Figures 3b and 3c show projected images of the optical dimmer of the system of Figure 3a when a viewer's eyes are focused at infinity (Figure 3b) and closer to infinity (Figure 3c); Figures 4a and 4b show an optical device comprising an array of complex refracting elements (Fig. 4a) and an array of complex refracting elements and neutral optical elements (Fig. 4b) according to an embodiment; Figures 5a-c show a particular configuration of the light field projection system of Figure 3a (Figure 5a), which results in a viewer focusing at infinity (Figure 5b) and closer than infinity (Figure 5c), according to an embodiment A patchwork image of separate images in the space of seeing; Figure 6a shows a light field projection system including an offset lens interacting with at least one of the modulating light field components, according to an embodiment; Figures 6b and 6c show projected images of the optical dimmer of the system of Figure 6a when a viewer's eyes are focused at infinity (Figure 6b) and closer than infinity (Figure 6c); 7 shows an optical device comprising an array of complex offset lenses, according to an embodiment; 8a shows a light field projection system including an imaging lens that interacts with at least one of the modulated light field components, according to an embodiment; Figures 8b and 8c show projected images of the optical dimmer of the system of Figure 8a when a viewer's eyes are focused at infinity (Figure 8b) and closer than infinity (Figure 8c); 9 shows an optical device comprising an array of imaging lenses in accordance with an embodiment; Figure 10 shows a point light array comprising an array of point lights; FIG. 11 shows a patched image of a projected second point light image seen by a viewer using the light field projection system including a refractor and a point light array containing nine point lights; FIG. 12 shows a patched image of the projected second spotlight image when the spotlight array includes 25 spotlights; FIG. 13 shows another example of a patched image of projecting the second point light image; FIG. 14 shows yet another example of a patched image of projecting the second point light image; Figure 15 shows a light field projection system according to another configuration; 16 shows a light field projection system according to yet another configuration; Figure 17 shows a light field projection system according to yet another configuration.

1: Light field projection system

10: Point light array

20: Optical Dimmer

30: The first point light plane

32: Modulating optics

40: Second Optical Element; Eyepiece

50: collimating or partially collimating lens

60: Optical device; Refraction lens

70: First (point light) optics

90: Viewer Eyes

92: Retina

100: Incident light field

110: Modulate light field components

112: Virtual Light Field

114: Modulator image

115: Modulator image plane

120: Second point light image

121: Viewport (area)

124: second point light plane; exit pupil

130: Pupil

170: Projection axis

Claims (16)

A light field projection system, comprising: a point light array comprising a plurality of point lights and generating an incident light field for illuminating an optical dimmer, the optical dimmer configured to modulate the incident light field and A plurality of modulated light field components are projected along a projection axis; a first optical element is configured to form a first point light image in a first point light plane and a tone in the modulator image plane a transformer image; and a second optical element defining an eye box area and configured to form a second point light image in a second point light plane within the eye box; wherein the The first and second point light planes and the modulator image plane are substantially perpendicular to the projection axis and wherein the modulator image plane is between the first optical elements and the second optical elements; the system further Including at least one optical device, the at least one optical device is at the first point light plane and is configured to refract at least one of the modulated light field components so that one of the modulated light field components corresponds to The modulator image of the at least one is spatially displaced in the modulator image plane. The system of claim 1, wherein the optical device comprises at least one refractive element configured to refract the at least one of the modulating light field components by a predetermined angle. The system of claim 1 or 2, wherein the optical device comprises at least one offset lens, the at least one offset lens configured such that the at least one of the modulated light field components is in the modulator image spatially displaced in a plane; and causing the modulator image of the at least one of the modulated light field components to be displaced relative to the modulator image plane along the projection axis. The system of claim 2, wherein the optical device further comprises at least one imaging lens, the at least one imaging lens being configured to cause the modulator image of the at least one of the modulated light field components to be relative to the modulation The transformer image plane is displaced along the projection axis. The system of claim 2, wherein the optical device further comprises at least one neutral optical element that interacts with at least one modulating light field component such that the modulating light field component is not optically modified. 2. The system of claim 1 or 2, wherein the at least one optical device comprises a plurality of optical devices arranged in an array, and each optical device interacts with at least one modulated light field component. The system of claim 6, wherein the array comprises complex refractive spheres. The system of claim 6, wherein the array includes one or more offset lenses. 7. The system of claim 7, wherein the complex optical devices are configured to refract the modulating light field components by different predetermined angles. The system of claim 9, wherein the modulated light field components are refracted by increasing predetermined angles from the center of the array toward the periphery. The system of claim 7, wherein the array includes at least one neutral optical element and/or at least one imaging lens. The system of claim 6, wherein the array is configured to interact with each modulated light field component of the modulated light field components. The system of claim 1 or 2, wherein the complex modulated light field components are projected simultaneously. The system of claim 1 or 2, wherein the complex modulated light field components are projected sequentially. The system of claim 1 or 2, further comprising an eye tracking and steering device configured to determine the spatial displacement in the modulator image plane. The system of claim 1 or 2, wherein the first optical element comprises: a first point light optical element configured to form the first point light image in the first point light plane; and a tuning A variable optical element configured to form a modulator image in the modulator image plane.

Images