RU2760473C1 - Augmented reality device with a multiplication of the exit pupil and with the possibility of forming a three-dimensional image and a method for forming an image by means of the specified augmented reality device with a multiplication of the exit pupil - Google Patents

Abstract

FIELD: augmented reality technology.

SUBSTANCE: invention relates to augmented reality devices with pupil multiplication, in which the formation of a multi-view image and the formation of an exit pupil are provided. The specified multi-view image contains at least two images with the same field of view, differing in wavelength and/or polarization state, or spaced in time. By means of a waveguide, the specified exit pupil is multiplied. The augmented reality image is formed by means of a multi-view image module and a waveguide. By means of the module for forming vision zones in the area of the exit pupil, images are separated by wave lengths and/or the state of polarization, or the time (t) of image formation, and the corresponding images are output to the corresponding vision zones in the area of the exit pupil with the formation of a three-dimensional image.

EFFECT: invention makes it possible to increase the compactness of the augmented reality device and rez up the resolution of the generated image.

42 cl, 36 dwg

Description

Technology area

The invention relates to augmented reality tools and methods of forming images in augmented reality devices with multiplying the exit pupil and forming 3D images, and can be used, in particular, as car projection displays, so-called "head-up" (hereinafter, as HUD) displays or 3D displays used to be embedded in the dashboard of a car and similar vehicles, namely motorcycles, bicycles, etc.

Description of the prior art

Currently, there are many configurations on the market, car head-up displays, but most of them have a field of view of no more than 15 degrees and a volume of more than 20 liters. Such a device is difficult to integrate into a car dashboard, so it became necessary to create a 3D display with a field of view of more than 15 degrees and a volume of no more than 5 liters.

The use of HUD devices in the automotive industry is becoming more and more popular. Such devices are located in the dashboard of the vehicle, form a virtual image at a finite or infinite distance from the driver and allow the user to focus on the road or the environment, while receiving information about the user's speed, engine status, phone calls and possibly other external information that otherwise it would distract the user's attention by using other external devices. The use of such displays is becoming necessary to improve the safety of the user and in general.

A variety of 3D imaging solutions are known in the art.

In US patent 9838674 B2, IPC H04N 13/04, H04N 9/47, publ. 12/05/2017 disclosed a multi-view autostereoscopic display and a method for controlling the distance of the formation of a virtual image. The display comprises an optical microlens raster element located on the pixel matrix of the display panel, an optimal viewing distance control device configured to adjust images visible to both eyes of the viewer and an image based on the viewer's position information perceived by the sensor for automatic image adjustment, and to create a view map using corrected images; a 3D formatting unit, configured to match pixel data of a multi-view image based on a view map received from the optimal viewing distance control device; and a display panel control circuit configured to write the pixel data of the multi-view image received from the 3D formatter to the display panel. In this display, for each type of image, its own pixel mask is used, which is displayed on the display, and this configuration of the display in combination with a microlens raster forms a separate image for the right and left eyes.

The specified multi-view autostereoscopic display is used in monitors, can be used in television for the formation of stereoscopic images, as well as for viewing stereofilms at home, but is not subject to use in dashboards for cars. The disadvantages of such a system are that the plane of the display coincides with the plane of image formation, which in turn limits the spread of the distance for displaying a 3D image and causes discomfort when observing a 3D image due to inconsistency of convergence and accommodation.

In US 8 786 683 B2, IPC G06T 15/00, H04N 13/04, publ. 07.22.2014, a stereoscopic display device is presented, comprising: a display panel configured to transmit light corresponding to image data; a polarization state conversion unit comprising a first polarization subunit for converting light transmitted by the display device into a first polarization state, and a second polarization subunit for converting the light transmitted by the display device into a second polarization state; an optical spacer that is driven, by applying a voltage, to an on state in which light transmitted by the display panel is refracted, or to an off state in which light transmitted from the display panel is not refracted. In the specified stereoscopic display device, the spatial image is localized at a finite distance coinciding with the plane of the display and the angular image that is obtained when imaging at infinity is not provided, which limits the use of such a stereoscopic display device for embedding in car dashboards, since the virtual image is formed at the final distance from the user, which entails a decrease in concentration on the road when the gaze is re-accommodated at the information virtual image.

US 10545346 B2, IPC G02B 27/00, G02B 27/01, publ. 28.01.2020, discloses an optical display for a helmet, the so-called HUD display, intended for the formation of virtual images, and including a set of waveguides, and holographic switchable diffraction gratings, prismatic optics, image input unit. This display is compact, but it is configured to provide only 2D images.

In US 2020/0073120 A1, IPC G02B 27/01, publ. 03/05/2020 disclosed a HUD display for a vehicle, including: a display panel, a deflector having a plurality of microlenses, and an image generator. The image generator is configured to generate a plurality of primary elementary images, which are multiplied by an optical multiplier by elementary images, which in turn are assigned in each case to a corresponding one of the plurality of microlenses. The specified display is compact and generates 3D images. One of the disadvantages of this display is the high pixel density in combination with the use of a microlens raster, which in turn makes its production quite costly and, therefore, unprofitable for mass production. In addition, the configuration of this display allows for imaging at a finite distance, which requires re-accommodation to view the virtual image.

The closest technical solution to the claimed invention is a device for forming a virtual image disclosed in the international publication WO 2019/238869 A1, IPC, B60K35 / 00, G02B 27/01, publ. 12/19/2019, and used in vehicle dashboards. In this case, the device (see Fig. 5 in WO 2019/238869 A1) contains a light source (14), which has at least two switchable light sources (14R, 14G, 14B) for generating radiation with different wavelengths. The said device also contains a display element (11) for generating an image and an optical waveguide for expanding the exit pupil. The optical waveguide has at least two optical waveguides (5R, 5G, 5B) that can be switched synchronously with the switchable light sources (14R, 14G, 14B) and are configured to operate at different wavelengths. The device provides only 2D imaging, which significantly reduces the driver's view of the vehicle.

All of the above solutions do not meet the modern requirements dictated by the automotive industry to ensure the safety of the vehicle driver, since when forming 2D images, it is very difficult for the driver to concentrate his attention on the road and on the virtual image at the same time, which leads to a loss of concentration. At the same time, in modern display devices it is very difficult to simultaneously combine the requirements of the compactness of the device, allowing it to be used in dashboards of vehicles, as well as the formation of 3D images with a high resolution of the generated image.

The claimed augmented reality device with exit pupil reproduction and with the possibility of forming a three-dimensional image is aimed at solving the above problems, namely, it provides the formation of 3D images with high resolution and with a field of view of about 15 degrees, while maintaining its compactness with a volume of less than 5 liters, which allows it integrate into the vehicle dashboard and use in other compact portable devices.

The essence of the invention

According to a first aspect of the invention, there is provided an augmented reality device with exit pupil multiplication and with the possibility of forming a three-dimensional image, comprising optically coupled:

- a module for forming a multi-view image, configured to form a multi-view image, and form an exit pupil containing the specified generated multi-view image, while the multi-view image contains at least two images with the same field of view (FoV), differing in wavelength and / or state polarizations, or spaced in time;

- a waveguide made with the possibility of multiplying the exit pupil formed in the module for generating a multi-view image;

- a module for the formation of zones of vision in the area of the exit pupil, made with the possibility of separating images by wavelengths, and / or the state of polarization, or time (t) of image formation; and outputting the corresponding images to the corresponding vision areas in the exit pupil region with the formation of a three-dimensional image;

additionally containing

- a control unit connected to a module for forming a multi-view image, a module for forming vision zones, and configured to control these modules according to a control signal;

the module for forming a multi-view image contains optically coupled at least one radiation source, a radiation combiner, at least one image source and projection optics;

the module for the formation of vision zones in the exit pupil region contains a stack of at least two microlens and / or micromirror rasters (LA1, LA2) and a spatial mask (SM) configured to operate in a passive mode, in which radiation is filtered by wavelength and / or the state of polarization, or in the active mode, in which the radiation is filtered in time (t), in response to a control signal from the control unit. Spatial mask SM is located in the optically conjugate plane of the exit pupil of the augmented reality device relative to the optical raster LA2.

In addition, the multiview imaging module contains at least 2 radiation sources, each configured to emit light at the same wavelength or different wavelengths, or at least 2 radiation sources configured to emit RGB radiation.

In the module for forming a multi-view image, the radiation sources are made with the possibility of emitting radiation simultaneously or alternately according to a signal from the control unit, and the radiation sources are one of: LED, laser diode, incandescent lamp.

In the multi-view imaging module, the sources of the radiation combiner are made with the possibility of mixing and combining radiation from different radiation sources and outputting the mixed radiation to the image source and is an optical element with a suitable coating, for example, with a dichroic coating or with a coating in the form of prismatic or diffractive elements, providing reflection or redirection of radiation in a given direction.

The implementation of the radiation combiner in the form of a waveguide combiner is also provided.

In the augmented reality device according to the first aspect of the invention, the image source is configured to form vision zones and is one of: self-emitting display using microscopic LEDs as backlight (uLED), liquid crystal display (LCD), reflective type liquid crystal display (LCOS), digital Micromirror Image Output Device (DMD), Scanning Mirror Image Forming Device (LBS).

And the waveguide is made in the form of a flat substrate, with an input element, an expander, and an output element built into it, and with the possibility of alternately multiplying the exit pupil, first along the X axis, and then along the Y axis, or vice versa, or with the possibility of multiplying the exit pupil, simultaneously , along the X and Y axes.

In this case, the input element in the waveguide is configured to input radiation with a predetermined angle into the waveguide and is one of: a diffractive element in the form of diffraction gratings, a holographic element or a semitransparent mirror; and the element of the output of the waveguide is made with the possibility of outputting radiation with a given angle from the waveguide and is one of: a diffractive element, in the form of diffraction gratings, a holographic element or a semitransparent mirror; and the waveguide expander is configured to multiply the exit pupil inside the waveguide and is one of: a diffractive element in the form of diffraction gratings, a holographic element, or a semitransparent mirror.

In this case, with the simultaneous multiplication of the exit pupil along the X and Y axes, the expander, the output element and the expander are combined into one optical element in the form of a diffractive element.

The waveguide can be made in the form of a combination of three waveguides, each designed to transfer an image of one color, for example, R, G, B colors, or as a combination of two waveguides with a combination of colors, for example, one waveguide B + G colors, and the other R color or one waveguide for G + R colors and another for B colors.

In addition, the waveguide can be made in the form of a single waveguide with the possibility of transferring an image with a combination of colors, for example, R + G + B colors.

In addition, the waveguide can be made in the form of a combination of different waveguides, each of which is designed to transfer one corner of the overall image for one of the colors R, G, B and / or a combination of colors.

The module for the formation of zones of vision in the area of the exit pupil contains a stack of at least two microlens and / or micromirror rasters (LA1, LA2), made in such a way that a telescopic path of rays at the entrance and exit of the specified stack is provided.

In this case, a stack of at least two microlens and / or micromirror rasters contains two microlens and / or micromirror rasters (LA1, LA2).

In this case, each of the microlens rasters LA1, LA2 contains at least one lenticular lens, which is a cylindrical lens or a spherical lens, the number of lenses in the first microlens raster LA1 being equal to the number of lenses in the second microlensing raster LA2.

In the module for generating vision areas in the exit pupil region, the first raster LA1 can be a micromirror raster consisting of at least one mirror, and the second raster LA2 can be at least one cylindrical or spherical lens, while the number of mirrors in the first raster LA1 coincides with the number of lenses in the LA2 raster.

According to one embodiment of the invention, the first lens raster LA1 can be built into the waveguide output element and can be capable of outputting radiation and focusing the radiation on the spatial mask SM.

In this case, the projection optics is an optical unit consisting of at least one or a combination of: a lens, a mirror, a polarizing beam splitter (PBS), a quarter-wave plate (QWP) and a half-wave plate (HWP), and provides the transformation of a spatial image into an angular image in the same field of view (FOV).

The spatial mask SM, which is part of the module for the formation of vision zones in the area of the exit pupil, operates in two modes: passive and active. In the passive mode of operation, the spatial mask SM is a layer of absorbing material with built-in alternating filter segments, each of which transmits radiation with a given wavelength corresponding to the radiation wavelength of the radiation source in the multi-view imaging module.

Moreover, these filter segments are dichroic filters.

In addition, in the passive mode of operation, the spatial mask SM is configured to transmit radiation according to the state of polarization, which is one of S polarization, P polarization, right-handed circular polarization (RHCP), left-handed circular polarization (RHCP).

In the active mode of operation, the spatial mask is made with the possibility of alternately reproducing images for the left and right eyes and is a spatial radiation modulator, for example, in the form of an LCD display, in which the frequency of changing the mask corresponds to the mode of transmission or blocking of radiation passing through the mask, and coincides with the display frame rate in the image source.

The augmented reality device according to the first aspect of the invention further comprises a synchronizer for synchronizing the operation of the spatial mask in active mode with the image source by a control signal from a control unit connected to the multiview imaging module and the synchronizer.

The augmented reality device according to the first aspect of the invention further further comprises a detector connected to the control unit and configured to register the displacement of the user's eyes, and a drive unit configured to displace the spatial mask, in passive mode of operation, upon a signal from the control unit.

In this case, in the passive mode of operation, the spatial mask is made with the possibility of alternately displaying an image with the same spectral composition or polarization state for the right and left eyes by displacing the mask along the horizontal axis coinciding with the location of the user's eyes.

The augmented reality device with pupil propagation is made with the possibility of embedding into the dashboard of any vehicle, as well as with the possibility of using it in compact portable devices, for example, tablets or in augmented reality glasses.

According to a second aspect of the invention, there is provided a method for forming an image in an augmented reality device with an exit pupil propagation according to the first aspect of the invention, comprising the steps of:

- provide the formation of a multi-view image, and the formation of the exit pupil containing the specified generated multi-view image by means of the module for the formation of a multi-view image, while the specified multi-view image contains at least two images with the same field of view FoV, differing in wavelength and / or polarization state, or spaced in time;

- by means of a waveguide, the specified exit pupil is multiplied;

- form an augmented reality image by means of a multi-view image module and a waveguide,

- by means of the module for the formation of zones of vision in the area of the exit pupil, provide separation of images by wavelengths, and / or the state of polarization, or time (t) of image formation; and

- output the corresponding images to the corresponding zones of vision in the area of the exit pupil with the formation of a three-dimensional image.

Brief Description of Drawings

The above and other features and advantages of the present invention are illustrated in the following description, illustrated by the drawings, in which the following is presented:

Fig. 1 is a diagram of the formation of a stereoscopic image according to the invention;

Fig. 2 is a schematic diagram of an augmented reality device with exit pupil multiplication and with the possibility of forming a three-dimensional image according to the invention;

3 is a block diagram of a multi-view image generating unit according to the invention;

4 is a block diagram of the exit pupil imaging by the exit pupil and waveguide vision zone generating unit according to the invention;

Fig. 5 is a diagram of image formation in the plane of the exit pupil according to the invention;

Fig. 6 is a diagram of image formation in the passive mode of operation of the spatial mask according to the invention;

Fig. 7a is a diagram of the passage of radiation from radiation sources to image sources by means of corresponding mirrors into a waveguide according to the invention;

7b is a graph illustrating the dependence of the reflectance of the mirror M ₁ as a function of the wavelength λ _{1 of the} radiation emitted by the radiation source 1 according to the invention;

Fig. 8a is a schematic representation of the process of pupil propagation along one axis alternately in a waveguide according to a preferred embodiment of the invention;

Fig. 8b is a schematic representation of the process of multiplying the pupil along two axes simultaneously;

8c is a schematic cross-sectional view of a waveguide in which the pupil is multiplied along one axis, alternately according to a preferred embodiment of the invention;

Fig. 9a is a schematic diagram showing the dependence of the transmittance of the spatial mask filters as a function of wavelength and schematically showing the corresponding segments of the mask filters according to the invention;

Fig. 9b is a diagram of the formation of views in the region of the exit pupil when the spatial mask operates in a passive mode according to the invention;

Fig. 10a shows a diagram of a module 3 for forming vision zones of the exit pupil, which ensures the formation of zones of vision V ₁ ... V _n along one axis according to the invention;

10b is a schematic diagram of a unit 3 for forming vision zones of the exit pupil, which provides the formation of vision zones V ₁ ... V _n along one axis according to the invention;

11a is a diagrammatic representation of the path of rays passing through a stack of two microlens rasters LA1 and LA2 according to a preferred embodiment of the invention;

Fig. 11b is a diagram of the passage of rays when passing through a stack of two microlens rasters LA1 and LA2 according to the invention;

Fig. 12a is a diagram of the passage of radiation in the module for generating vision areas of the exit pupil and waveguide according to a preferred embodiment of the invention;

Fig. 12b is a diagram of the passage of radiation in the module for forming the vision zones of the exit pupil and the waveguide according to the invention;

Fig. 13a is a diagram of the formation of two zones of vision without shifting the eyes of the driver of the vehicle according to the invention;

Fig. 13b is a diagram of the formation of two zones of vision when the eyes of a vehicle driver are shifted according to the invention;

14a is a block diagram of a multi-view imaging module according to one embodiment of the invention;

14b is a block diagram of a multi-view imaging unit according to another embodiment of the invention according to the invention;

FIG. 15a is a diagram of the formation of two zones of vision in the active mode of operation of the spatial mask according to the invention;

Fig. 15b is a diagram of the formation of two zones of vision in the active mode of operation of the spatial mask, when the position of the eyes of the driver of the vehicle according to the invention is shifted;

16a is an exemplary block diagram of a single display multi-view imaging unit in an active mode of operation according to the invention;

16b is an exemplary block diagram of a multi-view imaging unit with an LBS-based imaging unit in an active mode of operation according to the invention;

Fig. 16c is a schematic diagram of a spatial mask operating in an active mode according to the invention;

17a is a schematic diagram of a conventional waveguide-based imaging system with a single display with a single wavelength of radiation;

17b is a schematic diagram of a conventional dual display imaging system with different wavelengths;

Fig. 17c is a schematic diagram of a HUD device in accordance with the present invention;

FIG. 18a is a schematic diagram of a dual display HUD device in accordance with the present invention; FIG.

Fig. 18b is a diagram of beamforming in the HUD configuration of the device according to Fig. 18a and shows images reproduced on the retina of the left and right eyes;

19a is a schematic diagram of a compact HUD-based device according to the invention using a collapsible beam combiner;

19b is a schematic diagram of a compact HUD-based device according to the invention using a beam combiner with a beam redirecting function;

Fig. 20 is a diagram of augmented reality glasses based on the HUD of the device.

Preferred Embodiments of the Invention

Examples of embodiments of the present disclosure will be described in detail below. Examples of embodiments have been illustrated in the accompanying drawings, in which like or similar reference numbers refer to the same or similar elements or elements having the same or similar functions. The exemplary embodiments described with reference to the accompanying drawings are illustrative, used only to explain the present disclosure and should not be construed as any limitation thereto.

At the same time, the authors of the invention, to ensure the compactness of the augmented reality device with multiplying the exit pupil and with the possibility of forming a 3D image (hereinafter, as a HUD device), integrated a waveguide into the display structure, and to ensure the formation of a 3D image, they used the technology of stereo output, which provides for the formation of separate images for the left and the right eye, and due to the parallax effect, the final image is three-dimensional and can be formed at various distances from the user.

The module for generating a multi-view device, made according to the invention in combination with a waveguide, provides for the formation of an augmented reality image, and the unique design of the module for generating vision zones of the exit pupil, proposed by the authors of the present invention, provides output of various images to the corresponding vision zones with the formation of a 3D image.

Within the framework of the present invention, the following concepts and terms will be used, the interpretation of which is provided below by the inventors:

View - a single two-dimensional image of a multi-view image corresponding to a certain angle, which is generated in a multi-view imaging unit (PGU - picture generation unit) for observation in the corresponding area of vision.

The field of view is the area in the plane of the exit pupil (eyebox) in which the image corresponding to the view is observed. Within the framework of the present invention, the vision areas are formed as a spatial mask image in the exit pupil region, which is formed by the lens raster, and the number of radiation sources formed in the image generation unit of the views used in the HUD device determines the number of the vision areas.

The exit pupil is the amount of space in which the virtual image is observed.

Exit pupil multiplication - increasing the size of the exit pupil (by introducing waveguides into the optical system with the possibility of input, propagation of radiation inside and gradual output using diffractive, holographic elements or semitransparent mirrors).

A multi-view image is a three-dimensional image formed from many views of different angles. Within the framework of the present invention, the terms "multi-view" and "three-dimensional image (hereinafter referred to as 3D images)" are used interchangeably.

The plane of the virtual image is the plane in which two plane images are formed, i.e. stereo pair.

Stereopair - a pair of two-dimensional images of the same object displaying the view of this object from different viewing positions of this object.

Augmented reality (AR) is seen as a technology by which virtual objects can be superimposed on a real scene, and virtual information can be applied to the real world, so that the real scene and virtual objects are superimposed into one image or space in real time, and can be viewed by an observer, thereby providing an immersive augmented reality experience.

From the prior art, methods of forming and observing stereoscopic images differing in principle of operation are known, in particular a polarization method, an anaglyph method, holographic methods, a method for creating and then combining by optical methods two separate images intended for the left and right eyes, a method based on the use of optical cylindrical rasters. These methods make it possible to reproduce and observe stereoscopic images, however, each of them has certain disadvantages that limit their widespread practical use.

The claimed invention is based on a method of forming two separate images for the left and right eyes and, due to the parallax effect, forming a volumetric (3D) image for the observer.

Figure 1 shows a diagram of the formation of a stereoscopic image used in the invention, which illustrates the formation of a stereopair - separate two-dimensional images for the left eye (x_L, y_L, z_L) and right eye (x_R, y_R, z_R). The resulting volumetric image is formed at a distance D (m) from the observer and can vary depending on the coordinates of the stereopair output. Shown in figure 1 "Arrow" + icon "50m" is a three-dimensional 3D image that the driver sees.

The 3D image is generated using stereo output technology, according to which different planar images are formed for the left and right eyes, i.e. a stereo pair is formed.

The plane of the virtual image is the plane in which two plane images are formed, i.e. stereopair, in this case (50m + arrow), for the left and right eyes. The optical system of the HUD of the device forms images of a stereo pair in the plane of the virtual image.

When observing a stereopair in such a way that each eye perceives only the image intended for it, the effect of observing a three-dimensional 3D image appears.

The position of the 3D image can be changed by changing the images of stereopairs and their output coordinates in the plane of the virtual image.

The claimed augmented reality device with exit pupil multiplication with the ability to form a three-dimensional image, hereinafter referred to as a HUD device, can be conditionally divided into 3 main parts. A schematic representation of the claimed device is shown in Fig. 2, where the driver of the car is schematically shown and the solid line symbolically indicates the hood and windshield, and the dashed line represents the propagation of radiation coming out of the declared HUD device. Radiation exits the device's HUD and reflects off the windshield towards the driver's eyes (along the dashed line). At this time, the driver looks through the windshield and observes the image of the road + virtual image, i.e. generated by HUD device, 3D image.

An augmented reality device with multiplying the exit pupil and with the possibility of forming a three-dimensional image comprises a multi-view image generating unit (PGU) 1 capable of forming an image of at least two types or pictures of an image, i.e. species V ₁ , V ₂ ... V _n , while these species have the same field of view (FOV), but have distinctive characteristics, for example, differ in the wavelength of radiation and / or the state of polarization, or also the time (t) of the formation of the species. In addition, the claimed device contains a waveguide 2, which multiplies the exit pupil of the PGU module, and the formation of a virtual image at infinity, and a module 3 for the formation of vision zones in the area of the exit pupil of the HUD device, which includes a stack of at least two microlens or micromirror rasters and a spatial mask ( SM-spatial mask). In this case, the module 3 for the formation of zones of vision in the area of the exit pupil, provides a telescopic path of the rays coming out of the waveguide 2 and preserves the angular distribution of the rays coming out of the waveguide 2. In this case, a stack of two microlens rasters is used in combination with a spatial mask located in an optically conjugate the plane of the exit pupil of the HUD device relative to the second lens raster. In this case, the stack of lens rasters is configured to preserve the angular direction of the rays, and the spatial mask is in the conjugate plane with the exit pupil area and filters the radiation so that vision zones V ₁ , V ₂ ... V _{n are} formed in the exit pupil area. The zones of vision in the area of the output icon differ in the composition of the radiation corresponding to the transmission filters in the spatial mask. In this case, each area of vision provides an overview of one image generated by the multi-view imaging unit 1.

The multi-view imaging unit 1 (hereinafter referred to as the PGU unit) is configured to form a multi-view image, and form an exit pupil containing said multi-view image. The specified module PGU is schematically shown in figure 3 and contains at least two radiation sources, a radiation combiner, an image source and projection optics. As mentioned earlier, the multi-view image generating unit is configured to generate at least two images, wherein the generated images have the same field of view (FOV), but have distinctive characteristics, for example, differ in the radiation wavelength and / or polarization state, or also the time (t) of image formation.

A multi-view imaging unit (PGU unit) together with a waveguide provide a virtual augmented reality image.

Sources of radiation, in the case of the presence of two or more in the configuration of the PGU 1 module, are made with the possibility of emitting light both at the same wavelength and at different wavelengths, for example, RGB radiation in the ranges 450-480 nm, 510-540 nm, 610 -650 nm, respectively. In this case, these examples of wavelengths at which the PGU module operates are not limited to these ranges, but are presented as examples. Sources of radiation are LEDs, laser diodes, incandescent lamps.

The radiation combiner is made with the possibility of mixing and combining radiation from different radiation sources and outputting the mixed radiation to the image source. The radiation combiner is a dichroic mirror or multichannel optics, for example, a waveguide combiner.

The source of the image is a display (LCOS, DMD) or MEMS scanning system that provides information display, namely the output of text and / or graphic information.

Projection optics is an optical unit consisting of at least one or more of: lenses, mirrors, polarizing plates, and providing the transformation of a spatial image into an angular image in the same field of view (FOV) into a waveguide 2 (W-waveguide) ...

Thus, the main function of the PGU 1 module is combining, combining the radiation corresponding to each vision zone, transmitting it through the projection optics, introducing the specified radiation into the waveguide.

An exit pupil imaging circuit by the exit pupil and waveguide vision area generating unit 3 will be described with reference to FIG.

The module 3 for generating the exit pupil vision zones consists of at least two lens rasters, designated as LA1, LA2 in FIG. 4. Each of these rasters LA 1 and LA 2 consists of a plurality of cylindrical lenses or spherical lenses. In this case, the first microlens raster LA1 is configured to convert the angular distribution of the virtual image obtained from the waveguide 2 into a spatial image and enter it into a spatial mask, designated as SM in Fig. 4. In this case, LA2 is configured to transform a spatial image into an angular one. In this case, the microlens rasters LA1 and LA2, together, ensure the preservation of the angular directions of the images, while simultaneously filtering the radiation by wavelength and / or the state of polarization performed in the spatial mask (SM).

A spatial mask (SM) according to an embodiment of the invention is a thin layer of absorbing material with radiation-transmitting zones, whereby the image coming from the PGU, formed by at least two radiation sources and multiplied in the waveguide 2, is filtered by wavelength and / or polarization state radiation. In this case, the spatial mask is made with the possibility of filtering images by the position of the views in the plane of the exit pupil, taking into account the wavelengths and the state of polarization of the radiation that is emitted by the radiation sources in the PGU module.

Waveguide 2 is shown in FIG. 2 and designated by the reference numeral 2W. In this case, the waveguide is configured to multiply the exit pupil and form a virtual image at infinity. Waveguide 2 (W) provides the multiplication of the pupil using two one-dimensional multiplications, i.e. first along X, and then along Y, or with the help of one two-dimensional reproduction, i.e. simultaneously along X and along Y and is configured to input, transfer and output the multiplied image of the exit pupil, formed by the PGU 1 module.

The multiplied images at the exit from the module 3 for the formation of vision zones in the area of the exit pupil enter the plane of the exit pupil of the augmented reality device with the multiplication of the exit pupil with the possibility of forming a three-dimensional image (HUD device), where a stereo image is formed, which is observed by the driver of the vehicle or any other user. Thus, the unit 3 for generating vision areas in the exit pupil region forms a 3D image by outputting various images to the corresponding vision areas.

Figure 5 shows a diagram of image formation in the plane of the exit pupil.

As already mentioned above, the 2W waveguide ensures the multiplication of the exit pupil and at its output we obtain mixed rays, which correspond to the mixed images for the right and left eyes, formed by the PGU 1. Next, the lens rasters LA1 and LA2 are located, the lens rasters have such focal lengths to provide a telescopic beam path and form a virtual image at infinity. Thus, two lens rasters LA1 + LA2, in fact, are a telescopic system that provides an image at infinity. In this case, the lens rasters LA1, LA2 are made of a set of microlenses (cylindrical or spherical) sequentially located horizontally, i.e. in this case, along the axis coinciding with the location of the eyes of the vehicle user. In this case, the first lens raster LA1 focuses the radiation in the front focal plane of the second lens raster LA2. A spatial mask SM is located between LA1 and LA2, which is located in the plane optically conjugated with the plane of the exit pupil. Lens raster LA2 transfers the image of the mask SM to the plane of the exit pupil. In this case, the mask SM is made in such a way as to form vision zones in the area of the exit pupil in the area of the exit pupil. In the zones of vision, the image differs in its spectral or polarization composition.

In this case, the spatial mask (SM) according to the invention is configured to operate in an active or passive mode.

With the active mode of operation of the spatial mask SM, alternate reproduction of the image for each eye is provided in accordance with the time t.

For the passive mode of operation of the spatial mask SM, simultaneous formation of several zones of vision in the area of the exit pupil is envisaged. For this purpose, the inventors include in the PGU at least two image sources to form the corresponding zones of vision. In this case, each image source forms an image with a certain wavelength, or polarization state, different from another image source in the PGU. At the same time, for each zone of vision, its own image corresponds, which differs in wavelength or state of polarization. When the vehicle moves, the position of the driver's eyes shifts and the corresponding image enters the eyes.

Figure 6 shows a diagram of image formation in the passive mode of operation of the spatial mask.

Thus, in the passive mode of operation of the mask, the PGU 1 module generates at least 2 types that differ in their spectral composition or in the state of polarization, and in the active mode of the spatial mask, the PGU module generates at least 2 types, spaced apart in time t.

Thus, the PGU 1 contains at least one radiation source and at least one image source.

Moreover, in a preferred embodiment, i. E. in the passive mode of operation of the SM mask, the PGU 1 module contains 2 or more radiation sources and one 1 or more image sources (Fig. 6 conventionally represents one radiation source and one image source), i.e. in this case, one image source corresponds to 2 or more radiation sources. In this case, the image source generates different images for each view at a certain frequency, and the radiation sources alternately illuminate the image source, such as a display. In this case, the filters on the SM mask remain unchanged over time.

Thus, in the PGU 1 module, at least two images for the right and left eyes, differing in wavelength, are formed, which form the corresponding views (V ₁ , V ₂ ... V _n ) for the zones of vision in the region of the exit pupil 4. Radiation from the source the image passes through the projection optics and enters the waveguide 2, which consists of a flat substrate with an input element built into it, an output element and an expander made in the form of diffractive elements, for example, diffraction gratings. In this case, the waveguide is configured to multiply the pupil along one X-axis and along two X and Y axes, as already described earlier. Thus, image input, image propagation within the waveguide and output of the image formed in the PGU 1 are provided in the waveguide. A more detailed description of the waveguide will be described with reference to Figs. 8a to 8c.

Next, the image enters the module 3 for the formation of zones of vision in the area of the exit pupil, which provides a telescopic path of the rays emerging from the waveguide 2 and preserves the angular distribution of the rays coming out of the waveguide 2. In this case, the module 3 for the formation of zones of vision in the area of the exit pupil consists of a stack of two microlens rasters (LA1 + LA2) (the number of rasters 2 is presented as a non-limiting example of implementation of the invention) and is used in combination with a spatial mask (SM) located in the optically conjugate plane of the exit pupil of the HUD device relative to the second lens raster LA2.

It should be noted that the number of rasters in the stack included in the module 3 for the formation of vision areas of the exit pupil area can be increased and be more than two rasters, which is due to the requirement to increase the field of view of the optical system and the need to ensure the correction of optical aberrations.

Spatial mask SM is a thin layer of absorbing material with built-in alternating segments of dichroic filters, each of which transmits radiation with a given wavelength corresponding to the wavelength of the radiation source included in the configuration of the PGU and the corresponding vision zone. In this case, the stack of lens rasters is made with the ability to preserve the angular direction of the rays, and the spatial mask is in the conjugate plane with the area of the exit pupil and filters the radiation so that the vision zones V ₁ , V ₂ ... V _{n are} formed in the area of the exit pupil. In this case, in the plane of the vehicle windshield, radiation is reflected after the module 3 for forming vision zones into the plane of the exit pupil 4. The zones of vision V ₁ , V ₂ ... V _n in the area of the output icon 4 differ in the composition of the radiation corresponding to the dichroic transmission filters in the spatial mask. In this case, each area of vision provides an overview of one image generated by the multi-view imaging unit 1 (PGU unit).

The multi-view imaging unit 1 (PGU 1) contains at least one image source. In this case, the number of image sources can include 1, 2 ... n image sources. Each image source contains its own image for each type of V ₁ ... V _n and operates at a certain wavelength λ _1, λ _2, λ _{3 ...} λ _n , which correspond to their zone of vision in the region of the exit pupil 4.

A multi-view image is formed in the PGU 1 by combining images from different image sources, for example 1, 2 ... n, each operating at a certain wavelength λ _1, λ _2, λ _{3 ...} λ _n . In this case, each image source is equipped with a corresponding scanning mirror M ₁ , M ₂ and M _n.

In this case, the reflection spectrum of the mirror M1 corresponds to the radiation spectrum of the radiation source λ_1, and reflects light only with a wavelength λ₁(see Fig. 7a) which corresponds to the field of vision V₁in the area of the exit pupil, and the reflection spectrum of the mirror M_n corresponds to the emission spectrum of a radiation source with a wavelength λ_n(see fig. 7a)_, and reflects light only with a wavelength λ_n, which corresponds to the field of vision V_n.The graph shown in Fig. 7b illustrates the dependence of the reflectance of the mirror M1 as a function of the wavelength λ₁ radiation emitted by a radiation source 1.

The spatial mask (SM), as already mentioned, is configured to transmit radiation in accordance with the number n of types. The spatial mask SM according to an embodiment of the invention is a thin layer of absorbing material with built-in alternating segments of dichroic filters, each of which transmits radiation with a given wavelength corresponding to the wavelength of the radiation source included in the configuration of the PGU and the corresponding vision zone. All species are formed in the same field of view, but then they are separated by spectral composition in space and form zones of vision in the area of the exit pupil.

The PGU 1 is configured to operate in several modes, which will be described below.

1) In a preferred embodiment of the invention, the PGU 1 module is configured to form a multi-view image by combining n images with one field of view (FoV), but differing in wavelength, for example λ _1, λ _2, λ _{3 ...} λ _n, and when This uses a spatial mask SM, in which radiation is filtered at the appropriate wavelengths to simultaneously form zones of vision in the exit pupil region, while the images in the zones of vision differ in wavelength

2) The PGU 1 module provides the formation of a stereo image, by forming only two images in two zones of vision, using two image sources, but in order to ensure that the images are observed by the left and right eyes during eye movement, the spatial mask SM is shifted along the horizontal axis, those. along the X-axis, thereby providing alternate output of the image with the same spectral composition or polarization state for the right and left eyes.

3) The PGU 1 module is configured to form a multi-view image by combining n images with one field of view (FoV), but differing in the polarization state, for example, linear P polarization or S polarization, as well as right-handed circular polarization (RHCP) or left-handed circular polarization (LHCP).

4) The PGU 1 module provides the formation of a stereo image by forming one image using one image source with one spectral composition or polarization state and adjusting the functioning of the spatial mask in such a way as to provide alternating reproduction of the image for the right and left eyes (active mode of operation of the SM spatial mask) ...

Next, referring to FIG. 8a-8c, a waveguide 2 according to the invention will be described.

A waveguide is a thin flat substrate with an input element, an output element and an expander built into it, in the form of diffractive elements, for example, diffraction gratings, holographic optical elements, and semitransparent mirrors. In this case, the waveguide is made with the possibility of multiplying the pupil along one axis, for example, the X axis, and then along the other Y axis (see Fig. 7a) and simultaneously along two axes X and Y, (see Fig. 7b), as it was already described earlier. In this case, with reference to Fig. 8a, the input element is configured to introduce radiation into the waveguide with a predetermined radiation angle, the expander or multiplier is configured to multiply the introduced radiation inside the waveguide along one axis, for example X and redirect radiation to the region of the output element, and the output element is configured to multiply radiation along another axis, for example Y, and the radiation is output from the waveguide. 8b shows a diagram of a waveguide in which the pupil propagation is performed not alternately along the axes, but simultaneously along two axes. In this case, the input element is configured to introduce radiation into the waveguide with a given radiation angle. The expander and the output element are combined into one diffractive element, which simultaneously multiplies radiation along two axes X and Y and outputs radiation with a given radiation angle from the waveguide.

At the same time, in the invention for the formation of a 3-color image, the following can be used:

a) a combination of 3 waveguides, each for its own color, for example R, G, B;

b) a combination of 2 waveguides, with a combination of colors, for example, one waveguide for B + G colors and one for R colors, or one for G + R colors and one for B colors;

c) 1 waveguide with a combination of colors, for example R + G + B;

d) the waveguide is made in the form of a combination of different waveguides, each of which is designed to transfer one corner of the overall image for one of the colors R, G, B and / or a combination of colors.

Input and output elements - diffractive holographic or semi-transparent mirrors

With the help of a waveguide, see Fig. 8c, the images pass in the same field of view FoV: α_1…α_m,where α_1…α_m- the spread of the angles of the direction of radiation, and are displayed with the formation of a virtual image at an infinite distance from the user in the area of the exit pupil.

Fig. 9a is a schematic graph showing the dependence of the transmittance of the spatial mask filter as a function of wavelength and schematically showing the corresponding mask segments.

The number of filters (F ₁ , F ₂ ... F _n ) in each segment of the mask corresponds to the number of zones V ₁ , V ₂ ... V _n in the area of the exit pupil. In this case, the graph under the mask illustrates the curves corresponding to each segment of the mask, i.e. filter (F ₁ , F ₂ ... F _n ) with a transmission capacity corresponding to the wavelength λ ₁ , λ _{2 ...} λ _n. Thus, each dichroic filter (F ₁ , F ₂ ... F _n ) of the spatial mask corresponds to an image source and a corresponding field of vision. In this case, the reflection coefficients of the mirrors M ₁ , M ₂ …. M _n (see Fig. 7a) for the corresponding wavelengths λ ₁ , λ _{2 ...} λ _n are equal to the transmission coefficients of the filters F ₁ , F ₂ ... F _n for the corresponding wavelengths λ ₁ , λ _{2 ...} λ _n.

In this case, the images of the views V ₁ , V ₂ …. V _n differ from each other, or for example, if we arbitrarily consider the number of views equal to 6, then the images of the views V ₁ , V ₂ , V _{3 are} combined for the eye 1, and the images of the views V ₄ , V ₅ , V _{6 are} combined for the eye 2. And when the vehicle is moving, in each position of the driver's eyes, we see our own image with each eye.

Fig. 9b shows a diagram of the formation of views in the area of the exit pupil when the spatial mask is in passive mode. In this case, when the vehicle is moving, the driver will observe different images of the same object displaying views 1 ... n of this object from different viewing positions of this object, i.e. stereo image or pseudo 3D image. In this case, each segment with a spatial mask filter SM is characterized by a corresponding radiation transmittance F, tuned to the corresponding wavelength λ, at which the corresponding image source operates (Fig. 9a).

In this case, the longitudinal size of the filter segments in the spatial mask is determined as:

W ' _EB = M x W _EB (1)

where

W ' _EB - is the longitudinal dimension in (mm) of the spatial mask filter segment (SM),

W _EB - represents the longitudinal dimension in (mm) of the exit pupil of the HUD device,

M - represents the magnification of the second lens raster.

The magnification M of the second lenticular raster is defined as

M = -α ' _EB / α _EB (2)

where

α ' _EB - is the distance in (mm) from the spatial mask (SM) to the lens raster LA2,

α _EB is the distance in (mm) from the LA2 lens raster to the exit pupil of the HUD device.

In this case, the distance from the spatial mask (SM) to the second lens raster LA2 is determined as:

and

where

α ' _EB - is the distance in (mm) from the spatial mask to the second lens raster,

α _EB - is the distance in (mm) from the second lens raster to the exit pupil of the HUD,

f _LA2 is the focal length in (mm) of a single lens of the second lens raster LA2.

The stack of lens rasters is made in such a way that the focal lengths and positions of the lenses in the lens rasters LA1, LA2 are selected in such a way that a telescopic beam path is formed, i.e. parallel beams of rays at the entrance and exit from the lens raster and thus provides the formation of a virtual image at infinity. In this case, the set of lenses in the lens raster is selected either in the form of lenticular lenses, for example, cylindrical lenses or a set of spherical lenses. The number of lenses in the lens raster can be from 1 to n lenses. In this case, the number of lenses in the first lens raster LA1 should coincide with the number of lenses in the second lens raster LA2. According to one embodiment, the cylindrical lenses in the lens rasters LA1 and LA2 are located along the horizontal axis, which coincides along the axis with the location of the eyes of the vehicle user (see Fig.10a), which shows the module 3 for forming the exit pupil vision zones, consisting of two lens rasters , LA1, LA2 and the spatial mask SM. In this case, the formation of zones of vision V1 ... Vn is provided, distributed only along one axis. With this configuration of cylindrical lenses in the rasters, the formation of zones of vision only along one axis is ensured. 10b is a schematic diagram of the exit pupil vision zone forming unit 3, which consists of two lens rasters LA1, LA2 and a spatial mask SM. In this embodiment, spherical lenses in the lens rasters LA1, LA2 provide the formation of zones of vision V ₁ ... V _n along two axes.

With reference to FIGS. 11a and 11b, ray transmission patterns will be presented as they pass through the stack of microlens rasters LA1 and LA2. 11a and 11b schematically show a single lens of the first raster LA1 and a single lens of the second raster LA2.

As mentioned earlier, the lens rasters LA1, LA2 are selected in such a way that a telescopic path of the rays at the input and output of the optical system is provided, while the angular magnification provided by the lens rasters stack is M _LA = f _LA1 / f _LA2,

where

f _LA1 is the focal length in (mm) of a single lens in the first lens raster LA1;

f _LA2 is the focal length in (mm) of a single lens in the second lens raster LA2.

In a preferred embodiment of the invention, as shown in FIG. 11a, the following conditions are met:

1) f _LA1 = f _LA2

the focal lengths f of the lenses included in the lens rasters LA1 and LA2 are equal,

2) FoV ₁ = FoV ₂

the field of view FoV ₁ at the input of the lens rasters stack is equal to the field of view of FoV ₂ at the output.

3) M _LA = 1- angular magnification of the lens rasters stack M _LA = 1,

4) D _LA2eff ˃D _LA2,

where

D_LA2eff - effective diameter in (mm) of a single lens from the second lens raster LA2, i.e. aperture through which radiation passes without energy loss,

D _LA2 - actual diameter (in mm) of a single lens from the second lens raster LA2.

And thus, the effective lens diameter from the second lens raster LA2 is larger than the actual lens diameter from the second lens raster LA2, which causes the loss of useful radiation (see Fig. 11a).

In another embodiment, as shown in FIG. 11b, the following conditions are met:

In a preferred embodiment of the invention, as shown in FIG. 11b, the following conditions are met:

1) f _LA1 ˃ f _LA2

Those. the focal length f of a single lens in the first and second lens rasters LA1 and LA2 differ from each other,

2) FoV ₁ ˂ FoV ₂

the field of view of FoV ₁ at the entrance of the lens rasters stack is less than the field of view of FoV ₂ at the exit.

3) M _LA ˃1- angular magnification of the lens rasters stack is greater than 1

4) D _LA2eff ˂D _LA2 ,

where

D _LA2eff - effective diameter (aperture) (mm) of a single lens from the second lens raster LA2,

D _LA2 - actual diameter (mm) of a single lens from the second lens raster LA2.

And thus the effective diameter of the lenses from the second lens raster LA2 is less than the actual diameter of the lenses from the second lens raster LA2, in which case there is no energy loss in the circuit (see Fig. 11b).

Thus, the performance of the device's HUD can be improved in such a way that

1) the field of view F ₀ V, in which the radiation is output from the waveguide 2, is selected so that it is less than the final field of view formed at the output of the lens rasters LA1, LA2;

2) the selection of the aperture (D _LA2eff ) of the second lens raster LA2 is performed in such a way as to exclude the appearance of stripes in the virtual image; for this, a diffuser can be switched on in the plane of the spatial mask SM.

Figures 12a and 12b show the diagrams of the passage of radiation in the module for forming the zones of vision of the exit pupil and the waveguide.

Fig. 12a shows the diagrams of the passage of radiation in the module for forming the vision zones of the exit pupil and the waveguide. The module for the formation of zones of vision of the exit pupil, consists of at least two lens rasters, designated as LA1, LA2 (the number of rasters 2 is presented as a non-limiting example of the invention). Each of these rasters LA1 and LA2 consists of a plurality of cylindrical lenses or spherical lenses. Wherein f _{LA1 is the} focal length in (mm) of the lens in the first lens raster LA1; f _{LA2 is the} focal length in (mm) of a single lens in the second lens raster LA2. In this case, the first microlens raster LA1 is made with the possibility of converting the angular distribution of the virtual image obtained from the waveguide (where in Fig. 12a, t _{w is the} thickness in (mm) of the waveguide and n _w is the refractive index of the waveguide) into a spatial image and inputting it into the spatial mask marked as SM. In this case, LA2 is configured to transform a spatial image into an angular one. In this case, the microlens rasters LA1 and LA2, together, ensure the preservation of the angular directions of the images, while simultaneously filtering the radiation by wavelength and / or the state of polarization performed in the spatial mask (SM). It should be noted that the lens raster LA1 is made with the possibility of embedding it in the output element of the waveguide, and with the possibility of providing output of radiation and focusing of radiation on the spatial mask SM. This configuration leads to a reduction in the size of the claimed device while maintaining the quality of the generated 3D image.

12b shows a module for generating vision areas of the exit pupil, consisting of two lens rasters, designated as LA1, LA2, a spatial mask SM, and a waveguide W. The first lens raster LA1 is a mirror raster consisting of a plurality of mirrors. The second lens raster LA 2 is composed of a plurality of cylindrical lenses or spherical lenses. In this case f _{LA2 is the} focal length (mm) of a single lens in the second lens raster LA2; f _{LA1 is the} focal length (mm) of a single mirror in the first lens raster LA1. In this case, the first microlens raster LA1 is located under the waveguide and the radiation from the waveguide propagates "downward" to LA1, which is configured to convert the angular distribution of the virtual image obtained from the waveguide into a spatial image and enter it into a spatial mask designated as SM. In this case, LA2 is configured to transform a spatial image into an angular one. As stated earlier

In this case, the thickness of the waveguide t_w in (mm) is equal to the focal length f_LA1a single mirror of the first lenticular raster. And if the condition f_LA1= t_w/ n_wwhere f_LA1 is the focal length in (mm) of a single lens of the first lens raster LA1, t_w-thickness of the waveguide in (mm) and n_wis the refractive index of the waveguide, then the thickness of the HUD of the device can be significantly reduced, in this case by the value of the focal length of the first lens raster LA1. As already described earlier, one of the modes of operation of the HUD device is the formation of a stereo image, through the formation of only two images in two zones of vision, using two image sources, but in order to ensure that when the eyes move, the images are observed with the left and right eyes, the spatial SM masks along the horizontal axis, i.e. along the X-axis, thereby providing alternate output of the image with the same spectral composition or polarization state for the right and left eyes.

Let us dwell in more detail on the features of this mode of operation of the HUD device with reference to FIG. 13a and 13b, which are schematic diagrams of forming two images in two zones of vision E1 and E2.

On figa presents a diagram of the formation of two zones of vision without shifting the eyes of the driver of the vehicle, where α ' _EB is the distance (mm) from the spatial mask to the second lens raster,

α _EB is the distance (mm) from the second lens raster to the exit pupil of the HUD, and f _LA2 is the focal length (mm) of the single lens of the second lens raster LA2.

Thus, the magnification M of the second lens raster is defined as

M = -α ' _EB / α _EB

In Fig. 13b, a diagram of the formation of two zones of vision when the eyes of the vehicle driver are displaced, for example, by the value Δx in (mm), while monitoring the displacement of the driver's eyes, for example, by means of a detector, the signal from the detector is fed to the control unit, which calculates the necessary the amount of displacement of the spatial mask along the X-axis, as Δx _{SM =} M * Δx,

where M is the magnification of the second lens raster LA2,

Δx - displacement (mm) of the driver's eyes from the reference position.

At the same time, to adjust the width (profile) of the vision zones E1, E2, it is possible to adjust the position of the spatial mask along the Z axis as well.

And according to the signal from the control unit, the mask SM is shifted by the driving device.

14a is a block diagram of a multi-view imaging unit (PGU) in which a single radiation source is provided emitting radiation at both the same wavelength and different wavelengths. In this case, the emission of radiation is carried out by a signal from a control unit (not shown), depending on the selected operating mode of the HUD. And the specified radiation is emitted at different wavelengths simultaneously or alternately. Next, the radiation passes through the projection optics to a light separation cube, in this case a polarization beam splitter (PBS), where the radiation is redirected to image sources in the form of Display 1 and Display 2 with the possibility of forming two types of images or image patterns, i.e. species V ₁ , V ₂ , while these species have the same field of view (FOV), but have distinctive characteristics, for example, differ in the wavelength of radiation or the state of polarization.

On figa presents a variant in which there are two quarter-wave polarizing plates QWP, located in front of reflective displays 1 and 2, respectively, to provide an image formed in image sources with a given state of polarization, i.e. with linear P polarization or S polarization.

In this case, the Display 1 and the Display 2 generate images for the right and left eyes that differ in the polarization state, as shown in FIG. 14a or wavelength. The obtained two images, one with P-polarization and the other with S-polarization, are converted by means of projection optics from spatial images into angular images in the same field of view (FOV) and through an input element enter the waveguide W. If as sources images 1 and 2 are used LCoS displays (LCoS-liquid crystals on a silicon basis) it is necessary to use 2 polarizing elements as a polarizer, namely a quarter-wave plate (QWP) and a half-wave plate (HWP). In this case, the QWP is a quarter-wave plate that converts linearly polarized radiation into circular, HWP rotates the polarization state by 90 degrees.

Fig. 14b is a block diagram of a multi-view imaging unit (PGU module) in which two or more radiation sources are provided, for example, laser LEDs emitting radiation at the same wavelength, for example, radiation source 1 and radiation source 2, which emit radiation single color or multicolor radiation. The light sources can also be lamps, light emitting diodes (LED) or laser diodes (LD). In this case, the emission of radiation is carried out by a signal from a control unit (not shown), depending on the selected operating mode of the HUD. The radiation enters the scanning mirror 1 and the scanning mirror 2, operates alternately, according to a signal from the control unit, while the mirrors 1, 2 are made to rotate along two axes X and Y and provide a 2D image for the right and left eyes, respectively. Thus, scanning mirrors are image sources. In this case, the radiation source and the scanning mirror form a projector, for example a laser projector (LBS projector).

In Fig. 14b, a polarizer is understood to mean a polarizing element capable of transmitting radiation with only one polarization component (linear S, linear P, right-hand or left-hand).

QWP is a quarter-wave plate that converts linearly polarized radiation into circular radiation.

Thus, the image source 1 in the form of a scanning mirror 1 with a radiation source 1, forms a projector 1, which forms an image for the right eye, while the image passes through the polarizer, where it is linearly polarized, then passes through a quarter-wave plate (QWP), where the linear The polarized image is converted to a circularly polarized image, such as right-handed circularly polarized (RHCP), and entered into a PBS polarizing beam splitter. An image source 2 in the form of a mirror 2 with a radiation source 2 forms a projector 2, which forms an image, for example, for the left eye, which passes through a polarizer and a quarter-wave plate (QWP) and is converted into an image, for example, with left-hand circular polarization (LHCP) and then falls into a polarizing beam splitter (PBS). In PBS, RHCP and LHCP polarized images are combined and passed through projection optics, where the resulting two images, one with RHCP polarization and the other with LHCP polarization, are converted from spatial images to angular images in the same field of view (FOV) and through the input element enter the waveguide (W).

Image sources are one of: self-emitting display using microscopic LEDs as backlight (uLED), liquid crystal display (LCD), reflective type liquid crystal display (LCOS), digital micromirror image display device (DMD), scanning mirror imaging device (LBS).

Fig. 15a shows a diagram of the formation of two zones of vision with an active mode of operation of the spatial mask,

Fig. 15b shows a diagram of the formation of two zones of vision in the active mode of operation of the spatial mask, when the position of the eyes of the vehicle driver is shifted.

With the active mode of operation of the spatial mask SM, alternate image reproduction for each eye is provided. To work in the active mode, it is necessary to ensure synchronization of the operation of the image source, for example, the display and the spatial mask SM. In this operating mode, one image source and one projection optics are sufficient.

In the active mode of operation, the PGU 1 (not shown) provides stereo imaging by generating two images using one image source with one spectral content or one polarization state. In this case, the operation of the mask is adjusted so as to provide alternate reproduction of the image for the right and left eyes (View E1 and View E2) in the area of the exit pupil. Thus, the SM mask is configured for 2 modes of operation, this is the output of the image to the region of the left vision zone (View E1) and to the region of the right vision zone (View E2). the frequency of the mask must be equal to or close in value to the frame rate in the display of the PGU during imaging.

The mask in this case is a spatial radiation modulator, for example, a transparent LCD display, which displays the mask image, which consists of black and white stripes.

In the place where the stripe is white, the mask transmits radiation, where the black stripe blocks the transmission of radiation. In this case, the mask acts as a filter. In this case, the mask image (the thickness and order of the stripes) is selected in such a way that the area for only one eye (right or left) is exposed in the exit pupil of the HUD device - i.e. one area of vision is formed.

Thus, two mask images are generated on the mask - for highlighting the right and left eyes. These masks change one by one. Thus, alternately one vision zone is illuminated, then another with a certain frequency. Simultaneously, the PGU module generates alternately images for the right and left eyes - with the same frequency as the mask works. Thus, the driver of the vehicle sees different images with his left and right eyes. With the movement of the eyes of the driver of the vehicle, the image of the transmission filter on the spatial mask is output over time t. In the diagram of Fig. 15a, t2 means the time of the filter in the spatial mask, which forms the vision zone for the right eye (View E2). At the same time, in Fig. 15a, a view is presented when View E1 is not active, i.e. there is no image and View E2 is active, i.e. there is a picture.

In this case, a static step (Ps) is calculated for the mask operation, i.e. the spatial step of the mask, which determines the position of the zones of vision from each lens in the second lens raster LA2 and their correct overlay. Thus, the static mask pitch Ps (mm) is calculated as follows.

Ps = M * P _LA2

where

Ps - static pitch (mm)

P _LA2 - period of the lens raster LA2 (mm).

M - magnification M of the second lens raster LA2, which is defined as

M = -α ' _EB / α _EB

where

where α ' _EB is the distance (mm) from the spatial mask to the second lens raster,

α _EB is the distance (mm) from the second lens raster to the exit pupil of the HUD device, and

f _LA2 is the focal length (mm) of a single lens of the second lens raster LA2.

It should be noted that Ps, which is the characteristic of the mask, must be matched to the period of the lens raster LA2. 15b shows a diagram of the formation of two zones of vision in the active mode of operation of the spatial mask, when the position of the eyes of the vehicle driver is shifted by Δx (mm) at time t4, which indicates the output time of the filter in the spatial mask, which forms the vision zone for the right eye ( View E2).

The description of the active mode of operation of the spatial mask SM and its implementation is omitted in the description of FIG. 15b, since it is described in detail in the description of FIG. 15a.

According to Fig. 15b, when the position of the eyes of the driver of the vehicle changes, the signal characterizing the displacement of the eyes by the value Δx (mm) enters the detector, and the control unit sends a signal to the mask SM that the image should be displaced by several pixels, in this case by the Pd value, which is a dynamic step that characterizes the spatial step of the mask shift (pixel). As mentioned earlier, the signal from the synchronizer ensures synchronization of the mask operation frequency, which should be equal to the frame rate in the image source of the PGU module during image formation.

In this case, the dynamic pitch Pd (mm) is determined as

Pd = M * Δx

M - magnification of the second lens raster LA2,

Δx - displacement (mm) of the driver's eyes from the reference position (mm).

Thus, the active mode of operation of the spatial mask and the PGU is described in detail in the description of Figs. 15a and 15b, and in Figs. 16a (slide 18, right corner) is an exemplary block diagram of a multi-view imaging unit (PGU unit) in which a single radiation source is provided emitting radiation with one spectral composition or one polarization state. Next, the radiation passes through the projection optics to a light separation cube, in this case a polarization beam splitter (PBS), where the radiation is redirected to an image source in the form of Display 1, with the possibility of alternately forming two images for the left and right eyes. Further, By means of projection optics, the obtained images are converted from spatial images into angular images in the same field of view (FOV) and through an input element they enter the waveguide (W).

The specified configuration is quite cheap and easy to implement. However, the main difficulty when working in the active mode is to ensure synchronization of the operation of the spatial mask SM and the image source.

Image sources are one of: self-emitting display using microscopic LEDs as backlight (uLED), liquid crystal display (LCD), reflective type liquid crystal display (LCOS), digital micromirror image display device (DMD), scanning mirror imaging device (LBS).

Fig. 16b is an exemplary block diagram of a multi-view imaging unit with an LBS-based imaging unit in an active mode of operation.

In this case, a scanning mirror imaging technology (LBS) is used. In this case, a radiation source in the form of R, G, B lasers emit radiation at the corresponding wavelengths, which is alternately directed to the scanning mirror. In this case, the scanning mirror is made with the possibility of rotation along two axes X and Y and provides the formation of a 2D image for the right and left eyes, respectively. Thus, the scanning mirror is the source of the image. In this case, the radiation source and the scanning mirror form a projector, for example a laser projector (LBS projector). In this case, for the eye 1, the projector forms an image at the appropriate time: t ₁ , t ₃ , t ₅ ... t _2k-1 , and for the eye 2, the projector forms an image at the appropriate time: t ₂ , t ₄ , t ₆ ... t _2k.

Further, by means of projection optics, the obtained images are converted from spatial images into angular images in the same field of view (FOV) and through the input element are fed to the waveguide W.

As mentioned earlier, the main requirement for the PGU to work in the active mode is to ensure synchronization of the operating frequency (frame change) of the SM mask, which must be equal to the frame rate in the image source, in this case, the PGU's projector during image formation. This requirement is provided by the introduction of a synchronizer into the circuit, which regulates the operation of the mask and the image source according to the signal from the control unit (see Fig. 15b).

Fig. 16c is an active mode spatial mask diagram. The specified mask is a spatial radiation modulator, for example, an LCD panel, on which an image of a mask is displayed, which transmits or blocks radiation and can consist of black and white stripes.

In the place where the white band-unit filter E2 of the mask (in Fig. 16c denoted Mask E2) transmits radiation, where the black band-unit filter E1 of the mask (in Fig. 16c denoted Mask E1) - blocks the passage of radiation. In this case, the mask with single filters E1 and E2 acts as a filter.

In this case, for a single filter E2, the mask-state of transmission corresponds to the time: t ₂ , t ₄ , t ₆ ... t _2k ; and the state of absorption (blocking of radiation) corresponds to the time: t ₁ , t ₃ , t ₅ ... t _2k-1 .

For a single filter E1 mask, the transmission state corresponds to the time: t ₁ , t ₃ , t ₅ ... t _2k-1 , and the absorption state (blocking of radiation) corresponds to the time: t ₂ , t ₄ , t ₆ ... t _2k.

In this case, the bandwidth in the mask for the formation of one type, i.e. the size of a single mask filter lm (mm) is defined as:

lm = n * P;

where n is the number of pixels for each species in a unit bandwidth;

P is the pixel pitch (mm) obtained based on the parameters Ps and Pd of the mask described with reference to FIG. 15a and 15b. In this case, the mask image (the thickness and order of the stripes) is selected in such a way that the area for only one eye (right or left) is exposed in the exit pupil of the HUD device - i.e. one area of vision is formed.

Thus, two mask images are generated on the mask - for highlighting the right and left eyes. These masks change one by one. Thus, alternately one vision zone is illuminated, then another with a certain frequency. Simultaneously, the PGU module generates alternately pictures for the right and left eyes - with the same frequency as the mask works.

Effects of the invention

Augmented reality device with exit pupil reproduction and with the possibility of forming a three-dimensional image (HUD device) provides the following effects:

1) The module for the formation of a multi-view image (PGU module), provides the formation of a multi-view image consisting of several images formed from a variety of views of different angles.

2) Waveguide provides a compact HUD device, less than 5L; and provides pupil reproduction, forming a wide exit pupil.

3) The module for the formation of zones of vision in the area of the exit pupil ensures the transfer of the image of the spatial mask in the form of a filter into the plane of the exit pupil, while forming the zones of vision, and ensuring the observation of a three-dimensional image (display of an autostereoscopic image).

The effects of the claimed HUD were clearly demonstrated by the authors when simulating various configurations of imaging tools.

17a is a schematic diagram of a widely used standard waveguide imaging system with a single display with a single wavelength. In this case, the formed image passes through the projection optics, enters the waveguide and at the exit is formed in the area of the exit pupil. In this case, both eyes (left and right) see the same picture.

17b is a schematic diagram of a widely used standard imaging system based on two displays with different wavelengths, where the generated 2 images pass the projection optics into the waveguide and, after being output from the waveguide, enter the image exit pupil region, where they are superimposed on each other. In this case, both eyes see the same picture from the superimposed images.

Fig. 17c shows a diagram of an augmented reality device with exit pupil multiplication in accordance with the present invention, according to which, for each eye, its own image is formed; wavelengths, a waveguide providing pupil propagation, and a module for forming vision zones in the exit pupil region, consisting of at least two lens rasters LA1, LA2 (the number of rasters 2 is presented as a non-limiting example of the invention) and a spatial mask that provides image transfer of a spatial masks in the form of a filter into the plane of the exit pupil, while for each eye its own image is formed, and as a result, if the images for the right and left eyes are a stereo pair, a three-dimensional image is observed.

Fig. 18a is a schematic diagram of an augmented reality with pupil expansion (HUD) device according to the invention, which provides the formation of images "A" and "B" by means of two displays.

In this example, the case of image transfer is simulated when displays 1 and 2 operate at close wavelengths: λ = 519nm, λ = 520nm, respectively. In this case, the spatial mask contains dichroic narrow-band filters that provide image transmission, in this case with λ = 519nm and λ = 520nm. For each position of the right eye and left eye, the driver or observer can see different green "A" and "B" pictures. If the images for the right and left eyes are a stereo pair, a 3D image is generated.

Fig. 18b is a beamforming diagram of the HUD configuration of the device according to Fig. 18a, which illustrates the propagation of beams characterizing the image in the exit pupil region for the left and right eyes for λ = 519nm and λ = 520nm.

And below are the images formed on the retina of the right ("A") and left ("B") eyes in the area of the exit pupil, which practically do not differ in color, the difference in color is about 1 nm, but the eye cannot distinguish this difference.

Benefits of using the claimed HUD device

The declared device of augmented reality with exit pupil reproduction and with the possibility of forming a three-dimensional image (HUD device) is a compact solution with a volume of less than 5 liters, which allows it to be integrated into dashboards of any vehicles.

This ensures high concentration and safety of the vehicle driver, which is achieved through the formation of a stereo image and a virtual image at infinity, i.e. the formation of a stereo image consistent with the real situation on the road, which allows the driver to focus on the road or the environment, while receiving information about speed, engine status, phone calls and possibly other external information that would otherwise distract the driver's attention through the use of other external devices.

The key solution of the claimed invention, which provides all the indicated advantages and effects, is the use in the claimed device of a waveguide in combination with a module for shaping vision zones in the exit pupil area, consisting of lens rasters and a corresponding spatial mask, which ensures the formation of a stereo image in the exit pupil area. This configuration makes it possible to reduce the volume of the device by several times, in comparison with similar solutions of autostereoscopic displays known from the prior art.

The claimed device is quite budgetary for mass production and convenient for integration into any type of car.

The claimed device can also be used in any compact portable devices such as tablets or laptops, as well as in teleconferencing systems.

Fig. 19a is a schematic diagram of a compact HUD-based device according to the invention using a collapsible beam combiner.

Fig. 19b is a schematic diagram of a compact HUD-based device according to the invention using a radiation combiner with a beam redirecting function.

The principle of operation of these devices completely coincides with the operation of the HUD device disclosed in the present description, which contains a PGU module, a multi-view imaging module in the exit pupil region, a radiation combiner and a waveguide. In this case, the radiation combiner is a glass plate with a suitable coating that reflects or redirects the image to the exit pupil region. For this, a reflective coating, a dichroic coating, see Fig.19a or diffractive structures, prismatic structures (Fig.19b) is applied to the plate. In this case, the angle of reflection of the beam into the exit pupil region can be directly set by the radiation combiner, or the angle of the beam direction can be set by the projection optics when leaving the PGU module and then redirected to the exit pupil region by the radiation combiner.

Fig. 20 is a diagram of augmented reality glasses based on the HUD of the device.

The claimed device can be used in glasses with augmented reality, the diagram of which is shown in Fig.20. The principle of operation of these glasses completely repeats the operation of the HUD device, disclosed in the present description, and containing a PGU module, a module for forming a multi-view image in the exit pupil region, a waveguide, a radiation combiner. This solution generates a multi-view image that allows 3D images.

The direction of propagation of the beams in FIG. 19a, 19b and 20 are illustrated by solid and broken, dash-dotted lines, characterizing various properties of beams, differing in their composition: by wavelength, polarization state, or spaced in time. The curves in the graphs located next to the diagrams of the devices in Figs. 19a, 19b, 20 illustrate the intensities of illumination of the vision zones for each beam, differing in composition.

Industrial applicability

An augmented reality device with multiplying the exit pupil, and with the possibility of forming a three-dimensional image, can be integrated into vehicle dashboards, used in compact, portable devices, for example, tablets, laptops, teleconferencing systems, in augmented reality glasses and other devices that have the need for the formation of an autostereoscopic image.

Claims (54)

1. Augmented reality device with exit pupil reproduction and with the possibility of forming a three-dimensional image, containing optically coupled: - a multi-view imaging module configured to form a multi-view image and form an exit pupil containing said generated multi-view image, wherein the multi-view image contains at least two images with the same field of view (FoV), differing in wavelength and / or polarization state , or spaced in time; - a waveguide made with the possibility of multiplying the exit pupil formed in the module for generating a multi-view image; - a module for the formation of zones of vision in the area of the exit pupil, made with the possibility of dividing images by wavelengths, and / or the state of polarization, or time (t) of image formation; and outputting the corresponding images to the corresponding vision areas in the exit pupil region with the formation of a three-dimensional image; and additionally containing - a control unit connected to a module for forming a multi-view image, a module for forming vision zones and configured to control these modules by a control signal; the module for forming a multi-view image contains optically coupled at least one radiation source, a radiation combiner, at least one image source and projection optics; the module for the formation of vision zones in the exit pupil region contains a stack of at least two microlens and / or micromirror rasters (LA1, LA2) and a spatial mask (SM) configured to operate in a passive mode, in which radiation is filtered by wavelength and / or the state of polarization, or in the active mode, in which the radiation is filtered in time (t), in response to a control signal from the control unit. 2. The apparatus of claim 1, wherein the multiview imaging module comprises at least 2 radiation sources, each configured to emit light at the same wavelength or different wavelengths. 3. The device according to claim 2, wherein at least 2 radiation sources are configured to emit RGB radiation. 4. The device according to claim 1, wherein the radiation sources are configured to emit radiation simultaneously or alternately upon a signal from the control unit. 5. The device according to claim 1, in which the radiation sources are one of: light-emitting diode, laser diode, incandescent lamp. 6. The device according to claim 1, wherein the radiation combiner is configured to mix and combine radiation from different radiation sources and output the mixed radiation to the image source. 7. The device according to claim 6, wherein the radiation combiner is an optical element with an appropriate coating to reflect or redirect radiation in a predetermined direction. 8. The apparatus of claim 7, wherein the optical element is a dichroic coated glass plate or coated with prismatic or diffractive elements. 9. The apparatus of claim 6, wherein the radiation combiner is a waveguide combiner. 10. The device according to claim 1, in which the image source is configured to form zones of vision and is one of: self-emitting display using microscopic light-emitting diodes as backlight (uLED), liquid crystal display (LCD), reflective type liquid crystal display (LCOS) , digital micromirror image output device (DMD), scanning mirror imaging device (LBS). 11. The device according to claim 1, in which the waveguide is configured to alternately multiply the exit pupil, first along the X-axis, and then along the Y-axis, or vice versa. 12. The device of claim 1, wherein the waveguide is configured to multiply the exit pupil simultaneously along the X and Y axes. 13. The device according to claim 1, in which the waveguide is made in the form of a flat substrate with an input element, an expander and an output element built into it. 14. The device according to claim 13, in which the input element is configured to introduce radiation with a predetermined angle into the waveguide and is one of: a diffractive element in the form of diffraction gratings, a holographic element, or a semitransparent mirror. 15. The device according to claim 13, in which the waveguide output element is configured to output radiation at a predetermined angle from the waveguide and is one of: a diffractive element in the form of diffraction gratings, a holographic element or a semitransparent mirror. 16. The apparatus of claim 13, wherein the waveguide expander is configured to multiply the exit pupil inside the waveguide and is one of a diffractive element in the form of diffraction gratings, a holographic element, or a semitransparent mirror. 17. The apparatus of claim 13, wherein by simultaneously multiplying the exit pupil along the X and Y axes, the expander and the output element are combined into one optical element in the form of a diffractive element. 18. The device according to claim 1, in which, when forming RGB images in the multi-view imaging unit, the waveguide is made in the form of a combination of three waveguides, each designed to transfer an image of one color, for example, R, G, B colors. 19. The device according to claim 1, in which the waveguide is made in the form of a combination of two waveguides with a combination of colors, for example, one waveguide B + G colors, and the other R colors, or one waveguide for G + R colors and the other for B colors. 20. The device according to claim 1, in which the waveguide is made in the form of a single waveguide with the possibility of transferring an image with a combination of colors, for example, R + G + B colors. 21. The device according to claim 1, in which the waveguide is made in the form of a combination of different waveguides, each of which is designed to transfer one corner of the overall image for one of the colors R, G, B and / or a combination of these colors. 22. The device according to claim 1, in which the stack of at least two microlens and / or micromirror rasters (LA1, LA2) is designed in such a way as to provide a telescopic path of rays at the entrance and exit of said stack. 23. The device according to claim 1 or 22, in which the stack of at least two microlens and / or microscope rasters (LA1, LA2) contains two microlens and / or microscope rasters (LA1, LA2). 24. The apparatus of claim 1, wherein each of the microlens rasters (LA1, LA2) comprises at least one lenticular lens that is a cylindrical lens or a spherical lens. 25. The apparatus of claim 24, wherein the number of lenses in the first microlens raster LA1 is equal to the number of lenses in the second microlens raster LA2. 26. The apparatus of claim 23, wherein the first raster LA1 is a micromirror raster consisting of at least one mirror, and the second raster LA2 is at least one cylindrical or spherical lens, wherein the number of mirrors in the first raster LA1 is the same with the number of lenses in the LA2 raster. 27. The device according to claim 1, in which the first microlens raster LA1 is configured to be built into the waveguide output element and to provide radiation output and radiation focusing on the spatial mask SM. 28. The apparatus of claim 1, wherein the projection optics is an optical unit consisting of at least one or a combination of: a lens, a mirror, a polarizing beam splitter (PBS), a quarter-wave plate (QWP), and a half-wave plate (HWP), and converting a spatial image into an angular image in the same field of view (FOV). 29. The device according to claim 1, in which, in the passive mode of operation, the spatial mask SM is a layer of absorbing material with built-in alternating filter segments, each of which transmits radiation with a predetermined wavelength corresponding to the radiation wavelength of the radiation source in the multi-view formation module. Images. 30. The apparatus of claim 29, wherein said filter segments are dichroic filters. 31. The apparatus of claim 1, wherein during passive operation, the spatial mask SM is configured to transmit radiation in a polarization state that is one of S polarization, P polarization, right-handed circular polarization (RHCP), left-handed circular polarization (RHCP). 32. The apparatus of claim 1, wherein the spatial mask SM is configured to alternately display an image with the same spectral composition or polarization state for the left and right eyes. 33. The device according to claim 1, in which, in the active mode of operation, the spatial mask is configured to alternately display the image for the left and right eyes and is a spatial radiation modulator, for example, in the form of an LCD display. 34. The device according to claim 32 or 33, in which the frequency of changing the mask corresponding to the mode of transmission or blocking of radiation passing through the mask is equal to the frame rate of the display in the image source. 35. The device according to one of claims 1, 32-34, further comprising a synchronizer for synchronizing the operation of the spatial mask operating in the active mode with the image source, according to a control signal from the control unit connected to the multiview imaging module and to the synchronizer. 36. The device according to claim 1, further comprising a detector connected to the control unit and configured to register the displacement of the user's eyes, and a drive device configured to move the spatial mask in response to a signal from the control unit. 37. The device according to claim 1, wherein in the passive mode of the mask operation, the spatial mask is configured to alternately display an image with the same spectral composition or polarization state for the right and left eyes by displacing the mask along a horizontal axis coinciding with the location of the user's eyes. 38. The device according to claim 1, wherein the spatial mask SM is located in an optically conjugate plane of the exit pupil of the augmented reality device relative to the optical raster LA2. 39. A device according to one of claims 1 to 38, which is configured to be built into a vehicle dashboard. 40. The device according to one of claims 1 to 38, which is adapted to be used in compact portable devices, such as tablets or laptops, teleconferencing systems. 41. A device according to one of claims 1 to 38, which is adapted to be used in augmented reality glasses. 42. A method of forming an image in an augmented reality device with exit pupil reproduction according to one of claims 1 to 41, comprising the steps in which: - provide the formation of a multi-view image and the formation of an exit pupil containing the specified generated multi-view image by means of the multi-view imaging module, while the specified multi-view image contains at least two images with the same field of view FoV, differing in wavelength and / or polarization state, or spaced by time; - by means of a waveguide, the specified exit pupil is multiplied; - form an augmented reality image by means of a multi-view image module and a waveguide, - by means of the module of formation of zones of vision in the region of the exit pupil, separation of images by wavelengths and / or state of polarization, or time (t) of image formation is provided; and - output the corresponding images to the corresponding zones of vision in the area of the exit pupil with the formation of a three-dimensional image.

Images