EP4457559A1 - Vorrichtung zur projektion eines bildes in das auge eines benutzers - Google Patents

Vorrichtung zur projektion eines bildes in das auge eines benutzers

Info

Publication number
EP4457559A1
EP4457559A1 EP22844181.2A EP22844181A EP4457559A1 EP 4457559 A1 EP4457559 A1 EP 4457559A1 EP 22844181 A EP22844181 A EP 22844181A EP 4457559 A1 EP4457559 A1 EP 4457559A1
Authority
EP
European Patent Office
Prior art keywords
emission
light
twin
pixels
different
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP22844181.2A
Other languages
English (en)
French (fr)
Inventor
Matthias COLARD
Christophe Martinez
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Commissariat a lEnergie Atomique et aux Energies Alternatives CEA
Original Assignee
Commissariat a lEnergie Atomique CEA
Commissariat a lEnergie Atomique et aux Energies Alternatives CEA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Commissariat a lEnergie Atomique CEA, Commissariat a lEnergie Atomique et aux Energies Alternatives CEA filed Critical Commissariat a lEnergie Atomique CEA
Publication of EP4457559A1 publication Critical patent/EP4457559A1/de
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features

Definitions

  • the technical field of the invention relates to the projection of an image on an eye, in applications of the augmented reality type.
  • Wearable augmented reality devices such as goggles, make it possible to observe a real scene while viewing additional information.
  • This type of device is frequently based on micro-screens, making it possible to form an image in the immediate vicinity of a user's eye.
  • micro-screens can for example be integrated into a bezel.
  • An optical system comprising a set of lenses, allows the perception of a sharp image by the eye.
  • Patent US9632317 describes a device allowing projection, on the retina of an eye, without screen or optical system.
  • the device comprises a transparent integrated optical circuit composed of an array of nanometric light guides, an array of electrodes and a holographic film.
  • Such a device is compact, and makes it possible to obtain an extended field of vision. In addition, this makes it possible not to use a bulky optical system of complex design.
  • the nanometric light guides make it possible to define a set of emission points on the holographic film, each point being able to be illuminated by a light extracted from a light guide.
  • the set of emission points is subdivided into different emission subsets, each emission subset comprising emission points distributed, as randomly as possible, on the holographic film.
  • the emission points of the same emission subset can be simultaneously illuminated by the different light guides. Under the effect of the illumination, each emission point of the same emission subset emits a light wave propagating in the same angular direction as far as the pupil of the eye, so as to form a luminous point. unique to the retina. In this way, each subset of emission points allows formation of a pixel of the image perceived by the user.
  • An image can be formed by successively illuminating different subsets of emission points, so as to form an image comprising a large number of pixels.
  • the illumination frequency of each subset of emission points is dimensioned so that under the effect of retinal persistence, the user can feel the formation of a fixed image, despite the sequential formation of the various pixels of the image.
  • the emission points are distributed as randomly as possible, so as to avoid effects of repetition of patterns by periodic or quasi-periodic structures during the formation of the image on the retina.
  • each light guide In US9632317, light is extracted from each light guide by arranging electrically modulated diffraction gratings along the light guide.
  • the diffraction gratings are spaced from each other and define point light extraction zones. Under the effect of electrical activation, each diffraction grating allows extraction of the light propagating in a light guide.
  • the light guides are sinusoidal in shape, and extend parallel to each other. It is however necessary to have a large number of laser light sources, typically several hundred, if it is desired to have a sufficient number of pixels formed simultaneously on the image.
  • the inventors propose an optimized configuration, so as to maintain a high number of pixels, while reducing the number of laser light sources and preserving the quality of the images formed on the retina.
  • a first object of the invention is a device for projecting an image onto the retina of an eye, the image being composed of several pixels, the device comprising:
  • - light sources preferably laser
  • each light guide being connected to a light source and to a plurality of diffraction gratings, distributed along the light guide, each diffraction grating being electrically adjustable to extract part of the propagating light in the light guide to which it is connected;
  • electrodes each electrode being configured to modulate diffraction gratings connected to different light guides
  • emission points each emission point being formed at the level of a diffraction grating, and extending between an electrode and a light guide, each point emission being configured to emit light, in an angular direction, following an extraction of a light propagating in the light guide; the device being such that: different emission points are configured to emit the light according to the same angular direction, so as to converge on the retina, by forming the same pixel, the said emission points defining an emission subset , so that each emission sub-assembly corresponds to an angular direction of emission of the light; two adjacent pixels of the image are formed by two emission subsets, respectively associated with two different angular directions and spaced apart by an elementary angular difference; the device being characterized in that:
  • twins different emission sub-assemblies, called twins, configured to simultaneously form different pixels, called twin pixels, when the light source is activated, the twin emission sub-assemblies being associated with the light source;
  • each twin emission sub-assembly is spaced from each other by an angular difference greater than or equal to a minimum angular difference, the minimum angular difference corresponding to k times the elementary angular difference, k being greater than or equal to 2;
  • the emission points of different twin emission sub-assemblies are preferably connected to a same electrode or to an electrode of a same group of electrodes.
  • twin emission sub-assemblies are respectively connected to different light guides, to form different twin emission sub-assemblies, each twin emission sub-assembly being associated with the same light source;
  • each twin emission sub-assembly is spaced from each other by an angular deviation greater than the minimum angular deviation.
  • the waveguides, connected to the same light source, and forming a twin emission subset are different from other waveguides connected to said light source, and forming another subset twin emission associated with the same light source.
  • the minimum angular deviation can be greater than or equal to 0.5° or 1°.
  • the diameter or the diagonal of the emission points is less than or equal to 10 pm, the minimum angular deviation being greater than 1.5;
  • the diameter or the diagonal of the emission points is between 10 ⁇ m and 20 ⁇ m, the minimum angular difference being greater than 0.8;
  • the diameter or the diagonal of the emission points is greater than 20 pm, the minimum angular deviation being greater than 0.5;
  • the diameter or diagonal of each emission point is greater than 5 ⁇ m.
  • the light guides connected to the same light source define first twin emission sub-assemblies and second twin emission sub-assemblies, so as to respectively form first twin pixels and second twin pixels;
  • each second twin emission subassembly is connected to second electrodes, different from the first electrodes;
  • the device comprises a switch, to supply either the first electrodes, or the second electrodes, so that the light emitted by the light source is extracted sequentially either by the emission points of the first emission subassemblies, or by the emission points of the second emission subsets, to form sequentially, on the image, the first twin pixels and the second twin pixels.
  • different modulators are respectively interposed between a light source and different light guides connected to the light source, so as to modulate an intensity of the light propagating in said light guides independently for different light guides connected to the light source.
  • a light source is connected to N different twin emission sub-assemblies, configured to simultaneously form N twin pixels, N being an integer greater than or equal to 2; - the light source is connected to N modulators, each modulator extending between the light source and the waveguides forming the same emission sub-assembly.
  • the number of twin emission subsets formed by at least one light source is greater than or equal to 20.
  • the device may include fewer than 20 different light sources to form an image, or part of an image, of at least 200 pixels by 200 pixels.
  • the device comprises a holographic film, subdivided into different holograms, each hologram being associated with a diffraction grating, and configured to emit the light wave, according to the direction of emission, under the effect of light extracted by the diffraction grating with which it is associated, each association between a hologram and a diffraction grating forming a point of light emission.
  • a second object of the invention is a bezel, comprising bezel lenses, the bezel comprising a device according to any one of the preceding claims, the stack being formed on at least one bezel lens.
  • a third object of the invention is a method for parameterizing a device according to the first object of the invention, the parameterization comprising: a) modeling of a spatial distribution of the noise between two twin pixels, by modifying the angular difference minimal; b) estimation of the minimum angular deviation as a function of the spatial distribution.
  • Step b) can comprise an estimation of the signal-to-noise ratio as a function of the minimum angular deviation.
  • Another object of the invention is a device according to the first object of the invention, the minimum angular deviation of which is parameterized by the method according to the second object of the invention.
  • FIG. 1A a set of emission points has been represented, converging towards a pixel.
  • FIG. IB another set of emission points has been represented, converging towards an adjacent pixel of the pixel described in connection with FIG. IA.
  • FIG. 1 C shows an example of a subset of emission points distributed over an emission medium.
  • FIG. 1D illustrates a step for recording holograms on a holographic film.
  • FIG. 1E illustrates a step of emission of a light wave by emission points formed on the device.
  • FIG. 2 corresponds to an example of implantation of light guides and electrodes.
  • FIG. 3A represents a model of a light wave, produced by a subset of emission points, and reaching a pixel.
  • Figure 3A shows the intensity of the light wave incident on the retina as a function of position along a direction passing through the center of the pixel.
  • FIG. 3B corresponds to FIG. 3A, the unit of the abscissa axis being angular.
  • Figure 3C illustrates a calculation of the signal-to-noise ratio (SNR) associated with a light wave produced by an emission subassembly and reaching a pixel.
  • SNR signal-to-noise ratio
  • FIG. 4 represents pixels of an image formed on the retina of an eye, as well as a circular perimeter around pixels, the diameter of which determines a minimum angular difference between two pixels, called twins, formed from sub- emission sets simultaneously illuminated by the same light source.
  • FIG. 5A shows an evolution of the signal-to-noise ratio of a pixel, called a central pixel, surrounded by 4 neighboring pixels, for different configurations, as a function of the angular difference between the central pixel and each neighboring pixel.
  • FIG. 5B shows images of a central pixel, surrounded by 4 neighboring pixels, for three different angular deviations between the central pixel and each neighboring pixel.
  • the pixels result from the simultaneous illumination of emission subsets by the same light source: these are twin pixels.
  • FIG. 5C shows images of a central pixel, surrounded by 4 neighboring pixels, for three different angular deviations between the central pixel and each neighboring pixel.
  • the pixels result from the illumination of emission subsets by light sources different from each other.
  • FIG. 6A schematizes a configuration of light sources, light guides and electrodes making it possible to define 16 emission subsets, each emission subset comprising 4 emission points.
  • Figure 6B illustrates 16 pixels that can be formed by the configuration shown in Figure 6A.
  • FIG. 7A schematizes a configuration of light sources, light guides and electrodes making it possible to define 16 emission subsets, each subset emission comprising 4 emission points, while reducing the number of light sources compared to the configuration of FIG. 6A.
  • Figure 7B illustrates 16 pixels that can be formed by the configuration shown in Figure 7A.
  • FIG. 8A schematizes the configuration described in connection with FIG. 7A, with simultaneous activation of the two light sources and activation of half of the electrodes.
  • Figure 8B shows the pixels displayed by the configuration of Figure 8A.
  • FIG. 9A schematizes the configuration described in connection with FIG. 7A, with simultaneous activation of the two light sources and activation of the other half of the electrodes.
  • Figure 9B shows the pixels displayed by the configuration of Figure 9A.
  • FIG. 10 represents an evolution of the signal-to-noise ratio of the image as a function of the angular spacing between a central pixel and 4 neighboring pixels, all of the pixels being twin pixels.
  • the size of each emission point has also been varied.
  • FIG. 11 shows an example of an arrangement of twin pixels, formed by the same light source.
  • Figure 12 schematizes a compromise between the signal-to-noise ratio of the image (left ordinate axis) and the number of light sources used (right ordinate axis) as a function of the angular difference between the twin pixels ( horizontal axis).
  • FIGS. 1C and 1D illustrate the principles on which the invention is based. These principles are described in the publication Martinez C, “See-through holography retinal projection display concept”, Optica, Vol. 5, No. 10, October 2018.
  • a projection device 1 is placed facing a pupil P of an eye, the latter focusing the light on the retina R of the eye.
  • the projection device comprises an emission medium 10.
  • the emission medium 10 is formed of a set of emission points EP, each emission point being able to be illuminated by a light source.
  • the structure of transmission medium 10 is described in connection with FIGS. 1C and 1D.
  • the emission medium 10 is placed at a distance Zo from the pupil P.
  • the pupil P is placed at the focal distance f Q of the retina R.
  • Each emission point EP represented in FIG. IA is configured to emit light in an angular direction of emission 0, y towards the pupil P.
  • the emission points EP of the emission surface are divided into different EPDj emission subsets, (Emission Point Distribution) such that the emission points of the same emission subset all emit light each other. propagating parallel to the same angular direction of emission 0 ⁇ .
  • the angular direction of emission is defined with respect to a reference direction, for example a direction passing through the center of the pupil and perpendicular to the latter.
  • the reference direction is represented by a dashed line in Figures IA and IB.
  • Each emission point EP of a same emission subassembly EPDjj is configured to emit, under the effect of illumination by a light source, a light wave propagating in an angular direction of propagation towards the pupil P.
  • the phase relationship between the different light waves, respectively emitted by the emission points EP of a same emission subset EPDj makes it possible to form, upstream of the pupil P, a plane wave , of wave vector kjj or, more generally, a wave whose wavefront is controlled.
  • the wave front can have a flat shape, or else spherical or parabolic.
  • each light wave is focused by the pupil and converges to the same pixel R(i,j) on the retina R.
  • the projection device 1 thus makes it possible to form an image, on the retina R, the image being discretized into several pixels R(i,j), each pixel R(i,j) corresponding to the pixel of an image formed, by the projection device 1, on the retina R.
  • the image has a square shape, and the same applies to each pixel composing it.
  • An image can have several hundred pixels per side.
  • the light intensity at the level of the pixel R(i,j) results from the contribution of each light wave, propagating, upstream of the pupil, in the same angular direction 0, y resulting from each point of emission EP d' the same emission subset EPDjj, after focusing by the lens.
  • the index ij corresponds to an angular coordinate of the light wave which, after focusing by the pupil (or self-focusing), converges towards the pixel R(i,j) on the retina.
  • the transmission medium is segmented into different emission subsets EPDjj, each subset comprising several emission points EP distributed over the emission surface, each emission subset being associated with the same direction of propagation angular Qjj, given by the wave vector kjj, towards the pupil.
  • FIG. 1B represents another EPD i+1 subset.
  • the emission subset EPDj+1 comprises different emission points EP, each point being associated with a same direction of angular propagation 0 i+1J -, given by a same wave vector k i+1 .
  • each light wave, emitted by each point of the EPD i+1 emission subset converges to the same pixel R(i + l,j) on the retina R.
  • the pixel R(i + l,j) is adjacent to pixel R(i,j) shown in Figure IA.
  • the angular directions 0, y , Qt+ which respectively make it possible to form two adjacent pixels on the retina, are spaced apart by an elementary angular deviation /?.
  • the elementary angular deviation corresponds to an angle, upstream of the pupil, between two angular directions of propagation of light waves converging, downstream of the pupil, towards two adjacent pixels R(i + 1, j), R(i , j) on the retina R.
  • the elementary angular deviation /3 is typically less than 0.1° or 0.2°. It is for example equal to 0.06°.
  • FIG. a subset of emission points configured to emit light propagating towards the pupil P, parallel to the same angular direction ⁇ .
  • the emission medium extends parallel to the pupil, along an X axis and a Y axis.
  • Each emission point EP has coordinates (x EP , y E p) along these axes.
  • FIG. 1D diagrams the structure of the projection device 1.
  • the projection device comprises the emission medium 10, the latter being connected to several light sources 21 and several switches 23.
  • each light source is a source of laser light.
  • Each switch makes it possible to connect an electrode 13 to a power supply.
  • the emission medium is formed of several transparent layers superimposed on each other: a first layer, in which light guides 11 are formed.
  • Each light guide is configured to receive coherent light, emitted by a laser source 21, and to propagate the coherent light along the emission medium.
  • Each light guide can for example be formed from SiN (silicon nitride) deposited on glass.
  • Each guide can extend along a thickness and a width comprised between 200 nm and 300 nm.
  • each diffraction grating 12 is coupled with a light guide 11.
  • Each diffraction grating is configured to extract part of the light propagating through the light guide 11.
  • Each diffraction grating 12 corresponds to a periodic variation of refractive index, capable of being electrically modulated.
  • Each diffraction grating 12 can be formed from inclusions, defining a periodic pattern, for example a Bragg grating, in silicon oxide (SiOz).
  • Each inclusion is formed of a material whose refractive index is electrically adjustable, for example a liquid crystal.
  • the diffraction gratings 12 coupled to the same light guide 11 are spaced apart along the light guide, and are considered to be point-like.
  • the period of the pattern of the diffraction grating 12 can be between 300 nm and 400 nm.
  • a diffraction grating can extend according to 10 periodic patterns, and thus extend over a length of a few microns, for example between 2 and 10 ⁇ m.
  • the transparent electrodes can be formed from a transparent conductive material, for example ITO (indium tin oxide).
  • Each electrode can thus activate a diffraction grating under the effect of the electrical modulation.
  • a fourth layer corresponding to a holographic film 14.
  • holographic film is meant a photosensitive medium capable of recording a hologram.
  • the holographic film is assumed to be thin enough to be assimilated to an emission surface.
  • the holographic film can be a photopolymer, for example poly(methyl methacrylate), or a photoresist.
  • the transmission medium 10 is preferably formed on a plate. It may be a transparent plate 15 when the device is intended to be integrated into a bezel. It may for example be a plate of glass or polycarbonate.
  • each point diffraction grating 12 connected to the electrode can be activated, in the sense that it allows an extraction of part of the light propagating in a light guide 11 to which it is coupled.
  • the extracted light propagates towards an elementary zone of the holographic film 14, the elementary zone storing a hologram.
  • the hologram forms an emission point EP, emitting a light wave according to a predetermined wave vector k and phase O.
  • each diffraction grating 12, controlled by an electrode 13 allows coupling of a waveguide 11 with a hologram previously stored in the holographic film.
  • the phase of the light wave emitted by the emission point depends on the phase information stored in the hologram.
  • the light waves emitted by different emission points EP of the same emission subset EPDj are out of phase with respect to each other so that all of these light waves form a coherent wave, with the same vector of wave k ⁇ , for example plane, propagating towards the pupil P in the same angular direction 0 f .
  • each emission point EP corresponds to a superposition, parallel to the emission surface, between a point diffraction grating 12 coupled to a light guide 11, and an electrode 13, facing a hologram of the holographic film 14.
  • the emission points are distributed along an emission surface S.
  • the light guides 11 are arranged parallel to the emission surface S.
  • the electrodes 13 are superimposed on the light guides.
  • light 11 Parallel to the emission surface S, each electrode “crosses” several light guides, so as to define several intersections, each intersection corresponding to a position of an emission point EP.
  • the term "cross” is to be interpreted as designating a superposition of an electrode and a light guide.
  • a light guide 11 has been shown coupled to three diffraction gratings 12, the latter being connected to three different electrodes 13, the latter being oriented perpendicular to the light guide 11.
  • the holographic film 14 has previously been the subject of a holographic recording, shown schematically in FIG. 1D.
  • a hologram is formed by interference between two light waves emitted by a coherent light source: an object light wave and a reference light wave.
  • the interference fringes generated are stored physically or chemically in the holographic film 14.
  • the light extracted from a light guide 11 acts as a reference beam.
  • FIG. 1D there is represented: by dashed arrows, light emitted by the laser light source and propagating in a light guide 11; by solid dashed arrows, the light extracted from each light guide 11, respectively by three diffraction gratings 12, under the effect of activation by the three electrodes 13.
  • the object beam is a beam propagating towards the holographic film according to a wave vector k ⁇ , so as to converge at a point of the retina by autofocusing.
  • the object beam can be emitted by a collimated source.
  • FIG. 1D three object beams are represented propagating according to the same wave vector k j materialized by dashed arrows.
  • the object beams and each reference beam are emitted by the same laser light source.
  • the recording phase consists in storing holograms, in different elementary zones of the holographic film 14, each recording resulting from an interference between the object beam, propagating according to the same wave vector k j (and therefore the same angular direction 0 ⁇ ) and a reference beam extracted from a light guide 11.
  • different elementary zones of the holographic film 14 are exposed to an object beam of the same wave vector k ⁇ , so as to form a emission subset EPDjy of emission points EP corresponding to the same direction of propagation.
  • the emission points of the emission subassembly EPD ⁇ are illuminated by the reference beam, the latter being extracted from the light guides.
  • the other elementary zones of the holographic film 14, located opposite points belonging to other emission subsets, are masked.
  • different elementary zones of the holographic film 14 are respectively exposed to different object beams propagating according to different wave vectors, so as to form emission points associated with different emission directions e 0 ⁇ .
  • FIG. 1E illustrates the phase of use of the device 1.
  • the elementary zones of the holographic film 14 having recorded a hologram during the holographic recording step.
  • part of the laser light propagating in the light guide 11 is extracted and propagates towards the holographic film 14, as described in connection with figure ID.
  • each hologram stored in the photosensitive film diffracts a wave which corresponds to the object wave at the time of recording, and in particular along the direction of propagation k ⁇ .
  • the diffracted wave is represented by mixed dashes in Figure 1E.
  • the emission points EP corresponding to the same emission subset EPDij, associated with the same wave vector /c, '-J , are activated simultaneously: thus forming coherent diffracted waves, propagating parallel to the same direction of propagation 0 ⁇ towards the pupil P: the waves refracted by the pupil converge in the same pixel R(i, ) on the retina.
  • another emission subset EPD ⁇ ji can produce coherent diffracted waves propagating towards the pupil P, according to direction of propagation 9 ⁇ the waves refracted by the pupil converging in the same pixel on the image formed at the level of the retina, the emission points of the EPD ⁇ ji emission subset being illuminated by light extracted from other light guides illuminated by another laser light source or the same laser light source and activated by the same group of electrodes.
  • Emission points EP of different emission subset EPDjj can be activated sequentially, so as to converge sequentially on different pixels on the retina.
  • the electrodes 13 and the light guides 11 are distributed forming groups.
  • An emission sub-assembly EPDj corresponds to emission points EP formed by superimposing the electrodes of a group of electrodes on light guides of the group of light guides.
  • each emission subset EPDjj forming the same pixel 7?(i,j), is associated with a single group of light guides 11 and with a single group of electrodes 13.
  • the design of a projection device as previously described is confronted with constraints of compactness: it is considered that the diameter D p of a pupil is of the order of 4 mm. Furthermore, the emission surface S is greater than the surface of a pupil, so that the eye can move vis-à-vis the surface, without any degradation of the image formed on the retina is seen.
  • Each pixel R(i, of the image projected on the retina corresponds to an emission subset EPDjj of emission points EP associated with the same direction of propagation9j .
  • the number of emission points EP of a same emission subset EPDjj is preferably greater than 40, or even greater than 55 or 60.
  • the number of subsets of emission points EPDj corresponds to the number of pixels formed on the image. In order to increase the number of pixels of the image formed on the retina, it is necessary to increase the number of emission subsets EPDij respectively associated with different directions of propagation ⁇ .
  • Figure 2 illustrates an arrangement of electrodes and light guides as described in US9632317.
  • the light guides 11 extend, along a surface parallel to the emission surface, according to sinusoidal curves, along a longitudinal axis X.
  • Two adjacent light guides are translated relative to each other. the other, perpendicular to the axis X.
  • the electrodes 13 extend, according to a surface parallel to the emission surface, according to sinusoidal curves, along a lateral axis Y. Two adjacent electrodes are translated the one relative to the other, perpendicular to the Y axis.
  • the light guides are connected to laser light sources 21, for example laser diodes. Electrodes 13 are connected to switches 23. Each switch is configured to activate or deactivate each electrode to which it is connected.
  • the device described in US9632317 comprises 400 emission sub-assemblies, each emission sub-assembly being formed by 10 waveguides. This requires the use of 400 laser light sources.
  • the inventors propose to couple different light guides 11 to the same laser source 21, so as to simultaneously form different pixels, called twin pixels, spaced from each other.
  • the intensity of the light propagating in the light guides connected to the same light source can be modulated by placing a modulator 22 between each light guide connected to the laser source.
  • the intensity of each twin pixel can be adjusted independently.
  • the number of modulator associated with each laser light source corresponds to the number of twin pixels that can be simultaneously formed by the laser light source.
  • Each twin pixel corresponds to an emission subset, referred to as a twin emission subset.
  • the inventors have observed that the use of the same laser light source to simultaneously form twin pixels can lead to the appearance of interferences at the level of the image formed on the retina. This is because the same laser light source is the source of different coherent light waves which respectively propagate to different pixels, which can generate cross-interference.
  • Figures 3A to 3C illustrate spatial intensity distributions of light waves propagating to a retinal pixel.
  • Experimental studies have shown that the light intensity, formed by a subset of EPDij emission, around a retinal pixel can be modeled by a sum of two two-dimensional Gaussians: a first two-dimensional Gaussian, of intensity I lt and the half-waist w lt which represents the useful signal; a second two-dimensional Gaussian, of intensity I 2 , and half-waist w 2 , which represents the noise.
  • the width w 2 is due to diffraction effects by the emission points EP. The smaller the latter, the more the diffraction effects increase.
  • the intensity of the light produced by the emission subset EPDj can be expressed according to the relationship: with f 0 is the focal length of the eye;
  • D p is the diameter or diagonal of the support as shown in Figure IC;
  • A is the wavelength.
  • the modeled intensity has been represented (curve a), as well as the two Gaussians corresponding respectively to the useful signal and to the noise: curves b and c.
  • Expression (1) can be expressed as a function of an angle ip x with respect to a reference direction connecting the pupil to the center of the pixel.
  • the angle ip x is obtained from x according to: with
  • the modeled intensity has been represented (curve a), as well as the two Gaussians corresponding respectively to the useful signal and to the noise: curves b and c.
  • FIGS. 3A and 3B have been established by considering that each emission point extends along a disk 10 ⁇ m in diameter.
  • EPDj, EPDjiji are preferably spaced apart by an angular difference O- min greater than or equal to the angle 2fl 2 , that is to say twice the half-waist of the Gaussian representative of the noise.
  • the pixels 7?(i, j) and R(i'>j') respectively defined by the two emission subsets EPDjj, EPDj>j> are designated by the term “twin pixels”, because they are generated simultaneously by the same laser light source.
  • the emission subsets EPDjj, EPDj>j> respectively associated with the twin pixels are called twin transmit subsets.
  • the twin pixels are separated, on the image formed on the retina, by a minimum angle greater than the angle 2fl 2 , so as to avoid cross interference.
  • the twin emission subsets are configured to be simultaneously activated by electrodes, so as to simultaneously display the twin pixels.
  • FIG. 4 illustrates projections, on the retina, of rays from the same point of the pupil P.
  • the pixels of the image formed on the retina have been represented, in the form of a grid.
  • Four “twin” pixels have also been shown, corresponding to dark pixels.
  • a dashed circle has been drawn, the diameter of which is equal to 2 times the half-waist w 2 of the Gaussian representative of the noise.
  • the minimum distance w min can be expressed as minimum angular deviation Sl min .
  • an important aspect of the invention is that two twin pixels are separated from each other by an angular deviation fl greater than or equal to the minimum angular deviation Sl min .
  • the minimum angular deviation is defined by modeling the noise affecting the pixel when several twin pixels are formed.
  • the minimum angular deviation is k times the elementary angular deviation P separating two adjacent pixels, where k is an integer greater than or equal to 2.
  • the inventors have quantified the signal-to-noise ratio associated with the intensity projected by each pixel.
  • the projected intensity corresponds to the percussion response of the system formed by the emission medium, the pupil and the lens, usually designated by the acronym PSF (Point Spread Function).
  • the PSF corresponds to the image of a point on the retina.
  • Figure 3C illustrates PSF, depicting a spatial intensity distribution on the retina.
  • the ordinate axis corresponds to the light intensity /(%) of the image formed on the retina and the abscissa axis corresponds to a distance x from the origin, the origin corresponding at the center of the pixel formed on the retina.
  • the signal to noise ratio (SNR) is such that:
  • /(O) is the height of the central peak
  • w is the half-waist of the Gaussian representative of the useful signal, described in connection with FIGS. 3A and 3B
  • max (/(%)) represents the maximum value of the intensity outside the central peak
  • the inventors have calculated the signal-to-noise ratio of a pixel obtained by an emission subset of 80 emission points on an emission surface of dimensions 6 mm by 6 mm. In order to simulate the effect of twin pixels neighboring the modeled pixel, they assumed that each EP emission point contributing to a twin pixel forms a plane wave, whose intensity is modulated by a Gaussian envelope, as described in link with FIGS. 3A to 3C (gaussian representative of the noise).
  • the electric field of the plane wave is such that: x 2 +y 2
  • Z o is the distance between the emission support 10 and the pupil; x and y are coordinates on the retina, along the X and Y axes shown in Figure 1C. It is assumed that the emission medium is parallel to the retina or can be considered as such.
  • O is a phase shift of the light wave emitted by the emission point EP, this phase shift being adjusted as a function of the coordinates of each emission point so that the wave resulting from the different emission points of the same subset emission is a plane wave.
  • ⁇ and Q y are the components of the angle of propagation ⁇ i with respect to the X and Y axes respectively.
  • the inventors used expression (8) to simulate an image formed solely by a central pixel and four neighboring pixels regularly distributed around the central pixel.
  • neighboring pixel is meant a pixel situated in the vicinity of the central pixel. It is not the adjacent pixel.
  • the useful signal of the four neighboring pixels has been removed.
  • the four neighboring pixels have been placed at different distances from the central pixel.
  • neighboring pixels formed by waves coherent with the light wave forming the central pixel have been simulated.
  • This case is representative of the use of the same laser light source to respectively illuminate each emission subset forming each pixel.
  • This is the configuration according to the invention, in which it is sought to maximize the number of emission sub-assemblies illuminated by the same laser light source. It is also the least favorable configuration with respect to the formation of cross-interferences.
  • Figure 5A shows the evolution of the SNR signal-to-noise ratio, as defined in expression (7) (ordinate axis) as a function of the angular distance between the central pixel and each neighboring pixel (abscissa axis - unit degree ).
  • Curve a) corresponds to the configuration according to the invention: the central pixel and each neighboring pixel are twin pixels. The dotted line corresponds to the signal-to-noise ratio of the central pixel without taking into account the neighboring pixels.
  • Curve b) corresponds to the reference configuration.
  • FIG. 5B shows simulated images considering distances between the central pixel and the neighboring pixel of 5 ⁇ m, 25 ⁇ m and 525 ⁇ m. These distances correspond respectively to angular deviations of 0.0125°, 0.062°, and 1.35°.
  • the configuration according to the invention has been taken into account. We observe the background noise and its attenuation as the distance between twin pixels increases.
  • Figure 5C shows images similar to those shown in Figure 5B, taking into account the reference configuration.
  • Figure 5A shows that twin pixels that are too close together result in a large decrease in SNR. By moving the twin pixels apart by an angle greater than 1°, or even 1.5°, the impact on the SNR is lower. Beyond 2°, the impact on the SNR is negligible.
  • FIGS. 6A and 6B schematize an addressing method according to the prior art.
  • these figures show light guides 11 and linear electrodes 13, the electrodes being perpendicular to the light guides.
  • Each light guide is connected to a laser light source 21.
  • Each electrode 13 is connected to a switch 23: the electrodes 13i, 13a are connected to a first switch 23i and the electrodes 132, 134 are connected to a second switch 232 The switches are conductive and connected to a power supply.
  • Each emission point EP is placed at the intersection of a light guide and an electrode.
  • Each emission point is assigned a label, between 1 and 16, identifying the EPD emission subset to which the emission point belongs.
  • each EPD transmit subset has four pixels. There are 16 different transmission subsets.
  • FIG. 6B represents the 16 pixels respectively formed by the 16 emission subsets after self-focusing.
  • the emission subassemblies 1 and 9 are activated when the electrodes 13i and 133 are activated, and when the laser connected to the waveguides 111 and 118 is activated.
  • a bold frame shows the pixels formed when the electrodes 132 and 134 are activated.
  • FIGS. 7A and 7B schematize an addressing method according to the invention. Only two lasers 21i, 2I2 are used, the latter being coupled to 8 different waveguides.
  • the device comprises modulators 22 arranged between each laser and a set of waveguides. The modulators allow modulation of the intensity of the light propagating towards each emission subset. Intensity modulation makes it possible to form pixels of different light intensities with the same laser.
  • the shaded emission points are coupled to the laser 2I2. It is the same in FIG. 7B: the shaded pixels are emitted by an illumination of emission subsets by the laser 2I2.
  • FIG. 7B shows the pixels obtained: following the activation of the laser 21i and of the switch 23 4 : this allows display of the twin pixels 1, 2, 3 and 4: pixels displayed in white and framed by a thin line.
  • this allows a display of the twin pixels 9, 10, 11 and 12: pixels displayed in gray and framed by a thin line
  • following the activation of the laser 212 and the switch 23i this allows display of twin pixels 5, 6, 7, 8: pixels displayed in white and framed by a bold line.
  • this follows the activation of the laser 21 2 and of the switch 23 2 : this allows display of the twin pixels 13, 14, 15 and 16: pixels displayed in gray and framed by a bold line.
  • the modulators 22 make it possible to modulate the intensity of the pixels 1, 2, 3, 4, 9, 10, 11 and 12, activated by the first laser 21i, as well as the intensity of the pixels 5, 6, 7, 8, 13 , 14, 15 and 16 activated by the second laser 2I2. So that the intensities of pixels 1, 2, 3 4 on the one hand and 9, 10, 11, 12 on the other hand can be modulated independently of each other, the power supplies 23i and 232 are successively activated.
  • Pixels 1 and 9 are respectively generated by a first emission subset, bringing together the emission points bearing, in FIG. 7A, the label 1 and a second emission subset, bringing together the emission points bearing, in FIG. 7A, the label 9.
  • the emission points belonging respectively to the first and second emission sub-assemblies are formed on the same waveguides, connected to the same modulator 22.
  • the first emission subset (pixel 1) is activated by first electrodes (13i, 183) while the second emission subset (pixel 9) is activated by second electrodes (132, 134).
  • the sequential activation of the first and second electrodes allows the sequential display of pixels 1 and 9.
  • This aspect also concerns pixels 2 and 10, 3 and 11, 4 and 12, 5 and 13, 6 and 14, 7 and 15, 8 and 16.
  • the use of sequential activation of different electrodes is relevant when the points emission of different emission subsets are distributed over the same waveguides.
  • the selection of an electrode makes it possible to activate only one emission subset on said waveguides. This allows the sequential display of the pixels respectively associated with the emission subsets formed on common waveguides.
  • FIGS 8A and 8B show an arrangement similar to that described in connection with Figures 7A and 7B.
  • the switch 23i is on: this allows a display simultaneous pixels 1, 2, 3, 4 (with the laser source 21i) and pixels 5, 6, 7, 8 (with the laser source 21 2 ).
  • Pixels 1, 2, 3 and 4 are twins: pixels shown in white in FIG. 8B, framed by a thin line.
  • pixels 5, 6, 1, 8 pixels shown in gray in FIG. 8B, framed by a fine line.
  • the non-displayed pixels are surrounded by a dotted frame: these are pixels 9, 10, 11, 12, 13, 14 and 15.
  • FIGS. 9A and 9B represent a symmetrical configuration: only switch 23 2 is on: this allows display of pixels 9, 10, 11, 12 (with laser source 21i) and pixels 13, 14, 15, 16 (with the laser source 21 2 ).
  • Pixels 9, 10, 11 and 12 are twins: pixels shown in white in FIG. 9B, framed by a bold line.
  • pixels 13, 14, 15 and 16 pixels represented in gray in FIG. 9B, framed by a bold line.
  • the non-displayed pixels are surrounded by a dotted frame: these are pixels 1 to 8.
  • the configurations schematized in FIGS. 8A-8B as well as 9A-9B can be used successively, according to a sufficiently high repetition period so that, under the effect of retinal persistence, all the pixels appear simultaneously displayed.
  • the passage from one configuration to the other is carried out by switching the switches 23i and 23 2 .
  • the switching makes it possible to activate only one transmission sub-assembly among different transmission sub-assemblies arranged on common waveguides.
  • the width of the two-dimensional Gaussian w 2 representing the noise around a pixel depends on the size of the emission points EP.
  • the inventors have studied the influence of the size of the emission points on the SNR. For this, they carried out the modeling described in connection with FIG. 5A (curve a) for different sizes of emission points.
  • FIG. 10 represents the evolution of the SNR, as a function of the angular difference between the central pixel and four twin neighboring pixels, for different sizes comprised between 5 ⁇ m and 40 ⁇ m.
  • Figure 10 was drawn based on disc-shaped emission points It is observed that the smaller the size of the emission points, the more the SNR is degraded. It is particularly preferable for the size of each emission point to be greater than or equal to 10 ⁇ m when circular emission points are used.
  • a device 1 comprising an emission medium 10 defining a field of observation of 15°.
  • the emission support extends over a surface of 6mm x 6 mm. Its diameter D p is considered to be 6 mm.
  • Each waveguide 11, 300 nm wide, was spaced apart by a period dn 1.5 ⁇ m.
  • the number of pixels N pix is equal to 59000, i.e. 243 x 243.
  • the number of laser light sources would be 444.
  • the twin pixels can be distributed according to a square tiling, as shown in FIG. 11.
  • a first group of twin pixels can comprise 8 ⁇ 8 pixels, regularly distributed according to a square mesh according to the spatial pitch of 750 ⁇ m, ie a total image width of 5.5 mm.
  • the other groups of pixels are arranged regularly in a frame of side 5.5 mm, either in groups of 8x8, or in groups of 7x7. This leads to a total of ten groups of twin pixels, which requires only ten laser diodes.
  • FIG. 12 shows the first group of pixels, containing 8 ⁇ 8 pixels, and a second group of pixels, comprising 7 ⁇ 7 pixels.
  • the number of laser light sources required to tile the image regularly can be estimated by the expression: where FOV corresponds to the field of view and 11 corresponds to the angular difference between two twin pixels. N taser corresponds to the number of lasers in the reference configuration, i.e. 444 lasers.
  • a noise factor r corresponds to a ratio between the noise obtained by a configuration of a central pixel surrounded by 4 neighboring pixels, respectively with 5 different laser sources and with the same laser source. This amounts to comparing the noises respectively obtained in the configurations according to the invention and of the reference described in connection with FIGS. 5A to 5C.
  • the noise factor r expressed as a percentage, is represented in FIG. 12: curve a: left ordinate axis.
  • the abscissa axis corresponds to the minimum angle between twin pixels, unit degree.
  • Curve b represents the number of laser light sources necessary for the system (right ordinate axis) as a function of the angular pitch between two twin pixels (abscissa axis). The more the angular pitch decreases, the more the number of light sources also decreases. It can be seen that by considering an angular pitch comprised between 1.5° and 2°, for example 1.8 or 1.9°, an acceptable noise figure is obtained for a reasonable number of laser sources.
  • the invention may be implemented on portable augmented reality devices, in particular glasses, or visors, or screens, and more generally, on surfaces, intended to be arranged facing an eye so as to form an image superimposed on the image perceived by the eye on the surface or through the surface.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Eye Examination Apparatus (AREA)
EP22844181.2A 2021-12-28 2022-12-25 Vorrichtung zur projektion eines bildes in das auge eines benutzers Pending EP4457559A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR2114595A FR3131397B1 (fr) 2021-12-28 2021-12-28 Dispositif de projection d’une image dans l’œil dans utilisateur
PCT/EP2022/087839 WO2023126382A1 (fr) 2021-12-28 2022-12-25 Dispositif de projection d'une image dans l'œil dans utilisateur

Publications (1)

Publication Number Publication Date
EP4457559A1 true EP4457559A1 (de) 2024-11-06

Family

ID=81580747

Family Applications (1)

Application Number Title Priority Date Filing Date
EP22844181.2A Pending EP4457559A1 (de) 2021-12-28 2022-12-25 Vorrichtung zur projektion eines bildes in das auge eines benutzers

Country Status (3)

Country Link
EP (1) EP4457559A1 (de)
FR (1) FR3131397B1 (de)
WO (1) WO2023126382A1 (de)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2105017B3 (de) 1970-09-16 1973-06-08 Electronique Ste Lannion
US9250445B2 (en) * 2012-08-08 2016-02-02 Carol Ann Tosaya Multiple-pixel-beam retinal displays
FR3022642B1 (fr) * 2014-06-24 2017-11-24 Commissariat Energie Atomique Dispositif de projection d'une image
FR3041474A1 (fr) * 2015-09-23 2017-03-24 Commissariat Energie Atomique Dispositif d’imagerie sans lentille et procede d’observation associe
FR3075463B1 (fr) * 2017-12-19 2019-12-20 Commissariat A L'energie Atomique Et Aux Energies Alternatives Capteur d'image, permettant d'obtenir une information relative a la phase d'une onde lumineuse.

Also Published As

Publication number Publication date
FR3131397A1 (fr) 2023-06-30
WO2023126382A1 (fr) 2023-07-06
FR3131397B1 (fr) 2024-02-09

Similar Documents

Publication Publication Date Title
CN101490598B (zh) 反射光学系统、跟踪系统和全息投射系统及方法
EP2960715B1 (de) Vorrichtung zur projektion eines bildes
KR102678957B1 (ko) 광 가이드를 포함하는 디스플레이 장치
CN113253476B (zh) 采用虚拟或增强现实装置生成虚拟内容显示的方法和系统
KR102742565B1 (ko) 홀로그램 계산
CN113508321A (zh) 具有光扩展耦合器的光学系统
JP2017142506A (ja) 2次元/3次元ホログラフィ表示システム
EP3792681B1 (de) Mehrbildanzeigegerät mit holografischer projektion
CN109085700A (zh) 无零级光干扰的同轴全息近眼ar显示系统及其应用和全息图优化方法
EP4089470B1 (de) Vorrichtung zum projektion eines bildes in das auge des benutzers
TWI403782B (zh) Dynamic wave forming unit
CN117631288A (zh) 显示系统及其光控制元件
EP4394485A1 (de) Vorrichtung zum projizieren eines bildes, das von einem bildschirm gebildet wird
EP4443215B1 (de) Projektionsvorrichtung mit optimierter sendepunktverteilung aus isolinienkonfiguration
EP4457559A1 (de) Vorrichtung zur projektion eines bildes in das auge eines benutzers
KR20230132721A (ko) 도파관 동공 확장을 위한 광 차단
EP4394484B1 (de) Vorrichtung zum projizieren eines bildes, das von einem bildschirm gebildet wird
US12339621B2 (en) Augmented reality holographic display using optical waveguide and holographic optical element
US12158581B1 (en) Optical systems with holographic elements for producing uniform images
KR20200119716A (ko) 양안식 홀로그램 영상 디스플레이 방법 및 장치
EP4339712B1 (de) Optimierte hologrammaktualisierung
FR3147638A1 (fr) Dispositif de projection à répartition de points d’émission optimisée sur une surface d’émission discrétisée
TW202509618A (zh) 孔徑遮罩
KR20250161585A (ko) 턴 장치와 홀로그램이 구비된 헤드업 디스플레이
KR101987681B1 (ko) 홀로그램 광학소자를 포함하는 홀로그램 장치를 이용한 정보의 기록 및 재생 방법

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20240626

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20250811