EP3458898B1 - Head-mounted imaging device - Google Patents

Head-mounted imaging device Download PDF

Info

Publication number
EP3458898B1
EP3458898B1 EP16902290.2A EP16902290A EP3458898B1 EP 3458898 B1 EP3458898 B1 EP 3458898B1 EP 16902290 A EP16902290 A EP 16902290A EP 3458898 B1 EP3458898 B1 EP 3458898B1
Authority
EP
European Patent Office
Prior art keywords
light
waveguide substrate
optical element
optical
optical system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP16902290.2A
Other languages
German (de)
French (fr)
Other versions
EP3458898A4 (en
EP3458898A1 (en
Inventor
Yuval Ofir
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lumus Ltd
Original Assignee
Lumus Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lumus Ltd filed Critical Lumus Ltd
Publication of EP3458898A1 publication Critical patent/EP3458898A1/en
Publication of EP3458898A4 publication Critical patent/EP3458898A4/en
Application granted granted Critical
Publication of EP3458898B1 publication Critical patent/EP3458898B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/09Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
    • G02B27/0938Using specific optical elements
    • G02B27/095Refractive optical elements
    • G02B27/0955Lenses
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/10Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type
    • G02B6/12Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type of the integrated circuit kind
    • G02B6/122Basic optical elements, e.g. light-guiding paths
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/24Coupling light guides
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0149Head-up displays characterised by mechanical features
    • G02B2027/015Head-up displays characterised by mechanical features involving arrangement aiming to get less bulky devices
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0149Head-up displays characterised by mechanical features
    • G02B2027/0152Head-up displays characterised by mechanical features involving arrangement aiming to get lighter or better balanced devices
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type

Definitions

  • the present invention is generally in the field of augmented reality, and relates to an optical system for use in augmented reality system.
  • the invention can be implemented in a large number of imaging applications, such as portable DVDs, cellular phones, mobile TV receivers, video games, portable media players or any other mobile display devices.
  • the invention can be further implemented in any type of a waveguide system that uses a total internal reflection (TIR) principle.
  • TIR total internal reflection
  • such optical device may be incorporated within a see-through head-mounted display device (e.g. helmet- or eyeglasses-mounted display), which is a wearable display that has the capability of reflecting projected images as well as allowing the user to see through it.
  • an optical module serves both as an imaging lens and a combiner (optical mixer), and a two-dimensional image source is imaged to infinity and reflected into the eye of an observer.
  • image source can be obtained either directly from a spatial light modulator (SLM) based on a cathode ray tube (CRT), a liquid crystal display (LCD), an organic light emitting diode array (OLED), a scanning source or similar devices, or indirectly using a relay lens or an optical fiber bundle.
  • SLM spatial light modulator
  • CTR cathode ray tube
  • LCD liquid crystal display
  • OLED organic light emitting diode array
  • the image source typically includes a pixel matrix which is imaged to infinity by a collimating lens and is transmitted into the eye of the viewer by reflecting or partially reflecting surface(s) acting as a combiner for, respectively, non-see-through and see-through applications
  • US 5 712 694 A discloses an LCD display device having an emitter, a direct-view display screen, a light-guiding member for guiding illumination light emitted from the emitter to the direct-view display screen, a light separating element for separating the illumination light selectively into a first and second polarized light component and transmitting the first light component and reflecting the second light component, a light converting member for converting the reflected second light component to a first light component, a reflecting plate for returning the converted first light component to the light separating element, and a half-wave film for rotating the vibration direction of the first polarized light component.
  • US 2008/151375 A1 discloses a light guide device for use in back light module, the light guide device comprising a light guide plate made of transparent materials; and a light concentrating and diffusing structural portion integrally formed on an upper or outer portion of the light guide plate adjacent to a lightoutgoing surface of the light guide plate in order to enhance the light concentrating effect and the light diffusing effect of the light guide plate.
  • US 2005/024849 A1 discloses a method for use in manufacturing backlight/light emitting panel assembly, the method involving using a tool to cut or form multiple optical element shaped cavities in a surface of a substrate without rotating the tool or substrate during the cutting or forming process. At least some of the cavities are cut or formed to have at least two surfaces that come together to form a ridge and that are quite small relative to the length and width of the substrate.
  • US 2011/096566 A1 discloses a backlight module including a light guide plate, micro-structures, at least one light source, and a first prism sheet.
  • the light guide plate includes a first surface, a second surface, and a light incident surface connecting the first surface and the second surface.
  • the micro-structures are disposed on at least one of the first surface and the second surface.
  • the present invention provides a novel optical system which facilitates the exploitation of a very compact light-guide optical element (LOE) for, amongst other applications, HMDs.
  • LOE very compact light-guide optical element
  • the invention allows relatively wide FOVs together with relatively large eye-motion-box (EMB) values/angles. This provides a large, highquality image, which also accommodates large movements of the eye.
  • EMB eye-motion-box
  • the optical system of the present invention is particularly advantageous because it may be more compact than state-of-the-art implementations and yet it can be readily incorporated, even into optical systems having specialized configurations.
  • the LOE used in the optical device of the invention is a waveguide configured such that light waves are trapped inside the waveguide by total internal reflection. It is often the case that the optical device needs to include one or more additional optical element(s) in a path along which light output from the waveguide propagates to the viewer's eye.
  • Such optical element may or may not have optical power. This may for example be a protective element or an ophthalmic lens, e.g. with optical power prescribed for the specific user.
  • optical separation is needed between the waveguide (LOE) and such additional optical element(s) at least within an active region defined by light propagation and output of the waveguide namely optical separation enabling to maintain the image quality of the transmitted image.
  • the optical separation between the waveguide and the optical element allows the reflection of light waves from the external surfaces of the waveguide not to be degraded, and, on the other hand, allows not to disturb the coupling-out and the coupling-in mechanisms of the light waves from and to the LOE, i.e. the total internal reflection effects are maintained at an interface region between the LOE and the optical element.
  • the present invention solves the above problem by providing the interface region at least within the active region between the waveguide and optical element having a pattern (surface relief) configured to provide an effective pseudo air layer/gap adjacent to (in the vicinity of) the LOE interface effectively maintaining the TIR condition for light interacting with said interface.
  • the pattern at the interface region actually presents an angular sensitive reflective mechanism such that said interface substantially reflects the entire light waves which are coupled inside the LOE and impinge on the patterned interface at oblique angles, and substantially transmits the light waves which substantially normally (zero angle of incidence) impinge on the interface.
  • such patterned interface creating effective pseudo air layer/interface may be implemented by one of the following configurations: (i) providing a pattern (surface relief) on at least a portion of the external surface of the waveguide; (ii) providing a pattern on at least a portion of the external surface of the optical element; (iii) using a separate patterned element in between the surfaces of the waveguide and optical element.
  • such separate patterned element may for example be in the form of a film (a so-called "air gap film”) associated with either the waveguide's surface or surface of the optical element.
  • air gap film may for example be configured as a moth-eye structure which is configured for the purposes of the invention to provide angular sensitive reflective mechanism.
  • the pattern (surface relief) in the interface region is in the form of spaced-apart protrusions.
  • the arrangement of protrusions i.e. their height and spaces between them) is selected to form a hyperfine structure / subwavelength structure which, for wavelengths of predetermined wavelength range, creates an effective pseudo air layer allowing angular sensitive reflections.
  • the patterned interface may include a hexagonal pattern of bumps, of about 200 nm height arranged such that their centers are spaced apart about 300 nm.
  • bumps are smaller than the wavelength of visible light, and therefore light incident on the interface "sees" the interface as having a continuous refractive index gradient between air (in a contact / interface between the waveguide and optical element area) and the medium of the optical element or waveguide, which maintains the reflection at the LOE lens interface.
  • the same principles can be used for patterns of other shapes and dimensions in order to allow the formation of a pseudo air interface that is relevant in other wavelength ranges (from UV to IR) and wider light incidence angles (0 ⁇ 60 degrees).
  • any suitable patterning technique can be used. These include for example, creation of a random texture of antireflective microstructures using a plasma etching process (such technique is known and is described from example in US 8,187,481 ; or UV imprinting / thermal embossing of a hard coat with a mold having a desired hyperfine-structure; or 2D interference lithography of a hard coat on the surface; or standard high resolution lithography (100 nm or less features).
  • the waveguide, as well as the optical element may be in the form of any suitable transparent structure, e.g. made of glass or plastic, to which the above patterning techniques can be applied. If a plastic structure is used, then thermal embossing of top plastic surface can be used to create a desired pattern.
  • the plastic elements can be produced by a casting or injection molding, where the mold used, already has the negative of the hyperfine structure.
  • the moth-eye film is utilized for the creation a pseudo air-layer as well as an anti-reflection interface for normal incident light transmitted through the entire optical element from the surroundings.
  • the film When it is required to attach an optical element to the external surface of the LOE, and in case of use of an air gap film having a hyperfine structure the film could be cemented whether to the optical element or to the LOE. Therefore, when the coupled-in light waves inside the LOE impinge on the hyperfine structure at different oblique angles, they "see” only the external part of the periodic structure. Hence, the actual refractive index, which is "seen” by the incoming optical light waves, is close to the refractive index of the air and the total internal reflection mechanism is preserved.
  • the air gap film is substantially transparent to the incoming light waves from the external scene or to the light waves which are coupled out from the LOE.
  • a light-transmitting waveguide substrate configured for receiving input light indicative of an image being projected, guiding said input light by total internal reflection, and coupling the light out of the substrate to propagate along an output path in a predetermined direction; at least one transparent optical element accommodated in said output path and interfacing at least a portion of a surface of said waveguide substrate; an interface region between at least a portion of the surface of said waveguide substrate and a surface of the optical element being a patterned interface configured to provide optical coupling between the waveguide substrate and said optical element while maintaining the total internal reflection condition of light propagation within said light-transmitting waveguide.
  • the patterned interface is formed by a surface relief on said at least portion of the surface of the waveguide substrate; or by a surface relief on the surface of the optical element; or by an air gap film having a patterned surface and located in between said at least portion of the surface of the waveguide substrate and the optical element.
  • the air gap film is by its substantially unpatterned surface attached to either said at least portion of the waveguide substrate such that said patterned surface faces the optical element, or said surface of the optical element such that said patterned surface faces said at least portion of the waveguide substrate.
  • the pattern in said patterned interface comprises an array of protrusions forming air pockets between the protrusions and the surface of optical element of the waveguide substrate facing said protrusions.
  • the protrusions typically include dielectric material.
  • the protrusions are configured such that a cross section of the protrusion gradually changes from a base portion of the protrusion towards a distal end thereof as a function of a distance from the base portion.
  • the amount of dielectric material of the protrusion at the base portion is preferably maximal, while the amount of the dielectric material of the protrusion at the distal end is minimal.
  • a proportional portion of the dielectric material of the protrusion reduces from substantially equal to 1 at the base portion towards substantially equal to 0 at the distal end.
  • a length of the protrusion is less than 1 micron.
  • the configuration is such that an effective refractive index at the protrusion distal end is substantially equal to a refractive index of air.
  • the patterned interface comprises a periodic pattern.
  • the patterned interface may have a configuration of a moth eye.
  • the optical element may be a flat transparent substrate.
  • the optical element is a collimating module.
  • the optical element is a lens.
  • an additional optical element is provided being associated with another portion of a surface of the waveguide substrate via an additional patterned interface.
  • the patterned interfaces may thus be associated with opposite surfaces of the waveguide substrate.
  • the optical elements may be lenses serving for, respectively, imaging the light waves indicative of the (augmented) image being projected onto user's eye and imaging an external scene onto the user's eye.
  • the optical element may be composed of at least one lens having a substantially flat surface by which it faces the patterned interface.
  • the waveguide substrate and the at least one optical element are assembled inside an eyeglasses frame.
  • the waveguide substrate and the at least one optical element may be embedded together utilizing a peripheral bonding technique.
  • the waveguide substrate and the optical element may be monolithically embedded together.
  • the waveguide substrate may comprise at least one partially reflecting surface for coupling the light waves out of the substrate.
  • Such partially reflecting surface is typically inclined with respect to the major surfaces of the waveguide substrate.
  • the partially reflecting surface may be of configured as a diffractive element; as well as may be a substantially flat or curved surface.
  • the invention in its another aspect, provides an augmented reality system or a head up display system comprising the above described optical system, and an image generator device for generating light indicative of the image to be projected; and a collimating module for receiving said light and directing the collimated light waves indicative thereof towards the waveguide substrate.
  • the invention also provides an electronic device comprising the above described optical system.
  • Such electronic device may be a smartphone device, a smartwatch device; the optical element used in such device may be a touchscreen.
  • the invention also provides an optical module for use in the above described optical system, where the optical module comprise the waveguide structure carrying the at least one patterned interface on the at least portion of the surface of the waveguide.
  • FIG. 1 , 2 and 3 schematically illustrate the general configuration and operational principles of some head up display systems of the kind to which the present invention relates.
  • Fig. 1 illustrates a light propagation scheme in a planar waveguide 20, which is time referred to as light-guide optical element (LOE) or substrate suitable to be used in an optical device of the present invention.
  • the waveguide 20 is configured to provide total internal reflection (TIR) condition for light propagating therein.
  • the waveguide substrate 20 has a light input region 21 (which is aligned with an output of a collimating module, as will be described further below), and light directing interfaces 16 and 22 arranged with proper orientation inside the waveguide.
  • input light waves 18 (which are collimated and which are indicative of an image to be presented to a viewer) interact with the reflective interface 16 which reflects these light waves such that they are trapped inside the planar waveguide substrate 20 of the LOE, by total internal reflection. After several reflections from the major lower and upper surfaces 26, 28 of the substrate 20, the trapped light waves reach an array of selective partially reflecting surfaces 22, which couple the light out of the substrate to propagate towards a pupil 25 of viewer's eye 24.
  • the light input surface of the LOE will be regarded as the surface through which the input light waves enter the LOE
  • the light output surface of the LOE will be regarded as the surface through which the trapped waves exit the LOE.
  • both the input and the output surfaces are on the lower surface 26 of the LOE 20.
  • Other configurations, however, are envisioned in which the input and the image waves could be located on opposite sides of the substrate 20, or when the light is coupled into the LOE through a slanted edge of the substrate.
  • Figs. 2 and 3 exemplify two examples of the head up display system, in which an optical system includes the above described LOE 20 and a collimating module 6.
  • Light waves 2 which are output of the image creation device 4 (e.g. projector) and which are thus indicative of the image to be displayed, enters the collimating module 6 through its lower surface 30.
  • these light waves 2 have specific polarization, e.g. s-polarized input light-waves 2.
  • the collimating module 6 is usually made of a light-waves transmitting material, and is associated with a polarizer unit including a polarizing beam splitter 31, polarization rotators (e.g.
  • quarter-wavelength retardation plates 34 and 40 and reflectors 36 and 44 (e.g . metallic or dielectric coatings).
  • input polarized light 2 passes through facet 30 of the collimating module 6, and is reflected by the beam splitting surface 31 towards the quarter-wavelength retardation plate 34, and the so-created p-polarized light is reflected by reflector 36 (e.g., a flat mirror) to pass through the retardation plate 34 and then through the polarizing beamsplitting surface 31.
  • reflector 36 e.g., a flat mirror
  • p-polarized light now propagates through facet 38 of the collimating module 6 to pass through the second quarter-wavelength retardation plate 40, and after being collimated by a component 42, e.g., a lens, be reflected by reflector 44 (e.g. reflecting coating on lens's surface), and returned back to pass again through the retardation plate 34.
  • the now s-polarized light-waves are reflected by the polarizing beam-splitting surface 31 and exit the collimating module 6 through its facet 46 by which the module faces the input region 21 of the LOE.
  • the body 6 of the collimating module may be formed by prisms 52 and 54 (e.g. folding prisms).
  • the light output 48 from the collimating module 6 enters the waveguide/substrate 20 through an input region 21 on its lower surface 26.
  • the light waves 48 entering the substrate 20 are reflected from light directing element 16 and trapped in the substrate as described above with reference to Fig. 1 .
  • the collimating module 6 formed by the above described elements can easily be integrated into a single mechanical module and assembled independently of the waveguide substrate, without requiring accurate mechanical tolerances.
  • the retardation plates 34 and 40 could be cemented together with their associated reflecting optical elements 36 and 42, respectively, to form two units.
  • the collimating module 6 is spaced by an air gap from the input region 21 of the waveguide 20. It would be advantageous to attach all the components of the collimating module 6 to the waveguide substrate 20 with appropriate alignment with its input region 21, to form a single compact device of a simplified mechanical construction. This is exemplified in Fig. 3 , wherein the upper surface 46 of the collimating module 6 is attached at the interface plane 58, to the lower surface 26 of the substrate 20.
  • such configuration utilizing physical attachments between the module 6 and the waveguide 20 has no air gap ( 50 in Fig. 2 ) between these structures, while such air gap is essential for trapping the input light waves 48 inside the substrate 20.
  • the trapped light waves 48 should be reflected at points 62 and 64 of the interface plane 58. Therefore, a reflecting mechanism should be applied at this plane, either at the major surface 26 of the substrate 20, or at the upper surface 46 of the collimating module 6.
  • a simple reflecting coating cannot, however, be easily applied, since these surfaces should also be transparent to the light waves that enter and exit the substrate 20 at the exemplary points 66.
  • the light waves incident on surface 48 with small incident angles should pass through this surface, and light waves having higher incident angles should be reflected. Usually, the passing incident angles are between 0° and 15° and the reflecting incident angles are between 40° and 80°.
  • the image which is coupled into the LOE is collimated to infinity. Also, in most head up display applications, it is assumed that the scene is located at the infinity. However, there are applications requiring the transmitted image to be focused to a closer distance, for example, for people who suffer from myopia and cannot properly see images located at long distances. Also, there are professional or medical applications where the external scene is located at closer distances.
  • FIGs. 4 and 5 exemplifying optical device/systems of the invention which provide for incorporating an additional optical element in the optical module of the head up display system.
  • additional optical element is exemplified as a lens (i.e. optical element having optical power)
  • the principles of the invention are not limited to this specific example, and may advantageously be used with any optical element, of any suitable shape, having optical power or not.
  • FIGs. 4 and 5 illustrate a system 100 including an optical device/module 102 of the invention, which receives from a collimating module 6 (e.g. configured as described above) collimated light indicative of an image created by an image forming device (e.g. projector) 4, and conveys this image to be viewed by user.
  • a collimating module 6 e.g. configured as described above
  • an image 18 from infinity is coupled into a waveguide substrate 20 by a light directing element (reflecting surface) 16, and then further directed (reflected) by an array of partially reflective surfaces 22 into the eye 24 of the viewer.
  • the optical device 102 also includes an optical element, such as a lens 82.
  • this is a plano-concave lens 82 which focuses the image onto a prescribed focal plane and optionally corrects other aberrations of the viewer's eye, e.g. astigmatism.
  • the optical element (lens) 82 is properly optically separated from the waveguide substrate 20 at its flat surface portion 84.
  • An interface region between the waveguide 20 and the optical element 82 providing optical separation between them where waveguide light propagation and light output take place, is at times referred to herein as an active region.
  • the additional optical element 82 has a dual lens configuration, where lenses 82A and 82B are located at opposite sides of the waveguide 20 being aligned with the output region of the waveguide.
  • Image light waves 18 from infinity are coupled into the waveguide substrate 20 by a reflecting surface 16 and then reflected by an array of partially reflective surfaces 22 and focused by lens 82A into the eye 24 of the viewer.
  • Another image light 86 from a close distance scene is collimated to infinity by lens 82B and then passed through the waveguide substrate 20 into the eye 24 of a viewer.
  • the lens 82A focuses both the projected image 18 and the external scene image 86 onto the focal plane at a convenient distance, usually (but not necessarily always) the original distance of the external scene image, and corrects other aberrations of the viewer's eye, if required.
  • the lens 82 ( Fig. 4 ) and lenses 82A, 82B ( Fig. 5 ) are simple plano-concave and plano-convex lenses.
  • Fresnel lenses which can be made of thin molded plastic plates with fine steps.
  • an alternative way to implement the lenses instead of utilizing fixed lenses as described above, is to use electronically controlled dynamic lenses.
  • a high resolution, spatial light modulator (SLM) can be used to form a holographic element.
  • the most popular sources for that purpose are LCD devices, but other dynamic SLM devices can be used as well.
  • High resolution, dynamic lenses having several hundred features (lines) are known.
  • This kind of electro-optically controlled lenses can be used as the desired dynamic elements in the optical device of the present invention, instead of the fixed lenses described above in conjunction with Figs. 4 and 5 . Therefore, in real time, a user can determine and set the exact focal planes of both the virtual image (augmented image) projected by the waveguide substrate and the real image of the external scene.
  • the lenses 82 (of Fig. 4 ) and lenses 82A, 82B ( of Fig. 5 ) could be of any desired/required form factor (dimensions), e.g.
  • the optical element 82 could correspond to eye-motion-box area for correction lenses, and/or be aligned with the entire waveguide substrate 20 or a desired/required part thereof.
  • the optical element 82 is a protective element, then it preferably is aligned with the entire waveguide's surface (i.e. the interaction region extends along the entire waveguide substrate). This depends on the type of the additional optical element(s), as well as the manufacturing technology of the waveguide and optical element(s).
  • a thin air gap is to be maintained between the lens and the waveguide substrate, to ensure the trapping of the image light waves (light waves 18 of projected image) inside the waveguide substrate by total internal reflection.
  • the optical element 82 single-lens or dual lens 82A-82B
  • the main problem as hereinbefore described is that the attaching procedure cancels the previously existing air gap between the substrate 20 and the optical element 82, which gaps are essential for trapping image light waves inside the waveguide substrate 20.
  • the trapped image light waves are to be reflected at point/location 90 of the interface region 84 and transmitted through the same interface at point/location 92. Therefore, a similar reflecting mechanism as described above in relation to Fig. 3 should be applied at this region.
  • the interface region 84 should be properly configured with a pattern 85 having subwavelength features, e.g. a surface relief in the form of an arrangement of spaced-apart protrusions having height and spaces between them selected to form a hyperfine structure / subwavelength structure which, for wavelengths of predetermined wavelength range, creates a refractive index profile causing angular sensitive reflections.
  • a pattern 85 having subwavelength features e.g. a surface relief in the form of an arrangement of spaced-apart protrusions having height and spaces between them selected to form a hyperfine structure / subwavelength structure which, for wavelengths of predetermined wavelength range, creates a refractive index profile causing angular sensitive reflections.
  • the patterned interface 84 may be implemented providing a pattern (surface relief) on at least a portion of the external surface of the waveguide or on at least a portion of the external surface of the optical element. This is exemplified in Figs. 6A to 6C . It should be understood that the pattern in the figure is not to scale, just in order to facilitate understanding.
  • the patterned interface 84 is formed by direct patterning (creation of a surface relief) of at least a portion of the surface of optical element 82.
  • the patterned interface 84 is formed by direct patterning (creation of a surface relief) of at least a portion of the surface 28 of the waveguide substrate 20.
  • such patterned interface created by at least partial direct patterning of the surface of the waveguide and/or the surface of the optical element may be obtained using any known suitable patterning technique.
  • Some specific, but not limiting example of such technique include creation of a random texture of microstructures using a plasma etching process; UV imprinting / thermal embossing of a hard coat with a mold having a desired hyperfine-structure; 2D interference lithography of a hard coat on the surface; standard high resolution lithography.
  • the patterned interface may utilize a separate patterned element in between the surfaces of the waveguide and optical element.
  • a separate patterned element may be in the form of a film (a so-called "air gap film”), e.g. configured utilizing the principles of a moth-eye structure which, according to the invention, is configured to provide angular sensitive reflective mechanism effectively creating a pseudo air gap.
  • air gap film may be attached to the major surface of the waveguide substrate, or the surface of the optical element.
  • air gap film is schematically exemplified in Figs. 7A and 7B .
  • the air gap film is an optical device 110 having a flat transparent (dielectric) substrate / base 112 which has on its surface a hyper-fine periodic pattern 85 (surface relief) of features arranged at a small pitch shorter than the wavelengths of the photopic region, e.g., moth-eye film having a dense (uneven) hyperfine periodic structure.
  • the height of the surface relief is preferably (but not necessarily) less than 1 micron.
  • the protrusions/features of the pattern preferably have varying cross section, such that the cross sectional dimension of the protrusion is gradually reduced in a direction from the base towards the distal end of the protrusion.
  • the pattern 85 is such that the distal end of the features faces either the optical element or the waveguide.
  • any cross section 121 parallel to the surface of the air gap film 110 has a periodic formation/protrusion, wherein the proportional portion of the dielectric material 123 in the relief formation is changed gradually as a function of distance from the film itself.
  • the proportional portion of the dielectric material 125 in the relief formation 126 is maximal and substantially close to 1, while in the external cross section 127, i.e., close to the upper portion (distal end) of the hyperfine structure 85, the proportional portion of the dielectric material 128 in the relief formation 129 is minimal, namely, significantly lower than in material 125, and substantially equal to zero.
  • a patterned structure e.g. an air-gap film
  • the patterned structure faces the waveguide and forms the patterned interface region 84.
  • the coupled light waves 130 impinge on an interface 132 between the waveguide substrate 20 and the distal end of the pattern/film at angles higher than the critical angle, the air 131 confined between the film 110 and the waveguide substrate 20 provides an optical isolation due to the air-like refractive index in the boundary surface.
  • the condition of total internal reflection of the coupled-in light waves from the external surface is preserved and the light waves are contained inside the waveguide substrate. It should be understood that the same effect will take place while attaching such air film to the external surface 28 of the waveguide substrate 20 (or direct patterning of the waveguide substrate) with the patterned structure facing the optical element 82 .
  • the geometrical characteristic of the hyperfine structure such as the height, peak-to-peak and width thereof, can be between 10 to 800 nanometers. It should be understood that the shape of the hyperfine structure needs not be that of the moth eye. Any other nano-structure shape, such as pyramids, prisms, cones and others, can be utilized. Moreover, the hyperfine structure needs not be specifically periodic, although a periodic structure is usually easier to fabricate.
  • the hyperfine structure suitable to be used in the invention is, on one hand, solid enough not to collapse during the attaching process, and, on the other hand, the proportional portion of the dielectric material in the external cross-section of the structure is substantially equal to zero, to maintain the total internal reflection condition inside the waveguide substrate.
  • the size of the basic elements of the hyperfine structure is not be too large, in order to avoid diffraction effects.
  • reducing the thickness of the hyperfine structure to below 100 nm might undesirably allow the penetration of the trapped waves through the air gap film and the deterioration of the total internal reflection phenomena.
  • the hyperfine structure thickness is preferably between 200 and 300 nm.
  • Fig. 12A schematically illustrates an eyeglasses system 140 and Fig. 12B shows the waveguide substrate 20 which is embedded between lenses 141, 142 of the dual-lens optical element (corresponding to duel lens configuration 82A-82B as described above) and assembled inside the eyeglasses frame 143.
  • the frame can contain other accessories including a camera 144, a microphone 145, earphones 146, USB connectors, memory cards, an inertial measurement unit (IMU), and the like.
  • IMU inertial measurement unit
  • Figs. 13A, 13B and 13C illustrate a non-monolithic optical device 150 comprising a waveguide substrate 20 embedded between front positive lens 151 and rear negative lens 152 (constituting a dual-lens or two-part optical element), mounted together inside a frame 154 without adhesive.
  • the patterned interface(s) 84 between the waveguide 20 and the optical element(s) is constituted by, is an air gap film, but it should be understood, and described above, that the invention is not limited to this specific example.
  • the air gap films 110 Fig.
  • the air gap films 110 could be placed or bonded between the waveguide substrate 20 and the lenses 151, 152, wherein the hyperfine structure(s) 85 respectively facing the external surfaces 26 and 28 of the waveguide substrate 20.
  • the air gap films 110 ( Fig. 13C ) could also be placed or bonded between the waveguide substrate 20 and the lenses 151, 152, with the hyperfine structures 85 respectively facing the external surfaces 26 and 28 of the waveguide substrate 20.
  • the air gap films 110 can be directly cemented on the planar surfaces of the optical lenses 151 and 152 using pressuresensitive adhesive (PSA), a thermally curable or UV-curable adhesive or can be fabricated directly as an integral part of the lenses utilizing embossing, injection molding, casting, machining, soft lithography or any other relevant fabrication method.
  • PSA pressuresensitive adhesive
  • the embedded optical element 150 can be assembled inside the frame 154 utilizing pressure or cementing techniques.
  • the interface could be also created by at least partial (within the active area) direct patterning of the surface of the waveguide or the surface of the optical element obtained using any known suitable patterning technique.
  • FIGs. 14A, 14B and 14C An alternative technique for peripheral bonding the waveguide substrate 20 between the two optical lenses is exemplified in Figs. 14A, 14B and 14C .
  • the waveguide substrate 20 is embedded between the optical lenses utilizing a peripheral bonding technique.
  • the front lens 151 and rear lens 152 are cemented to the peripheral edges of the waveguide substrate 20 using optical or non-optical adhesive or any other high-viscosity adhesive 156 that mount all components together.
  • the viscosity of the adhesive is selected to be high enough in order to prevent leakage of the adhesive into protrusions in the optically active are or air pockets 131 which are confined between the film 110 and the waveguide substrate 20.
  • the required adhesive 156 can, for example, be OP-67-LS or any room temperature vulcanization (RTV) silicone.
  • the interface could be also created by at least partial (active area) direct patterning of the surface of the waveguide or the surface of the optical element obtained using any known suitable patterning technique.
  • a technique for monolithically embedding the waveguide substrate 20 between the two optical lenses is exemplified in Figs. 15A, 15B and 15C .
  • the production procedure of the embedded element may be as follows: placing the air gap film 110, with the hyperfine structures 85 facing the external surfaces 26 and 28 of the waveguide substrate 20; utilizing attaching techniques such as static electricity; preparing a mold 160 having the required external shape of the element; inserting the waveguide substrate 20 into the mold; casting or injecting the liquid resin polymer into the mold, curing the polymer by UV or by changing the polymer temperature, and finally, ejecting the embedded element from the mold.
  • attaching techniques such as static electricity
  • the hyperfine regions are isolated from the injected material during the injection molding process, in order to prevent a leakage of the material into the air pockets 131 between the waveguide substrate 20 and the air gap film 110.
  • the Figs. 12A to 15C illustrate different techniques for forming an optical device comprising a waveguide substrate embedded between two optical elements (lenses). However, there are some applications requiring attachment of planar elements to the external surfaces of the waveguide substrate. An example for such an embodiment is illustrated in the above-described Fig. 4 , wherein the collimating element/module 6 is attached to the waveguide substrate 20.
  • Some other reasons for attaching a flat optical element to a waveguide substrate can be for mechanically protecting the waveguide substrate to enhance the user's eye-safety, or applying a coating on the external surface of the flat element to achieve various characteristics such as, photochromic response, scratch resistance, super-hydrophobicity, tinted (colored) view, polarization, anti-finger print and the like.
  • a waveguide substrate 20 embedded between two flat optical elements (substrates) 162 and 164 and assembled inside frames 166, 167 is exemplified in Figs. 16A, 16B and 16C .
  • the embedding process of the waveguide substrate and flat elements can be implemented utilizing mechanical attachment, peripheral cementing or monolithic fabrication. Embedding processes can include attaching only a single element to one of the external surfaces of the waveguide substrate or combining different elements, such as flat substrates as well as curved lenses.
  • the element for coupling light waves out of the waveguide substrate is at least one flat partially reflecting surface 22 located inside the waveguide substrate 20, which is usually obtained using a partially reflecting dielectric coating, and is non-parallel to the major surfaces of the waveguide substrate.
  • the special reflective mechanism provided according to the present invention in the form of a patterned interface can be exploited also for other coupling-out technologies.
  • Fig. 17 illustrates a waveguide substrate 20 wherein a coupling-in element 170 and/or a coupling-out element 172 are provided which are diffractive elements.
  • other coupling-out elements like a curved partially reflecting surface and other means can be used.
  • Figs. 12-16 are just examples illustrating the simple implementation of the present invention. Since the substrate-guided optical element, constituting the core of the system, is very compact and lightweight, it could be installed in a vast variety of arrangements. Hence, many other embodiments are also possible, including a visor, a folding display, a monocle, and many more. This embodiment is designated for applications where the display is to be near-to-eye; head-mounted, head-worn or head-carried. There are, however, applications where the display is located differently. An example of such an application is a hand-carried device for mobile applications, such as for example a smartphone or smartwatch. The main problem of these smart deices is the contradiction between the required small size and volume and the desired high quality image.
  • Fig. 18 illustrates an alternative technique, based on the principles of the present invention, which eliminates the current necessary compromise between the small size of mobile devices and the desire to view digital content on a full format display.
  • This application is a hand-carried display (HHD) which resolves the previously opposing requirements, of achieving small mobile devices, and the desire to view digital content on a full format display, by projecting high quality images directly into the eye of the user.
  • An optical module/device includes a display source 4 (image generator), the folding and collimating optics 6 and the waveguide substrate 20 which are all integrated into the body of a smart device 210, where the waveguide substrate 20 replaces the existing protective coverwindow of the phone.
  • the volume of the support components, including source 4 and optics 6, is sufficiently small to fit inside the acceptable volume for modern smart device.
  • the window of the device In order to view the full screen, transmitted by the device, the window of the device is positioned in front of the user's eye 24, observing the image with high FOV, a large eye-motion-box and a comfortable eye-relief. It is also possible to view the entire FOV at a larger eye-relief by tilting the device to display different portions of the image.
  • the optical module can operate in see-through configuration, a dual operation of the device is possible; namely there is an option to maintain the conventional display 212 intact. In this manner, the standard display can be viewed through the waveguide substrate 20 when the display source 4 is shut-off.
  • the conventional display 212 is shut-off, while the display source 4 projects the required wide FOV image into the eye of the viewer through the waveguide substrate 20.
  • the user can operate the smart device by using a touch screen which is embedded on the front window of the device.
  • the touch screen 220 can be attached to a smart device by directly cementing it on the external surface of the air gap film 110 which is located on the waveguide substrate 20.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Optical Couplings Of Light Guides (AREA)
  • Optical Integrated Circuits (AREA)
  • Light Guides In General And Applications Therefor (AREA)

Description

    TECHNOLOGICAL FIELD AND BACKGROUND
  • The present invention is generally in the field of augmented reality, and relates to an optical system for use in augmented reality system. The invention can be implemented in a large number of imaging applications, such as portable DVDs, cellular phones, mobile TV receivers, video games, portable media players or any other mobile display devices. The invention can be further implemented in any type of a waveguide system that uses a total internal reflection (TIR) principle. In particular, such optical device may be incorporated within a see-through head-mounted display device (e.g. helmet- or eyeglasses-mounted display), which is a wearable display that has the capability of reflecting projected images as well as allowing the user to see through it.
  • In head-mounted displays (HMDs), an optical module serves both as an imaging lens and a combiner (optical mixer), and a two-dimensional image source is imaged to infinity and reflected into the eye of an observer. Such image source can be obtained either directly from a spatial light modulator (SLM) based on a cathode ray tube (CRT), a liquid crystal display (LCD), an organic light emitting diode array (OLED), a scanning source or similar devices, or indirectly using a relay lens or an optical fiber bundle. The image source typically includes a pixel matrix which is imaged to infinity by a collimating lens and is transmitted into the eye of the viewer by reflecting or partially reflecting surface(s) acting as a combiner for, respectively, non-see-through and see-through applications
  • Various optical devices and systems for augmented reality applications are described in the following patent publications, all assigned to the assignee of the present application: WO 01/95027 , WO 03/081320 , WO 2005/024485 , WO 2005/024491 , WO 2005/024969 , WO 2005/124427 , WO 2006/013565 , WO 2006/085309 , WO 2006/085310 , WO 2006/087709 , WO 2007/054928 , WO 2007/093983 , WO 2008/023367 , WO 2008/129539 , WO 2008/149339 , WO 2013/175465 and IL 2014/232197 .
  • US 5 712 694 A discloses an LCD display device having an emitter, a direct-view display screen, a light-guiding member for guiding illumination light emitted from the emitter to the direct-view display screen, a light separating element for separating the illumination light selectively into a first and second polarized light component and transmitting the first light component and reflecting the second light component, a light converting member for converting the reflected second light component to a first light component, a reflecting plate for returning the converted first light component to the light separating element, and a half-wave film for rotating the vibration direction of the first polarized light component.
  • US 2008/151375 A1 discloses a light guide device for use in back light module, the light guide device comprising a light guide plate made of transparent materials; and a light concentrating and diffusing structural portion integrally formed on an upper or outer portion of the light guide plate adjacent to a lightoutgoing surface of the light guide plate in order to enhance the light concentrating effect and the light diffusing effect of the light guide plate.
  • US 2005/024849 A1 discloses a method for use in manufacturing backlight/light emitting panel assembly, the method involving using a tool to cut or form multiple optical element shaped cavities in a surface of a substrate without rotating the tool or substrate during the cutting or forming process. At least some of the cavities are cut or formed to have at least two surfaces that come together to form a ridge and that are quite small relative to the length and width of the substrate.
  • US 2011/096566 A1 discloses a backlight module including a light guide plate, micro-structures, at least one light source, and a first prism sheet. The light guide plate includes a first surface, a second surface, and a light incident surface connecting the first surface and the second surface. The micro-structures are disposed on at least one of the first surface and the second surface.
  • GENERAL DESCRIPTION
  • There is a need in the art in a novel optical device for use in augmented reality system, enabling high quality imaging.
  • As indicated above, conventional augmented reality systems utilize an optical module which serves as an imaging lens and a combiner. Typically, this is a free-space optical module. It is desired to increase a field-of-view (FOV) of the system. However, this results in that the optical module becomes larger, heavier and bulkier. Hence, even for a moderate performance device, such a system is impractical. This is more critical for head-mounted applications, which are to be as light and compact as possible.
  • It is also desired to reduce the sensitivity of the performance of the optical device to small movements thereof relative to the eye of the viewer, and allow sufficient pupil motion for comfortable reading of text from the displays.
  • The present invention provides a novel optical system which facilitates the exploitation of a very compact light-guide optical element (LOE) for, amongst other applications, HMDs. The invention allows relatively wide FOVs together with relatively large eye-motion-box (EMB) values/angles. This provides a large, highquality image, which also accommodates large movements of the eye. The optical system of the present invention is particularly advantageous because it may be more compact than state-of-the-art implementations and yet it can be readily incorporated, even into optical systems having specialized configurations.
  • The LOE used in the optical device of the invention is a waveguide configured such that light waves are trapped inside the waveguide by total internal reflection. It is often the case that the optical device needs to include one or more additional optical element(s) in a path along which light output from the waveguide propagates to the viewer's eye. Such optical element may or may not have optical power. This may for example be a protective element or an ophthalmic lens, e.g. with optical power prescribed for the specific user.
  • Thus, proper optical separation is needed between the waveguide (LOE) and such additional optical element(s) at least within an active region defined by light propagation and output of the waveguide namely optical separation enabling to maintain the image quality of the transmitted image. This means that the optical separation between the waveguide and the optical element, on the one hand, allows the reflection of light waves from the external surfaces of the waveguide not to be degraded, and, on the other hand, allows not to disturb the coupling-out and the coupling-in mechanisms of the light waves from and to the LOE, i.e. the total internal reflection effects are maintained at an interface region between the LOE and the optical element.
  • The present invention solves the above problem by providing the interface region at least within the active region between the waveguide and optical element having a pattern (surface relief) configured to provide an effective pseudo air layer/gap adjacent to (in the vicinity of) the LOE interface effectively maintaining the TIR condition for light interacting with said interface.
  • The pattern at the interface region actually presents an angular sensitive reflective mechanism such that said interface substantially reflects the entire light waves which are coupled inside the LOE and impinge on the patterned interface at oblique angles, and substantially transmits the light waves which substantially normally (zero angle of incidence) impinge on the interface.
  • It should be understood that such patterned interface creating effective pseudo air layer/interface may be implemented by one of the following configurations: (i) providing a pattern (surface relief) on at least a portion of the external surface of the waveguide; (ii) providing a pattern on at least a portion of the external surface of the optical element; (iii) using a separate patterned element in between the surfaces of the waveguide and optical element. In the latter case, such separate patterned element may for example be in the form of a film (a so-called "air gap film") associated with either the waveguide's surface or surface of the optical element. Such an air gap film may for example be configured as a moth-eye structure which is configured for the purposes of the invention to provide angular sensitive reflective mechanism.
  • Thus, generally, the pattern (surface relief) in the interface region is in the form of spaced-apart protrusions. The arrangement of protrusions (i.e. their height and spaces between them) is selected to form a hyperfine structure / subwavelength structure which, for wavelengths of predetermined wavelength range, creates an effective pseudo air layer allowing angular sensitive reflections.
  • For example, the patterned interface may include a hexagonal pattern of bumps, of about 200 nm height arranged such that their centers are spaced apart about 300 nm. Such bumps are smaller than the wavelength of visible light, and therefore light incident on the interface "sees" the interface as having a continuous refractive index gradient between air (in a contact / interface between the waveguide and optical element area) and the medium of the optical element or waveguide, which maintains the reflection at the LOE lens interface. The same principles can be used for patterns of other shapes and dimensions in order to allow the formation of a pseudo air interface that is relevant in other wavelength ranges (from UV to IR) and wider light incidence angles (0±60 degrees).
  • Considering the patterned interface created by direct patterning of the surface of the waveguide or the surface of the optical element (e.g. lens), any suitable patterning technique can be used. These include for example, creation of a random texture of antireflective microstructures using a plasma etching process (such technique is known and is described from example in US 8,187,481 ; or UV imprinting / thermal embossing of a hard coat with a mold having a desired hyperfine-structure; or 2D interference lithography of a hard coat on the surface; or standard high resolution lithography (100 nm or less features).
  • It should be noted that the waveguide, as well as the optical element (which may or may not have optical power) may be in the form of any suitable transparent structure, e.g. made of glass or plastic, to which the above patterning techniques can be applied. If a plastic structure is used, then thermal embossing of top plastic surface can be used to create a desired pattern. Alternatively, the plastic elements can be produced by a casting or injection molding, where the mold used, already has the negative of the hyperfine structure.
  • According to an aspect of the present invention the moth-eye film, or any similar hyperfine structure, is utilized for the creation a pseudo air-layer as well as an anti-reflection interface for normal incident light transmitted through the entire optical element from the surroundings.
  • When it is required to attach an optical element to the external surface of the LOE, and in case of use of an air gap film having a hyperfine structure the film could be cemented whether to the optical element or to the LOE. Therefore, when the coupled-in light waves inside the LOE impinge on the hyperfine structure at different oblique angles, they "see" only the external part of the periodic structure. Hence, the actual refractive index, which is "seen" by the incoming optical light waves, is close to the refractive index of the air and the total internal reflection mechanism is preserved. On the other hand, the air gap film is substantially transparent to the incoming light waves from the external scene or to the light waves which are coupled out from the LOE.
  • Thus, according to the invention, it provides an optical system according to claim 1, wherein preferred embodiments are mentioned in the subclaims. From a general aspect there is provided a light-transmitting waveguide substrate configured for receiving input light indicative of an image being projected, guiding said input light by total internal reflection, and coupling the light out of the substrate to propagate along an output path in a predetermined direction; at least one transparent optical element accommodated in said output path and interfacing at least a portion of a surface of said waveguide substrate; an interface region between at least a portion of the surface of said waveguide substrate and a surface of the optical element being a patterned interface configured to provide optical coupling between the waveguide substrate and said optical element while maintaining the total internal reflection condition of light propagation within said light-transmitting waveguide.
  • The patterned interface is formed by a surface relief on said at least portion of the surface of the waveguide substrate; or by a surface relief on the surface of the optical element; or by an air gap film having a patterned surface and located in between said at least portion of the surface of the waveguide substrate and the optical element. In the latter case, the air gap film is by its substantially unpatterned surface attached to either said at least portion of the waveguide substrate such that said patterned surface faces the optical element, or said surface of the optical element such that said patterned surface faces said at least portion of the waveguide substrate.
  • The pattern in said patterned interface comprises an array of protrusions forming air pockets between the protrusions and the surface of optical element of the waveguide substrate facing said protrusions. Thus, such patterns forms a pseudo air layer/interface between the waveguide and the optical element. The protrusions typically include dielectric material. Preferably, the protrusions are configured such that a cross section of the protrusion gradually changes from a base portion of the protrusion towards a distal end thereof as a function of a distance from the base portion. With this configuration, the amount of dielectric material of the protrusion at the base portion is preferably maximal, while the amount of the dielectric material of the protrusion at the distal end is minimal. Preferably, a proportional portion of the dielectric material of the protrusion reduces from substantially equal to 1 at the base portion towards substantially equal to 0 at the distal end.
  • In some embodiments, a length of the protrusion is less than 1 micron.
  • Preferably, the configuration is such that an effective refractive index at the protrusion distal end is substantially equal to a refractive index of air.
  • The patterned interface comprises a periodic pattern.
  • The patterned interface may have a configuration of a moth eye.
  • The optical element may be a flat transparent substrate. In some embodiments, the optical element is a collimating module. In some embodiments, the optical element is a lens.
  • In some embodiments, an additional optical element is provided being associated with another portion of a surface of the waveguide substrate via an additional patterned interface. The patterned interfaces may thus be associated with opposite surfaces of the waveguide substrate. The optical elements may be lenses serving for, respectively, imaging the light waves indicative of the (augmented) image being projected onto user's eye and imaging an external scene onto the user's eye.
  • In some embodiments, the optical element may be composed of at least one lens having a substantially flat surface by which it faces the patterned interface.
  • In some embodiments, the waveguide substrate and the at least one optical element are assembled inside an eyeglasses frame.
  • The waveguide substrate and the at least one optical element may be embedded together utilizing a peripheral bonding technique. The waveguide substrate and the optical element may be monolithically embedded together.
  • The waveguide substrate may comprise at least one partially reflecting surface for coupling the light waves out of the substrate. Such partially reflecting surface is typically inclined with respect to the major surfaces of the waveguide substrate. The partially reflecting surface may be of configured as a diffractive element; as well as may be a substantially flat or curved surface.
  • The invention, in its another aspect, provides an augmented reality system or a head up display system comprising the above described optical system, and an image generator device for generating light indicative of the image to be projected; and a collimating module for receiving said light and directing the collimated light waves indicative thereof towards the waveguide substrate.
  • The invention also provides an electronic device comprising the above described optical system. Such electronic device may be a smartphone device, a smartwatch device; the optical element used in such device may be a touchscreen.
  • The invention also provides an optical module for use in the above described optical system, where the optical module comprise the waveguide structure carrying the at least one patterned interface on the at least portion of the surface of the waveguide.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • In order to better understand the subject matter that is disclosed herein and to exemplify how it may be carried out in practice, embodiments will now be described, by way of non-limiting example only, with reference to the accompanying drawings.
  • With specific reference to the figures in detail, it is stressed that the particulars shown are by way of example and for purposes of illustrative discussion of the preferred embodiments of the present invention only, and are presented in the cause of providing what is believed to be the most useful and readily understood description of the principles and conceptual aspects of the invention. In this regard, no attempt is made to show structural details of the invention in more detail than is necessary for a fundamental understanding of the invention. The description taken with the drawings are to serve as direction to those skilled in the art as to how the several forms of the invention may be embodied in practice.
  • In the drawings:
    • Figs. 1 to 3 schematically illustrate the general configuration and operational principles of head up display systems, where Fig. 1 is a schematic illustration of a light propagation scheme in a waveguide structure used in a head up display system; and Figs. 2 and 3 show schematic diagrams illustrating two known configurations, respectively, for collimating and coupling-in input light-waves from a display light source into the waveguide structure.
    • Fig. 4 illustrates an exemplary embodiment of a optical device not being part of the present invention for use in head up display system, wherein the optical element is in the form of a negative lens attached to an external surface of the light-guide optical element;
    • Fig. 5 illustrates an exemplary embodiment of a optical device not being part of the present invention for use in head up display system, wherein the optical element is in the form of negative and positive lenses attached to the external surfaces of the light-guide optical element;
    • Figs. 6A to 6C exemplify three different implementation of a patterned interface in the optical device of the invention obtained by direct patterning of the optical device (Fig. 6A, 6C), direct patterning the surface of the waveguide's surface (Fig. 6B);
    • Figs. 7A and 7B are two- and three-dimensional schematic views of an exemplary embodiment of the configuration of the patterned interface being implemented as an air gap film, wherein a hyper-fine periodic structure (pattern) of transparent dielectric material is arranged at a small pitch shorter than the wavelengths of the photonic region, and is constructed on a flat transparent substrate;
    • Figs. 8A and 8B respectively illustrate a side view and a top view of an exemplary air gap film;
    • Figs. 9A and 9B respectively illustrate a side view and a top view of an exemplary air gap film for an internal cross section which is close to the base;
    • Figs. 10A and 10B respectively illustrate a side view and a top view of an exemplary air gap film for an external cross section which is close to the air;
    • Fig. 11 illustrates an air-gap film which is attached to the external surface of an LOE, wherein a coupled light wave impinges on the interface between the LOE and the film and is totally reflected of the surface;
    • Figs. 12A and 12B illustrate how the head up display system utilizing the present invention can be incorporated in the eyeglasses, wherein the LOE is embedded between two optical lenses and assembled inside the eyeglasses frame;
    • Figs. 13A, 13B and 13C exemplify how a non-monolithic optical element comprising an LOE can be embedded between a front positive lens and a rear negative lens, mounted together inside a frame without adhesive;
    • Figs. 14A, 14B and 14C exemplify another technique for bonding an LOE between two optical lenses, utilizing a peripheral bonding technique;
    • Figs. 15A, 15B and 15C exemplify an embodiment according to the invention for monolithically embedding an LOE between two optical lenses,
    • Figs. 16A, 16B and 16C exemplify an LOE embedded between two flat substrates and assembled inside a frame;
    • Fig. 17 exemplifies a waveguide substrate associated with diffractive coupling-in and/or coupling-out optical elements; and
    • Fig. 18 exemplifies the use of the principles of the present invention in a hand-carried display (HHD) configured as a small mobile devices.
    DETAILED DESCRIPTION OF THE EMBODIMENTS
  • Reference is first made to Figs. 1 , 2 and 3 which schematically illustrate the general configuration and operational principles of some head up display systems of the kind to which the present invention relates.
  • Fig. 1 illustrates a light propagation scheme in a planar waveguide 20, which is time referred to as light-guide optical element (LOE) or substrate suitable to be used in an optical device of the present invention. Generally, the waveguide 20 is configured to provide total internal reflection (TIR) condition for light propagating therein. The waveguide substrate 20 has a light input region 21 (which is aligned with an output of a collimating module, as will be described further below), and light directing interfaces 16 and 22 arranged with proper orientation inside the waveguide.
  • As shown, input light waves 18 (which are collimated and which are indicative of an image to be presented to a viewer) interact with the reflective interface 16 which reflects these light waves such that they are trapped inside the planar waveguide substrate 20 of the LOE, by total internal reflection. After several reflections from the major lower and upper surfaces 26, 28 of the substrate 20, the trapped light waves reach an array of selective partially reflecting surfaces 22, which couple the light out of the substrate to propagate towards a pupil 25 of viewer's eye 24.
  • Herein, the light input surface of the LOE will be regarded as the surface through which the input light waves enter the LOE, and the light output surface of the LOE will be regarded as the surface through which the trapped waves exit the LOE. With the LOE configuration illustrated in Fig. 1 , both the input and the output surfaces are on the lower surface 26 of the LOE 20. Other configurations, however, are envisioned in which the input and the image waves could be located on opposite sides of the substrate 20, or when the light is coupled into the LOE through a slanted edge of the substrate.
  • Figs. 2 and 3 exemplify two examples of the head up display system, in which an optical system includes the above described LOE 20 and a collimating module 6. Light waves 2 which are output of the image creation device 4 (e.g. projector) and which are thus indicative of the image to be displayed, enters the collimating module 6 through its lower surface 30. Typically, these light waves 2 have specific polarization, e.g. s-polarized input light-waves 2. The collimating module 6 is usually made of a light-waves transmitting material, and is associated with a polarizer unit including a polarizing beam splitter 31, polarization rotators (e.g. quarter-wavelength retardation plates) 34 and 40, and reflectors 36 and 44 (e.g. metallic or dielectric coatings). Thus, input polarized light 2 passes through facet 30 of the collimating module 6, and is reflected by the beam splitting surface 31 towards the quarter-wavelength retardation plate 34, and the so-created p-polarized light is reflected by reflector 36 (e.g., a flat mirror) to pass through the retardation plate 34 and then through the polarizing beamsplitting surface 31. These p-polarized light now propagates through facet 38 of the collimating module 6 to pass through the second quarter-wavelength retardation plate 40, and after being collimated by a component 42, e.g., a lens, be reflected by reflector 44 (e.g. reflecting coating on lens's surface), and returned back to pass again through the retardation plate 34. The now s-polarized light-waves are reflected by the polarizing beam-splitting surface 31 and exit the collimating module 6 through its facet 46 by which the module faces the input region 21 of the LOE. The body 6 of the collimating module may be formed by prisms 52 and 54 (e.g. folding prisms).
  • As shown in the examples of Figs. 2 and 3 , the light output 48 from the collimating module 6 enters the waveguide/substrate 20 through an input region 21 on its lower surface 26. The light waves 48 entering the substrate 20 are reflected from light directing element 16 and trapped in the substrate as described above with reference to Fig. 1 . The collimating module 6 formed by the above described elements can easily be integrated into a single mechanical module and assembled independently of the waveguide substrate, without requiring accurate mechanical tolerances. In addition, the retardation plates 34 and 40 could be cemented together with their associated reflecting optical elements 36 and 42, respectively, to form two units.
  • In the example of Fig. 2 , the collimating module 6 is spaced by an air gap from the input region 21 of the waveguide 20. It would be advantageous to attach all the components of the collimating module 6 to the waveguide substrate 20 with appropriate alignment with its input region 21, to form a single compact device of a simplified mechanical construction. This is exemplified in Fig. 3 , wherein the upper surface 46 of the collimating module 6 is attached at the interface plane 58, to the lower surface 26 of the substrate 20. However, such configuration utilizing physical attachments between the module 6 and the waveguide 20 has no air gap (50 in Fig. 2 ) between these structures, while such air gap is essential for trapping the input light waves 48 inside the substrate 20. The trapped light waves 48 should be reflected at points 62 and 64 of the interface plane 58. Therefore, a reflecting mechanism should be applied at this plane, either at the major surface 26 of the substrate 20, or at the upper surface 46 of the collimating module 6. A simple reflecting coating cannot, however, be easily applied, since these surfaces should also be transparent to the light waves that enter and exit the substrate 20 at the exemplary points 66. The light waves incident on surface 48 with small incident angles should pass through this surface, and light waves having higher incident angles should be reflected. Usually, the passing incident angles are between 0° and 15° and the reflecting incident angles are between 40° and 80°.
  • In the above-described known head up display system, the image which is coupled into the LOE is collimated to infinity. Also, in most head up display applications, it is assumed that the scene is located at the infinity. However, there are applications requiring the transmitted image to be focused to a closer distance, for example, for people who suffer from myopia and cannot properly see images located at long distances. Also, there are professional or medical applications where the external scene is located at closer distances.
  • Reference is made to Figs. 4 and 5 exemplifying optical device/systems of the invention which provide for incorporating an additional optical element in the optical module of the head up display system. It should be understood that, although in the description below, such additional optical element is exemplified as a lens (i.e. optical element having optical power), the principles of the invention are not limited to this specific example, and may advantageously be used with any optical element, of any suitable shape, having optical power or not.
  • To facilitate illustration and understanding, the same reference numbers are used for identifying functionally common components in all the examples.
  • Thus, Figs. 4 and 5 illustrate a system 100 including an optical device/module 102 of the invention, which receives from a collimating module 6 (e.g. configured as described above) collimated light indicative of an image created by an image forming device (e.g. projector) 4, and conveys this image to be viewed by user. As schematically shown in the figures, an image 18 from infinity is coupled into a waveguide substrate 20 by a light directing element (reflecting surface) 16, and then further directed (reflected) by an array of partially reflective surfaces 22 into the eye 24 of the viewer. The optical device 102 also includes an optical element, such as a lens 82.
  • In the example of Fig. 4 , this is a plano-concave lens 82 which focuses the image onto a prescribed focal plane and optionally corrects other aberrations of the viewer's eye, e.g. astigmatism. The optical element (lens) 82 is properly optically separated from the waveguide substrate 20 at its flat surface portion 84. An interface region between the waveguide 20 and the optical element 82 providing optical separation between them where waveguide light propagation and light output take place, is at times referred to herein as an active region.
  • In the example of Fig. 5 , the additional optical element 82 has a dual lens configuration, where lenses 82A and 82B are located at opposite sides of the waveguide 20 being aligned with the output region of the waveguide. Image light waves 18 from infinity (obtained by collimation by module 6) are coupled into the waveguide substrate 20 by a reflecting surface 16 and then reflected by an array of partially reflective surfaces 22 and focused by lens 82A into the eye 24 of the viewer. Another image light 86 from a close distance scene is collimated to infinity by lens 82B and then passed through the waveguide substrate 20 into the eye 24 of a viewer. The lens 82A focuses both the projected image 18 and the external scene image 86 onto the focal plane at a convenient distance, usually (but not necessarily always) the original distance of the external scene image, and corrects other aberrations of the viewer's eye, if required.
  • The lens 82 ( Fig. 4 ) and lenses 82A, 82B ( Fig. 5 ) are simple plano-concave and plano-convex lenses. However, in order to keep the planar shape of the waveguide substrate, it is possible to utilize Fresnel lenses, which can be made of thin molded plastic plates with fine steps. Moreover, an alternative way to implement the lenses, instead of utilizing fixed lenses as described above, is to use electronically controlled dynamic lenses. There are applications where the user will not only be able to see a non-collimated image but also to dynamically control the focus of the image. It has been shown that a high resolution, spatial light modulator (SLM) can be used to form a holographic element. Presently, the most popular sources for that purpose are LCD devices, but other dynamic SLM devices can be used as well. High resolution, dynamic lenses having several hundred features (lines) are known. This kind of electro-optically controlled lenses can be used as the desired dynamic elements in the optical device of the present invention, instead of the fixed lenses described above in conjunction with Figs. 4 and 5 . Therefore, in real time, a user can determine and set the exact focal planes of both the virtual image (augmented image) projected by the waveguide substrate and the real image of the external scene. The lenses 82 (of Fig. 4 ) and lenses 82A, 82B (of Fig. 5 ) could be of any desired/required form factor (dimensions), e.g. could correspond to eye-motion-box area for correction lenses, and/or be aligned with the entire waveguide substrate 20 or a desired/required part thereof. For example, if the optical element 82 is a protective element, then it preferably is aligned with the entire waveguide's surface (i.e. the interaction region extends along the entire waveguide substrate). This depends on the type of the additional optical element(s), as well as the manufacturing technology of the waveguide and optical element(s).
  • As explained above with regard to Fig. 3 , a thin air gap is to be maintained between the lens and the waveguide substrate, to ensure the trapping of the image light waves (light waves 18 of projected image) inside the waveguide substrate by total internal reflection.
  • As illustrated in Figs. 4 and 5 , it would be advantageous to attach the optical element 82 (single-lens or dual lens 82A-82B) to the waveguide substrate 20, to form a single (integral), compact simplified mechanical module. Clearly, the main problem as hereinbefore described, is that the attaching procedure cancels the previously existing air gap between the substrate 20 and the optical element 82, which gaps are essential for trapping image light waves inside the waveguide substrate 20. As shown in Fig. 5 (being also true for Fig. 4 ), the trapped image light waves are to be reflected at point/location 90 of the interface region 84 and transmitted through the same interface at point/location 92. Therefore, a similar reflecting mechanism as described above in relation to Fig. 3 should be applied at this region.
  • To achieve the required totally reflecting mechanism, the interface region 84 should be properly configured with a pattern 85 having subwavelength features, e.g. a surface relief in the form of an arrangement of spaced-apart protrusions having height and spaces between them selected to form a hyperfine structure / subwavelength structure which, for wavelengths of predetermined wavelength range, creates a refractive index profile causing angular sensitive reflections.
  • The patterned interface 84 may be implemented providing a pattern (surface relief) on at least a portion of the external surface of the waveguide or on at least a portion of the external surface of the optical element. This is exemplified in Figs. 6A to 6C . It should be understood that the pattern in the figure is not to scale, just in order to facilitate understanding. In the example of Figs. 6A and 6C , the patterned interface 84 is formed by direct patterning (creation of a surface relief) of at least a portion of the surface of optical element 82. In the example of Fig. 6B , the patterned interface 84 is formed by direct patterning (creation of a surface relief) of at least a portion of the surface 28 of the waveguide substrate 20.
  • As described above, such patterned interface created by at least partial direct patterning of the surface of the waveguide and/or the surface of the optical element may be obtained using any known suitable patterning technique. Some specific, but not limiting example of such technique include creation of a random texture of microstructures using a plasma etching process; UV imprinting / thermal embossing of a hard coat with a mold having a desired hyperfine-structure; 2D interference lithography of a hard coat on the surface; standard high resolution lithography.
  • Alternatively (or additionally), the patterned interface may utilize a separate patterned element in between the surfaces of the waveguide and optical element. Such separate patterned element may be in the form of a film (a so-called "air gap film"), e.g. configured utilizing the principles of a moth-eye structure which, according to the invention, is configured to provide angular sensitive reflective mechanism effectively creating a pseudo air gap. Such transparent air gap film may be attached to the major surface of the waveguide substrate, or the surface of the optical element. Such air gap film is schematically exemplified in Figs. 7A and 7B . The air gap film is an optical device 110 having a flat transparent (dielectric) substrate / base 112 which has on its surface a hyper-fine periodic pattern 85 (surface relief) of features arranged at a small pitch shorter than the wavelengths of the photopic region, e.g., moth-eye film having a dense (uneven) hyperfine periodic structure. The height of the surface relief is preferably (but not necessarily) less than 1 micron. This film 110, when located between the surfaces of the waveguide 20 and the optical element 82 (while being attached to one of them) presents the patterned interface region 84.
  • In any one of the examples of Figs. 6A-6C and 7A-76B, the protrusions/features of the pattern preferably have varying cross section, such that the cross sectional dimension of the protrusion is gradually reduced in a direction from the base towards the distal end of the protrusion. The pattern 85 is such that the distal end of the features faces either the optical element or the waveguide.
  • As illustrated more specifically in Figs. 8A and 8B , any cross section 121 parallel to the surface of the air gap film 110 has a periodic formation/protrusion, wherein the proportional portion of the dielectric material 123 in the relief formation is changed gradually as a function of distance from the film itself.
  • As further seen in Figs. 9A-9B and 10A - 10B, in the internal cross section 124, which is close the film's base 112, i.e., the lower (proximal) portion of the hyperfine structure 85, the proportional portion of the dielectric material 125 in the relief formation 126 is maximal and substantially close to 1, while in the external cross section 127, i.e., close to the upper portion (distal end) of the hyperfine structure 85, the proportional portion of the dielectric material 128 in the relief formation 129 is minimal, namely, significantly lower than in material 125, and substantially equal to zero.
  • Typically, when light waves pass through an optical device having a periodically patterned structure, diffraction of light occurs and the brightness of the zero order of the diffracted light, namely, the light which is transmitted through the device without any diffraction, is considerably reduced. When the pitch of the hyper-fine periodic structure is, however, considerably shorter than the wavelength of the incoming light waves, no diffraction occurs. Instead, since the optical waves interacts with a medium having an effective refractive index which is the average of the materials contained in this medium, effective anti-reflection properties can be obtained.
  • On the other hand, when light waves impinge on the periodic hyperfine structure 85 at the upper side (distal end) of the structure at oblique angles, they "see" (are affected by) only the external part of the periodic structure, wherein the proportional part of the transparent material is very low. Therefore, the actual / effective refractive index, which is "seen" by the incoming optical waves (i.e. which affects the light wave propagation), is close to the refractive index of the air.
  • As illustrated in Fig. 11 , when such a patterned structure (e.g. an air-gap film) is provided between the external surface 28 of the waveguide substrate 20 and the external surface 87 of the optical element 82 (e.g. film attached to the surface of the optical element as shown in this specific not limiting example), the patterned structure faces the waveguide and forms the patterned interface region 84. The coupled light waves 130 impinge on an interface 132 between the waveguide substrate 20 and the distal end of the pattern/film at angles higher than the critical angle, the air 131 confined between the film 110 and the waveguide substrate 20 provides an optical isolation due to the air-like refractive index in the boundary surface. Therefore, the condition of total internal reflection of the coupled-in light waves from the external surface is preserved and the light waves are contained inside the waveguide substrate. It should be understood that the same effect will take place while attaching such air film to the external surface 28 of the waveguide substrate 20 (or direct patterning of the waveguide substrate) with the patterned structure facing the optical element 82.The geometrical characteristic of the hyperfine structure, such as the height, peak-to-peak and width thereof, can be between 10 to 800 nanometers. It should be understood that the shape of the hyperfine structure needs not be that of the moth eye. Any other nano-structure shape, such as pyramids, prisms, cones and others, can be utilized. Moreover, the hyperfine structure needs not be specifically periodic, although a periodic structure is usually easier to fabricate. The hyperfine structure suitable to be used in the invention is, on one hand, solid enough not to collapse during the attaching process, and, on the other hand, the proportional portion of the dielectric material in the external cross-section of the structure is substantially equal to zero, to maintain the total internal reflection condition inside the waveguide substrate. In addition, the size of the basic elements of the hyperfine structure is not be too large, in order to avoid diffraction effects. However, reducing the thickness of the hyperfine structure to below 100 nm might undesirably allow the penetration of the trapped waves through the air gap film and the deterioration of the total internal reflection phenomena. Hence, the hyperfine structure thickness is preferably between 200 and 300 nm.
  • Reference is made to Figs. 12A and 12B , where Fig. 12A schematically illustrates an eyeglasses system 140 and Fig. 12B shows the waveguide substrate 20 which is embedded between lenses 141, 142 of the dual-lens optical element (corresponding to duel lens configuration 82A-82B as described above) and assembled inside the eyeglasses frame 143. As seen, in addition to the optical elements, the frame can contain other accessories including a camera 144, a microphone 145, earphones 146, USB connectors, memory cards, an inertial measurement unit (IMU), and the like.
  • Figs. 13A, 13B and 13C illustrate a non-monolithic optical device 150 comprising a waveguide substrate 20 embedded between front positive lens 151 and rear negative lens 152 (constituting a dual-lens or two-part optical element), mounted together inside a frame 154 without adhesive. In this specific example, the patterned interface(s) 84 between the waveguide 20 and the optical element(s) is constituted by, is an air gap film, but it should be understood, and described above, that the invention is not limited to this specific example. The air gap films 110 ( Fig. 13C ) could be placed or bonded between the waveguide substrate 20 and the lenses 151, 152, wherein the hyperfine structure(s) 85 respectively facing the external surfaces 26 and 28 of the waveguide substrate 20. The air gap films 110 ( Fig. 13C ) could also be placed or bonded between the waveguide substrate 20 and the lenses 151, 152, with the hyperfine structures 85 respectively facing the external surfaces 26 and 28 of the waveguide substrate 20. The air gap films 110 can be directly cemented on the planar surfaces of the optical lenses 151 and 152 using pressuresensitive adhesive (PSA), a thermally curable or UV-curable adhesive or can be fabricated directly as an integral part of the lenses utilizing embossing, injection molding, casting, machining, soft lithography or any other relevant fabrication method. The embedded optical element 150 can be assembled inside the frame 154 utilizing pressure or cementing techniques. The interface could be also created by at least partial (within the active area) direct patterning of the surface of the waveguide or the surface of the optical element obtained using any known suitable patterning technique.
  • An alternative technique for peripheral bonding the waveguide substrate 20 between the two optical lenses is exemplified in Figs. 14A, 14B and 14C . The waveguide substrate 20 is embedded between the optical lenses utilizing a peripheral bonding technique. The front lens 151 and rear lens 152 are cemented to the peripheral edges of the waveguide substrate 20 using optical or non-optical adhesive or any other high-viscosity adhesive 156 that mount all components together. The viscosity of the adhesive is selected to be high enough in order to prevent leakage of the adhesive into protrusions in the optically active are or air pockets 131 which are confined between the film 110 and the waveguide substrate 20. Such a leakage can eliminate the air gap which is required to preserve the total internal reflection of the light waves from the external surfaces of the waveguide substrate. The required adhesive 156 can, for example, be OP-67-LS or any room temperature vulcanization (RTV) silicone. The interface could be also created by at least partial (active area) direct patterning of the surface of the waveguide or the surface of the optical element obtained using any known suitable patterning technique.
  • According to the invention a technique for monolithically embedding the waveguide substrate 20 between the two optical lenses is exemplified in Figs. 15A, 15B and 15C . The production procedure of the embedded element may be as follows: placing the air gap film 110, with the hyperfine structures 85 facing the external surfaces 26 and 28 of the waveguide substrate 20; utilizing attaching techniques such as static electricity; preparing a mold 160 having the required external shape of the element; inserting the waveguide substrate 20 into the mold; casting or injecting the liquid resin polymer into the mold, curing the polymer by UV or by changing the polymer temperature, and finally, ejecting the embedded element from the mold. As explained above in relation to Figs. 14A to 14C , the hyperfine regions are isolated from the injected material during the injection molding process, in order to prevent a leakage of the material into the air pockets 131 between the waveguide substrate 20 and the air gap film 110. The Figs. 12A to 15C illustrate different techniques for forming an optical device comprising a waveguide substrate embedded between two optical elements (lenses). However, there are some applications requiring attachment of planar elements to the external surfaces of the waveguide substrate. An example for such an embodiment is illustrated in the above-described Fig. 4 , wherein the collimating element/module 6 is attached to the waveguide substrate 20. Some other reasons for attaching a flat optical element to a waveguide substrate can be for mechanically protecting the waveguide substrate to enhance the user's eye-safety, or applying a coating on the external surface of the flat element to achieve various characteristics such as, photochromic response, scratch resistance, super-hydrophobicity, tinted (colored) view, polarization, anti-finger print and the like.
  • A waveguide substrate 20 embedded between two flat optical elements (substrates) 162 and 164 and assembled inside frames 166, 167 is exemplified in Figs. 16A, 16B and 16C . The embedding process of the waveguide substrate and flat elements can be implemented utilizing mechanical attachment, peripheral cementing or monolithic fabrication. Embedding processes can include attaching only a single element to one of the external surfaces of the waveguide substrate or combining different elements, such as flat substrates as well as curved lenses.
  • In all the embodiments illustrated so far the element for coupling light waves out of the waveguide substrate is at least one flat partially reflecting surface 22 located inside the waveguide substrate 20, which is usually obtained using a partially reflecting dielectric coating, and is non-parallel to the major surfaces of the waveguide substrate. However, the special reflective mechanism provided according to the present invention in the form of a patterned interface can be exploited also for other coupling-out technologies. Fig. 17 illustrates a waveguide substrate 20 wherein a coupling-in element 170 and/or a coupling-out element 172 are provided which are diffractive elements. In addition, other coupling-out elements like a curved partially reflecting surface and other means can be used.
  • The embodiments of the above-described Figs. 12-16 are just examples illustrating the simple implementation of the present invention. Since the substrate-guided optical element, constituting the core of the system, is very compact and lightweight, it could be installed in a vast variety of arrangements. Hence, many other embodiments are also possible, including a visor, a folding display, a monocle, and many more. This embodiment is designated for applications where the display is to be near-to-eye; head-mounted, head-worn or head-carried. There are, however, applications where the display is located differently. An example of such an application is a hand-carried device for mobile applications, such as for example a smartphone or smartwatch. The main problem of these smart deices is the contradiction between the required small size and volume and the desired high quality image.
  • Fig. 18 illustrates an alternative technique, based on the principles of the present invention, which eliminates the current necessary compromise between the small size of mobile devices and the desire to view digital content on a full format display. This application is a hand-carried display (HHD) which resolves the previously opposing requirements, of achieving small mobile devices, and the desire to view digital content on a full format display, by projecting high quality images directly into the eye of the user. An optical module/device includes a display source 4 (image generator), the folding and collimating optics 6 and the waveguide substrate 20 which are all integrated into the body of a smart device 210, where the waveguide substrate 20 replaces the existing protective coverwindow of the phone. Specifically, the volume of the support components, including source 4 and optics 6, is sufficiently small to fit inside the acceptable volume for modern smart device. In order to view the full screen, transmitted by the device, the window of the device is positioned in front of the user's eye 24, observing the image with high FOV, a large eye-motion-box and a comfortable eye-relief. It is also possible to view the entire FOV at a larger eye-relief by tilting the device to display different portions of the image. Furthermore, since the optical module can operate in see-through configuration, a dual operation of the device is possible; namely there is an option to maintain the conventional display 212 intact. In this manner, the standard display can be viewed through the waveguide substrate 20 when the display source 4 is shut-off. In a second, virtualmode, designated for a massive internet surfing, or high quality video operations, the conventional display 212 is shut-off, while the display source 4 projects the required wide FOV image into the eye of the viewer through the waveguide substrate 20. Usually, in most of the hand-carried smart devices, the user can operate the smart device by using a touch screen which is embedded on the front window of the device. As illustrated in Fig. 18 , the touch screen 220 can be attached to a smart device by directly cementing it on the external surface of the air gap film 110 which is located on the waveguide substrate 20.

Claims (15)

  1. An optical system, comprising:
    a light-transmitting waveguide substrate (20) configured for receiving input light indicative of an image being projected, guiding said input light by total internal reflection, and coupling the light out of the substrate to propagate along an output path in a predetermined direction;
    at least one transparent optical element (82, 82a, 82b) accommodated in said output path and interfacing with at least a portion of a surface of said light-transmitting waveguide substrate,
    an interface region (84) between at least a portion of the surface of said light-transmitting waveguide substrate and a surface of the optical element being a patterned interface configured to provide optical coupling between the light-transmitting waveguide substrate (20) and said optical element (82, 82a, 82b) while maintaining the total internal reflection condition of light propagation within said light-transmitting waveguide substrate,
    wherein a pattern (85) in said patterned interface is a hyperfine structure / subwavelength structure comprising an array of protrusions forming air pockets between the protrusions and the surface of optical element or the waveguide substrate facing said protrusions,
    each of the protrusions is configured such that a cross section of the protrusion gradually changes from a base portion of the protrusion towards a distal end thereof as a function of a distance from the base portion, and
    wherein light-transmitting waveguide substrate (20) and said optical element (82, 82a, 82b) are monolithically embedded together.
  2. The optical system according to claim 1, wherein said patterned interface is formed by a surface relief on either said at least portion of the surface of the waveguide substrate, or the surface of the optical element.
  3. The optical system according to claim 1, wherein said patterned interface is formed by an air gap film (110) having a patterned surface and located in between said at least portion of the surface of the waveguide substrate and the optical element.
  4. The optical system according to claim 3, wherein said air gap film (110) is by its substantially unpatterned surface either attached to said at least portion of the waveguide substrate such that said patterned surface faces the optical element, or attached to said surface of the optical element such that said patterned surface faces said at least portion of the waveguide substrate.
  5. The optical system according to claim 1, wherein the protrusions include dielectric material.
  6. The optical system according to claim 5, wherein a cross section of the protrusions gradually reduces from the base portion towards the distal end, such that amount of said dielectric material of the protrusion at the base portion is maximal.
  7. The optical system according to claim 5, having one of the following configurations: (i) amount of the dielectric material of the protrusion at the distal end is minimal; and (ii) a proportional portion of the dielectric material of the protrusion reduces from substantially equal to one at the base portion towards substantially equal to zero at the distal end.
  8. The optical system according to claim 1, wherein a length of the protrusion is less than 1 micron.
  9. The optical system according to claim 1, wherein an effective refractive index at the protrusion distal end is substantially equal to a refractive index of air.
  10. The optical system according to claim 1, wherein the patterned interface comprises a periodic pattern.
  11. The optical system according to claim 1, wherein the patterned interface has a configuration of a moth eye.
  12. The optical system according to claim 1, wherein the optical element has at least one of the following configurations: is configured as a flat transparent substrate; is configured as a collimating module; is configured as a lens; comprises at least one lens having a substantially flat surface by which it faces the patterned interface.
  13. The optical system according to claim 1, further comprising an additional optical element optically coupled to another portion of a surface of the waveguide substrate via an additional patterned interface.
  14. The optical system according to claim 1, wherein the waveguide substrate comprises at least one partially reflecting surface for coupling the light waves out of the substrate.
  15. The optical system according to claim 14, wherein said at least one partially reflecting surface has at least one of the following configurations: is inclined with respect to the major surfaces of said waveguide substrate; is configured as a diffractive element; is a substantially flat surface; is a curved surface.
EP16902290.2A 2016-05-18 2016-05-18 Head-mounted imaging device Active EP3458898B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IL2016/050523 WO2017199232A1 (en) 2016-05-18 2016-05-18 Head-mounted imaging device

Publications (3)

Publication Number Publication Date
EP3458898A1 EP3458898A1 (en) 2019-03-27
EP3458898A4 EP3458898A4 (en) 2020-03-11
EP3458898B1 true EP3458898B1 (en) 2023-02-15

Family

ID=60324874

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16902290.2A Active EP3458898B1 (en) 2016-05-18 2016-05-18 Head-mounted imaging device

Country Status (8)

Country Link
US (1) US10739598B2 (en)
EP (1) EP3458898B1 (en)
JP (1) JP6740366B2 (en)
KR (1) KR102549713B1 (en)
CN (1) CN109154720A (en)
IL (1) IL262566B (en)
TW (1) TWI712821B (en)
WO (1) WO2017199232A1 (en)

Families Citing this family (76)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10073264B2 (en) 2007-08-03 2018-09-11 Lumus Ltd. Substrate-guide optical device
US10048499B2 (en) 2005-11-08 2018-08-14 Lumus Ltd. Polarizing optical system
IL232197B (en) 2014-04-23 2018-04-30 Lumus Ltd Compact head-mounted display system
IL235642B (en) 2014-11-11 2021-08-31 Lumus Ltd Compact head-mounted display system protected by a hyperfine structure
IL237337B (en) 2015-02-19 2020-03-31 Amitai Yaakov Compact head-mounted display system having uniform image
DE102016105060B3 (en) * 2016-03-18 2017-07-06 Carl Zeiss Smart Optics Gmbh Spectacle lens for imaging optics, imaging optics and data glasses
CA2992213C (en) 2016-10-09 2023-08-29 Yochay Danziger Aperture multiplier using a rectangular waveguide
KR20230084335A (en) 2016-11-08 2023-06-12 루머스 리미티드 Light-guide device with optical cutoff edge and corresponding production methods
US20190129183A1 (en) * 2016-12-08 2019-05-02 Snail Innovation Institute Integrated frames in wearable display devices
WO2018138714A1 (en) 2017-01-28 2018-08-02 Lumus Ltd. Augmented reality imaging system
EP3397998A4 (en) 2017-02-22 2019-04-17 Lumus Ltd. Light guide optical assembly
KR20230025946A (en) 2017-03-22 2023-02-23 루머스 리미티드 Overlapping facets
IL251645B (en) 2017-04-06 2018-08-30 Lumus Ltd Light-guide optical element and method of its manufacture
KR102561362B1 (en) 2017-09-29 2023-07-28 루머스 리미티드 augmented reality display
US11099404B2 (en) 2017-09-29 2021-08-24 Google Llc Systems, devices, and methods for embedding a holographic optical element in an eyeglass lens
CN111133362B (en) 2017-10-22 2021-12-28 鲁姆斯有限公司 Head-mounted augmented reality device employing optical bench
CN111417883B (en) 2017-12-03 2022-06-17 鲁姆斯有限公司 Optical equipment alignment method
FI129113B (en) * 2017-12-22 2021-07-15 Dispelix Oy Waveguide display and display element with novel grating configuration
CN110915210B (en) 2018-01-02 2021-10-15 鲁姆斯有限公司 Augmented reality display with active alignment and corresponding method
US10551544B2 (en) 2018-01-21 2020-02-04 Lumus Ltd. Light-guide optical element with multiple-axis internal aperture expansion
JP6956887B2 (en) * 2018-02-09 2021-11-02 ビュージックス コーポレーションVuzix Corporation Image light guide with circularly polarized light
KR20200140349A (en) 2018-04-08 2020-12-15 루머스 리미티드 Optical sample characterization
WO2019226269A2 (en) 2018-04-24 2019-11-28 Mentor Acquisition One, Llc See-through computer display systems with vision correction and increased content density
TW201947264A (en) 2018-05-14 2019-12-16 以色列商魯姆斯有限公司 Projector configuration with subdivided optical aperture for near-eye displays, and corresponding optical systems
CN112119344B (en) 2018-05-17 2023-01-20 鲁姆斯有限公司 Near-eye display with overlapping projector assemblies
IL259518B2 (en) 2018-05-22 2023-04-01 Lumus Ltd Optical system and method for improvement of light field uniformity
TWI813691B (en) 2018-05-23 2023-09-01 以色列商魯姆斯有限公司 Optical system including light-guide optical element with partially-reflective internal surfaces
IL279500B (en) 2018-06-21 2022-09-01 Lumus Ltd Measurement technique for refractive index inhomogeneity between plates of a lightguide optical element (loe)
WO2020016772A1 (en) 2018-07-16 2020-01-23 Lumus Ltd. Light-guide optical element employing polarized internal reflectors
AU2019335612A1 (en) 2018-09-09 2021-04-08 Lumus Ltd. Optical systems including light-guide optical elements with two-dimensional expansion
TWI668471B (en) * 2018-09-14 2019-08-11 量子光電股份有限公司 Head mounted display and optical device thereof
CN113168017A (en) * 2018-09-21 2021-07-23 谷歌有限责任公司 Optical combination lens for wearable head-up display
WO2020061541A1 (en) * 2018-09-21 2020-03-26 Dolby Laboratories Licensing Corporation Incorporating components inside optical stacks of head-mounted devices
TW202026685A (en) 2018-11-08 2020-07-16 以色列商魯姆斯有限公司 Light-guide display with reflector
US11947130B2 (en) 2018-11-08 2024-04-02 Lumus Ltd. Optical devices and systems with dichroic beamsplitter color combiner
TWM598414U (en) 2018-11-11 2020-07-11 以色列商魯姆斯有限公司 Near eye display with intermediate window
KR20200069799A (en) * 2018-12-07 2020-06-17 엘지디스플레이 주식회사 Fordable display device
CN109445109A (en) * 2018-12-26 2019-03-08 深圳珑璟光电技术有限公司 A kind of light-transmitting plate
CN110146980A (en) * 2018-12-29 2019-08-20 深圳珑璟光电技术有限公司 A kind of substrate-guided optical device
KR20200084498A (en) * 2019-01-02 2020-07-13 삼성디스플레이 주식회사 Device for providing augmented reality
EP3911982B1 (en) * 2019-01-20 2023-07-05 Lumus Ltd. Optical device testing method and apparatus
US10983264B2 (en) 2019-01-24 2021-04-20 Lumus Ltd. Optical systems including light-guide optical elements with two-dimensional expansion
IL264551B1 (en) * 2019-01-29 2024-05-01 Oorym Optics Ltd Highly efficient compact head-mounted display system having small input aperture
JP7398131B2 (en) 2019-03-12 2023-12-14 ルムス エルティーディー. image projector
US10928639B2 (en) * 2019-03-29 2021-02-23 Intel Corporation Thin, multi-focal plane, augmented reality eyewear
WO2020232170A1 (en) * 2019-05-14 2020-11-19 Arizona Board Of Regents On Behalf Of The University Of Arizona A light combiner employing a curved waveguide system
US10775626B1 (en) * 2019-05-16 2020-09-15 Rockwell Collins, Inc. Wide field of view head worn display device
CN110187507A (en) * 2019-05-28 2019-08-30 深圳市思坦科技有限公司 A kind of nearly optics of the eye display device
CA3137994A1 (en) 2019-06-27 2020-12-30 Lumus Ltd Apparatus and methods for eye tracking based on eye imaging via a light-guide optical element
US20220357496A1 (en) * 2019-07-18 2022-11-10 Lumus Ltd. Encapsulated light-guide optical element
FR3102571A1 (en) * 2019-10-25 2021-04-30 Valeo Comfort And Driving Assistance Method and device for manufacturing a reflective optical part for a head-up display
US11156699B2 (en) * 2019-10-29 2021-10-26 Waymo Llc Multilayer optical devices and systems
KR102622406B1 (en) 2019-11-25 2024-01-05 루머스 리미티드 How to polish the surface of a waveguide
IL270991B (en) 2019-11-27 2020-07-30 Lumus Ltd Lightguide optical element for polarization scrambling
JP7396738B2 (en) 2019-12-05 2023-12-12 ルーマス リミテッド Light-guiding optics with complementary coating partial reflectors and light-guiding optics with reduced light scattering
KR20240059655A (en) 2019-12-08 2024-05-07 루머스 리미티드 Optical systems with compact image projector
US11237412B1 (en) 2019-12-17 2022-02-01 Snap Inc. Antenna implementation embedded in optical waveguide module
CN114846400A (en) * 2019-12-19 2022-08-02 鲁姆斯有限公司 Image projector using phase image generator
TWI740355B (en) * 2020-01-20 2021-09-21 尚立光電股份有限公司 Light-guide optical element
TWI718054B (en) * 2020-04-23 2021-02-01 宏碁股份有限公司 Optical device combining spectacle function with augmented reality function and augmented reality device
CN113703173B (en) * 2020-05-20 2023-08-15 宏碁股份有限公司 Optical device combining glasses function and augmented reality device
JP2021184050A (en) * 2020-05-22 2021-12-02 株式会社日立エルジーデータストレージ Image display device, and head-mounted display
US20220269081A1 (en) * 2020-05-27 2022-08-25 Google Llc Freeform lens with integrated lightguide and method of manufacture
DE202021104723U1 (en) 2020-09-11 2021-10-18 Lumus Ltd. Image projector coupled to an optical light guide element
FI130396B (en) * 2020-09-23 2023-08-10 Dispelix Oy Optical Waveguide for Augmented Reality Display
CN112287584A (en) * 2020-10-30 2021-01-29 西北工业大学 Ultrathin slab waveguide device and design method thereof
CN114793448A (en) * 2020-11-23 2022-07-26 瑞仪光电(苏州)有限公司 Optical element, image waveguide method, head-mounted display device, and diffraction waveguide display
EP4162314A4 (en) 2021-02-25 2023-11-22 Lumus Ltd. Optical aperture multipliers having a rectangular waveguide
CN116635773A (en) 2021-03-01 2023-08-22 鲁姆斯有限公司 Optical system with compact coupling from projector into waveguide
US20220342219A1 (en) * 2021-04-26 2022-10-27 Meta Platforms Technologies, Llc Apparatus, system, and method for disposing photonic integrated circuits on surfaces
IL309418A (en) * 2021-06-15 2024-02-01 Lumus Ltd Encapsulated light-guide optical elements for near eye display
KR20230156802A (en) 2021-07-04 2023-11-14 루머스 리미티드 Display with stacked light guiding elements providing different parts of the field of view
TW202326231A (en) * 2021-08-30 2023-07-01 美商元平台技術有限公司 Ophthalmic lens with embedded dimmer
US11808985B2 (en) * 2021-10-12 2023-11-07 Himax Technologies Limited Waveguide combiner with light beam processing area
WO2023114503A2 (en) * 2021-12-17 2023-06-22 Magic Leap, Inc. Shaped color- absorbing regions for waveguides
CN115453678B (en) * 2022-01-30 2023-08-29 珠海莫界科技有限公司 Optical combiner and display device

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3219943B2 (en) 1994-09-16 2001-10-15 株式会社東芝 Planar direct-view display device
US20050024849A1 (en) 1999-02-23 2005-02-03 Parker Jeffery R. Methods of cutting or forming cavities in a substrate for use in making optical films, components or wave guides
PL209571B1 (en) 2000-06-05 2011-09-30 Lumus Ltd Substrate-guided optical beam expander
IL148804A (en) 2002-03-21 2007-02-11 Yaacov Amitai Optical device
JP4029662B2 (en) 2002-05-17 2008-01-09 ソニー株式会社 Image display device
IL157836A (en) 2003-09-10 2009-08-03 Yaakov Amitai Optical devices particularly for remote viewing applications
IL157837A (en) 2003-09-10 2012-12-31 Yaakov Amitai Substrate-guided optical device particularly for three-dimensional displays
IL162572A (en) 2004-06-17 2013-02-28 Lumus Ltd High brightness optical device
IL163361A (en) 2004-08-05 2011-06-30 Lumus Ltd Optical device for light coupling into a guiding substrate
WO2006064301A1 (en) * 2004-12-13 2006-06-22 Nokia Corporation System and method for beam expansion with near focus in a display device
US7724443B2 (en) 2005-02-10 2010-05-25 Lumus Ltd. Substrate-guided optical device utilizing thin transparent layer
WO2006085310A1 (en) 2005-02-10 2006-08-17 Lumus Ltd. Substrate-guided optical device particularly for vision enhanced optical systems
EP1848966A1 (en) 2005-02-17 2007-10-31 Lumus Ltd Personal navigation system
US8187481B1 (en) 2005-05-05 2012-05-29 Coho Holdings, Llc Random texture anti-reflection optical surface treatment
IL171820A (en) 2005-11-08 2014-04-30 Lumus Ltd Polarizing optical device for light coupling
IL173715A0 (en) 2006-02-14 2007-03-08 Lumus Ltd Substrate-guided imaging lens
IL177618A (en) 2006-08-22 2015-02-26 Lumus Ltd Substrate- guided optical device
CN101529156B (en) * 2006-10-16 2012-03-21 皇家飞利浦电子股份有限公司 Lighting device
US20080151375A1 (en) 2006-12-26 2008-06-26 Ching-Bin Lin Light guide means as dually effected by light concentrating and light diffusing
US7530721B2 (en) * 2007-04-18 2009-05-12 Skc Haas Display Films Co., Ltd. Double-sided turning film
EP2142953B1 (en) 2007-04-22 2019-06-05 Lumus Ltd A collimating optical device and system
IL183637A (en) 2007-06-04 2013-06-27 Zvi Lapidot Distributed head-mounted display
US8414304B2 (en) * 2008-08-19 2013-04-09 Plextronics, Inc. Organic light emitting diode lighting devices
WO2010124028A2 (en) 2009-04-21 2010-10-28 Vasylyev Sergiy V Light collection and illumination systems employing planar waveguide
US20100291489A1 (en) * 2009-05-15 2010-11-18 Api Nanofabrication And Research Corp. Exposure methods for forming patterned layers and apparatus for performing the same
TW201115231A (en) * 2009-10-28 2011-05-01 Coretronic Corp Backlight module
JP2013525955A (en) * 2010-04-16 2013-06-20 フレックス ライティング 2,エルエルシー Lighting device with film-based light guide
US9028123B2 (en) * 2010-04-16 2015-05-12 Flex Lighting Ii, Llc Display illumination device with a film-based lightguide having stacked incident surfaces
JP2010217906A (en) 2010-04-20 2010-09-30 Panasonic Corp Liquid crystal display
JP2012123936A (en) * 2010-12-06 2012-06-28 Omron Corp Plane light source device, and three-dimensional display device
EP2656135B1 (en) * 2010-12-24 2022-05-04 Magic Leap, Inc. Freeform waveguide prism
US8873148B1 (en) * 2011-12-12 2014-10-28 Google Inc. Eyepiece having total internal reflection based light folding
US8848289B2 (en) * 2012-03-15 2014-09-30 Google Inc. Near-to-eye display with diffractive lens
IL219907A (en) 2012-05-21 2017-08-31 Lumus Ltd Head-mounted display eyeball tracker integrated system
US20140146394A1 (en) * 2012-11-28 2014-05-29 Nigel David Tout Peripheral display for a near-eye display device
DE102012224352A1 (en) * 2012-12-21 2014-06-26 Continental Automotive Gmbh Electro-optical display with a transparent cover
CA2931776A1 (en) * 2013-11-27 2015-06-04 Magic Leap, Inc. Virtual and augmented reality systems and methods
US9474902B2 (en) 2013-12-31 2016-10-25 Nano Retina Ltd. Wearable apparatus for delivery of power to a retinal prosthesis
US9423552B2 (en) * 2014-02-24 2016-08-23 Google Inc. Lightguide device with outcoupling structures
JP6746282B2 (en) * 2014-07-09 2020-08-26 恵和株式会社 Optical sheet, edge light type backlight unit, and method for manufacturing optical sheet
IL235642B (en) * 2014-11-11 2021-08-31 Lumus Ltd Compact head-mounted display system protected by a hyperfine structure
CN104597602A (en) * 2015-01-24 2015-05-06 上海理湃光晶技术有限公司 Efficiently coupled tooth embedded slab guide optical element in compact structure

Also Published As

Publication number Publication date
IL262566A (en) 2018-12-31
KR20190008311A (en) 2019-01-23
IL262566B (en) 2020-11-30
TWI712821B (en) 2020-12-11
KR102549713B1 (en) 2023-06-29
US20190278086A1 (en) 2019-09-12
EP3458898A4 (en) 2020-03-11
CN109154720A (en) 2019-01-04
US10739598B2 (en) 2020-08-11
WO2017199232A1 (en) 2017-11-23
EP3458898A1 (en) 2019-03-27
TW201805692A (en) 2018-02-16
JP2019517018A (en) 2019-06-20
JP6740366B2 (en) 2020-08-12

Similar Documents

Publication Publication Date Title
EP3458898B1 (en) Head-mounted imaging device
US10782532B2 (en) Compact head-mounted display system protected by a hyperfine structure
EP2740004B1 (en) Method and apparatus for a near-to-eye display
KR102578625B1 (en) Substrate-guided optical device
US8743464B1 (en) Waveguide with embedded mirrors
US8848289B2 (en) Near-to-eye display with diffractive lens
US8867131B1 (en) Hybrid polarizing beam splitter
US20180329208A1 (en) Light guide and virtual image display device
US9389422B1 (en) Eyepiece for head wearable display using partial and total internal reflections
CN219349182U (en) Optical waveguide and near-to-eye display device
WO2023205123A1 (en) Low stress loca additive and loca processing for bonding optical substrates

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20181211

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

RIN1 Information on inventor provided before grant (corrected)

Inventor name: OFIR, YUVAL

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20200207

RIC1 Information provided on ipc code assigned before grant

Ipc: G02B 27/01 20060101AFI20200203BHEP

Ipc: G02B 6/24 20060101ALI20200203BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20221116

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016077887

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1548526

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230315

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20230215

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230527

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1548526

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230215

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230615

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230515

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230526

Year of fee payment: 8

Ref country code: DE

Payment date: 20230519

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230615

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230516

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230524

Year of fee payment: 8

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602016077887

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

26N No opposition filed

Effective date: 20231116

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230215

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230518

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230531

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230531

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230518