WO2015157016A1 - Head mounted display and low conspicuity pupil illuminator - Google Patents
Head mounted display and low conspicuity pupil illuminator Download PDFInfo
- Publication number
- WO2015157016A1 WO2015157016A1 PCT/US2015/023000 US2015023000W WO2015157016A1 WO 2015157016 A1 WO2015157016 A1 WO 2015157016A1 US 2015023000 W US2015023000 W US 2015023000W WO 2015157016 A1 WO2015157016 A1 WO 2015157016A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- reflector
- head
- eye
- retarder
- tracking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0149—Head-up displays characterised by mechanical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/14—Beam splitting or combining systems operating by reflection only
- G02B27/141—Beam splitting or combining systems operating by reflection only using dichroic mirrors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/30—Polarising elements
- G02B5/3083—Birefringent or phase retarding elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Definitions
- a major trend in wearable devices is not only providing data to a user, but also sensing important information from a user.
- the user's eyes can provide critical information to help the user navigate through screens, monitor the health and alertness of the user, and provide feedback on reactions of the user to different sources of information.
- Eye monitoring commonly requires illumination sources, typically infrared lights, to be positioned in front of the eye. This front illumination adds devices and electrical connections to a highly visible part of eyewear, often limiting design aesthetics.
- the electrical connections can often pass through the hinge of the eyewear, and can result in the hinge becoming stiffer, reducing the reliability of the electrical connection, or both.
- the present disclosure provides for an optical element useful in an optical device for illuminating the pupil of an eye, particularly for use with a head mountable display that can include eye-tracking.
- the optical device includes a light source and an optical element that transmits light, where light emitted from the light source is directed by the optical element toward the pupil of the eye, and attributes of the eye can then be detected by an optical sensor such as a camera.
- the light source can emit infrared light that is not visible to the human eye, so that world view images and/or combined digital images of the head-mountable display are not compromised.
- the present disclosure provides an optical element that includes a lens having a concave first major surface, an opposing second major surface, and an embedded reflector disposed therebetween; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; and a retarder between the reflective polarizer and the embedded reflector, the retarder having a fast axis aligned at a retarder angle to the first polarization direction,.
- the present disclosure provides a head-mountable display that includes a lens having a concave first major surface, an opposing second major surface, and an embedded reflector disposed therebetween; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; and a retarder between the concave first major surface and the reflective polarizer, the retarder having a fast axis aligned at a retarder angle to the first polarization direction.
- the head-mountable display further includes an image forming device positioned to project an image light beam toward the concave first major surface, the image light beam comprising light polarized in the first polarization direction, wherein at least a portion of the image light beam is capable of being directed toward an eye disposed adjacent the image forming device.
- the present disclosure provides a head-mountable tracking device that includes a lens having a concave first major surface and an opposing second major surface; a partial reflector disposed adjacent to the concave first major surface; an illuminator positioned to project a light beam toward the partial reflector, a portion of the light beam reflected by the partial reflector and capable of illuminating an eye positioned adjacent the illuminator; and an image receiving device positioned adjacent the illuminator and capable of receiving an image of the illuminated eye reflected from the partial reflector.
- the present disclosure provides a tracking head-mountable display that includes a lens having a concave first major surface, an opposing second major surface, and an embedded reflector; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; and a retarder between the concave first major surface and the reflective polarizer, the retarder having a fast axis aligned at a retarder angle to the first polarization direction.
- the tracking head-mountable display further includes an image forming device positioned to project an image light beam toward the concave first major surface, the image light beam comprising light polarized in the first polarization direction, wherein at least a portion of the image light beam is capable of being directed toward an eye disposed adjacent the image forming device; an illuminator positioned adjacent the image forming device, capable of projecting an illuminator light beam toward the reflective polarizer; and an image receiving device positioned adjacent the illuminator; wherein the reflective polarizer, the retarder, and the embedded reflector together are capable of illuminating the eye positioned adjacent the illuminator, the image receiving device being capable of receiving an image of the illuminated eye.
- FIG. 1A shows a schematic cross-sectional view of a head mountable display system
- FIG. IB shows a schematic cross-sectional view of an optical element of FIG. 1A
- FIG. 2 shows a schematic cross-sectional view of a head-mountable tracking device
- FIG. 3 shows a schematic cross-sectional view of a head-mountable tracking device
- FIG. 4 shows a schematic cross-sectional view of a head-mountable tracking device
- FIG. 5 shows a schematic cross-sectional view of a head-mountable tracking device
- FIG. 6 shows a perspective view of a head-mounted tracking display system.
- the figures are not necessarily to scale.
- Like numbers used in the figures refer to like components. However, it will be understood that the use of a number to refer to a component in a given figure is not intended to limit the component in another figure labeled with the same number. Detailed Description
- the present disclosure provides for an optical element useful in an optical device for illuminating the pupil of an eye, particularly for use with a head mountable display that can include eye-tracking.
- the optical device includes a light source and an optical element that transmits light, where light emitted from the light source is directed by the optical element toward the pupil of the eye, and attributes of the eye can then be detected by an optical sensor such as a camera.
- the light source can emit infrared light that is not visible to the human eye, so that world view images and/or combined digital images of the head-mountable display are not compromised.
- an element, component or layer for example when an element, component or layer for example is described as forming a "coincident interface" with, or being “on” “connected to,” “coupled with” or “in contact with” another element, component or layer, it can be directly on, directly connected to, directly coupled with, in direct contact with, or intervening elements, components or layers may be on, connected, coupled or in contact with the particular element, component or layer, for example.
- an element, component or layer for example is referred to as being “directly on,” “directly connected to,” “directly coupled with,” or “directly in contact with” another element, there are no intervening elements, components or layers for example.
- Combining or "combiner" near-eye displays generally rely on the use of optics to both transmit the real world view to the user, and also project a secondary (e.g., digital) image to the eye.
- a secondary (e.g., digital) image may be used to the eye.
- One type of combiner display may use a partial mirror, such as a 50% visible light transmission
- VLT VLT
- Another type of combiner display may use a reflective or weakly reflective polarizer which can nearly fully transmit one polarization state of the world view to the user and also nearly fully (or at least partially) reflect a polarized secondary image to the user.
- Another type of combiner display may use a dichroic, "notch", or “comb” type reflector which can reflect a band of wavelengths of light (e.g., a first wavelength range of light) to a certain extent but also transmit other bands of wavelengths (e.g., second or more wavelength range of light) or partially transmit the reflection band of wavelengths.
- a head-mountable display as provided herein is capable of transmitting a view of the real world to the user's eye(s) while also reflecting or transmitting a secondary image, such as one produced via a digital display.
- an optical element such as a lens includes a coating or film that has a dichroic, "notched", or “comb” type transmission and reflection profile.
- the optical element includes a reflective polarizer that reflects one polarization state (e.g., a first polarization direction) and passes another polarization state (e.g., a second polarization direction orthogonal to the first polarization direction) to varying degrees.
- the optical element may also include retarding layer such as a quarter- wave retarder.
- the shape of the optical element can provide for a magnification of either of the secondary images, the real world view image, or both.
- This transmission/reflection profile of the optical element (whether polarization dependent, wavelength dependent, or independent) enables the user to see, simultaneously, a view of the real world "combined" with the second image based on the wavelengths and/or polarization states of the real world and second image.
- the optical element itself or in combination with another refractive element and/or film and/or coating may provide image magnification based on refraction through and/or reflection from curved surfaces.
- the optical device for illuminating the pupil of an eye, and the image sensor (e.g., camera) for gathering attributes of the eye can be used as a stand-alone eye monitoring device, or it can be used in tandem with the head mounted display.
- the image sensor e.g., camera
- head mounted displays useful with the present invention include, for example, co-pending U.S. Provisional Patent Application Serial No. 61/954,690, filed March 18, 2014 entitled "Low Profile Image Combiner for Near-Eye Displays" and also U.S. Provisional Patent Application Serial No.
- the optical device for illuminating the pupil can be positioned adjacent the digital display for producing the secondary image in the head-mountable display that combines the real-world and secondary image.
- the digital display and the image sensor can be positioned in the same imaging device, further reducing the electronics for use with a head mountable display that can include eye-tracking. It is to be understood that any of the eye illumination and sensing devices described herein can be used with a head-mounted display capable of providing a combined world- view and digital image.
- FIG. 1A shows a schematic cross-sectional view of a head mountable display system 100
- FIG. IB shows schematic cross-sectional view of an optical element of FIG. 1A, according to one aspect of the disclosure.
- Head mounted display 100 includes a frame 140 that can be used to position the head mountable display system on a users head (not shown).
- Frame 140 supports an image source 101, which generates an image with a chief ray 103.
- the image source 101 may include both an image generator 101a and an image sensor 101b such as a camera.
- the image generator 101a can be used to create a secondary image that can be combined with a real world view 150, as described elsewhere.
- the head-mounted display may also include a light source 102 affixed to the frame 140, as described elsewhere.
- the chief ray 103 is directed to an optical element 105 which includes a base lens 1 13 that has a first surface 1 14 bonded to a quarter- wave retarder 109, which is in turn bonded to a linear reflective polarizer 107.
- Optical element 105 is also affixed to the frame 140.
- a first polarization direction of the chief ray is transmitted by the linear reflective polarizer 107, and the linearly polarized light is converted to circularly polarized light ray 1 15 which is reflected by an embedded reflector 11 1 disposed within the base lens 113, between the first surface 1 14 and an opposing second surface.
- the reflected light ray 1 19 has the opposite circular polarization of circularly polarized light ray 1 15.
- Reflected light ray 1 19 is transmitted through the quarter- wave retarder 109, becomes linearly polarized in the second polarization direction orthogonal to the first polarization direction, is reflected by the linear reflective polarizer 107, and is transmitted again through quarter- wave retarder 109, becoming circularly polarized in the opposite direction than reflected light ray 1 19.
- the resulting ray 121 is reflected by reflector 1 1 1 becoming ray 125, again switching direction of circular polarization.
- Ray 125 is transmitted through the quarter- wave retarder 109 and passes through reflective polarizer 107 becoming digital image ray 127 having the first polarization direction.
- Digital image ray 127 is then visible to an eye 129.
- the reflector 1 1 1 may be a partial reflector, and form partially transmitted rays 1 17 and 123. A partial reflector allows the user to see a world-view in combination with the display image, as described elsewhere.
- Quarter- wave retarder 109 is a well known optical device that converts linearly polarized light to circularly polarized light, and circularly polarized light to linearly polarized light.
- suitable material include ZeonorFilm® ZM16-138, available from Zeon Corp, Japan.
- the film is preferably oriented such that the stretch axis of the film is at a 45 degree angle from the block polarization axis of the linear reflective polarizer.
- the retarder can be disposed immediately adjacen the reflective polarizer 107; however, in some cases, the retarder can instead be disposed immediately adjacent the reflector 1 1 1.
- the partial reflector can be a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light, or the partial reflector can be a broadband partial mirror.
- the embedded reflector 1 1 1 can be a curved reflector or a planar reflector.
- FIG. 2 shows a schematic cross-sectional view of a head-mountable tracking device 200, according to one aspect of the disclosure.
- Each of the elements 201-250 shown in FIG. 2 correspond to like-numbered elements 101-150 shown in FIG. 1, which have been described previously.
- frame 240 shown in FIG. 2 corresponds to frame 140 shown in FIG. 1, and so on.
- the head-mountable tracking device 200 shows illumination of the iris of the eye 229 with light, where a light source 202 (also referred to as an illuminator 202) emits light forming ray bundle 204, which then illuminates optical element 205 having a surface with a partial reflector 207.
- a light source 202 also referred to as an illuminator 202
- At least a portion of ray bundle 203 is reflected by partial reflector 207 forming ray bundle 206, which illuminates the iris of the eye 229.
- a camera 201b forms an image of the iris, and the image can be processed to determine one or more attributes of the eye 229.
- These attributes of the eye 229 that can be detected may include one or more of the following: the viewing direction of the eye, diameter and changes in the diameter of the pupil, blinking of the eyelids, the eye tracking objects, and saccade movement.
- Eye tracking parameters may include velocity of the eye rotation and lag or phase between movement of an object and movement of the eye.
- Saccade movement may include duration, velocity, and pattern of the movement.
- the partial reflector 207 may be made from a dichroic coating composed of one or more layers of an optically transparent material, using refractive index differences between the layers and adjacent layers to create reflection.
- the partial reflector may also be made of a thin metallic coating such as aluminum or silver.
- the partial reflector may be made from a reflective polarizer.
- the partial reflector may be curved in one or more directions, or may be flat. Suitable optically transparent materials include silicon monoxide, silicon dioxide, magnesium fluoride, aluminum oxide, hafnium oxide, zirconium oxide, silicon nitride, titanium dioxide, polymer layers, other organic or inorganic materials, and combinations thereof.
- the light source 202 may emit unpolarized light, polarized light, visible light, ultraviolet light, infrared light, or a combination thereof. All or a portion of the light may be linearly or circularly polarized. Using polarized light can change the illumination pattern on the eye (for example allowing either the lighting path shown in FIG. 2, or the lighting path shown below in FIG. 3, or a combination of the two).
- FIG. 3 shows a schematic cross-sectional view of a head-mountable tracking device 300, according to one aspect of the disclosure.
- Each of the elements 301-350 shown in FIG. 3 correspond to like-numbered elements 101-150 shown in FIG. 1, which have been described previously.
- frame 340 shown in FIG. 3 corresponds to frame 140 shown in FIG. 1, and so on.
- a different light path results, in a manner similar to the path of light shown in FIG. 1, and includes reflections of circularly polarized light from a partial reflector 31 1.
- a light source 302 emits light forming a ray bundle 304a, and at least a portion of the ray bundle 304a is transmitted by a reflective polarizer 307.
- the transmitted rays pass through a quarter-wave retarder 309 to a partial reflector 31 1.
- Rays reflected by the partial reflector 31 1 again pass through quarter- wave retarder 309, reflect off the reflective polarizer 307, again pass through the quarter- wave retarder 309, reflect off the partial reflector 311, pass a final time through quarter- wave retarder 309, and pass through the reflective polarizer 307, forming ray bundle 306a, which illuminates the iris of the eye 329.
- FIG. 4 shows a schematic cross-sectional view of a head-mountable tracking device 400, according to one aspect of the disclosure.
- Each of the elements 401-450 shown in FIG. 4 correspond to like-numbered elements 101-150 shown in FIG. 1, which have been described previously.
- frame 440 shown in FIG. 4 corresponds to frame 140 shown in FIG. 1, and so on.
- FIG. 4 shows a variation of the placement of the light source 402.
- the light source 402 may be placed adjacent to the camera 401b, and may be collinear with the center axis of the camera view through the use of a beam splitter (not shown), as known to one of skill in the art.
- Light source 402 emits light forming a ray bundle 404a, and at least a portion of the ray bundle 404a is transmitted by a reflective polarizer 407.
- the transmitted rays pass through a quarter- wave retarder 409 to a partial reflector 41 1.
- Rays reflected by the partial reflector 41 1 again pass through quarter- wave retarder 409, reflect off the reflective polarizer 407, again pass through the quarter- wave retarder 409, reflect off the partial reflector 411, pass a final time through quarter- wave retarder 409, and pass through the reflective polarizer 407, forming ray bundle 406a, which illuminates the iris of the eye 429.
- Multiple light sources 402 may be used, as well as unpolarized light, allowing for example, illumination combining one or more of the ray bundles 206, 306a, or 406a.
- FIG. 5 shows a schematic cross-sectional view of a head-mountable tracking device 500, according to one aspect of the disclosure.
- Each of the elements 501-550 shown in FIG. 5 correspond to like-numbered elements 101-150 shown in FIG. 1, which have been described previously.
- frame 540 shown in FIG. 5 corresponds to frame 140 shown in FIG. 1, and so on.
- FIG. 5 shows another variation, where a light source 502 emits light forming ray bundle 504b, which is reflected by optical element 505 made from a reflective surface 51 lb immersed in lens 513. The reflected light forms ray bundle 506b which illuminates the iris of eye 529. Light reflected by the eye forms rays of light that approximately follow chief ray 503 to camera 501b.
- Reflective surface 51 lb may be a reflective polarizer.
- the reflective polarizer may be made from birefringent polymer optical stacks, such as Advanced Polarizing Film, available from 3M Company, a wire grid polarizer, a cholesteric reflective polarizer, or any other suitable reflective polarizer.
- FIG. 6 shows a perspective view of a head-mounted tracking display system 600, according to one aspect of the disclosure.
- Each of the elements 601-640 and 60 ⁇ -640' shown in FIG. 6 correspond to like-numbered elements 101-140 shown in FIG. 1, which have been described previously.
- frame 640 shown in FIG. 6 corresponds to frame 640 shown in FIG. 1 , and so on.
- Head-mounted tracking display system 600 includes a first image source 601 that is positioned to project an image light toward a first optical element 605, and an optional second image source 60 ⁇ that is positioned to project a second image light toward an optional second optical element 605', as described elsewhere.
- Head-mounted tracking display system 600 further includes a first light source 602 and an optional second light source 602' disposed to project light toward first and second optical elements 605, 605', respectively, as described elsewhere.
- Each of the first and optional optical elements 605, 605'; first and optional second image sources 601, 60 ⁇ ; and first and optional second light sources 602, 602' can be attached to a first and a second frame 640, 640', which may be positioned on the user's head (not shown) similar to a pair of eyeglasses.
- the head-mounted tracking display system 600 further includes a bridge 645 connecting the first and second optical elements 605, 605' together.
- any of the eye-monitoring systems described herein can be combined with near-eye display systems having pellicle reflective elements, such as those described in co-pending U.S. Patent Application having Attorney Docket No. 74975US002 entitled “Near-Eye Display", filed on an even date herewith.
- the eye monitoring attributes that can be detected may include one or more of the following: the viewing direction of the eye, diameter and changes in the diameter of the pupil, blinking of the eyelids, the eye tracking objects, and saccade movement.
- Eye tracking parameters may include velocity of the eye rotation and lag or phase between movement of an object and movement of the eye. Saccade movement may include duration, velocity, and pattern of the movement.
- the described pellicles may be useful for providing the reflective surface for the pupil illuminator and image receiving optics, as well as for providing a reflective surface for the near-eye display, as can be readily understood to those having ordinary skill in the art.
- Item 1 is an optical element, comprising: a lens having a concave first major surface, an opposing second major surface, and an embedded reflector disposed therebetween; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; and a retarder between the reflective polarizer and the embedded reflector, the retarder having a fast axis aligned at a retarder angle to the first polarization direction.
- Item 2 is the optical element of item 1, wherein the retarder is disposed immediately adjacent the reflective polarizer.
- Item 3 is the optical element of item 1 or item 2, wherein the retarder is disposed immediately adjacent the embedded reflector.
- Item 4 is the optical element of item 1 to item 3, wherein the retarder is a quarter- wave retarder, and the retarder angle is about 45 degrees.
- Item 5 is the optical element of item 1 to item 4, wherein the embedded reflector comprises a partial reflector.
- Item 6 is the optical element of item 5, wherein the partial reflector comprises a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light.
- Item 7 is the optical element of item 5, wherein the partial reflector comprises a broadband partial mirror.
- Item 8 is the optical element of item 1 to item 7, wherein the embedded reflector is a planar reflector.
- Item 9 is the optical element of item 1 to item 8, wherein the embedded reflector is a curved reflector capable of collimating an incident light beam.
- Item 10 is a head-mountable display, comprising: a lens having a concave first major surface, an opposing second major surface, and an embedded reflector disposed therebetween; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; a retarder between the concave first major surface and the reflective polarizer, the retarder having a fast axis aligned at a retarder angle to the first polarization direction; and an image forming device positioned to project an image light beam toward the concave first major surface, the image light beam comprising light polarized in the first polarization direction, wherein at least a portion of the image light beam is capable of being directed toward an eye disposed adjacent the image forming device.
- Item 1 1 is the head-mountable display of item 10, wherein the retarder is disposed immediately adjacent the reflective polarizer.
- Item 12 is the head-mountable display of item 10 or item 1 1, wherein the retarder is disposed immediately adjacent the embedded reflector.
- Item 13 is the head-mountable display of item 10 to item 12, wherein the retarder is a quarter- wave retarder and the retarder angle is about 45 degrees.
- Item 14 is the head-mountable display of item 10 to item 13, wherein the embedded reflector comprises a partial reflector.
- Item 15 is the head-mountable display of item 14, wherein the partial reflector comprises a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light.
- Item 16 is the head-mountable display of item 14, wherein the partial reflector comprises a broadband partial mirror.
- Item 17 is the head-mountable display of item 10 to item 16, wherein the embedded reflector is a planar reflector.
- Item 18 is the head-mountable display of item 10 to item 17, wherein the embedded reflector is a curved reflector capable of collimating an incident light beam.
- Item 19 is the head-mountable display of item 10 to item 18, further comprising a tracking device disposed to detect a viewing direction of the eye, a diameter of the eye pupil, changes in a diameter of the eye pupil, a blinking of an eyelid, a tracking object of the eye, a saccade eye movement, or combination thereof.
- Item 20 is the head-mountable display of item 19, wherein the tracking device comprises: an illuminator positioned to project a light beam toward the embedded reflector, a portion of the light beam reflected to illuminate the eye positioned adjacent the illuminator; an image receiving device positioned adjacent the illuminator and capable of receiving an image of the illuminated eye.
- the tracking device comprises: an illuminator positioned to project a light beam toward the embedded reflector, a portion of the light beam reflected to illuminate the eye positioned adjacent the illuminator; an image receiving device positioned adjacent the illuminator and capable of receiving an image of the illuminated eye.
- Item 21 is a head-mountable tracking device, comprising: a lens having a concave first major surface and an opposing second major surface; a partial reflector disposed adjacent to the concave first major surface; an illuminator positioned to project a light beam toward the partial reflector, a portion of the light beam reflected by the partial reflector and capable of illuminating an eye positioned adjacent the illuminator; and an image receiving device positioned adjacent the illuminator and capable of receiving an image of the illuminated eye reflected from the partial reflector.
- Item 22 is the head-mountable tracking device of item 21 , wherein the partial reflector comprises a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light.
- the partial reflector comprises a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light.
- Item 23 is the head-mountable tracking device of item 21 or item 22, wherein the partial reflector comprises a broadband partial mirror.
- Item 24 is the head-mountable tracking device of item 21 to item 23, wherein the partial reflector comprises a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface.
- Item 25 is the head-mountable tracking device of item 21 to item 24, wherein the image receiving device is capable of detecting a viewing direction of the eye, a diameter of the eye pupil, changes in a diameter of the eye pupil, a blinking of an eyelid, a tracking object of the eye, a saccade eye movement, or combination thereof.
- Item 26 is a tracking head-mountable display, comprising: a lens having a concave first major surface, an opposing second major surface, and an embedded reflector; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; a retarder between the concave first major surface and the reflective polarizer, the retarder having a fast axis aligned at a retarder angle to the first polarization direction; an image forming device positioned to project an image light beam toward the concave first major surface, the image light beam comprising light polarized in the first polarization direction, wherein at least a portion of the image light beam is capable of being directed toward an eye disposed adjacent the image forming device; an illuminator positioned adjacent the image forming device, capable of projecting an illuminator light beam toward the reflective polarizer; and an image receiving device positioned adjacent the illuminator; wherein the reflective polarizer, the retarder, and the embedded reflector together are
- Item 27 is the tracking head-mountable display of item 26, wherein the retarder is disposed immediately adjacent the reflective polarizer.
- Item 28 is the tracking head-mountable display of item 26 or item 27, wherein the retarder is disposed immediately adjacent the embedded reflector.
- Item 29 is the tracking head-mountable display of item 26 to item 28, wherein the retarder is a quarter-wave retarder and the retarder angle is about 45 degrees.
- Item 30 is the tracking head-mountable display of item 26 to item 29, wherein the embedded reflector comprises a partial reflector.
- Item 31 is the tracking head-mountable display of item 30, wherein the partial reflector comprises a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light.
- the partial reflector comprises a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light.
- Item 32 is the tracking head-mountable display of item 30, wherein the partial reflector comprises a broadband partial mirror.
- Item 33 is the tracking head-mountable display of item 26 to item 32, wherein the embedded reflector is a planar reflector.
- Item 34 is the tracking head-mountable display of item 26 to item 33, wherein the embedded reflector is a curved reflector capable of collimating an incident light beam.
- Item 35 is the tracking head-mountable display of item 26 to item 34, wherein the illuminator light beam comprises a polarized light beam aligned to the first polarization direction.
- Item 36 is the tracking head-mountable display of item 26 to item 35, wherein image of the illuminated eye comprises a viewing direction of the eye, a diameter of the eye pupil, changes in a diameter of the eye pupil, a blinking of an eyelid, a tracking object of the eye, a saccade eye movement, and combination thereof.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Eyeglasses (AREA)
Priority Applications (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2016561813A JP6637440B2 (ja) | 2014-04-09 | 2015-03-27 | ヘッドマウントディスプレイ及び目立ちにくい瞳孔イルミネーター |
| EP15776789.8A EP3129822A4 (en) | 2014-04-09 | 2015-03-27 | Head mounted display and low conspicuity pupil illuminator |
| US15/127,040 US10545340B2 (en) | 2014-04-09 | 2015-03-27 | Head mounted display and low conspicuity pupil illuminator |
| CN201580018377.2A CN106164745B (zh) | 2014-04-09 | 2015-03-27 | 头戴式显示器和低醒目性瞳孔照明器 |
| KR1020167030921A KR20160143749A (ko) | 2014-04-09 | 2015-03-27 | 머리 장착형 디스플레이 및 저 가시성 동공 조명기 |
| US16/745,415 US11675191B2 (en) | 2014-04-09 | 2020-01-17 | Head mounted display and low conspicuity pupil illuminator |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201461977171P | 2014-04-09 | 2014-04-09 | |
| US61/977,171 | 2014-04-09 |
Related Child Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/127,040 A-371-Of-International US10545340B2 (en) | 2014-04-09 | 2015-03-27 | Head mounted display and low conspicuity pupil illuminator |
| US16/745,415 Continuation US11675191B2 (en) | 2014-04-09 | 2020-01-17 | Head mounted display and low conspicuity pupil illuminator |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015157016A1 true WO2015157016A1 (en) | 2015-10-15 |
Family
ID=54288267
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2015/023000 Ceased WO2015157016A1 (en) | 2014-04-09 | 2015-03-27 | Head mounted display and low conspicuity pupil illuminator |
Country Status (6)
| Country | Link |
|---|---|
| US (2) | US10545340B2 (enExample) |
| EP (1) | EP3129822A4 (enExample) |
| JP (1) | JP6637440B2 (enExample) |
| KR (1) | KR20160143749A (enExample) |
| CN (1) | CN106164745B (enExample) |
| WO (1) | WO2015157016A1 (enExample) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10120194B2 (en) | 2016-01-22 | 2018-11-06 | Corning Incorporated | Wide field personal display |
| US10514553B2 (en) | 2015-06-30 | 2019-12-24 | 3M Innovative Properties Company | Polarizing beam splitting system |
| EP3557308A4 (en) * | 2017-02-27 | 2020-01-29 | Alibaba Group Holding Limited | HEAD-MOUNTED DEVICE WITH VIRTUAL REALITY |
| US20200142276A1 (en) * | 2018-11-02 | 2020-05-07 | Gary Sharp Innovations, Llc | Compact polarization-based multi-pass optical architectures |
| JP2020522010A (ja) * | 2017-05-29 | 2020-07-27 | アイウェイ ビジョン リミテッドEyeWay Vision Ltd. | 焦点合わせ管理を伴う眼の投影システム、及び、方法 |
| CN111665622A (zh) * | 2019-03-06 | 2020-09-15 | 株式会社理光 | 光学装置、视网膜投影显示装置、头部安装型显示装置 |
| US10976551B2 (en) | 2017-08-30 | 2021-04-13 | Corning Incorporated | Wide field personal display device |
| CN114072717A (zh) * | 2019-06-27 | 2022-02-18 | 鲁姆斯有限公司 | 基于经由光导光学元件对眼睛成像来进行眼睛追踪的设备和方法 |
| US12130436B2 (en) | 2019-05-03 | 2024-10-29 | 3M Innovative Properties Company | Optical system |
Families Citing this family (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10206568B2 (en) * | 2014-05-23 | 2019-02-19 | Natus Medical Incorporated | Head mountable device for measuring eye movement |
| EP3434069B1 (en) * | 2016-03-21 | 2020-02-19 | Koninklijke Philips N.V. | An adaptive lighting system for a mirror component and a method of controlling an adaptive lighting system |
| US10444511B2 (en) * | 2016-11-16 | 2019-10-15 | Lumens Co., Ltd. | Head-mounted display apparatuses |
| CN106773038A (zh) * | 2016-12-06 | 2017-05-31 | 栗明 | 一种基于视觉追踪的头戴显示设备的红外灯透射装置 |
| US10545347B2 (en) * | 2017-02-23 | 2020-01-28 | Google Llc | Compact eye tracking using folded display optics |
| US10521658B2 (en) * | 2017-07-07 | 2019-12-31 | Facebook Technologies, Llc | Embedded eye tracker with dichroic mirror |
| US10788677B2 (en) | 2017-10-03 | 2020-09-29 | Facebook Technologies, Llc | Fresnel assembly for light redirection in eye tracking systems |
| US10845594B1 (en) | 2017-12-21 | 2020-11-24 | Facebook Technologies, Llc | Prism based light redirection system for eye tracking systems |
| CN108398788B (zh) * | 2018-03-23 | 2024-04-16 | 京东方科技集团股份有限公司 | 眼睛跟踪装置及虚拟现实成像设备 |
| US10585477B1 (en) * | 2018-04-05 | 2020-03-10 | Facebook Technologies, Llc | Patterned optical filter for eye tracking |
| US20200041790A1 (en) * | 2018-08-02 | 2020-02-06 | Google Llc | Catadioptric freeform head mounted display |
| EP3627194B1 (en) | 2018-09-20 | 2025-09-17 | Essilor International | An optical device with reduced reflection in deep red, near infrared and visible ranges |
| US11500185B2 (en) | 2018-11-09 | 2022-11-15 | Meta Platforms Technologies, Llc | Catadioptric and refractive optical structures for beam shaping |
| CN110426853B (zh) * | 2019-07-31 | 2020-10-16 | 华为技术有限公司 | 镜片和头戴式显示装置 |
| CN112578556B (zh) * | 2019-09-27 | 2023-02-21 | 托比股份公司 | 用于减少来自光学装置的不合需的反射的眼睛跟踪系统 |
| KR102570187B1 (ko) | 2019-09-30 | 2023-08-25 | 주식회사 엘지화학 | 헤드 마운티드 디스플레이 |
| US11108977B1 (en) * | 2020-02-20 | 2021-08-31 | Facebook Technologies, Llc | Dual wavelength eye imaging |
| US11269131B2 (en) * | 2020-03-16 | 2022-03-08 | Facebook Technologies, Llc | Liquid crystal reflective polarizer and pancake lens assembly having the same |
| CN111474715A (zh) * | 2020-04-23 | 2020-07-31 | 歌尔股份有限公司 | 光学系统及增强现实设备 |
| US11662583B2 (en) * | 2020-10-15 | 2023-05-30 | Google Llc | Optical combiner with integrated prescription optical correction and method of manufacturing the same |
| KR102803339B1 (ko) | 2020-11-10 | 2025-05-07 | 삼성전자주식회사 | 디스플레이를 포함하는 웨어러블 전자 장치 |
| CN114563871B (zh) * | 2020-11-27 | 2023-04-11 | 华为技术有限公司 | 眼动追踪装置及电子设备 |
| CN113671709B (zh) * | 2021-08-04 | 2022-11-01 | 歌尔光学科技有限公司 | 光学系统和头戴显示设备 |
| CN113671707B (zh) * | 2021-08-04 | 2023-04-25 | 歌尔光学科技有限公司 | 光学系统和头戴显示设备 |
| CN117148580A (zh) * | 2023-08-15 | 2023-12-01 | 歌尔光学科技有限公司 | 光学模组以及头戴显示设备 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6384982B1 (en) * | 1996-10-08 | 2002-05-07 | The Microoptical Corporation | Compact image display system for eyeglasses or other head-borne frames |
| US20080278812A1 (en) * | 2005-11-08 | 2008-11-13 | Lumus Ltd. | Polarizing Optical System |
| US20120086907A1 (en) * | 2007-10-11 | 2012-04-12 | RealD, INC. | Curved retarder based optical filters and eyewear |
| US20130222384A1 (en) * | 2010-11-08 | 2013-08-29 | Seereal Technologies S.A. | Display device, in particular a head-mounted display, based on temporal and spatial multiplexing of hologram tiles |
| KR20140017735A (ko) * | 2012-07-31 | 2014-02-12 | 인텔렉추얼디스커버리 주식회사 | 착용형 전자 장치 및 그의 제어 방법 |
Family Cites Families (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5654827A (en) * | 1992-11-26 | 1997-08-05 | Elop Electrooptics Industries Ltd. | Optical system |
| JPH08122642A (ja) * | 1994-10-26 | 1996-05-17 | Olympus Optical Co Ltd | 光学系 |
| US5715023A (en) * | 1996-04-30 | 1998-02-03 | Kaiser Electro-Optics, Inc. | Plane parallel optical collimating device employing a cholesteric liquid crystal |
| US5982555A (en) | 1998-01-20 | 1999-11-09 | University Of Washington | Virtual retinal display with eye tracking |
| US6075651A (en) * | 1999-01-28 | 2000-06-13 | Kaiser Electro-Optics, Inc. | Compact collimating apparatus |
| JP2003504663A (ja) * | 1999-07-02 | 2003-02-04 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | ヘッドマウントディスプレイ |
| US6853491B1 (en) * | 2003-11-26 | 2005-02-08 | Frank Ruhle | Collimating optical member for real world simulation |
| DE102005062847A1 (de) | 2005-12-23 | 2007-07-05 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Okularsystem |
| JP2007286317A (ja) * | 2006-04-17 | 2007-11-01 | Nikon Corp | 装着型ディスプレイ装置 |
| US20070273970A1 (en) * | 2006-05-26 | 2007-11-29 | Creative Display Systems, Llc | Wide field of view, compact collimating apparatus |
| TW200819899A (en) | 2006-07-31 | 2008-05-01 | 3M Innovative Properties Co | Combination camera/projector system |
| WO2008129539A2 (en) * | 2007-04-22 | 2008-10-30 | Lumus Ltd. | A collimating optical device and system |
| JP2009157634A (ja) | 2007-12-26 | 2009-07-16 | Fuji Xerox Co Ltd | 照射制御装置、照射制御プログラム、視線分析システム |
| US8531394B2 (en) | 2010-07-23 | 2013-09-10 | Gregory A. Maltz | Unitized, vision-controlled, wireless eyeglasses transceiver |
| JP2012053342A (ja) | 2010-09-02 | 2012-03-15 | Sony Corp | 表示装置 |
| JP5664031B2 (ja) * | 2010-09-02 | 2015-02-04 | ソニー株式会社 | 表示装置 |
| JP2012058599A (ja) | 2010-09-10 | 2012-03-22 | Sony Corp | 立体画像表示装置および画像表示素子 |
| JP2012063704A (ja) | 2010-09-17 | 2012-03-29 | Sony Corp | 表示装置 |
| US8970452B2 (en) | 2011-11-02 | 2015-03-03 | Google Inc. | Imaging method |
| US8929589B2 (en) | 2011-11-07 | 2015-01-06 | Eyefluence, Inc. | Systems and methods for high-resolution gaze tracking |
| US8955973B2 (en) | 2012-01-06 | 2015-02-17 | Google Inc. | Method and system for input detection using structured light projection |
| BR112014018154A8 (pt) | 2012-01-24 | 2017-07-11 | Univ Arizona | Visor de monitoramento ocular montado na cabeça |
| US9001030B2 (en) | 2012-02-15 | 2015-04-07 | Google Inc. | Heads up display |
| US9244528B2 (en) | 2012-04-05 | 2016-01-26 | Lc Technologies, Inc. | Gaze based communications for locked-in hospital patients |
| US8937591B2 (en) | 2012-04-06 | 2015-01-20 | Apple Inc. | Systems and methods for counteracting a perceptual fading of a movable indicator |
| US20140240843A1 (en) * | 2013-02-28 | 2014-08-28 | Joel S. Kollin | Near-eye display system |
| EP3014334B1 (en) * | 2013-06-27 | 2017-08-02 | CY Vision Inc. | Image display device in the form of a pair of eye glasses |
| US11227294B2 (en) * | 2014-04-03 | 2022-01-18 | Mentor Acquisition One, Llc | Sight information collection in head worn computing |
| EP3260892A1 (en) | 2014-03-18 | 2017-12-27 | 3M Innovative Properties Company | Optic |
| US10642044B2 (en) | 2014-04-09 | 2020-05-05 | 3M Innovative Properties Company | Near-eye display system having a pellicle as a combiner |
-
2015
- 2015-03-27 WO PCT/US2015/023000 patent/WO2015157016A1/en not_active Ceased
- 2015-03-27 CN CN201580018377.2A patent/CN106164745B/zh active Active
- 2015-03-27 US US15/127,040 patent/US10545340B2/en active Active
- 2015-03-27 KR KR1020167030921A patent/KR20160143749A/ko not_active Ceased
- 2015-03-27 JP JP2016561813A patent/JP6637440B2/ja active Active
- 2015-03-27 EP EP15776789.8A patent/EP3129822A4/en not_active Withdrawn
-
2020
- 2020-01-17 US US16/745,415 patent/US11675191B2/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6384982B1 (en) * | 1996-10-08 | 2002-05-07 | The Microoptical Corporation | Compact image display system for eyeglasses or other head-borne frames |
| US20080278812A1 (en) * | 2005-11-08 | 2008-11-13 | Lumus Ltd. | Polarizing Optical System |
| US20120086907A1 (en) * | 2007-10-11 | 2012-04-12 | RealD, INC. | Curved retarder based optical filters and eyewear |
| US20130222384A1 (en) * | 2010-11-08 | 2013-08-29 | Seereal Technologies S.A. | Display device, in particular a head-mounted display, based on temporal and spatial multiplexing of hologram tiles |
| KR20140017735A (ko) * | 2012-07-31 | 2014-02-12 | 인텔렉추얼디스커버리 주식회사 | 착용형 전자 장치 및 그의 제어 방법 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3129822A4 * |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11693243B2 (en) | 2015-06-30 | 2023-07-04 | 3M Innovative Properties Company | Polarizing beam splitting system |
| US10514553B2 (en) | 2015-06-30 | 2019-12-24 | 3M Innovative Properties Company | Polarizing beam splitting system |
| US11061233B2 (en) | 2015-06-30 | 2021-07-13 | 3M Innovative Properties Company | Polarizing beam splitter and illuminator including same |
| US10649210B2 (en) | 2016-01-22 | 2020-05-12 | Corning Incorporated | Wide field personal display |
| US10120194B2 (en) | 2016-01-22 | 2018-11-06 | Corning Incorporated | Wide field personal display |
| US11442270B2 (en) | 2017-02-27 | 2022-09-13 | Advanced New Technologies Co., Ltd. | Virtual reality head-mounted apparatus with a partial-reflection partial-transmission wedge |
| EP3557308A4 (en) * | 2017-02-27 | 2020-01-29 | Alibaba Group Holding Limited | HEAD-MOUNTED DEVICE WITH VIRTUAL REALITY |
| JP2020522010A (ja) * | 2017-05-29 | 2020-07-27 | アイウェイ ビジョン リミテッドEyeWay Vision Ltd. | 焦点合わせ管理を伴う眼の投影システム、及び、方法 |
| US10976551B2 (en) | 2017-08-30 | 2021-04-13 | Corning Incorporated | Wide field personal display device |
| US20200142276A1 (en) * | 2018-11-02 | 2020-05-07 | Gary Sharp Innovations, Llc | Compact polarization-based multi-pass optical architectures |
| US11740536B2 (en) * | 2018-11-02 | 2023-08-29 | Meta Platforms Technologies, Llc | Compact polarization-based multi-pass optical architectures |
| CN111665622B (zh) * | 2019-03-06 | 2022-07-08 | 株式会社理光 | 光学装置、视网膜投影显示装置、头部安装型显示装置 |
| CN111665622A (zh) * | 2019-03-06 | 2020-09-15 | 株式会社理光 | 光学装置、视网膜投影显示装置、头部安装型显示装置 |
| US11803057B2 (en) | 2019-03-06 | 2023-10-31 | Ricoh Company, Ltd. | Optical device, retinal projection display, head-mounted display, and optometric apparatus |
| US12130436B2 (en) | 2019-05-03 | 2024-10-29 | 3M Innovative Properties Company | Optical system |
| CN114072717A (zh) * | 2019-06-27 | 2022-02-18 | 鲁姆斯有限公司 | 基于经由光导光学元件对眼睛成像来进行眼睛追踪的设备和方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| US11675191B2 (en) | 2023-06-13 |
| CN106164745B (zh) | 2020-04-24 |
| US10545340B2 (en) | 2020-01-28 |
| JP2017514169A (ja) | 2017-06-01 |
| KR20160143749A (ko) | 2016-12-14 |
| US20200150439A1 (en) | 2020-05-14 |
| EP3129822A4 (en) | 2017-11-15 |
| US20170176749A1 (en) | 2017-06-22 |
| EP3129822A1 (en) | 2017-02-15 |
| JP6637440B2 (ja) | 2020-01-29 |
| CN106164745A (zh) | 2016-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11675191B2 (en) | Head mounted display and low conspicuity pupil illuminator | |
| JP7076891B2 (ja) | 視標追跡機能を備えるヘッドマウント式ディスプレイ | |
| US10983341B2 (en) | Eye tracking based on polarization volume grating | |
| US10642044B2 (en) | Near-eye display system having a pellicle as a combiner | |
| KR102474236B1 (ko) | 착용 가능 헤드업 디스플레이들에 눈 추적 및 스캐닝 레이저 투사를 통합시키는 시스템들, 디바이스들 및 방법들 | |
| US10600352B1 (en) | Display device with a switchable window and see-through pancake lens assembly | |
| US9977246B2 (en) | Low profile image combiner for near-eye displays | |
| JP2020514926A5 (enExample) | ||
| EP4031928B1 (en) | Varifocal polarization sensitive diffusive display | |
| US20230087535A1 (en) | Wavefront sensing from retina-reflected light | |
| US11579425B1 (en) | Narrow-band peripheral see-through pancake lens assembly and display device with same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15776789 Country of ref document: EP Kind code of ref document: A1 |
|
| REEP | Request for entry into the european phase |
Ref document number: 2015776789 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2015776789 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 15127040 Country of ref document: US |
|
| ENP | Entry into the national phase |
Ref document number: 2016561813 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 20167030921 Country of ref document: KR Kind code of ref document: A |