US20230187908A1 - Addressable vertical cavity surface emitting laser array for generating structured light patterns - Google Patents
Addressable vertical cavity surface emitting laser array for generating structured light patterns Download PDFInfo
- Publication number
- US20230187908A1 US20230187908A1 US18/107,747 US202318107747A US2023187908A1 US 20230187908 A1 US20230187908 A1 US 20230187908A1 US 202318107747 A US202318107747 A US 202318107747A US 2023187908 A1 US2023187908 A1 US 2023187908A1
- Authority
- US
- United States
- Prior art keywords
- trace
- vcsels
- traces
- group
- structured light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 claims description 23
- 230000003213 activating effect Effects 0.000 claims description 8
- 230000003287 optical effect Effects 0.000 description 25
- 230000009471 action Effects 0.000 description 15
- 238000005286 illumination Methods 0.000 description 14
- 238000005259 measurement Methods 0.000 description 13
- 238000003384 imaging method Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 10
- 230000033001 locomotion Effects 0.000 description 9
- 230000004044 response Effects 0.000 description 8
- 239000000758 substrate Substances 0.000 description 8
- 230000004075 alteration Effects 0.000 description 6
- 238000004590 computer program Methods 0.000 description 6
- 230000001143 conditioned effect Effects 0.000 description 6
- 238000013507 mapping Methods 0.000 description 4
- 230000003190 augmentative effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 230000010287 polarization Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 229920001621 AMOLED Polymers 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000004438 eyesight Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 241000226585 Antennaria plantaginifolia Species 0.000 description 1
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 239000006117 anti-reflective coating Substances 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 201000009310 astigmatism Diseases 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 210000000845 cartilage Anatomy 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 229910052737 gold Inorganic materials 0.000 description 1
- 239000010931 gold Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 210000001519 tissue Anatomy 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/40—Arrangement of two or more semiconductor lasers, not provided for in groups H01S5/02 - H01S5/30
- H01S5/42—Arrays of surface emitting lasers
- H01S5/423—Arrays of surface emitting lasers having a vertical cavity
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/40—Arrangement of two or more semiconductor lasers, not provided for in groups H01S5/02 - H01S5/30
- H01S5/4025—Array arrangements, e.g. constituted by discrete laser diodes or laser bar
- H01S5/4087—Array arrangements, e.g. constituted by discrete laser diodes or laser bar emitting more than one wavelength
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
- G03B21/20—Lamp housings
- G03B21/2006—Lamp housings characterised by the light source
- G03B21/2013—Plural light sources
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
- G03B21/20—Lamp housings
- G03B21/2006—Lamp housings characterised by the light source
- G03B21/2033—LED or laser light sources
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/04—Processes or apparatus for excitation, e.g. pumping, e.g. by electron beams
- H01S5/042—Electrical excitation ; Circuits therefor
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/04—Processes or apparatus for excitation, e.g. pumping, e.g. by electron beams
- H01S5/042—Electrical excitation ; Circuits therefor
- H01S5/0425—Electrodes, e.g. characterised by the structure
- H01S5/04256—Electrodes, e.g. characterised by the structure characterised by the configuration
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/06—Arrangements for controlling the laser output parameters, e.g. by operating on the active medium
- H01S5/062—Arrangements for controlling the laser output parameters, e.g. by operating on the active medium by varying the potential of the electrodes
- H01S5/06233—Controlling other output parameters than intensity or frequency
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/06—Arrangements for controlling the laser output parameters, e.g. by operating on the active medium
- H01S5/062—Arrangements for controlling the laser output parameters, e.g. by operating on the active medium by varying the potential of the electrodes
- H01S5/06233—Controlling other output parameters than intensity or frequency
- H01S5/06236—Controlling other output parameters than intensity or frequency controlling the polarisation, e.g. TM/TE polarisation switching
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/06—Arrangements for controlling the laser output parameters, e.g. by operating on the active medium
- H01S5/062—Arrangements for controlling the laser output parameters, e.g. by operating on the active medium by varying the potential of the electrodes
- H01S5/06233—Controlling other output parameters than intensity or frequency
- H01S5/0624—Controlling other output parameters than intensity or frequency controlling the near- or far field
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/06—Arrangements for controlling the laser output parameters, e.g. by operating on the active medium
- H01S5/062—Arrangements for controlling the laser output parameters, e.g. by operating on the active medium by varying the potential of the electrodes
- H01S5/06233—Controlling other output parameters than intensity or frequency
- H01S5/06243—Controlling other output parameters than intensity or frequency controlling the position or direction of the emitted beam
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/40—Arrangement of two or more semiconductor lasers, not provided for in groups H01S5/02 - H01S5/30
- H01S5/4025—Array arrangements, e.g. constituted by discrete laser diodes or laser bar
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/40—Arrangement of two or more semiconductor lasers, not provided for in groups H01S5/02 - H01S5/30
- H01S5/4025—Array arrangements, e.g. constituted by discrete laser diodes or laser bar
- H01S5/4081—Near-or far field control
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2513—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C5/00—Constructions of non-optical parts
- G02C5/008—Spectacles frames characterized by their material, material structure and material properties
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/005—Optical components external to the laser cavity, specially adapted therefor, e.g. for homogenisation or merging of the beams or for manipulating laser pulses, e.g. pulse shaping
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01S—DEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
- H01S5/00—Semiconductor lasers
- H01S5/02—Structural details or components not essential to laser action
- H01S5/022—Mountings; Housings
- H01S5/0233—Mounting configuration of laser chips
- H01S5/02345—Wire-bonding
Definitions
- This disclosure relates generally to generating structured light patterns, and more specifically to an addressable vertical cavity surface emitting laser (VCSEL) array for generating structured light patterns.
- VCSEL vertical cavity surface emitting laser
- structured light sensing is the process of projecting a known structured light pattern (e.g., bars) onto a scene using a structured light projector. Depth information of the scene may be calculated using images of the scene illuminated with the structured light pattern. Effectiveness of the structured light pattern is based in part on a density of the pattern features.
- Conventional structured light projectors typically have a fixed pattern that is not dynamically adjusted. Accordingly, conventional structured light projectors typically are optimized for a particular range of distances—but outside of those distances the pattern either becomes too dense (e.g., such that the features are not resolvable from each other) or too sparse (e.g., leads to very low resolution).
- An addressable vertical cavity surface emitting laser (VCSEL) array configured to generate a plurality of different dot patterns.
- the dot patterns are directly projected into a local area to form a structured light pattern.
- one or more of the dot patterns are tiled throughout the local area to form the structured light pattern.
- the VCSEL array includes a plurality of conductive traces that control different groups of VCSELs, such that each group of VCSELs may be individually controlled.
- the VCSEL groups are configured to emit a respective dot pattern. By modulating which groups of VCSELs are active different dot patterns may be emitted.
- one set of one or more VCSEL groups may emit a dot pattern that has a first dot density
- a different set of one or more VCSEL groups may emit a dot pattern of a second dot density that is different than the first dot density.
- the VCSEL array may be formed such that the conductive traces are all in the same plane and do not overlap.
- one or more of the conductive traces may be in different planes and pass over and/or under one or more other conductive traces.
- the VCSELs in different groups may emit light at different wavelengths.
- the VCSEL array may be part of a depth projector that projects the dot pattern into a local area.
- a vertical cavity surface emitting laser (VCSEL) array may comprise: a plurality of groups of VCSELs on a single VCSEL chip, where each group of VCSELs forms a different dot pattern; and a plurality of traces, where each trace conductively couples to a respective group of VCSELs such that each group of VCSELs is individually addressable.
- VCSEL vertical cavity surface emitting laser
- a structured light projector may comprise: a first group of emitters conductively coupled to a first trace; and a second group of emitters conductively coupled to a second trace, wherein the first group of emitters and the second group of emitters are individually addressable.
- a method may comprise: selecting a first dot pattern, of a plurality of dot patterns, based in part on a target density and a target distance, wherein the first dot pattern is associated with a subset of traces of a plurality of traces on a chip, and each respective trace is conductively coupled to a respective group of VCSELs on the chip; activating at least one group of VCSELs that are conductively coupled via the first subset of traces, such that the activated at least one group of VCSELs emit light that forms a first dot pattern; and projecting the first dot pattern into the local area, wherein the first dot pattern has the target density at the target distance.
- a vertical cavity surface emitting laser (VCSEL) array includes a plurality of groups of VCSELs on a single VCSEL chip, where each group of VCSELs forms a respective dot pattern.
- the VCSEL array further includes a plurality of traces, where each trace conductively couples to a respective group of VCSELs such that each group of VCSELs is individually addressable, and wherein a first trace in the plurality of traces overlaps a second trace in the plurality of traces.
- a method may comprise: selecting a first dot pattern, of a plurality of dot patterns, based in part on a target density and a target distance, wherein the first dot pattern is associated with a first subset of traces of a plurality of traces on a chip, wherein the first subset of traces includes a first trace that overlaps a second trace, and wherein each respective trace is conductively coupled to a respective group of VCSELs on the chip.
- the method may further comprise activating at least one group of VCSELs that are conductively coupled via the first subset of traces, such that the activated at least one group of VCSELs emit light that forms a first dot pattern; and projecting the first dot pattern into a local area, wherein the first dot pattern has the target density at the target distance.
- FIG. 1 A is a perspective view of a headset implemented as an eyewear device, in accordance with one or more embodiments.
- FIG. 1 B is a perspective view of a headset implemented as a head-mounted display, in accordance with one or more embodiments.
- FIG. 2 is a block diagram of a depth camera assembly, in accordance with one or more embodiments.
- FIG. 3 A is a schematic side view of a structured light projector, in accordance with one or more embodiments.
- FIG. 3 B is an example of a structured light pattern, in accordance with one or more embodiments.
- FIG. 4 A is a plan view of a VCSEL chip having sinusoidal traces, in accordance with one or more embodiments.
- FIG. 4 B is a plan view of a VCSEL chip having overlapping traces, in accordance with one or more embodiments.
- FIG. 4 C is a plan view of a VCSEL chip having angled traces, in accordance with one or more embodiments.
- FIG. 5 is a flowchart illustrating a process for generating a structured light pattern, in accordance with one or more embodiments.
- FIG. 6 is a system that includes a headset, in accordance with one or more embodiments.
- a VCSEL array is configured to generate a plurality of different dot patterns.
- the VCSEL array may be part of a structured light projector of a depth camera assembly (e.g., for a headset).
- the VCSEL array includes a plurality of groups of emitters. Each group of emitters may comprise multiple discrete VCSELs which each generate a beam of light (e.g., near-infrared light). Each group of emitters may be independently controlled (e.g., by a depth camera assembly).
- Controlling a group of emitters may comprise instructing emitters in the group to emit light, instructing emitters in the group not to emit light, varying an intensity of light emitted from the emitters in the group, varying a wavelength of the light emitted by the emitters in the group, varying a temperature of the emitters in the group, or some combination thereof.
- near field depth sensing relative to far field
- far field depth sensing may use a relatively less dense dot pattern, and some emitters may be inactivated.
- far field depth sensing may use a relatively denser dot pattern, and more emitters may be activated.
- the addressable groups of emitters allow for a greater variety of dot patterns to be dynamically generated compared to conventional systems. Any desired dot density may be achieved through trace pattern design and selective activation of groups of emitters. Additionally, power input is proportional to the dot density. Thus, using a single VCSEL array, a depth camera assembly may select a less dense dot pattern for a near range application to save power. Subsequently, the depth camera assembly may adjust the dot density for a far range application by increasing the dot pattern density.
- Embodiments of the invention may include or be implemented in conjunction with an artificial reality system.
- Artificial reality is a form of reality that has been adjusted in some manner before presentation to a user, which may include, e.g., a virtual reality (VR), an augmented reality (AR), a mixed reality (MR), a hybrid reality, or some combination and/or derivatives thereof.
- Artificial reality content may include completely generated content or generated content combined with captured (e.g., real-world) content.
- the artificial reality content may include video, audio, haptic feedback, or some combination thereof, any of which may be presented in a single channel or in multiple channels (such as stereo video that produces a three-dimensional effect to the viewer).
- artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to create content in an artificial reality and/or are otherwise used in an artificial reality.
- the artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable device (e.g., headset) connected to a host computer system, a standalone wearable device (e.g., headset), a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
- FIG. 1 A is a perspective view of a headset 100 implemented as an eyewear device, in accordance with one or more embodiments.
- the eyewear device is a near eye display (NED).
- the headset 100 may be worn on the face of a user such that content (e.g., media content) is presented using a display assembly and/or an audio system.
- content e.g., media content
- the headset 100 may also be used such that media content is presented to a user in a different manner. Examples of media content presented by the headset 100 include one or more images, video, audio, or some combination thereof.
- the headset 100 includes a frame, and may include, among other components, a display assembly including one or more display elements 120 , a depth camera assembly (DCA), an audio system, and a position sensor 190 .
- DCA depth camera assembly
- FIG. 1 A illustrates the components of the headset 100 in example locations on the headset 100
- the components may be located elsewhere on the headset 100 , on a peripheral device paired with the headset 100 , or some combination thereof.
- the frame 110 holds the other components of the headset 100 .
- the frame 110 includes a front part that holds the one or more display elements 120 and end pieces (e.g., temples) to attach to a head of the user.
- the front part of the frame 110 bridges the top of a nose of the user.
- the length of the end pieces may be adjustable (e.g., adjustable temple length) to fit different users.
- the end pieces may also include a portion that curls behind the ear of the user (e.g., temple tip, ear piece).
- the one or more display elements 120 provide light to a user wearing the headset 100 .
- the headset includes a display element 120 for each eye of a user.
- a display element 120 generates image light that is provided to an eyebox of the headset 100 .
- the eyebox is a location in space that an eye of user occupies while wearing the headset 100 .
- a display element 120 may be a waveguide display.
- a waveguide display includes a light source (e.g., a two-dimensional source, one or more line sources, one or more point sources, etc.) and one or more waveguides. Light from the light source is in-coupled into the one or more waveguides which outputs the light in a manner such that there is pupil replication in an eyebox of the headset 100 .
- the waveguide display includes a scanning element (e.g., waveguide, mirror, etc.) that scans light from the light source as it is in-coupled into the one or more waveguides.
- a scanning element e.g., waveguide, mirror, etc.
- the display elements 120 are opaque and do not transmit light from a local area around the headset 100 .
- the local area is the area surrounding the headset 100 .
- the local area may be a room that a user wearing the headset 100 is inside, or the user wearing the headset 100 may be outside and the local area is an outside area.
- the headset 100 generates VR content.
- one or both of the display elements 120 are at least partially transparent, such that light from the local area may be combined with light from the one or more display elements to produce AR and/or MR content.
- a display element 120 does not generate image light, and instead is a lens that transmits light from the local area to the eyebox.
- the display elements 120 may be a lens without correction (non-prescription) or a prescription lens (e.g., single vision, bifocal and trifocal, or progressive) to help correct for defects in a user's eyesight.
- the display element 120 may be polarized and/or tinted to protect the user's eyes from the sun.
- the display element 120 may include an additional optics block (not shown).
- the optics block may include one or more optical elements (e.g., lens, Fresnel lens, etc.) that direct light from the display element 120 to the eyebox.
- the optics block may, e.g., correct for aberrations in some or all of the image content, magnify some or all of the image, or some combination thereof.
- the DCA determines depth information for a portion of a local area surrounding the headset 100 .
- the DCA includes one or more imaging devices 130 , a structured light projector 140 , and a DCA controller 150 .
- the structured light projector 140 illuminates a portion of the local area with light.
- the light may be, e.g., structured light (e.g., dot pattern, bars, etc.) in the infrared (IR), IR flash for time-of-flight, etc.
- the one or more imaging devices 130 capture images of the portion of the local area that include the light from the structured light projector 140 .
- FIG. 1 A shows a single structured light projector 140 and two imaging devices 130 . In alternate embodiments, there is no structured light projector 140 and at least two imaging devices 130 .
- the structured light projector 140 comprises at least one VCSEL chip.
- a VCSEL emits a plurality of different dot patterns.
- the VCSEL chip includes a plurality of traces.
- a trace includes a plurality of emitters that have an arrangement on the VCSEL chip (such as sinusoidal arrangement, a pseudo random arrangement, etc.). The arrangement is such that when a trace is active, the plurality of emitters emit a dot pattern that has a spatial distribution that corresponds to the arrangement of the plurality of emitters.
- the arrangement may be the same for different traces. Alternatively, the arrangement may be different between at least one trace and one other trace on the VCSEL chip. In some embodiments, the arrangement is different for each of the traces.
- Each emitter may emit a beam of light resulting in a dot.
- the particular arrangement is such that light emitted from the plurality of emitters for a trace forms a corresponding dot pattern in the local area.
- Each trace may be individually addressable.
- different dot patterns may be generating by activating different traces on the VCSEL chip.
- the DCA controller 150 may activate all traces on the VCSEL chip.
- the DCA controller 150 may activate a subset of the traces on the VCSEL chip.
- the DCA controller 150 computes depth information for the portion of the local area using the captured images and one or more depth determination techniques.
- the depth determination technique may be, e.g., direct time-of-flight (ToF) depth sensing, indirect ToF depth sensing, structured light, passive stereo analysis, active stereo analysis (uses texture added to the scene by light from the structured light projector 140 ), some other technique to determine depth of a scene, or some combination thereof.
- ToF direct time-of-flight
- ToF ToF depth sensing
- structured light passive stereo analysis
- active stereo analysis uses texture added to the scene by light from the structured light projector 140
- some other technique to determine depth of a scene or some combination thereof.
- the audio system provides audio content.
- the audio system includes a transducer array, a sensor array, and an audio controller.
- the audio system may include different and/or additional components.
- functionality described with reference to the components of the audio system can be distributed among the components in a different manner than is described here. For example, some or all of the functions of the controller may be performed by a remote server.
- the transducer array presents sound to user.
- the transducer array includes a plurality of transducers.
- a transducer may be a speaker 160 or a tissue transducer 170 (e.g., a bone conduction transducer or a cartilage conduction transducer).
- the sensor array detects sounds within the local area of the headset 100 .
- the sensor array includes a plurality of acoustic sensors 180 .
- An acoustic sensor 180 captures sounds emitted from one or more sound sources in the local area (e.g., a room). Each acoustic sensor is configured to detect sound and convert the detected sound into an electronic format (analog or digital).
- the acoustic sensors 180 may be acoustic wave sensors, microphones, sound transducers, or similar sensors that are suitable for detecting sounds.
- the audio controller processes information from the sensor array that describes sounds detected by the sensor array.
- the audio controller may comprise a processor and a computer-readable storage medium.
- the audio controller may be configured to generate direction of arrival (DOA) estimates, generate acoustic transfer functions (e.g., array transfer functions and/or head-related transfer functions), track the location of sound sources, form beams in the direction of sound sources, classify sound sources, generate sound filters for the speakers 160 , or some combination thereof.
- DOA direction of arrival
- the position sensor 190 generates one or more measurement signals in response to motion of the headset 100 .
- the position sensor 190 may be located on a portion of the frame 110 of the headset 100 .
- the position sensor 190 may include an inertial measurement unit (IMU).
- IMU inertial measurement unit
- Examples of position sensor 190 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of the IMU, or some combination thereof.
- the position sensor 190 may be located external to the IMU, internal to the IMU, or some combination thereof.
- the headset 100 may provide for simultaneous localization and mapping (SLAM) for a position of the headset 100 and updating of a model of the local area.
- the headset 100 may include a passive camera assembly (PCA) that generates color image data.
- the PCA may include one or more RGB cameras that capture images of some or all of the local area.
- some or all of the imaging devices 130 of the DCA may also function as the PCA.
- the images captured by the PCA and the depth information determined by the DCA may be used to determine parameters of the local area, generate a model of the local area, update a model of the local area, or some combination thereof.
- the position sensor 190 tracks the position (e.g., location and pose) of the headset 100 within the room. Additional details regarding the components of the headset 100 are discussed below in connection with FIG. 6 .
- FIG. 1 B is a perspective view of a headset 105 implemented as a HMD, in accordance with one or more embodiments.
- portions of a front side of the HMD are at least partially transparent in the visible band ( ⁇ 380 nm to 750 nm), and portions of the HMD that are between the front side of the HMD and an eye of the user are at least partially transparent (e.g., a partially transparent electronic display).
- the HMD includes a front rigid body 115 and a band 175 .
- the headset 105 includes many of the same components described above with reference to FIG. 1 A , but modified to integrate with the HMD form factor.
- the HMD includes a display assembly, a DCA, an audio system, and a position sensor 190 .
- FIG. 1 B shows the structured light projector 140 , a plurality of the speakers 160 , a plurality of the imaging devices 130 , a plurality of acoustic sensors 180 , and the position sensor 190 .
- FIG. 2 is a block diagram of a DCA 200 for a headset, in accordance with one or more embodiments.
- the DCA 200 may be the DCA described with respect to FIG. 1 A and FIG. 1 B .
- Some embodiments of the DCA 200 have different components than those described here.
- the functions can be distributed among the components in a different manner than is described here.
- some of the functions of the DCA 200 may be part of different components (e.g., some may be part of the headset and some maybe part of a console and/or server).
- the DCA 200 generates depth information of a local area, such as a room. Depth information includes pixel values defining distance from the DCA 200 , providing a mapping of locations captured in the depth information, such as a three-dimensional mapping of locations captured in the depth information.
- the DCA 200 includes a structured light projector 210 , a camera assembly 220 , and a controller 230 .
- the structured light projector 210 generates structured light and projects the structured light into the local area.
- the structured light projector 140 of FIG. 1 A may be an embodiment of the structured light projector 210 .
- the structured light projector 210 comprises one or more illumination sources, an optical assembly, and a projection assembly.
- An illumination source is configured to emit light (e.g., as an optical beam), and may emit multiple wavelengths of light.
- the illumination source may emit light in, e.g., a visible band ( ⁇ 380 nm to 750 nm), in an infrared (IR) band ( ⁇ 750 nm to 1,800 nm), in an ultraviolet band ( ⁇ 100 nm to 380 nm), some other portion of the electromagnetic spectrum that the camera assembly 220 is configured to detect, or some combination thereof.
- Light emitted from the one or more of the illumination sources may be, e.g., polarized (e.g., linear, circular, etc.).
- the illumination source may comprise a vertical-cavity surface-emitting laser (VCSEL) chip.
- the VCSEL chip may comprise a plurality of traces. Each trace may comprise a plurality of emitters that have an arrangement on the VCSEL chip (such as sinusoidal arrangement, a pseudo random arrangement, etc.). In some embodiments, one or more traces on the VCSEL chip may overlap. The arrangement is such that when a trace is active, the plurality of emitters emit a dot pattern that has a spatial distribution that corresponds to the arrangement of the plurality of emitters. Each emitter may emit a beam of light resulting in a dot. The emitters may emit light of different wavelengths or polarizations. Each trace may be individually addressable.
- different dot patterns may be generating by activating different traces on the VCSEL chip.
- the DCA controller 150 may activate all traces on the VCSEL chip.
- the DCA controller 150 may activate a subset of the traces on the VCSEL chip.
- the emitter arrangement may be the same for different traces. Alternatively, the arrangement may be different between at least one trace and one other trace on the VCSEL chip. In some embodiments, the arrangement is different for each of the traces. In this manner, the VCSEL chip can emit dot patterns of variable density, where density of the emitted dot pattern increases with a number of traces that are activated. In some embodiments, each emitter may be controlled by its own trace. Thus, each emitter on the VCSEL chip could be individually controlled. The VCSEL chips and their operation are discussed in additional detail with respect to FIG. 3 - FIG. 5 .
- the projection assembly projects one or more structured light patterns into the local area.
- the conditioned one or more dot patterns form a corresponding structured light pattern that the projection assembly projects into the local area.
- Each trace may emit a particular dot pattern.
- the combination of active dot patterns combines to form a corresponding structured light pattern in the local area.
- the projection assembly projects different structured light patterns.
- the projection assembly comprises one or more optical elements that direct the structured light pattern into the local area.
- the projection assembly could comprise a plurality of lenses.
- the projection assembly includes a beam shaping element that changes a profile, or general intensity envelope, of the structured light.
- the structured light pattern includes a plurality of structured light elements. Each element is a discrete portion of the structured light pattern, such as a dot.
- the projection assembly generates a plurality of tiles using the conditioned light (dot pattern emitted by the VCSEL array) and projects the tiles throughout the local area to form a structured light pattern.
- the projection assembly may comprise one or more optical elements, such as diffractive optical elements (e.g., 1D and/or 2D gratings), scanning mirrors (e.g., MEMS mirror), lenses, mirrors, or some combination thereof.
- all of the tiles generated by the projection assembly have the same dot pattern.
- the projection assembly may generate one or more tiles that have a dot pattern that is different from at least one other tile.
- the VCSEL chip may generate a first dot pattern that is projected into a particular portion of the local area using a scanning mirror, and then produce a second dot pattern that is projected into a different portion of the local area using a scanning mirror.
- the structured light projector 210 may vary the structured light pattern in accordance with illumination instructions from the controller 230 .
- the structured light projector 210 may project the same pattern over the entire field of view of the structured light projector 210 , or the structured light projector 210 may project different structured light patterns to different portions of the field of view.
- the structured light pattern may be formed from a plurality of tiles that are each projected into a respective portion of the field of view of the structured light projector 210 .
- the plurality of tiles together form an entire structured light pattern.
- each tile of the structured light pattern may contain a different structured light pattern and may be individually adjusted.
- the structured light projector 210 may increase the intensity of the structured light pattern in a first tile, such as by activating a trace or by increasing the current driven through a trace, and the structured light projector 210 may simultaneously decrease the intensity of the structured light pattern in a second tile, such as by deactivating a trace or decreasing the current driven through the trace.
- the structured light projector 210 may adjust any suitable property of the structured light pattern, such as the intensity, density, pattern shape (e.g., dots, grids), polarization, blink rate, etc.
- the structured light pattern may be time multiplexed, such that different patterns are projected into different portions of the field of view at different times.
- the structured light projector 210 may vary the structured light pattern by having different groups of emitters be active and/or having some or all of the emitters be tunable.
- the structured light pattern is controlled by controlling each emitter individually or by group or section, in which the dynamic properties are manifested in the projected pattern in terms of pattern shape, intensity, polarization, temporal modulation, field of view, etc.
- the combination of using an addressable light source and tunable optics may be adopted to realize dynamic light patterns with considerations in projector size, weight, power, cost, etc.
- the structured light projector 210 may apply different currents or pulse durations to different traces to make a structured light pattern with multiple dot intensity levels. This may make the dot constellation detection algorithm less complicated, which may reduce a computation power requirement. Additionally, by placing emitters on narrow curved traces, the layout allows uniform coverage of dot emitters across a VCSEL chip.
- the camera assembly 220 is configured to capture images of the local area.
- the camera assembly 220 includes one or more imaging devices (e.g., a camera) that can capture images in at least a band of the structured light pattern, such as in the infrared band.
- the imaging devices 130 of FIG. 1 A may be an embodiment of the camera assembly 220 .
- the one or more imaging devices and/or other imaging devices of the camera assembly 220 may also capture light in a visible optical band.
- some or all of the captured images of the local area may include some or all of the structured light pattern (e.g., reflected by objects in the local area).
- the controller 230 controls the components of the DCA 200 .
- the controller may comprise an illumination module 250 and a depth measurement module 240 .
- Some embodiments of the controller 230 have different components than those described here. Similarly, the functions can be distributed among the components in a different manner than is described here. In some embodiments, some of the functions of the controller 230 may be part of different components (e.g., some may be part of the headset and some maybe part of a console and/or server).
- the illumination module 250 may generate illumination instructions to provide to the structured light projector 210 to project a structured light pattern.
- the illumination instructions may reduce (and in some cases minimize) power consumption of the structured light projector 210 while providing sufficient texture in the local area to calculate depth information.
- the illumination module 250 may determine that the local area contains sufficient texture based on a confidence level of depth measurements (e.g., texture may be sufficient if depth measurements are calculated with a confidence level of greater than 95%, or greater than 50%).
- the illumination instructions may cause the structured light projector to activate or deactivate groups of emitters based on a distance to an object. For example, in response to a known or measured distance to an object that is less than a threshold distance, such as less than 3 feet, or less than 10 feet, the illumination instructions may cause the structured light projector 210 to deactivate at least one group of emitters, or a percentage of the groups of emitters, such as 50% of the groups of emitters. In response to a known or measured distance to an object that is greater than the threshold distance, the illumination instructions may instruct the structured light projector 210 to activate all of the groups of emitters, or a percentage of the groups of emitters, such as at least 75% of the groups of emitters. In some embodiments, different numbers or combinations of the groups of emitters may be activated based on different distances to objects.
- the depth measurement module 240 determines depth information for each pixel of an image based on images captured by the camera assembly 220 and stores the depth information for each pixel in association with the pixel to generate the depth image.
- the depth measurement module analyzes the images containing the structured light pattern. Distortions in the structured light pattern by three-dimensional objects in the local area allow the DCA to calculate three-dimensional depth information.
- the depth measurement module uses known methods to calculate depth information, such as active stereo, time-of-flight, etc.
- FIG. 3 A is an example schematic side view of a structured light projector 300 according to one or more embodiments.
- the structured light projector 300 may be an embodiment of the structured light projector 210 of FIG. 2 .
- the structured light projector 300 may comprise at least one VCSEL chip 310 and an optical assembly 320 .
- the VCSEL chip 310 is an embodiment of the VCSEL array and/or VCSEL chip described above. Note, while a single VCSEL chip 310 is shown, in other embodiments, multiple VCSEL chips may part of the structured light projector 300 .
- the structured light projector 300 may also include a projection assembly 330 .
- the structured light projector 300 generates and projects a structured light pattern, of a plurality of structured light patterns, in accordance with instructions from a depth camera assembly (not shown), such as the depth camera assembly 200 of FIG. 2 .
- the structured light projector 300 projects structured light 315 into a local area 325 .
- the local area 325 may include one or more objects, such as object 335 and object 345 .
- the object 335 and the object 345 may be located at different distances to the structured light projector 300 .
- the structured light projector 300 may select different structure light densities or patterns to illuminate the object 335 and the object 345 .
- the structured light projector 300 may select a denser pattern in the area of object 335 , and a relatively less dense pattern in the area of object 345 .
- the optical assembly 320 conditions light from the VCSEL chip 310 of FIG. 3 A .
- Conditioning light may include, e.g., collimating light from the VCSEL chip 310 , error and/or aberration correction, beam expansion, projection, or some combination thereof.
- the optical assembly 320 may comprise one or more lenses, mirrors, or other components configured to condition light from the VCSEL chip 310 .
- there is no beam multiplication DOE and the optical assembly 320 projects the conditioned light directly into the local area.
- the conditioned dot pattern is the structured light pattern.
- the optical assembly may comprise a beam combiner that combines beams from different VCSEL chips to further increase pattern density. For example, different VCSELs may emit light at different wavelengths, which may be combined using a dichroic mirror.
- the structured light projector 300 may also include a projection assembly 330 .
- the projection assembly 330 generates a plurality of tiles 340 using the conditioned light (dot pattern emitted by the VCSEL array) and projects the tiles throughout the local area to form a structured light pattern.
- the projection assembly 330 may comprise one or more optical elements, such as diffractive optical elements (e.g., 1D and/or 2D gratings), scanning mirrors (e.g., MEMS mirror), lenses, mirrors, or some combination thereof.
- FIG. 3 B is an example of a structured light pattern according to one or more embodiments.
- the structured light projector 300 of FIG. 3 A generates a dot pattern comprising a plurality of dots 350 , of a plurality of dot patterns, in accordance with instructions from a controller of a depth camera assembly (not shown).
- the projection assembly 330 replicates the conditioned light (dot pattern) to form a n ⁇ M tile pattern in the local area, where each tile comprises the dot pattern, and n and M are integers. In some embodiments, all of the instances have the same dot pattern (e.g., as illustrated). In other embodiments, the projection assembly may generate one or more tiles that have a dot pattern that is different from at least one other tile.
- a row 360 of tiles including tiles 340 a, 340 b, and 340 c may receive beams from emitters on a first subset of the traces
- a row 370 of tiles may receive beams from emitters on a second subset of the traces
- a row 380 of tiles may receive beams from emitters on a third subset of the traces.
- the VCSEL chip may generate a first dot pattern that is projected into a particular portion (e.g., that would be occupied by row 360 ) of the local area using a scanning mirror, and then produce a second dot pattern that is projected into a different portion (e.g., that would be occupied by row 370 ) of the local area using a scanning mirror.
- a density of the dot pattern for each tile may be dependent on instructions from the DCA.
- the DCA may instruct the structured light projector 300 to provide a particular density pattern based on how far objects are located away from the DCA. For example, a portion of the local area that is closer to a user (e.g., user's hands) may have tiles with a dot pattern density that is lower than a portion of the local area that is far from the user (e.g., 20 feet away).
- each trace can be made to have a unique intensity by setting, for example, different numbers of emitters in each trace.
- Other methods can include driving each trace with a different current or a different operating pulse width.
- the result is a tile with a unique pattern of dot density or dot intensities.
- the tile can then be projected into the local area.
- FIG. 4 A is a plan view of a VCSEL chip 400 according to one or more embodiments.
- the VCSEL chip is an example of the VCSEL array.
- the VCSEL chip 400 may comprise a plurality of bond pads 410 , 420 , a plurality of traces 430 , and a plurality of emitters 400 deposited on a substrate 450 .
- the VCSEL chip 400 may be a component of the structured light projector 210 of FIG. 2 .
- a first series of bond pads 410 and a second series of bond pads 420 provide coupling locations between the substrate 450 and the plurality of traces 430 .
- a voltage differential may be applied between the first series of bond pads 410 and the second series of bond pads 420 , causing current to flow between electrically connected bond pads.
- the voltage differentials may be selectively applied individually to each pair of connected bond pads.
- the components connected to each pair of connected bond pads may be individually controllable.
- each trace 430 may be coupled to the substrate 450 via a single bond pad in order to reduce the footprint of the substrate.
- the plurality of traces 430 provides an electrical connection from a bond pad in the first series of bond pads 410 to a bond pad in the second series of bond pads 420 .
- the trace 430 may comprise an electrically conductive material (e.g., copper, gold, etc.) deposited on the substrate 450 .
- two or more traces may be connected in parallel.
- a trace 430 may comprise a straight line between two bond pads.
- at least a portion of a trace 430 may comprise a change in direction, such as a curve or angle, such that the trace 430 is not a complete straight line between the bond pads connected by the trace.
- the trace 430 may have a width of approximately 15 microns, or in some embodiments between 5 microns-30 microns. As illustrated in FIG. 4 A , each trace 430 is in the general shape of a sinusoidal wave. The shape of the traces 430 provide for uniform emitter coverage on the VCSEL chip 400 .
- all the traces 430 on the VCSEL chip 400 may be coplanar.
- the traces 430 may be deposited in a single process, and the traces 430 may be separated by a separation distance, such as at least 5 microns, to prevent electrical communication between adjacent traces.
- the plurality of emitters 440 are each VCSELs. Each emitter 440 may generate a beam of light which provides one or more dots in a structured light pattern.
- Each trace 430 may comprise a plurality of emitters 440 conductively coupled to the trace 430 , referred to as a group of emitters 440 . As illustrated, each trace 430 comprises approximately 16 emitters 440 . However, traces 430 may comprise any suitable number of emitters 440 , such as between 5 and 15 emitters 440 , between 1 and 30 emitters 440 , or greater than 30 emitters 440 .
- the number of emitters 440 on a single trace 430 may be limited by a minimum pitch distance between emitters 440 which maintains the ability of the emitters 440 to emit a discrete beam of light which is separate from adjacent emitters 440 .
- Each emitter 440 may be approximately 5 microns in diameter, or between 2 microns-10 microns in diameter.
- An emitter 440 with a 5 micron diameter may provide a good single mode/gaussian shape dot, with a relatively narrow beam divergence and a suitable dot power consumption.
- a minimum pitch distance between emitters 440 on different traces 430 may be approximately 25 microns, or at least 20 microns.
- a minimum pitch distance between emitters 440 on the same trace 430 may be approximately 20 microns, or at least 15 microns.
- the plurality of emitters 440 are all of a same type (e.g., emit at a same wavelength).
- the plurality of emitters 440 includes at least one emitter 440 that is of a different type from another emitter 440 (e.g., emit at two different wavelengths).
- all of the emitters 440 in a group are of a same type.
- at least one emitter 440 in a group is of a different type than another emitter 440 within the group.
- each trace 430 comprises the same number of operational emitters, but varies a driving current for each group. Accordingly, some dots from one group may have a higher intensity than dots in a different group. And in some embodiments, intensity of emitters 440 within a single group may be different from one another.
- power reduction circuits may be user before one or more emitters within a group of emitters 440 . A power reduction circuit reduces an amount of power provided to a particular emitter 440 .
- different traces 430 on the VCSEL chip 400 are of different length, thus having different numbers of emitters 440 in order to achieve different intensities.
- the spacing between emitters 440 is even within a group and/or a plurality of groups (in some cases all groups).
- a spacing between emitters 440 on a trace 430 may vary within a group and/or a plurality of groups (in some cases all groups).
- the emitters 440 on a single trace 430 are not collinear. As shown, the traces 430 are curved, and the multiple emitters 440 are located at different positions along the curved traces 430 .
- the emitters 440 on a single trace 430 may be controlled as a group by controlling the voltage differential between the bond pads 410 , 420 connected to the trace 430 . Thus, each group of emitters 440 may be individually addressable. By controlling the non-collinear emitters 440 as a group, a greater variety of addressable dot patterns may be generated versus using groups of collinear emitters.
- the curved traces 430 may be used to generate dots in a random pattern, as the emitters 440 may be placed at any desired locations along the curved traces 430 . Some applications may benefit from the ability to create a structured light pattern of random or semi-random dots.
- FIG. 4 B is a plan view of a VCSEL chip 401 with overlapping traces in accordance with one or more embodiments.
- the VCSEL chip 401 comprises a first series of bond pads 411 connected to a second series of bond pads 421 by a plurality of traces 431 .
- a plurality of emitters 441 are electrically coupled to the traces 431 .
- the traces 431 are deposited on a substrate 451 .
- Each trace 431 may be a straight line from a bond pad 411 to a bond pad 421 . However, in some embodiments one or more of the traces 431 may have curves or angles.
- At least one trace may overlap at least one other trace.
- trace 431 A overlaps traces 431 B, such that at least a portion of trace 431 B is located between a portion of trace 431 A and the substrate 451 .
- the traces 431 A, 431 B may be created in different planes.
- the traces may be deposited in different layers. For example, a first trace 431 B may be deposited, a dielectric layer may be deposited over the first trace 431 B, and a second trace 431 A may be deposited on the dielectric layer.
- the second trace 431 A may overlap the first trace 431 B, and the dielectric layer may prevent electrical communication between the first trace and the second trace.
- the dielectric layer may be transparent such that light emitted by the emitters passes through the dielectric layer. In some embodiments, the dielectric layer may be partially opaque, such that a portion of the light emitted by the emitters is obscured by the dielectric layer.
- the emitters located under the dielectric layer emitting light at the same intensity as the emitters located over the dielectric layer may generate dots of lesser intensity in the structured light pattern. Overlapping traces may provide the ability to generate a greater variety of dot patterns.
- FIG. 4 C is a plan view of a VCSEL chip 402 with angled traces in accordance with one or more embodiments.
- the VCSEL chip 402 comprises a first series of bond pads 412 connected to a second series of bond pads 422 by a plurality of traces 432 .
- a plurality of emitters 442 are electrically coupled to the traces 432 .
- the traces 432 are deposited on a substrate 452 .
- Each trace 431 may comprise a plurality of straight line segments from a bond pad 411 to a bond pad 421 .
- the trace 432 comprises a first straight segment 462 and a second straight segment 472 which intersect at an angle 482 .
- the angle 482 may range from greater than 0° to less than 180°.
- the traces 432 may comprise any suitable number of straight line segments or curved segments. Angled traces may provide the ability to generate a greater variety of dot patterns.
- Any combination of the above embodiments may also be provided for achieving dots of varying intensity.
- a reason for combining the embodiments is to provide a residual level of intensity difference with the further option of increasing the intensity difference when the region being illuminated demands a greater contrast, a better ambiguity, or a better ability to detect a projected dot pattern.
- FIG. 5 is a flowchart of a process 500 for generating a structured light pattern in accordance with one or more embodiments.
- the process shown in FIG. 5 may be performed by components of a DCA (e.g., DCA 200 ).
- Other entities may perform some or all of the steps in FIG. 5 in other embodiments.
- Embodiments may include different and/or additional steps, or perform the steps in different orders.
- the DCA controller selects 510 a first dot pattern, of a plurality of dot patterns, based in part on a target density and a target distance, wherein the first dot pattern is associated with a subset of traces of a plurality of traces on a chip, and each respective trace is conductively coupled to a respective group of VCSELs on the chip.
- the first dot pattern may be selected based on a distance to an object, based on a calculated texture in a local area, manually input, or selected by any other suitable process.
- the distance may be a previously known distance.
- the distance to the object may be measured by the depth measurement module.
- the DCA controller may initially activate all groups of emitters to create a dense dot pattern over the field of view of the camera assembly.
- the depth measurement module may measure the distance to objects within the field of view. Based on the distance, object size, etc., the DCA controller may determine a target density for the first dot pattern.
- the DCA controller activates 520 at least one group of VCSELs that are conductively coupled via the first subset of traces, such that the activated at least one group of VCSELs emit light that forms a first dot pattern.
- Activating the groups of VCSELs may cause the emitters coupled to the traces to emit light, or to increase an amount of light emitted by the emitters.
- the structured light projector projects 530 the first dot pattern into the local area, wherein the first dot pattern has the target density at the target distance.
- a first portion of the first dot pattern may be projected by a first group of dot emitters, and a second portion of the first dot pattern may be projected by a second group of dot emitters.
- the first portion of the first dot pattern may be a first tile of the first dot pattern, and the second portion of the first dot pattern may be a second tile of the first dot pattern.
- the first portion of the first dot pattern may be a first plurality of dots in the first dot pattern, and the second portion of the first dot pattern may be a second plurality of dots in the first dot pattern. The first plurality of dots and the second plurality of dots may both be projected into a first tile of the first dot pattern.
- the DCA controller may select a second dot pattern.
- the second dot pattern may be less dense than the first pattern density.
- the DCA controller may determine that a distance to an object has decreased, and thus a lesser dot density may be desirable.
- the second pattern density may be greater than the first pattern density.
- the structured light projector may project the second dot pattern with the second pattern density.
- FIG. 6 is a system 600 that includes a headset 605 , in accordance with one or more embodiments.
- the headset 605 may be the headset 100 of FIG. 1 A or the headset 105 of FIG. 1 B .
- the system 600 may operate in an artificial reality environment (e.g., a virtual reality environment, an augmented reality environment, a mixed reality environment, or some combination thereof).
- the system 600 shown by FIG. 6 includes the headset 605 , an input/output (I/O) interface 610 that is coupled to a console 615 . While FIG. 6 shows an example system 600 including one headset 605 and one I/O interface 610 , in other embodiments any number of these components may be included in the system 600 .
- each headset and I/O interface 610 communicating with the console 615 .
- different and/or additional components may be included in the system 600 .
- functionality described in conjunction with one or more of the components shown in FIG. 6 may be distributed among the components in a different manner than described in conjunction with FIG. 6 in some embodiments.
- some or all of the functionality of the console 615 may be provided by the headset 605 .
- the headset 605 includes the display assembly 630 , an optics block 635 , one or more position sensors 640 , and the DCA 645 .
- Some embodiments of headset 605 have different components than those described in conjunction with FIG. 6 . Additionally, the functionality provided by various components described in conjunction with FIG. 6 may be differently distributed among the components of the headset 605 in other embodiments, or be captured in separate assemblies remote from the headset 605 .
- the display assembly 630 displays content to the user in accordance with data received from the console 615 .
- the display assembly 630 displays the content using one or more display elements (e.g., the display elements 120 ).
- a display element may be, e.g., an electronic display.
- the display assembly 630 comprises a single display element or multiple display elements (e.g., a display for each eye of a user). Examples of an electronic display include: a liquid crystal display (LCD), an organic light emitting diode (OLED) display, an active-matrix organic light-emitting diode display (AMOLED), a waveguide display, some other display, or some combination thereof.
- the display element 120 may also include some or all of the functionality of the optics block 635 .
- the optics block 635 may magnify image light received from the electronic display, corrects optical errors associated with the image light, and presents the corrected image light to one or both eyeboxes of the headset 605 .
- the optics block 635 includes one or more optical elements.
- Example optical elements included in the optics block 635 include: an aperture, a Fresnel lens, a convex lens, a concave lens, a filter, a reflecting surface, or any other suitable optical element that affects image light.
- the optics block 635 may include combinations of different optical elements.
- one or more of the optical elements in the optics block 635 may have one or more coatings, such as partially reflective or anti-reflective coatings.
- Magnification and focusing of the image light by the optics block 635 allows the electronic display to be physically smaller, weigh less, and consume less power than larger displays. Additionally, magnification may increase the field of view of the content presented by the electronic display. For example, the field of view of the displayed content is such that the displayed content is presented using almost all (e.g., approximately 110 degrees diagonal), and in some cases all, of the user's field of view. Additionally, in some embodiments, the amount of magnification may be adjusted by adding or removing optical elements.
- the optics block 635 may be designed to correct one or more types of optical error.
- optical error include barrel or pincushion distortion, longitudinal chromatic aberrations, or transverse chromatic aberrations.
- Other types of optical errors may further include spherical aberrations, chromatic aberrations, or errors due to the lens field curvature, astigmatisms, or any other type of optical error.
- content provided to the electronic display for display is pre-distorted, and the optics block 635 corrects the distortion when it receives image light from the electronic display generated based on the content.
- the position sensor 640 is an electronic device that generates data indicating a position of the headset 605 .
- the position sensor 640 generates one or more measurement signals in response to motion of the headset 605 .
- the position sensor 190 is an embodiment of the position sensor 640 .
- Examples of a position sensor 640 include: one or more IMUS, one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, or some combination thereof.
- the position sensor 640 may include multiple accelerometers to measure translational motion (forward/back, up/down, left/right) and multiple gyroscopes to measure rotational motion (e.g., pitch, yaw, roll).
- an IMU rapidly samples the measurement signals and calculates the estimated position of the headset 605 from the sampled data. For example, the IMU integrates the measurement signals received from the accelerometers over time to estimate a velocity vector and integrates the velocity vector over time to determine an estimated position of a reference point on the headset 605 .
- the reference point is a point that may be used to describe the position of the headset 605 . While the reference point may generally be defined as a point in space, however, in practice the reference point is defined as a point within the headset 605 .
- the DCA 645 generates depth information for a portion of the local area.
- the DCA includes one or more imaging devices and a DCA controller.
- the DCA 645 may also include a structured light projector.
- the DCA 200 of FIG. 2 may be an embodiment of the DCA 645 .
- the structured light projector comprises at least one VCSEL chip.
- a VCSEL emits a plurality of different dot patterns.
- the VCSEL chip includes a plurality of traces.
- a trace includes a plurality of emitters that have an arrangement on the VCSEL chip (such as sinusoidal arrangement, a pseudo random arrangement, etc.). The arrangement is such that when a trace is active, the plurality of emitters emit a dot pattern that has a spatial distribution that corresponds to the arrangement of the plurality of emitters.
- the arrangement may be the same for different traces. Alternatively, the arrangement may be different between at least one trace and one other trace on the VCSEL chip. In some embodiments, the arrangement is different for each of the traces.
- Each emitter may emit a beam of light resulting in a dot.
- the particular arrangement is such that light emitted from the plurality of emitters for a trace forms a corresponding dot pattern in the local area.
- Each trace may be individually addressable.
- different dot patterns may be generating by activating different traces on the VCSEL chip.
- the DCA controller 150 may activate all traces on the VCSEL chip.
- the DCA controller may activate a subset of the traces on the VCSEL chip. Operation and structure of the DCA 645 and the VCSEL chips are discussed in greater detail with respect to FIG. 2 - FIG. 5 .
- the audio system 650 provides audio content to a user of the headset 605 .
- the audio system 650 may comprise one or acoustic sensors, one or more transducers, and an audio controller.
- the audio system 650 may provide spatialized audio content to the user.
- the audio system 650 may provide information describing at least a portion of the local area from e.g., the DCA 645 and/or location information for the headset 605 from the position sensor 640 .
- the audio system 650 may generate one or more sound filters, and use the sound filters to provide audio content to the user.
- the I/O interface 610 is a device that allows a user to send action requests and receive responses from the console 615 .
- An action request is a request to perform a particular action.
- an action request may be an instruction to start or end capture of image or video data, or an instruction to perform a particular action within an application.
- the I/O interface 610 may include one or more input devices.
- Example input devices include: a keyboard, a mouse, a game controller, or any other suitable device for receiving action requests and communicating the action requests to the console 615 .
- An action request received by the I/O interface 610 is communicated to the console 615 , which performs an action corresponding to the action request.
- the I/O interface 610 includes an IMU that captures calibration data indicating an estimated position of the I/O interface 610 relative to an initial position of the I/O interface 610 .
- the I/O interface 610 may provide haptic feedback to the user in accordance with instructions received from the console 615 . For example, haptic feedback is provided when an action request is received, or the console 615 communicates instructions to the I/O interface 610 causing the I/O interface 610 to generate haptic feedback when the console 615 performs an action.
- the console 615 provides content to the headset 605 for processing in accordance with information received from one or more of: the DCA 645 , the headset 605 , and the I/O interface 610 .
- the console 615 includes an application store 655 , a tracking module 660 , and an engine 665 .
- Some embodiments of the console 615 have different modules or components than those described in conjunction with FIG. 6 .
- the functions further described below may be distributed among components of the console 615 in a different manner than described in conjunction with FIG. 6 .
- the functionality discussed herein with respect to the console 615 may be implemented in the headset 605 , or a remote system.
- the application store 655 stores one or more applications for execution by the console 615 .
- An application is a group of instructions, that when executed by a processor, generates content for presentation to the user. Content generated by an application may be in response to inputs received from the user via movement of the headset 605 or the I/O interface 610 . Examples of applications include: gaming applications, conferencing applications, video playback applications, or other suitable applications.
- the tracking module 660 tracks movements of the headset 605 or of the I/O interface 610 using information from the DCA 645 , the one or more position sensors 640 , or some combination thereof. For example, the tracking module 660 determines a position of a reference point of the headset 605 in a mapping of a local area based on information from the headset 605 . The tracking module 660 may also determine positions of an object or virtual object. Additionally, in some embodiments, the tracking module 660 may use portions of data indicating a position of the headset 605 from the position sensor 640 as well as representations of the local area from the DCA 645 to predict a future location of the headset 605 . The tracking module 660 provides the estimated or predicted future position of the headset 605 or the I/O interface 610 to the engine 665 .
- the engine 665 executes applications and receives position information, acceleration information, velocity information, predicted future positions, or some combination thereof, of the headset 605 from the tracking module 660 . Based on the received information, the engine 665 determines content to provide to the headset 605 for presentation to the user. For example, if the received information indicates that the user has looked to the left, the engine 665 generates content for the headset 605 that mirrors the user's movement in a virtual local area or in a local area augmenting the local area with additional content. Additionally, the engine 665 performs an action within an application executing on the console 615 in response to an action request received from the I/O interface 610 and provides feedback to the user that the action was performed. The provided feedback may be visual or audible feedback via the headset 605 or haptic feedback via the I/O interface 610 .
- a software module is implemented with a computer program product comprising a computer-readable medium containing computer program code, which can be executed by a computer processor for performing any or all the steps, operations, or processes described.
- Embodiments may also relate to an apparatus for performing the operations herein.
- This apparatus may be specially constructed for the required purposes, and/or it may comprise a general-purpose computing device selectively activated or reconfigured by a computer program stored in the computer.
- a computer program may be stored in a non-transitory, tangible computer readable storage medium, or any type of media suitable for storing electronic instructions, which may be coupled to a computer system bus.
- any computing systems referred to in the specification may include a single processor or may be architectures employing multiple processor designs for increased computing capability.
- Embodiments may also relate to a product that is produced by a computing process described herein.
- a product may comprise information resulting from a computing process, where the information is stored on a non-transitory, tangible computer readable storage medium and may include any embodiment of a computer program product or other data combination described herein.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- Electromagnetism (AREA)
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
An addressable vertical cavity surface emitting laser (VCSEL) array may generate structured light in dot patterns. The VCSEL array includes a plurality of traces that control different groups of VCSELs, such that each group of VCSELs may be individually controlled. The VCSEL groups are arranged such that they emit a dot pattern, and by modulating which groups of VCSELs are active a density of the dot pattern may be adjusted. The VCSEL array may be part of a depth projector that projects the dot pattern into a local area. A projection assembly may replicate the dot pattern in multiple tiles.
Description
- This application is a continuation of co-pending U.S. application Ser. No. 17/347,506, filed Jun. 14, 2021, which is a continuation of U.S. application Ser. No. 16/521,480, filed Jul. 24, 2019, now U.S. Pat. No. 11,063,407, which claims the benefit of U.S. Provisional Application No. 62/835,965, filed on Apr. 18, 2019, each of which is incorporated by reference in its entirety.
- This disclosure relates generally to generating structured light patterns, and more specifically to an addressable vertical cavity surface emitting laser (VCSEL) array for generating structured light patterns.
- Very generally, structured light sensing is the process of projecting a known structured light pattern (e.g., bars) onto a scene using a structured light projector. Depth information of the scene may be calculated using images of the scene illuminated with the structured light pattern. Effectiveness of the structured light pattern is based in part on a density of the pattern features. Conventional structured light projectors typically have a fixed pattern that is not dynamically adjusted. Accordingly, conventional structured light projectors typically are optimized for a particular range of distances—but outside of those distances the pattern either becomes too dense (e.g., such that the features are not resolvable from each other) or too sparse (e.g., leads to very low resolution).
- An addressable vertical cavity surface emitting laser (VCSEL) array configured to generate a plurality of different dot patterns. In some embodiments, the dot patterns are directly projected into a local area to form a structured light pattern. In other embodiments, one or more of the dot patterns are tiled throughout the local area to form the structured light pattern. The VCSEL array includes a plurality of conductive traces that control different groups of VCSELs, such that each group of VCSELs may be individually controlled. The VCSEL groups are configured to emit a respective dot pattern. By modulating which groups of VCSELs are active different dot patterns may be emitted. For example, one set of one or more VCSEL groups may emit a dot pattern that has a first dot density, and a different set of one or more VCSEL groups may emit a dot pattern of a second dot density that is different than the first dot density. The VCSEL array may be formed such that the conductive traces are all in the same plane and do not overlap. In some embodiments, one or more of the conductive traces may be in different planes and pass over and/or under one or more other conductive traces. In some embodiments, the VCSELs in different groups may emit light at different wavelengths. The VCSEL array may be part of a depth projector that projects the dot pattern into a local area.
- In some embodiments, a vertical cavity surface emitting laser (VCSEL) array may comprise: a plurality of groups of VCSELs on a single VCSEL chip, where each group of VCSELs forms a different dot pattern; and a plurality of traces, where each trace conductively couples to a respective group of VCSELs such that each group of VCSELs is individually addressable.
- In some embodiments, a structured light projector may comprise: a first group of emitters conductively coupled to a first trace; and a second group of emitters conductively coupled to a second trace, wherein the first group of emitters and the second group of emitters are individually addressable.
- In some embodiments, a method may comprise: selecting a first dot pattern, of a plurality of dot patterns, based in part on a target density and a target distance, wherein the first dot pattern is associated with a subset of traces of a plurality of traces on a chip, and each respective trace is conductively coupled to a respective group of VCSELs on the chip; activating at least one group of VCSELs that are conductively coupled via the first subset of traces, such that the activated at least one group of VCSELs emit light that forms a first dot pattern; and projecting the first dot pattern into the local area, wherein the first dot pattern has the target density at the target distance.
- In some embodiments, a vertical cavity surface emitting laser (VCSEL) array is described. The VCSEL array includes a plurality of groups of VCSELs on a single VCSEL chip, where each group of VCSELs forms a respective dot pattern. The VCSEL array further includes a plurality of traces, where each trace conductively couples to a respective group of VCSELs such that each group of VCSELs is individually addressable, and wherein a first trace in the plurality of traces overlaps a second trace in the plurality of traces.
- In some embodiments a method may comprise: selecting a first dot pattern, of a plurality of dot patterns, based in part on a target density and a target distance, wherein the first dot pattern is associated with a first subset of traces of a plurality of traces on a chip, wherein the first subset of traces includes a first trace that overlaps a second trace, and wherein each respective trace is conductively coupled to a respective group of VCSELs on the chip. The method may further comprise activating at least one group of VCSELs that are conductively coupled via the first subset of traces, such that the activated at least one group of VCSELs emit light that forms a first dot pattern; and projecting the first dot pattern into a local area, wherein the first dot pattern has the target density at the target distance.
-
FIG. 1A is a perspective view of a headset implemented as an eyewear device, in accordance with one or more embodiments. -
FIG. 1B is a perspective view of a headset implemented as a head-mounted display, in accordance with one or more embodiments. -
FIG. 2 is a block diagram of a depth camera assembly, in accordance with one or more embodiments. -
FIG. 3A is a schematic side view of a structured light projector, in accordance with one or more embodiments. -
FIG. 3B is an example of a structured light pattern, in accordance with one or more embodiments. -
FIG. 4A is a plan view of a VCSEL chip having sinusoidal traces, in accordance with one or more embodiments. -
FIG. 4B is a plan view of a VCSEL chip having overlapping traces, in accordance with one or more embodiments. -
FIG. 4C is a plan view of a VCSEL chip having angled traces, in accordance with one or more embodiments. -
FIG. 5 is a flowchart illustrating a process for generating a structured light pattern, in accordance with one or more embodiments. -
FIG. 6 is a system that includes a headset, in accordance with one or more embodiments. - The figures depict various embodiments for purposes of illustration only. One skilled in the art will readily recognize from the following discussion that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles described herein.
- A VCSEL array is configured to generate a plurality of different dot patterns. The VCSEL array may be part of a structured light projector of a depth camera assembly (e.g., for a headset). The VCSEL array includes a plurality of groups of emitters. Each group of emitters may comprise multiple discrete VCSELs which each generate a beam of light (e.g., near-infrared light). Each group of emitters may be independently controlled (e.g., by a depth camera assembly). Controlling a group of emitters may comprise instructing emitters in the group to emit light, instructing emitters in the group not to emit light, varying an intensity of light emitted from the emitters in the group, varying a wavelength of the light emitted by the emitters in the group, varying a temperature of the emitters in the group, or some combination thereof. For example, near field depth sensing (relative to far field) may use a relatively less dense dot pattern, and some emitters may be inactivated. In contrast, far field depth sensing may use a relatively denser dot pattern, and more emitters may be activated.
- The addressable groups of emitters allow for a greater variety of dot patterns to be dynamically generated compared to conventional systems. Any desired dot density may be achieved through trace pattern design and selective activation of groups of emitters. Additionally, power input is proportional to the dot density. Thus, using a single VCSEL array, a depth camera assembly may select a less dense dot pattern for a near range application to save power. Subsequently, the depth camera assembly may adjust the dot density for a far range application by increasing the dot pattern density.
- Embodiments of the invention may include or be implemented in conjunction with an artificial reality system. Artificial reality is a form of reality that has been adjusted in some manner before presentation to a user, which may include, e.g., a virtual reality (VR), an augmented reality (AR), a mixed reality (MR), a hybrid reality, or some combination and/or derivatives thereof. Artificial reality content may include completely generated content or generated content combined with captured (e.g., real-world) content. The artificial reality content may include video, audio, haptic feedback, or some combination thereof, any of which may be presented in a single channel or in multiple channels (such as stereo video that produces a three-dimensional effect to the viewer). Additionally, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to create content in an artificial reality and/or are otherwise used in an artificial reality. The artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable device (e.g., headset) connected to a host computer system, a standalone wearable device (e.g., headset), a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
-
FIG. 1A is a perspective view of aheadset 100 implemented as an eyewear device, in accordance with one or more embodiments. In some embodiments, the eyewear device is a near eye display (NED). In general, theheadset 100 may be worn on the face of a user such that content (e.g., media content) is presented using a display assembly and/or an audio system. However, theheadset 100 may also be used such that media content is presented to a user in a different manner. Examples of media content presented by theheadset 100 include one or more images, video, audio, or some combination thereof. Theheadset 100 includes a frame, and may include, among other components, a display assembly including one ormore display elements 120, a depth camera assembly (DCA), an audio system, and aposition sensor 190. WhileFIG. 1A illustrates the components of theheadset 100 in example locations on theheadset 100, the components may be located elsewhere on theheadset 100, on a peripheral device paired with theheadset 100, or some combination thereof. Similarly, there may be more or fewer components on theheadset 100 than what is shown inFIG. 1A . - The
frame 110 holds the other components of theheadset 100. Theframe 110 includes a front part that holds the one ormore display elements 120 and end pieces (e.g., temples) to attach to a head of the user. The front part of theframe 110 bridges the top of a nose of the user. The length of the end pieces may be adjustable (e.g., adjustable temple length) to fit different users. The end pieces may also include a portion that curls behind the ear of the user (e.g., temple tip, ear piece). - The one or
more display elements 120 provide light to a user wearing theheadset 100. As illustrated the headset includes adisplay element 120 for each eye of a user. In some embodiments, adisplay element 120 generates image light that is provided to an eyebox of theheadset 100. The eyebox is a location in space that an eye of user occupies while wearing theheadset 100. For example, adisplay element 120 may be a waveguide display. A waveguide display includes a light source (e.g., a two-dimensional source, one or more line sources, one or more point sources, etc.) and one or more waveguides. Light from the light source is in-coupled into the one or more waveguides which outputs the light in a manner such that there is pupil replication in an eyebox of theheadset 100. In-coupling and/or outcoupling of light from the one or more waveguides may be done using one or more diffraction gratings. In some embodiments, the waveguide display includes a scanning element (e.g., waveguide, mirror, etc.) that scans light from the light source as it is in-coupled into the one or more waveguides. Note that in some embodiments, one or both of thedisplay elements 120 are opaque and do not transmit light from a local area around theheadset 100. The local area is the area surrounding theheadset 100. For example, the local area may be a room that a user wearing theheadset 100 is inside, or the user wearing theheadset 100 may be outside and the local area is an outside area. In this context, theheadset 100 generates VR content. Alternatively, in some embodiments, one or both of thedisplay elements 120 are at least partially transparent, such that light from the local area may be combined with light from the one or more display elements to produce AR and/or MR content. - In some embodiments, a
display element 120 does not generate image light, and instead is a lens that transmits light from the local area to the eyebox. For example, one or both of thedisplay elements 120 may be a lens without correction (non-prescription) or a prescription lens (e.g., single vision, bifocal and trifocal, or progressive) to help correct for defects in a user's eyesight. In some embodiments, thedisplay element 120 may be polarized and/or tinted to protect the user's eyes from the sun. - Note that in some embodiments, the
display element 120 may include an additional optics block (not shown). The optics block may include one or more optical elements (e.g., lens, Fresnel lens, etc.) that direct light from thedisplay element 120 to the eyebox. The optics block may, e.g., correct for aberrations in some or all of the image content, magnify some or all of the image, or some combination thereof. - The DCA determines depth information for a portion of a local area surrounding the
headset 100. The DCA includes one ormore imaging devices 130, a structuredlight projector 140, and aDCA controller 150. In some embodiments, the structuredlight projector 140 illuminates a portion of the local area with light. The light may be, e.g., structured light (e.g., dot pattern, bars, etc.) in the infrared (IR), IR flash for time-of-flight, etc. In some embodiments, the one ormore imaging devices 130 capture images of the portion of the local area that include the light from the structuredlight projector 140. As illustrated,FIG. 1A shows a single structuredlight projector 140 and twoimaging devices 130. In alternate embodiments, there is no structuredlight projector 140 and at least twoimaging devices 130. - The structured
light projector 140 comprises at least one VCSEL chip. A VCSEL emits a plurality of different dot patterns. The VCSEL chip includes a plurality of traces. A trace includes a plurality of emitters that have an arrangement on the VCSEL chip (such as sinusoidal arrangement, a pseudo random arrangement, etc.). The arrangement is such that when a trace is active, the plurality of emitters emit a dot pattern that has a spatial distribution that corresponds to the arrangement of the plurality of emitters. In some embodiments, the arrangement may be the same for different traces. Alternatively, the arrangement may be different between at least one trace and one other trace on the VCSEL chip. In some embodiments, the arrangement is different for each of the traces. Each emitter may emit a beam of light resulting in a dot. The particular arrangement is such that light emitted from the plurality of emitters for a trace forms a corresponding dot pattern in the local area. Each trace may be individually addressable. Thus, different dot patterns may be generating by activating different traces on the VCSEL chip. In circumstances where a high-density dot pattern is desirable, such as for depth-sensing at long ranges, theDCA controller 150 may activate all traces on the VCSEL chip. In circumstances where a low-density dot pattern is desirable, such as for depth sensing at short ranges, theDCA controller 150 may activate a subset of the traces on the VCSEL chip. The VCSEL chips and their operation are discussed in greater detail with respect toFIG. 2 -FIG. 5 . - The
DCA controller 150 computes depth information for the portion of the local area using the captured images and one or more depth determination techniques. The depth determination technique may be, e.g., direct time-of-flight (ToF) depth sensing, indirect ToF depth sensing, structured light, passive stereo analysis, active stereo analysis (uses texture added to the scene by light from the structured light projector 140), some other technique to determine depth of a scene, or some combination thereof. - The audio system provides audio content. The audio system includes a transducer array, a sensor array, and an audio controller. However, in other embodiments, the audio system may include different and/or additional components. Similarly, in some cases, functionality described with reference to the components of the audio system can be distributed among the components in a different manner than is described here. For example, some or all of the functions of the controller may be performed by a remote server.
- The transducer array presents sound to user. The transducer array includes a plurality of transducers. A transducer may be a
speaker 160 or a tissue transducer 170 (e.g., a bone conduction transducer or a cartilage conduction transducer). - The sensor array detects sounds within the local area of the
headset 100. The sensor array includes a plurality of acoustic sensors 180. An acoustic sensor 180 captures sounds emitted from one or more sound sources in the local area (e.g., a room). Each acoustic sensor is configured to detect sound and convert the detected sound into an electronic format (analog or digital). The acoustic sensors 180 may be acoustic wave sensors, microphones, sound transducers, or similar sensors that are suitable for detecting sounds. - The audio controller (not shown in
FIG. 1A ) processes information from the sensor array that describes sounds detected by the sensor array. The audio controller may comprise a processor and a computer-readable storage medium. The audio controller may be configured to generate direction of arrival (DOA) estimates, generate acoustic transfer functions (e.g., array transfer functions and/or head-related transfer functions), track the location of sound sources, form beams in the direction of sound sources, classify sound sources, generate sound filters for thespeakers 160, or some combination thereof. - The
position sensor 190 generates one or more measurement signals in response to motion of theheadset 100. Theposition sensor 190 may be located on a portion of theframe 110 of theheadset 100. Theposition sensor 190 may include an inertial measurement unit (IMU). Examples ofposition sensor 190 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of the IMU, or some combination thereof. Theposition sensor 190 may be located external to the IMU, internal to the IMU, or some combination thereof. - In some embodiments, the
headset 100 may provide for simultaneous localization and mapping (SLAM) for a position of theheadset 100 and updating of a model of the local area. For example, theheadset 100 may include a passive camera assembly (PCA) that generates color image data. The PCA may include one or more RGB cameras that capture images of some or all of the local area. In some embodiments, some or all of theimaging devices 130 of the DCA may also function as the PCA. The images captured by the PCA and the depth information determined by the DCA may be used to determine parameters of the local area, generate a model of the local area, update a model of the local area, or some combination thereof. Furthermore, theposition sensor 190 tracks the position (e.g., location and pose) of theheadset 100 within the room. Additional details regarding the components of theheadset 100 are discussed below in connection withFIG. 6 . -
FIG. 1B is a perspective view of aheadset 105 implemented as a HMD, in accordance with one or more embodiments. In embodiments that describe an AR system and/or a MR system, portions of a front side of the HMD are at least partially transparent in the visible band (˜380 nm to 750 nm), and portions of the HMD that are between the front side of the HMD and an eye of the user are at least partially transparent (e.g., a partially transparent electronic display). The HMD includes a frontrigid body 115 and aband 175. Theheadset 105 includes many of the same components described above with reference toFIG. 1A , but modified to integrate with the HMD form factor. For example, the HMD includes a display assembly, a DCA, an audio system, and aposition sensor 190.FIG. 1B shows the structuredlight projector 140, a plurality of thespeakers 160, a plurality of theimaging devices 130, a plurality of acoustic sensors 180, and theposition sensor 190. -
FIG. 2 is a block diagram of aDCA 200 for a headset, in accordance with one or more embodiments. In some embodiments, theDCA 200 may be the DCA described with respect toFIG. 1A andFIG. 1B . Some embodiments of theDCA 200 have different components than those described here. Similarly, the functions can be distributed among the components in a different manner than is described here. In some embodiments, some of the functions of theDCA 200 may be part of different components (e.g., some may be part of the headset and some maybe part of a console and/or server). - The
DCA 200 generates depth information of a local area, such as a room. Depth information includes pixel values defining distance from theDCA 200, providing a mapping of locations captured in the depth information, such as a three-dimensional mapping of locations captured in the depth information. TheDCA 200 includes a structuredlight projector 210, acamera assembly 220, and acontroller 230. - The structured
light projector 210 generates structured light and projects the structured light into the local area. The structuredlight projector 140 ofFIG. 1A may be an embodiment of the structuredlight projector 210. The structuredlight projector 210 comprises one or more illumination sources, an optical assembly, and a projection assembly. An illumination source is configured to emit light (e.g., as an optical beam), and may emit multiple wavelengths of light. The illumination source may emit light in, e.g., a visible band (˜380 nm to 750 nm), in an infrared (IR) band (˜750 nm to 1,800 nm), in an ultraviolet band (˜100 nm to 380 nm), some other portion of the electromagnetic spectrum that thecamera assembly 220 is configured to detect, or some combination thereof. Light emitted from the one or more of the illumination sources may be, e.g., polarized (e.g., linear, circular, etc.). - The illumination source may comprise a vertical-cavity surface-emitting laser (VCSEL) chip. The VCSEL chip may comprise a plurality of traces. Each trace may comprise a plurality of emitters that have an arrangement on the VCSEL chip (such as sinusoidal arrangement, a pseudo random arrangement, etc.). In some embodiments, one or more traces on the VCSEL chip may overlap. The arrangement is such that when a trace is active, the plurality of emitters emit a dot pattern that has a spatial distribution that corresponds to the arrangement of the plurality of emitters. Each emitter may emit a beam of light resulting in a dot. The emitters may emit light of different wavelengths or polarizations. Each trace may be individually addressable. Thus, different dot patterns may be generating by activating different traces on the VCSEL chip. In circumstances where a high-density dot pattern is desirable, such as for depth-sensing at long ranges, the
DCA controller 150 may activate all traces on the VCSEL chip. In circumstances where a low-density dot pattern is desirable, such as for depth sensing at short ranges, theDCA controller 150 may activate a subset of the traces on the VCSEL chip. - In some embodiments, the emitter arrangement may be the same for different traces. Alternatively, the arrangement may be different between at least one trace and one other trace on the VCSEL chip. In some embodiments, the arrangement is different for each of the traces. In this manner, the VCSEL chip can emit dot patterns of variable density, where density of the emitted dot pattern increases with a number of traces that are activated. In some embodiments, each emitter may be controlled by its own trace. Thus, each emitter on the VCSEL chip could be individually controlled. The VCSEL chips and their operation are discussed in additional detail with respect to
FIG. 3 -FIG. 5 . - The projection assembly projects one or more structured light patterns into the local area. The conditioned one or more dot patterns form a corresponding structured light pattern that the projection assembly projects into the local area. Each trace may emit a particular dot pattern. The combination of active dot patterns combines to form a corresponding structured light pattern in the local area. With different active groups of emitters, the projection assembly projects different structured light patterns. The projection assembly comprises one or more optical elements that direct the structured light pattern into the local area. For example, the projection assembly could comprise a plurality of lenses. In some embodiments, the projection assembly includes a beam shaping element that changes a profile, or general intensity envelope, of the structured light. The structured light pattern includes a plurality of structured light elements. Each element is a discrete portion of the structured light pattern, such as a dot.
- The projection assembly generates a plurality of tiles using the conditioned light (dot pattern emitted by the VCSEL array) and projects the tiles throughout the local area to form a structured light pattern. The projection assembly may comprise one or more optical elements, such as diffractive optical elements (e.g., 1D and/or 2D gratings), scanning mirrors (e.g., MEMS mirror), lenses, mirrors, or some combination thereof.
- In some embodiments, all of the tiles generated by the projection assembly have the same dot pattern. In other embodiments, the projection assembly may generate one or more tiles that have a dot pattern that is different from at least one other tile. For example, the VCSEL chip may generate a first dot pattern that is projected into a particular portion of the local area using a scanning mirror, and then produce a second dot pattern that is projected into a different portion of the local area using a scanning mirror.
- The structured
light projector 210 may vary the structured light pattern in accordance with illumination instructions from thecontroller 230. In some embodiments, the structuredlight projector 210 may project the same pattern over the entire field of view of the structuredlight projector 210, or the structuredlight projector 210 may project different structured light patterns to different portions of the field of view. For example, the structured light pattern may be formed from a plurality of tiles that are each projected into a respective portion of the field of view of the structuredlight projector 210. The plurality of tiles together form an entire structured light pattern. In some embodiments, each tile of the structured light pattern may contain a different structured light pattern and may be individually adjusted. For example, in response to a change in condition at a given instant in time, the structuredlight projector 210 may increase the intensity of the structured light pattern in a first tile, such as by activating a trace or by increasing the current driven through a trace, and the structuredlight projector 210 may simultaneously decrease the intensity of the structured light pattern in a second tile, such as by deactivating a trace or decreasing the current driven through the trace. For each portion of the field of view of the structuredlight projector 210, the structuredlight projector 210 may adjust any suitable property of the structured light pattern, such as the intensity, density, pattern shape (e.g., dots, grids), polarization, blink rate, etc. In some embodiments, the structured light pattern may be time multiplexed, such that different patterns are projected into different portions of the field of view at different times. - The structured
light projector 210 may vary the structured light pattern by having different groups of emitters be active and/or having some or all of the emitters be tunable. In some embodiments, the structured light pattern is controlled by controlling each emitter individually or by group or section, in which the dynamic properties are manifested in the projected pattern in terms of pattern shape, intensity, polarization, temporal modulation, field of view, etc. In some embodiments, the combination of using an addressable light source and tunable optics may be adopted to realize dynamic light patterns with considerations in projector size, weight, power, cost, etc. - Different VCSEL chips may be designed for specific applications. In some embodiments, the structured
light projector 210 may apply different currents or pulse durations to different traces to make a structured light pattern with multiple dot intensity levels. This may make the dot constellation detection algorithm less complicated, which may reduce a computation power requirement. Additionally, by placing emitters on narrow curved traces, the layout allows uniform coverage of dot emitters across a VCSEL chip. - The
camera assembly 220 is configured to capture images of the local area. Thecamera assembly 220 includes one or more imaging devices (e.g., a camera) that can capture images in at least a band of the structured light pattern, such as in the infrared band. Theimaging devices 130 ofFIG. 1A may be an embodiment of thecamera assembly 220. In some embodiments, the one or more imaging devices and/or other imaging devices of thecamera assembly 220 may also capture light in a visible optical band. In some instances, some or all of the captured images of the local area may include some or all of the structured light pattern (e.g., reflected by objects in the local area). - The
controller 230 controls the components of theDCA 200. The controller may comprise anillumination module 250 and adepth measurement module 240. Some embodiments of thecontroller 230 have different components than those described here. Similarly, the functions can be distributed among the components in a different manner than is described here. In some embodiments, some of the functions of thecontroller 230 may be part of different components (e.g., some may be part of the headset and some maybe part of a console and/or server). - The
illumination module 250 may generate illumination instructions to provide to the structuredlight projector 210 to project a structured light pattern. The illumination instructions may reduce (and in some cases minimize) power consumption of the structuredlight projector 210 while providing sufficient texture in the local area to calculate depth information. In some embodiments, theillumination module 250 may determine that the local area contains sufficient texture based on a confidence level of depth measurements (e.g., texture may be sufficient if depth measurements are calculated with a confidence level of greater than 95%, or greater than 50%). - In some embodiments, the illumination instructions may cause the structured light projector to activate or deactivate groups of emitters based on a distance to an object. For example, in response to a known or measured distance to an object that is less than a threshold distance, such as less than 3 feet, or less than 10 feet, the illumination instructions may cause the structured
light projector 210 to deactivate at least one group of emitters, or a percentage of the groups of emitters, such as 50% of the groups of emitters. In response to a known or measured distance to an object that is greater than the threshold distance, the illumination instructions may instruct the structuredlight projector 210 to activate all of the groups of emitters, or a percentage of the groups of emitters, such as at least 75% of the groups of emitters. In some embodiments, different numbers or combinations of the groups of emitters may be activated based on different distances to objects. - The
depth measurement module 240 determines depth information for each pixel of an image based on images captured by thecamera assembly 220 and stores the depth information for each pixel in association with the pixel to generate the depth image. The depth measurement module analyzes the images containing the structured light pattern. Distortions in the structured light pattern by three-dimensional objects in the local area allow the DCA to calculate three-dimensional depth information. In some embodiments, the depth measurement module uses known methods to calculate depth information, such as active stereo, time-of-flight, etc. -
FIG. 3A is an example schematic side view of a structuredlight projector 300 according to one or more embodiments. In some embodiments, the structuredlight projector 300 may be an embodiment of the structuredlight projector 210 ofFIG. 2 . The structuredlight projector 300 may comprise at least oneVCSEL chip 310 and anoptical assembly 320. TheVCSEL chip 310 is an embodiment of the VCSEL array and/or VCSEL chip described above. Note, while asingle VCSEL chip 310 is shown, in other embodiments, multiple VCSEL chips may part of the structuredlight projector 300. In some embodiments, the structuredlight projector 300 may also include aprojection assembly 330. The structuredlight projector 300 generates and projects a structured light pattern, of a plurality of structured light patterns, in accordance with instructions from a depth camera assembly (not shown), such as thedepth camera assembly 200 ofFIG. 2 . - The structured
light projector 300 projects structured light 315 into a local area 325. The local area 325 may include one or more objects, such asobject 335 andobject 345. Theobject 335 and theobject 345 may be located at different distances to the structuredlight projector 300. Based on the different distances, the structuredlight projector 300 may select different structure light densities or patterns to illuminate theobject 335 and theobject 345. For example, the structuredlight projector 300 may select a denser pattern in the area ofobject 335, and a relatively less dense pattern in the area ofobject 345. - The
optical assembly 320 conditions light from theVCSEL chip 310 ofFIG. 3A . Conditioning light may include, e.g., collimating light from theVCSEL chip 310, error and/or aberration correction, beam expansion, projection, or some combination thereof. Theoptical assembly 320 may comprise one or more lenses, mirrors, or other components configured to condition light from theVCSEL chip 310. In some embodiments, there is no beam multiplication DOE and theoptical assembly 320 projects the conditioned light directly into the local area. In this case the conditioned dot pattern is the structured light pattern. In some embodiments the optical assembly may comprise a beam combiner that combines beams from different VCSEL chips to further increase pattern density. For example, different VCSELs may emit light at different wavelengths, which may be combined using a dichroic mirror. - In some embodiments, the structured
light projector 300 may also include aprojection assembly 330. Theprojection assembly 330 generates a plurality of tiles 340 using the conditioned light (dot pattern emitted by the VCSEL array) and projects the tiles throughout the local area to form a structured light pattern. Theprojection assembly 330 may comprise one or more optical elements, such as diffractive optical elements (e.g., 1D and/or 2D gratings), scanning mirrors (e.g., MEMS mirror), lenses, mirrors, or some combination thereof. -
FIG. 3B is an example of a structured light pattern according to one or more embodiments. The structuredlight projector 300 ofFIG. 3A generates a dot pattern comprising a plurality ofdots 350, of a plurality of dot patterns, in accordance with instructions from a controller of a depth camera assembly (not shown). - In the illustrated example, the
projection assembly 330 replicates the conditioned light (dot pattern) to form a n×M tile pattern in the local area, where each tile comprises the dot pattern, and n and M are integers. In some embodiments, all of the instances have the same dot pattern (e.g., as illustrated). In other embodiments, the projection assembly may generate one or more tiles that have a dot pattern that is different from at least one other tile. For example, arow 360 oftiles including tiles row 370 of tiles may receive beams from emitters on a second subset of the traces, and a row 380 of tiles may receive beams from emitters on a third subset of the traces. For example, the VCSEL chip may generate a first dot pattern that is projected into a particular portion (e.g., that would be occupied by row 360) of the local area using a scanning mirror, and then produce a second dot pattern that is projected into a different portion (e.g., that would be occupied by row 370) of the local area using a scanning mirror. - In another example, a density of the dot pattern for each tile may be dependent on instructions from the DCA. For example, the DCA may instruct the structured
light projector 300 to provide a particular density pattern based on how far objects are located away from the DCA. For example, a portion of the local area that is closer to a user (e.g., user's hands) may have tiles with a dot pattern density that is lower than a portion of the local area that is far from the user (e.g., 20 feet away). - As mentioned, each trace can be made to have a unique intensity by setting, for example, different numbers of emitters in each trace. Other methods can include driving each trace with a different current or a different operating pulse width. The result is a tile with a unique pattern of dot density or dot intensities. In some embodiments, the tile can then be projected into the local area.
-
FIG. 4A is a plan view of aVCSEL chip 400 according to one or more embodiments. The VCSEL chip is an example of the VCSEL array. TheVCSEL chip 400 may comprise a plurality ofbond pads traces 430, and a plurality ofemitters 400 deposited on asubstrate 450. TheVCSEL chip 400 may be a component of the structuredlight projector 210 ofFIG. 2 . - A first series of
bond pads 410 and a second series ofbond pads 420 provide coupling locations between thesubstrate 450 and the plurality oftraces 430. A voltage differential may be applied between the first series ofbond pads 410 and the second series ofbond pads 420, causing current to flow between electrically connected bond pads. The voltage differentials may be selectively applied individually to each pair of connected bond pads. Thus, the components connected to each pair of connected bond pads may be individually controllable. In some embodiments, eachtrace 430 may be coupled to thesubstrate 450 via a single bond pad in order to reduce the footprint of the substrate. - The plurality of
traces 430 provides an electrical connection from a bond pad in the first series ofbond pads 410 to a bond pad in the second series ofbond pads 420. Thetrace 430 may comprise an electrically conductive material (e.g., copper, gold, etc.) deposited on thesubstrate 450. In some embodiments, two or more traces may be connected in parallel. In some embodiments, atrace 430 may comprise a straight line between two bond pads. In some embodiments, at least a portion of atrace 430 may comprise a change in direction, such as a curve or angle, such that thetrace 430 is not a complete straight line between the bond pads connected by the trace. Thetrace 430 may have a width of approximately 15 microns, or in some embodiments between 5 microns-30 microns. As illustrated inFIG. 4A , eachtrace 430 is in the general shape of a sinusoidal wave. The shape of thetraces 430 provide for uniform emitter coverage on theVCSEL chip 400. - In some embodiments, all the
traces 430 on theVCSEL chip 400 may be coplanar. Thetraces 430 may be deposited in a single process, and thetraces 430 may be separated by a separation distance, such as at least 5 microns, to prevent electrical communication between adjacent traces. - The plurality of
emitters 440 are each VCSELs. Eachemitter 440 may generate a beam of light which provides one or more dots in a structured light pattern. Eachtrace 430 may comprise a plurality ofemitters 440 conductively coupled to thetrace 430, referred to as a group ofemitters 440. As illustrated, eachtrace 430 comprises approximately 16emitters 440. However, traces 430 may comprise any suitable number ofemitters 440, such as between 5 and 15emitters 440, between 1 and 30emitters 440, or greater than 30emitters 440. The number ofemitters 440 on asingle trace 430 may be limited by a minimum pitch distance betweenemitters 440 which maintains the ability of theemitters 440 to emit a discrete beam of light which is separate fromadjacent emitters 440. Eachemitter 440 may be approximately 5 microns in diameter, or between 2 microns-10 microns in diameter. Anemitter 440 with a 5 micron diameter may provide a good single mode/gaussian shape dot, with a relatively narrow beam divergence and a suitable dot power consumption. In some embodiments, a minimum pitch distance betweenemitters 440 ondifferent traces 430 may be approximately 25 microns, or at least 20 microns. A minimum pitch distance betweenemitters 440 on thesame trace 430 may be approximately 20 microns, or at least 15 microns. In some embodiments the plurality ofemitters 440 are all of a same type (e.g., emit at a same wavelength). In some embodiments, the plurality ofemitters 440 includes at least oneemitter 440 that is of a different type from another emitter 440 (e.g., emit at two different wavelengths). In some embodiments, all of theemitters 440 in a group are of a same type. In other embodiments, at least oneemitter 440 in a group is of a different type than anotheremitter 440 within the group. - In some embodiments each
trace 430 comprises the same number of operational emitters, but varies a driving current for each group. Accordingly, some dots from one group may have a higher intensity than dots in a different group. And in some embodiments, intensity ofemitters 440 within a single group may be different from one another. For example, power reduction circuits may be user before one or more emitters within a group ofemitters 440. A power reduction circuit reduces an amount of power provided to aparticular emitter 440. - In a further alternative,
different traces 430 on theVCSEL chip 400 are of different length, thus having different numbers ofemitters 440 in order to achieve different intensities. In some embodiments, the spacing betweenemitters 440 is even within a group and/or a plurality of groups (in some cases all groups). Alternatively, a spacing betweenemitters 440 on atrace 430 may vary within a group and/or a plurality of groups (in some cases all groups). - In some embodiments, the
emitters 440 on asingle trace 430 are not collinear. As shown, thetraces 430 are curved, and themultiple emitters 440 are located at different positions along the curved traces 430. Theemitters 440 on asingle trace 430 may be controlled as a group by controlling the voltage differential between thebond pads trace 430. Thus, each group ofemitters 440 may be individually addressable. By controlling thenon-collinear emitters 440 as a group, a greater variety of addressable dot patterns may be generated versus using groups of collinear emitters. In contrast to straight traces, which may be used for a grid or line pattern, thecurved traces 430 may be used to generate dots in a random pattern, as theemitters 440 may be placed at any desired locations along the curved traces 430. Some applications may benefit from the ability to create a structured light pattern of random or semi-random dots. -
FIG. 4B is a plan view of aVCSEL chip 401 with overlapping traces in accordance with one or more embodiments. TheVCSEL chip 401 comprises a first series ofbond pads 411 connected to a second series ofbond pads 421 by a plurality oftraces 431. A plurality ofemitters 441 are electrically coupled to thetraces 431. Thetraces 431 are deposited on asubstrate 451. Eachtrace 431 may be a straight line from abond pad 411 to abond pad 421. However, in some embodiments one or more of thetraces 431 may have curves or angles. - In some embodiments, at least one trace may overlap at least one other trace. For example,
trace 431A overlaps traces 431B, such that at least a portion oftrace 431B is located between a portion oftrace 431A and thesubstrate 451. Thetraces first trace 431B may be deposited, a dielectric layer may be deposited over thefirst trace 431B, and asecond trace 431A may be deposited on the dielectric layer. Thus, thesecond trace 431A may overlap thefirst trace 431B, and the dielectric layer may prevent electrical communication between the first trace and the second trace. In some embodiments, the dielectric layer may be transparent such that light emitted by the emitters passes through the dielectric layer. In some embodiments, the dielectric layer may be partially opaque, such that a portion of the light emitted by the emitters is obscured by the dielectric layer. Thus, the emitters located under the dielectric layer emitting light at the same intensity as the emitters located over the dielectric layer may generate dots of lesser intensity in the structured light pattern. Overlapping traces may provide the ability to generate a greater variety of dot patterns. -
FIG. 4C is a plan view of aVCSEL chip 402 with angled traces in accordance with one or more embodiments. TheVCSEL chip 402 comprises a first series ofbond pads 412 connected to a second series ofbond pads 422 by a plurality oftraces 432. A plurality ofemitters 442 are electrically coupled to thetraces 432. Thetraces 432 are deposited on asubstrate 452. Eachtrace 431 may comprise a plurality of straight line segments from abond pad 411 to abond pad 421. For example, as shown thetrace 432 comprises a firststraight segment 462 and a secondstraight segment 472 which intersect at anangle 482. Theangle 482 may range from greater than 0° to less than 180°. Although shown with two segments, thetraces 432 may comprise any suitable number of straight line segments or curved segments. Angled traces may provide the ability to generate a greater variety of dot patterns. - Any combination of the above embodiments may also be provided for achieving dots of varying intensity. A reason for combining the embodiments is to provide a residual level of intensity difference with the further option of increasing the intensity difference when the region being illuminated demands a greater contrast, a better ambiguity, or a better ability to detect a projected dot pattern.
-
FIG. 5 is a flowchart of aprocess 500 for generating a structured light pattern in accordance with one or more embodiments. The process shown inFIG. 5 may be performed by components of a DCA (e.g., DCA 200). Other entities may perform some or all of the steps inFIG. 5 in other embodiments. Embodiments may include different and/or additional steps, or perform the steps in different orders. - The DCA controller selects 510 a first dot pattern, of a plurality of dot patterns, based in part on a target density and a target distance, wherein the first dot pattern is associated with a subset of traces of a plurality of traces on a chip, and each respective trace is conductively coupled to a respective group of VCSELs on the chip. The first dot pattern may be selected based on a distance to an object, based on a calculated texture in a local area, manually input, or selected by any other suitable process. In some embodiments, the distance may be a previously known distance. In some embodiments, the distance to the object may be measured by the depth measurement module.
- The DCA controller may initially activate all groups of emitters to create a dense dot pattern over the field of view of the camera assembly. The depth measurement module may measure the distance to objects within the field of view. Based on the distance, object size, etc., the DCA controller may determine a target density for the first dot pattern.
- The DCA controller activates 520 at least one group of VCSELs that are conductively coupled via the first subset of traces, such that the activated at least one group of VCSELs emit light that forms a first dot pattern. Activating the groups of VCSELs may cause the emitters coupled to the traces to emit light, or to increase an amount of light emitted by the emitters.
- The structured
light projector projects 530 the first dot pattern into the local area, wherein the first dot pattern has the target density at the target distance. A first portion of the first dot pattern may be projected by a first group of dot emitters, and a second portion of the first dot pattern may be projected by a second group of dot emitters. In some embodiments, the first portion of the first dot pattern may be a first tile of the first dot pattern, and the second portion of the first dot pattern may be a second tile of the first dot pattern. However, in some embodiments, the first portion of the first dot pattern may be a first plurality of dots in the first dot pattern, and the second portion of the first dot pattern may be a second plurality of dots in the first dot pattern. The first plurality of dots and the second plurality of dots may both be projected into a first tile of the first dot pattern. - The DCA controller may select a second dot pattern. The second dot pattern may be less dense than the first pattern density. For example, the DCA controller may determine that a distance to an object has decreased, and thus a lesser dot density may be desirable. In some embodiment, the second pattern density may be greater than the first pattern density. The structured light projector may project the second dot pattern with the second pattern density.
-
FIG. 6 is asystem 600 that includes aheadset 605, in accordance with one or more embodiments. In some embodiments, theheadset 605 may be theheadset 100 ofFIG. 1A or theheadset 105 ofFIG. 1B . Thesystem 600 may operate in an artificial reality environment (e.g., a virtual reality environment, an augmented reality environment, a mixed reality environment, or some combination thereof). Thesystem 600 shown byFIG. 6 includes theheadset 605, an input/output (I/O)interface 610 that is coupled to aconsole 615. WhileFIG. 6 shows anexample system 600 including oneheadset 605 and one I/O interface 610, in other embodiments any number of these components may be included in thesystem 600. For example, there may be multiple headsets each having an associated I/O interface 610, with each headset and I/O interface 610 communicating with theconsole 615. In alternative configurations, different and/or additional components may be included in thesystem 600. Additionally, functionality described in conjunction with one or more of the components shown inFIG. 6 may be distributed among the components in a different manner than described in conjunction withFIG. 6 in some embodiments. For example, some or all of the functionality of theconsole 615 may be provided by theheadset 605. - The
headset 605 includes thedisplay assembly 630, anoptics block 635, one ormore position sensors 640, and theDCA 645. Some embodiments ofheadset 605 have different components than those described in conjunction withFIG. 6 . Additionally, the functionality provided by various components described in conjunction withFIG. 6 may be differently distributed among the components of theheadset 605 in other embodiments, or be captured in separate assemblies remote from theheadset 605. - The
display assembly 630 displays content to the user in accordance with data received from theconsole 615. Thedisplay assembly 630 displays the content using one or more display elements (e.g., the display elements 120). A display element may be, e.g., an electronic display. In one or more embodiments, thedisplay assembly 630 comprises a single display element or multiple display elements (e.g., a display for each eye of a user). Examples of an electronic display include: a liquid crystal display (LCD), an organic light emitting diode (OLED) display, an active-matrix organic light-emitting diode display (AMOLED), a waveguide display, some other display, or some combination thereof. Note in some embodiments, thedisplay element 120 may also include some or all of the functionality of the optics block 635. - The optics block 635 may magnify image light received from the electronic display, corrects optical errors associated with the image light, and presents the corrected image light to one or both eyeboxes of the
headset 605. In one or more embodiments, the optics block 635 includes one or more optical elements. Example optical elements included in the optics block 635 include: an aperture, a Fresnel lens, a convex lens, a concave lens, a filter, a reflecting surface, or any other suitable optical element that affects image light. Moreover, the optics block 635 may include combinations of different optical elements. In some embodiments, one or more of the optical elements in the optics block 635 may have one or more coatings, such as partially reflective or anti-reflective coatings. - Magnification and focusing of the image light by the optics block 635 allows the electronic display to be physically smaller, weigh less, and consume less power than larger displays. Additionally, magnification may increase the field of view of the content presented by the electronic display. For example, the field of view of the displayed content is such that the displayed content is presented using almost all (e.g., approximately 110 degrees diagonal), and in some cases all, of the user's field of view. Additionally, in some embodiments, the amount of magnification may be adjusted by adding or removing optical elements.
- In some embodiments, the optics block 635 may be designed to correct one or more types of optical error. Examples of optical error include barrel or pincushion distortion, longitudinal chromatic aberrations, or transverse chromatic aberrations. Other types of optical errors may further include spherical aberrations, chromatic aberrations, or errors due to the lens field curvature, astigmatisms, or any other type of optical error. In some embodiments, content provided to the electronic display for display is pre-distorted, and the optics block 635 corrects the distortion when it receives image light from the electronic display generated based on the content.
- The
position sensor 640 is an electronic device that generates data indicating a position of theheadset 605. Theposition sensor 640 generates one or more measurement signals in response to motion of theheadset 605. Theposition sensor 190 is an embodiment of theposition sensor 640. Examples of aposition sensor 640 include: one or more IMUS, one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, or some combination thereof. Theposition sensor 640 may include multiple accelerometers to measure translational motion (forward/back, up/down, left/right) and multiple gyroscopes to measure rotational motion (e.g., pitch, yaw, roll). In some embodiments, an IMU rapidly samples the measurement signals and calculates the estimated position of theheadset 605 from the sampled data. For example, the IMU integrates the measurement signals received from the accelerometers over time to estimate a velocity vector and integrates the velocity vector over time to determine an estimated position of a reference point on theheadset 605. The reference point is a point that may be used to describe the position of theheadset 605. While the reference point may generally be defined as a point in space, however, in practice the reference point is defined as a point within theheadset 605. - The
DCA 645 generates depth information for a portion of the local area. The DCA includes one or more imaging devices and a DCA controller. TheDCA 645 may also include a structured light projector. TheDCA 200 ofFIG. 2 may be an embodiment of theDCA 645. - The structured light projector comprises at least one VCSEL chip. A VCSEL emits a plurality of different dot patterns. The VCSEL chip includes a plurality of traces. A trace includes a plurality of emitters that have an arrangement on the VCSEL chip (such as sinusoidal arrangement, a pseudo random arrangement, etc.). The arrangement is such that when a trace is active, the plurality of emitters emit a dot pattern that has a spatial distribution that corresponds to the arrangement of the plurality of emitters. In some embodiments, the arrangement may be the same for different traces. Alternatively, the arrangement may be different between at least one trace and one other trace on the VCSEL chip. In some embodiments, the arrangement is different for each of the traces. Each emitter may emit a beam of light resulting in a dot. The particular arrangement is such that light emitted from the plurality of emitters for a trace forms a corresponding dot pattern in the local area. Each trace may be individually addressable. Thus, different dot patterns may be generating by activating different traces on the VCSEL chip. In circumstances where a high-density dot pattern is desirable, such as for depth-sensing at long ranges, the
DCA controller 150 may activate all traces on the VCSEL chip. In circumstances where a low-density dot pattern is desirable, such as for depth sensing at short ranges, the DCA controller may activate a subset of the traces on the VCSEL chip. Operation and structure of theDCA 645 and the VCSEL chips are discussed in greater detail with respect toFIG. 2 -FIG. 5 . - The
audio system 650 provides audio content to a user of theheadset 605. Theaudio system 650 may comprise one or acoustic sensors, one or more transducers, and an audio controller. Theaudio system 650 may provide spatialized audio content to the user. Theaudio system 650 may provide information describing at least a portion of the local area from e.g., theDCA 645 and/or location information for theheadset 605 from theposition sensor 640. Theaudio system 650 may generate one or more sound filters, and use the sound filters to provide audio content to the user. - The I/
O interface 610 is a device that allows a user to send action requests and receive responses from theconsole 615. An action request is a request to perform a particular action. For example, an action request may be an instruction to start or end capture of image or video data, or an instruction to perform a particular action within an application. The I/O interface 610 may include one or more input devices. Example input devices include: a keyboard, a mouse, a game controller, or any other suitable device for receiving action requests and communicating the action requests to theconsole 615. An action request received by the I/O interface 610 is communicated to theconsole 615, which performs an action corresponding to the action request. In some embodiments, the I/O interface 610 includes an IMU that captures calibration data indicating an estimated position of the I/O interface 610 relative to an initial position of the I/O interface 610. In some embodiments, the I/O interface 610 may provide haptic feedback to the user in accordance with instructions received from theconsole 615. For example, haptic feedback is provided when an action request is received, or theconsole 615 communicates instructions to the I/O interface 610 causing the I/O interface 610 to generate haptic feedback when theconsole 615 performs an action. - The
console 615 provides content to theheadset 605 for processing in accordance with information received from one or more of: theDCA 645, theheadset 605, and the I/O interface 610. In the example shown inFIG. 6 , theconsole 615 includes anapplication store 655, atracking module 660, and anengine 665. Some embodiments of theconsole 615 have different modules or components than those described in conjunction withFIG. 6 . Similarly, the functions further described below may be distributed among components of theconsole 615 in a different manner than described in conjunction withFIG. 6 . In some embodiments, the functionality discussed herein with respect to theconsole 615 may be implemented in theheadset 605, or a remote system. - The
application store 655 stores one or more applications for execution by theconsole 615. An application is a group of instructions, that when executed by a processor, generates content for presentation to the user. Content generated by an application may be in response to inputs received from the user via movement of theheadset 605 or the I/O interface 610. Examples of applications include: gaming applications, conferencing applications, video playback applications, or other suitable applications. - The
tracking module 660 tracks movements of theheadset 605 or of the I/O interface 610 using information from theDCA 645, the one ormore position sensors 640, or some combination thereof. For example, thetracking module 660 determines a position of a reference point of theheadset 605 in a mapping of a local area based on information from theheadset 605. Thetracking module 660 may also determine positions of an object or virtual object. Additionally, in some embodiments, thetracking module 660 may use portions of data indicating a position of theheadset 605 from theposition sensor 640 as well as representations of the local area from theDCA 645 to predict a future location of theheadset 605. Thetracking module 660 provides the estimated or predicted future position of theheadset 605 or the I/O interface 610 to theengine 665. - The
engine 665 executes applications and receives position information, acceleration information, velocity information, predicted future positions, or some combination thereof, of theheadset 605 from thetracking module 660. Based on the received information, theengine 665 determines content to provide to theheadset 605 for presentation to the user. For example, if the received information indicates that the user has looked to the left, theengine 665 generates content for theheadset 605 that mirrors the user's movement in a virtual local area or in a local area augmenting the local area with additional content. Additionally, theengine 665 performs an action within an application executing on theconsole 615 in response to an action request received from the I/O interface 610 and provides feedback to the user that the action was performed. The provided feedback may be visual or audible feedback via theheadset 605 or haptic feedback via the I/O interface 610. - The foregoing description of the embodiments has been presented for illustration; it is not intended to be exhaustive or to limit the patent rights to the precise forms disclosed. Persons skilled in the relevant art can appreciate that many modifications and variations are possible considering the above disclosure.
- Some portions of this description describe the embodiments in terms of algorithms and symbolic representations of operations on information. These algorithmic descriptions and representations are commonly used by those skilled in the data processing arts to convey the substance of their work effectively to others skilled in the art. These operations, while described functionally, computationally, or logically, are understood to be implemented by computer programs or equivalent electrical circuits, microcode, or the like. Furthermore, it has also proven convenient at times, to refer to these arrangements of operations as modules, without loss of generality. The described operations and their associated modules may be embodied in software, firmware, hardware, or any combinations thereof.
- Any of the steps, operations, or processes described herein may be performed or implemented with one or more hardware or software modules, alone or in combination with other devices. In one embodiment, a software module is implemented with a computer program product comprising a computer-readable medium containing computer program code, which can be executed by a computer processor for performing any or all the steps, operations, or processes described.
- Embodiments may also relate to an apparatus for performing the operations herein. This apparatus may be specially constructed for the required purposes, and/or it may comprise a general-purpose computing device selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a non-transitory, tangible computer readable storage medium, or any type of media suitable for storing electronic instructions, which may be coupled to a computer system bus. Furthermore, any computing systems referred to in the specification may include a single processor or may be architectures employing multiple processor designs for increased computing capability.
- Embodiments may also relate to a product that is produced by a computing process described herein. Such a product may comprise information resulting from a computing process, where the information is stored on a non-transitory, tangible computer readable storage medium and may include any embodiment of a computer program product or other data combination described herein.
- Finally, the language used in the specification has been principally selected for readability and instructional purposes, and it may not have been selected to delineate or circumscribe the patent rights. It is therefore intended that the scope of the patent rights be limited not by this detailed description, but rather by any claims that issue on an application based hereon. Accordingly, the disclosure of the embodiments is intended to be illustrative, but not limiting, of the scope of the patent rights, which is set forth in the following claims.
Claims (20)
1. A vertical cavity surface emitting laser (VCSEL) array comprising:
a plurality of groups of VCSELs on a single VCSEL chip, where each group of VCSELs forms a respective dot pattern; and
a plurality of traces, where each trace conductively couples to a respective group of VCSELs such that each group of VCSELs is individually addressable, and wherein a first trace in the plurality of traces overlaps a second trace in the plurality of traces.
2. The VCSEL array of claim 1 , wherein the first trace and the second trace are each linear and overlap in an X pattern.
3. The VCSEL array of claim 1 , wherein a group of VCSELs, of the plurality of groups of VCSELs, is individually addressable by changing a voltage differential between a first bond pad and a second bond pad coupled to a trace that electrically connects the group of VCSELs to the first bond pad and the second bond pad.
4. The VCSEL array of claim 1 , further comprising a projection assembly configured to project light emitted by the plurality of groups of VCSELs into a plurality of tiles.
5. The VCSEL array of claim 1 , further comprising a dielectric layer deposited between a first plane comprising the first trace in the plurality of traces and a second plane comprising a second trace in the plurality of traces.
6. The VCSEL array of claim 5 , wherein the first plane is below the dielectric layer, such that light emitted from the first trace passes through the dielectric layer and the dielectric layer is transparent to light emitted by the first trace.
7. The VCSEL array of claim 5 , wherein the first plane is below the dielectric layer, such that light emitted from the first trace passes through the dielectric layer and the dielectric layer is partially opaque to light emitted by the first trace, such that, for a given drive current, light output from the VCSEL array that originates from the first trace has a lower intensity than light output from the VCSEL array that originates from the second trace.
8. The VCSEL array of claim 1 , wherein the second trace is curved.
9. A structured light projector comprising:
a plurality of groups of VCSELs on a single VCSEL chip, where each group of the plurality of groups of VCSELs forms a respective dot pattern; and
a plurality of traces, where each trace conductively couples to a respective group of VCSELs such that each group of the plurality of groups of VCSELs is individually addressable, and wherein a first trace in the plurality of traces overlaps a second trace in the plurality of traces.
10. The structured light projector of claim 9 , further comprising:
a first bond pad and a second bond pad coupled to the first trace, wherein a first group of VCSELS of the plurality of groups of VCSELs is individually addressable by changing a voltage differential between the first bond pad and the second bond pad; and
a third bond pad and a fourth bond pad coupled to the second trace, wherein a second group of VCSELs of the plurality of groups of VCSELs is individually addressable by changing a voltage differential between the third bond pad and the fourth bond pad.
11. The structured light projector of claim 9 , further comprising a projection assembly configured to project light emitted by the plurality of groups of VCSELs into a plurality of tiles.
12. The structured light projector of claim 11 , wherein the projection assembly projects light from a first group of VCELS of the plurality of groups of VCSELs into a first tile, and wherein the projection assembly projects light from a second group of VCELS of the plurality of groups of VCSELs into a second tile.
13. The structured light projector of claim 9 , further comprising a projection assembly configured to project light from a first group of VCELS of the plurality of groups of VCSELs and a second group of VCELS of the plurality of groups of VCSELs into a first tile.
14. The structured light projector of claim 9 , wherein the first trace and the second trace are each linear and overlap in an X pattern.
15. The structured light projector of claim 9 , further comprising a dielectric layer between a first plane comprising the first trace and a second plane comprising the second trace.
16. The structured light projector of claim 15 , wherein the first plane is below the dielectric layer, such that light emitted from the first trace passes through the dielectric layer and the dielectric layer is transparent to light emitted by the first trace.
17. The structured light projector of claim 15 , wherein the first plane is below the dielectric layer, such that light emitted from the first trace passes through the dielectric layer and the dielectric layer is partially opaque to light emitted by the first trace, such that, for a given drive current, light output from the structured light projector that originates from the first trace has a lower intensity than light output from the structured light projector that originates from the second trace.
18. A method comprising:
selecting a first dot pattern, of a plurality of dot patterns, based in part on a target density and a target distance, wherein the first dot pattern is associated with a first subset of traces of a plurality of traces on a chip, wherein the first subset of traces includes a first trace that overlaps a second trace, and wherein each respective trace is conductively coupled to a respective group of VCSELs on the chip;
activating at least one group of VCSELs that are conductively coupled via the first subset of traces, such that the activated at least one group of VCSELs emit light that forms a first dot pattern; and
projecting the first dot pattern into a local area, wherein the first dot pattern has the target density at the target distance.
19. The method of claim 18 , wherein the first subset of traces includes the second trace, and the first trace is conductively coupled to a first group of VCSELs and the second trace is conductively coupled to a second group of VCSELs.
20. The method of claim 18 , wherein at least one trace of the plurality of traces is conductively coupled to a group of emitters that is inactive.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18/107,747 US20230187908A1 (en) | 2019-04-18 | 2023-02-09 | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201962835965P | 2019-04-18 | 2019-04-18 | |
US16/521,480 US11063407B1 (en) | 2019-04-18 | 2019-07-24 | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
US17/347,506 US11611197B2 (en) | 2019-04-18 | 2021-06-14 | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
US18/107,747 US20230187908A1 (en) | 2019-04-18 | 2023-02-09 | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/347,506 Continuation US11611197B2 (en) | 2019-04-18 | 2021-06-14 | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
Publications (1)
Publication Number | Publication Date |
---|---|
US20230187908A1 true US20230187908A1 (en) | 2023-06-15 |
Family
ID=70476550
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/521,480 Active US11063407B1 (en) | 2019-04-18 | 2019-07-24 | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
US17/347,506 Active 2039-08-24 US11611197B2 (en) | 2019-04-18 | 2021-06-14 | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
US18/107,747 Abandoned US20230187908A1 (en) | 2019-04-18 | 2023-02-09 | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/521,480 Active US11063407B1 (en) | 2019-04-18 | 2019-07-24 | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
US17/347,506 Active 2039-08-24 US11611197B2 (en) | 2019-04-18 | 2021-06-14 | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
Country Status (4)
Country | Link |
---|---|
US (3) | US11063407B1 (en) |
EP (1) | EP3956632A1 (en) |
CN (1) | CN113748576A (en) |
WO (1) | WO2020214503A1 (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11063407B1 (en) * | 2019-04-18 | 2021-07-13 | Facebook Technologies, Llc | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
US11409365B2 (en) * | 2019-09-06 | 2022-08-09 | Apple Inc. | Self-mixing interferometry-based gesture input system including a wearable or handheld device |
US11419546B2 (en) | 2019-09-24 | 2022-08-23 | Apple Inc. | Wearable self-mixing interferometry device used to sense physiological conditions |
CN113410752A (en) * | 2020-03-17 | 2021-09-17 | 富士胶片商业创新有限公司 | Laser element array, light emitting and optical device, and measuring and information processing device |
US12003076B2 (en) * | 2020-04-30 | 2024-06-04 | Lumentum Operations Llc | Multi-layer metallization for multi-channel emitter array |
US20220344909A1 (en) * | 2021-04-26 | 2022-10-27 | Lumentum Operations Llc | Matrix addressable vertical cavity surface emitting laser array |
US11979548B2 (en) * | 2022-04-08 | 2024-05-07 | Himax Technologies Limited | Structured light projector and three-dimensional image sensing apparatus |
WO2024088935A1 (en) * | 2022-10-28 | 2024-05-02 | Ams International Ag | System and method for object depth estimation |
CN117369196A (en) * | 2023-08-23 | 2024-01-09 | 深圳博升光电科技有限公司 | Adjustable structured light generator, photoelectric device with same and manufacturing method |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140376092A1 (en) * | 2013-06-19 | 2014-12-25 | Primesense Ltd. | Integrated structured-light projector |
US20150260830A1 (en) * | 2013-07-12 | 2015-09-17 | Princeton Optronics Inc. | 2-D Planar VCSEL Source for 3-D Imaging |
US20180048880A1 (en) * | 2016-08-09 | 2018-02-15 | Oculus Vr, Llc | Multiple emitter illumination source for depth information determination |
US10497295B1 (en) * | 2018-03-14 | 2019-12-03 | Facebook Technologies, Llc | Near-eye display assembly with adjustable resolution and frame rate |
US10509128B1 (en) * | 2019-04-12 | 2019-12-17 | K Laser Technology, Inc. | Programmable pattern optical projector for depth detection |
US10645520B1 (en) * | 2019-06-24 | 2020-05-05 | Facebook Technologies, Llc | Audio system for artificial reality environment |
US20200251886A1 (en) * | 2019-01-31 | 2020-08-06 | Himax Technologies Limited | Optical device |
US11611197B2 (en) * | 2019-04-18 | 2023-03-21 | Meta Platforms Technologies, Llc | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9371986B2 (en) * | 2013-05-17 | 2016-06-21 | Erogear, Inc. | Flexible LED light arrays |
US10349038B2 (en) * | 2016-01-04 | 2019-07-09 | Facebook Technologies, Llc | Dynamic control over structured illumination intensity |
US9909862B2 (en) * | 2016-06-13 | 2018-03-06 | Google Llc | Curved array of light-emitting elements for sweeping out an angular range |
EP3282285B1 (en) | 2016-08-09 | 2020-09-09 | Facebook Technologies, LLC | Multiple emitter illumination source for depth information determination |
TWI786170B (en) | 2017-08-22 | 2022-12-11 | 美商普林斯頓光電公司 | Multilayer conductor interconnects for high density light emitter arrays |
US10715909B1 (en) * | 2018-04-06 | 2020-07-14 | Facebook Technologies, Llc | Direct path acoustic signal selection using a soft mask |
WO2020050777A1 (en) | 2018-09-04 | 2020-03-12 | Ams Sensors Asia Pte. Ltd. | Linear vcsel arrays |
-
2019
- 2019-07-24 US US16/521,480 patent/US11063407B1/en active Active
-
2020
- 2020-04-10 CN CN202080029660.6A patent/CN113748576A/en active Pending
- 2020-04-10 WO PCT/US2020/027753 patent/WO2020214503A1/en active Application Filing
- 2020-04-10 EP EP20722940.2A patent/EP3956632A1/en active Pending
-
2021
- 2021-06-14 US US17/347,506 patent/US11611197B2/en active Active
-
2023
- 2023-02-09 US US18/107,747 patent/US20230187908A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140376092A1 (en) * | 2013-06-19 | 2014-12-25 | Primesense Ltd. | Integrated structured-light projector |
US20150260830A1 (en) * | 2013-07-12 | 2015-09-17 | Princeton Optronics Inc. | 2-D Planar VCSEL Source for 3-D Imaging |
US20180048880A1 (en) * | 2016-08-09 | 2018-02-15 | Oculus Vr, Llc | Multiple emitter illumination source for depth information determination |
US10497295B1 (en) * | 2018-03-14 | 2019-12-03 | Facebook Technologies, Llc | Near-eye display assembly with adjustable resolution and frame rate |
US20200251886A1 (en) * | 2019-01-31 | 2020-08-06 | Himax Technologies Limited | Optical device |
US10509128B1 (en) * | 2019-04-12 | 2019-12-17 | K Laser Technology, Inc. | Programmable pattern optical projector for depth detection |
US11611197B2 (en) * | 2019-04-18 | 2023-03-21 | Meta Platforms Technologies, Llc | Addressable vertical cavity surface emitting laser array for generating structured light patterns |
US10645520B1 (en) * | 2019-06-24 | 2020-05-05 | Facebook Technologies, Llc | Audio system for artificial reality environment |
Also Published As
Publication number | Publication date |
---|---|
CN113748576A (en) | 2021-12-03 |
US11063407B1 (en) | 2021-07-13 |
WO2020214503A1 (en) | 2020-10-22 |
EP3956632A1 (en) | 2022-02-23 |
US11611197B2 (en) | 2023-03-21 |
US20210313778A1 (en) | 2021-10-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11611197B2 (en) | Addressable vertical cavity surface emitting laser array for generating structured light patterns | |
US10416766B1 (en) | Varifocal head-mounted display including modular air spaced optical assembly | |
US11733524B1 (en) | Depth camera assembly based on near infra-red illuminator | |
US11330193B2 (en) | Imaging device based on lens assembly with embedded filter | |
US10878594B1 (en) | Boundary region glint tracking | |
KR102510644B1 (en) | Camera assembly with programmable diffractive optical elements for depth sensing | |
US10789782B1 (en) | Image plane adjustment in a near-eye display | |
US10598941B1 (en) | Dynamic control of optical axis location in head-mounted displays | |
US10914953B1 (en) | Varifocal waveguide display using tunable lens | |
US10809429B1 (en) | Angle selective filter having curved surface for near eye displays | |
US10914956B1 (en) | Tiled display assemblies for artificial reality headset | |
US11397368B1 (en) | Ultra-wide field-of-view scanning devices for depth sensing | |
US10928635B1 (en) | Curved display assembly for artificial reality headset | |
US11747523B1 (en) | Dynamic dot array illuminators | |
CN111352240B (en) | Spatial distribution compensated backlight display assembly with non-uniform brightness via light extraction features | |
US10848753B1 (en) | Eye-tracking system using a scanning laser assembly | |
US11195291B1 (en) | Dynamic illumination control for depth determination | |
US20230280468A1 (en) | Addressable projector for dot based direct time of flight depth sensing | |
WO2023150239A2 (en) | Techniques for producing glints and iris illumination for eye tracking | |
EP3445049B1 (en) | Camera assembly with programmable diffractive optical element for depth sensing | |
US10359845B1 (en) | Display assembly using dynamic liquid crystal array | |
US20230085063A1 (en) | Vcsel chip for generation of linear structured light patterns and flood illumination | |
US11709364B1 (en) | Addressable crossed line projector for depth camera assembly | |
US11297286B1 (en) | Monochrome cameras with sparsely arranged clusters of color filters for coloration of content | |
US20230216269A1 (en) | Wafer level optics for structured light generation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |